Guinea pigs cannot eat yucca because the stems and trunks store toxic saponins and have a soapy taste. Additionally, the flowers and leaves of the yucca plant are also toxic to guinea pigs. Ingesting yucca can cause harm to a guinea pig’s digestive system and overall health.