The president spoke at a Hispanic Heritage Month event as Latino voters abandon him.