Yes
Caffeine is a real toxin; what saves us is the amount. A fatal dose for an adult is on the order of 10 grams, far more than any normal cup delivers. It is Paracelsus's rule in your kitchen: the difference between a pick-me-up and a poison is purely the dose.