Can you be allergic to coffee?

If you have anxiety, a faster heartbeat, or an upset stomach after drinking coffee, you probably have a caffeine sensitivity. But could it be an allergy?