Is caffeine harmful?

I used to drink coffee every morning, and now I am cutting back because it has started to bother my stomach. Now I drink green tea on most mornings, but it is still caffeinated. So I am wondering if I should be worried about my caffeine consumption.