Angie, it may be what you are trying to eat and as already said, what you've had before your going.
I've read simple easily digestable carbs right before and within about an hour of finishing a shorter workout is a good way to get your body fueled. Longer workouts will need some fueling along the way.
You probably want the stomach kind of more empty, especially for before so food doesn't hang there when blood is being diverted to the rest of the body during your workout, but you need something to get you through if it is a more intense workout and especially if it is going to last over an hour. For after, the simple carbs will also replenish the needed glycogen that has been used up so your muscles do not become the source of draw for that glycogen. Way after couple hours the protein will be needed.
We are all different in what we can tolerate. Experiment with what works for you. For me, I cannot handle a full Gu packet. I can only tolerate 1/2 with water at a time. In a.m. I like a banana then will come back and eat oatmeal packet if it is a morning workout. Whatever you consume, it doesn't have to be much. Take what you can in small amounts.
If you are exercising to lose weight, remember what you are taking in needs to be less than what you are using. Try to make it in smaller amounts more often, i.e. the 6 meals Smaller portions as opposed to 3 meals full portions. Hope this wasn't too much info to "digest."