Depending on how much of an issue cost is, you can also take into account which foods are the worst "offenders" when it comes to chemicals, hormones, etc, and only buy those organic.
You can find lists all over the internet of the worst offenders that you really should buy organic or the foods that really don't make sense to spend more to buy organic. For example, meat, dairy and certain fruits and vegetables make sense to buy the organic versions to avoid hormones, pesticides, etc, but other fruits and vegetables are generally fine to buy the non-organic variety.