Get a subscription to Runner's World. Lots of great articles for beginners. I would imagine that over the years it all feels recycled to experienced runners, but for a newbie I've enjoyed every issue that arrives. It's not expensive either. Check their site and I think you can get it for $12 or $15 per year.
Shoes - take the time to visit a running store. One that has a good return policy. Wear them only for running.
Clothes - do you live near an outlet shopping center? I buy my Under Armor shirts at an outlet in Orlando. They're half the price that I would pay locally at Sports Authority or Dick's.
I ditto the Runner's World subscription.
I joined a local running club, one that is tailored to who I am. It's sponsored by Jeff Galloway and is a run/walk group that has all paces (7min mile to 15min miles) and does a long run together every Saturday morning.
Your area may have another group that is more for you. Check with your local running stores, or just google your general area + running and you may find one. Be sure that the group is okay with your pace, though, whatever it is, or you can find yourself either held back and frustrated, or discouraged that you can't keep up.
Clothes - I find Target or
Walmart has decent non-cotten wicking wear, or you can try a store like TJ Maxx, Kohl's, Marshalls, or Ross. Biggest advice I can give is NO COTTON, especially in the summer months. Look for polyester blends that say moisture wicking. If you are larger like me, you may want to check out the men's section.
Socks - don't neglect socks. Dri-wick is also important here. Dual layer is best. I would try out what works for you, though. I *have* to go with the cushioning socks or I get blisters, but some don't like them. TJ Maxx, Ross, Marshals are also excellent sources here because you can try out different brands and kinds without breaking the bank.
Sports bra - also important. Local running store, Dick's, or if you have a Champion store/outlet nearby are the best bets for that. I am, umm, on the larger side, so I need the super-compression kind with underwire. Champion and Moving Comfort both have good ones for almost any type, though.
Also, once you get past 8 miles and/or over 1-1.5 hours out on long runs, it's time to start thinking about water belts or handheld water, and fuel. Some like Gu, or Sports Beans, or Chomps for fuel, others do fine with regular jelly beans, and I have even seen some go for string cheese.
We are here to help!! Any questions, just ask. Best thing to do is take all of the advice and opinions and find what works best for you.
I should have mentioned that he also works with a woman that runs marathons and trains people for them. She's the one who helps people at the store. She knows her stuff and she's worked with running stores before (she just likes REI better and it is a great company to work for). She's been a real asset for them --- not something all the REI stores have and she will tell you if they don't have the shoe that would be best for you. So she can help. Also since my husband is an employee we can get shoes from anywhere as long as REI sells them.
But I do thank-you for your advice.
From what I have seen, no research proving they help, but people do swear by them. 
