I'd start at my local scrapbook store, if I had one.
Other than that, before you buy too much stuff, maybe Michaels or Joann's has a class you could take.
Find a friendly scrapbooker among your friends to take you buy the hand.
Check the local high school adult education offerings - I found a crop full of nice women at mine - especially useful if you don't know anyone who scraps.
I started by wandering round our hobby shop.... but I had NO idea what I wanted or needed so I came home again I then had a Creative Memories class at home which started me and a few friends off scrapping (its still not very developed over here, there's loads of people just go if you say "I spent the weekend scrapping") Then I joined a few swaps over on the swap board - boy, does THAT teach you a lot! - and went from there
Even our Dollar Stores these days a great for beginners, embelishments,glue sticks, paper,paper trimmer. Best thing, go sit down and watch Youtube. Millions of ideas.