This has probably already been answered by our early birds, but here's my recommendation for starting out.
Get yourself a good/sharp pair of straight-edge scissors, a ruler, and adhesive of some sort. You'll need to decide what size album you want to start with. Of course you don't have to stick with just one size. You'll also want some cardstock which you can pick up in individual sheets or in multi-color packs. It's not necessary, but a paper trimmer also comes in handy. I'm sure I'm forgetting a few basics but never fear, scrappers are alway willing to help and spread addiction.
You can find all this stuff at general craft stores like Michael's or Joann's, dedicated scrapbook stores - you'll see people refer to them as LSS (Local Scrapbook Store), or even online.
Don't be intimidated at all. Everyone starts somewhere and over time your comfort level and style changes. I know lots of people hate their first pages/albums and go back to redo them. I think it's great to see how I've evolved so I'll never do that. Here's my very first album. I cut the heck out of my photos, used way too many stickers, and the color choices on some of the pages make me want to puke now. But I love this album because it was the beginning of my obsession.