I'm not sure how the Windows version of iTunes goes, but I assume it's very similar to the Mac version. Along the top (right above the song titles), there is a row of column headings. In mine, the first item is Name(of the song), the next column is Time, then comes Artist and Album. If yours were arranged by album, you should be able to click on the Album heading and it will arrange your songs by what album they are in. When I do that, it arranges my songs in alphabetic order by the title of the album the song is in. You might have to click that heading more than once to get them into alphabetic order.