We were there on Friday and Saturday. Friday had bad weather in the middle of the day and Saturday was cold, but not terrible.
Anyhow, the crowds were very low. 15 minute waits for both Potter rides. 5-10 minutes on pretty much everything else. We walked on Minion, but it was right at rope drop.
Jan. 29-31 is the Celebration of Harry Potter, so that will likely boost crowds in the Potter areas during that time. Of course, they may be doing other things than the rides.