We all drink whole milk. I don't find it particularly thick or sweet. My kids don't have weight issues at all, and DH and I mostly drink a little bit in tea or coffee, so the health aspect isn't an issue for us.
Note: Our milk is produced locally, and is more like American 2% than American whole milk.