My DNeice just graduated there last year, she loved it. I think the area is generally safe, but I think that may be true of all campus'. I went to CCSU and we all knew what areas of town wern't the safest for us to be in.
My DS is a junior this year and we are hoping to do some campus visits over april vacation. I don't know how far Danbury is from you, maybe you can take a weekend trip to see the area for yourself.
Good Luck.