We love DTD and have been there countless times, it's best to go there in the morning on the weekdays. We love to stroll and shop and eat there.
The Boardwalk we've visited a couple times and it doesn't do much for us.
I definitely don't think either area is a "must do".