You will have fun, especially with good planning. Because of having students, and now schoolteachers, in the family, the week after Easter has been the most common time for our trips. A few things to keep in mind:
1. Late March and early April is, in my opinion, the best time of the year to visit Florida in terms of weather. Even if there are above average temperatures, it isn't likely to be as hot and humid as it is from May through September or October. But, it is also likely to be warm enough for swimming if you care about that.
2. The parks usually have long hours, so it is perfect for people who like to start early or stay late. The last few years the MK has had AM EMH starting at 7 AM every day so, if you're staying on site, that presents a perfect opportunity to do a lot of things with short waits for 3 or 4 hours. Then, if you like, you can take a break in the middle of the day, and come back later to use your FPs.
I know I was a little apprehensive when we took our first Easter trip in 1997. But, that trip was great and now that has become my favorite time of the year to visit WDW. I expect to be visiting again next spring from the Saturday before Easter until the Friday after.