Yes, points borrowed from your 2004 Use Year must be used by the end of the 2003 Use Year.
Since you are not cancelling the entire reservation (only 2 days?) you can probably have MS reallocate the reservation so that the borrowed points are used for that trip and the 2003 points may be banked (subject to normal banking deadlines).
Good luck!