It really doesn't matter to the final product, but I've always found it easier to rinse with the rubber bands on for awhile until a good deal of the dye is out, then when you cut the bands you'll probably get more dye out. At least that's how it seems to go with my stuff.