It really doesn't matter what time of the day or night you head out that way, you'll hit traffic and/or construction.
Back in November I went to Ybor on a Tuesday night, got hung up in construction traffic just north of 75 around 6:45pm. Left around 10:30pm to drive back home, I got mired in traffic (no construction/accident or obvious issue) around Lakeland--around 11:00pm. Go figure.
If you mean Harborside over in Ybor--like where the cruiseline piers are, you'll hit construction before you even get off that exit...
Anne