I think I screwed up.

I got a letter from Chase today saying my CIP was denied b/c of too many cards opened in the past 24 months. I thought I was only at 3/24 so I was really confused. I knew I had some more that I was just an AU on, but I asked my DH to remove me from them and I thought they went away but now I see they are listed as "Closed" but still on my credit report. I SWEAR I looked at this before.. this divorce must be making me more crazy than I thought. I can't believe I goofed on that after all the research and thinking I did.
So anyway, trying to figure out what to do now. I will be at 5/24 in January, and then not 4/24 until April. Unfortunately the furniture I was planning to buy to meet any MSR's needs to be purchased way before then.

Plus I was trying to earn free flights for our trip to WDW in February. What do you guys recommend? I remember someone saying that their DH wrote to all three credit bureaus asking them to remove the AU cards... I could try and do that if someone could tell me exactly how to go about that? Or should I give up on Chase and try something else... American Express? I have been so focused on Chase I don't really know anything about the other cards out there. I currently have a Barclay Arrival card, a Disney VISA and an AA Citibank Mastercard. Like I said my main problem is that any major spending I am going to do is going to happen in the next few months. My credit is still looking in the "exceptional" range so that's good news.
Any advice? I am so bummed and can't believe I didn't see that before when I remember going in to check.