Should be very quick and no questions asked...other than "Do you want to leave the deposit in escrow and look for another contract?"
I have never been asked that, but I suggested it once with The Timeshare Store because I knew I was going to buy and I knew I was going to buy through them because of the great service I had on the first attempt.
If you ask for YOUR money back, there should be no discussion and no delay. The money is being held in YOUR name, on YOUR behalf, and it should be promptly refunded if that's what you want.