My main problem is, you TOLD him you would pick him up if he decided not to stay. If you had told him "let's see how this works out", or something else, I would feel differently.
Since you promised him he would be picked up if needed, I think you should pick him up. JMO.:)