Sounds like he's trying to blackmail you. Don't go out with him if you don't want to, man! The unwillingness is on his head, not yours. If he can't get his act together and do his job, that's his problem.