You should always include a non-payment clause. If full payment is not received by due date, that you rightfully are able to retain any deposit made and fully own the concept you created to resell elsewhere.
That being said tell him you're ending the project, keeping the down payment for services rendered but retaining all rights to the project as full payment was not received. Then sell it off