A good idea is to create an 'Idiots' or 'User Guide' which includes a variety of topics that most clients may come across. For example, how to FTP onto their site, how to set-up their email accounts etc. If you use a custom CMS, create a guide to using that and hopefully you should keep down the support calls.

Otherwise, set-up a premium rate support number and see if they still call you