There's a module for that:
image_caption_formatter
Found via the module creator's description of why and how... before turning it into a module by popular demand.
The client would like the alt text used also as the hover text now that the title is the caption; the module does not do this... yet.