Here is my advice:
1. Tell your manager that you have had time to think about this and want to get a few things straight before letting it go. This is a natural reaction and is not over the top. Bear in mind that Ceiling Cat is living with some very funky asbestos in that ceiling.
2. Ask if he has documented anything in your file about this. If he has, ask to see it so that you can respond to the contents of your file with your own written statement. Bear in mind that he is under no obligation to let you see your file as this is the company's file not yours. For those who would argue with this, go to law school.
3. If there is something in your file, then prepare a written response to the complaint in your file and ask that your manager include it in your file. If you are not allowed to see the complaint, then just outline in writing your version of the events.
4. If there is nothing in your file, tell your manager that you are fine with letting it go and that based on this incident, you will limit yourself to just having professional and minimal interaction with this individual.
5. It sounds like your manager wants to just let it go - probably because he has better things to do. If he has truly handled it informally, then so should you. Most harassment policies have a vexatious claim clause but triggering this puts everything under a microscope.
6. If at some point an investigation is launched (unlikely), then lawyer up and tell them you want counsel present for all meetings.
7. Finally, think twice about what you say to women in the office. Unfortunately you have to err on the side of caution these days. So don't say "Nice cans" unless she is holding two cans of your favorite beer. Cheers!