This issue is one of the major reasons we opted for a golf course lot...no one behind us! Not so much because we would hear others, but because we want to be able to have our TV friends over for a party and not worry about bothering our neighbors. Of course, the neighbors will be here too...
Having the gentleman over would likely not resolve anything, especially if he has hearing loss. Most likely, he would think you are hypersensitive and just grumble to himself and go back home. The TV would NOT sound loud to him and he may not even be able to hear it at all, from your house...hearing loss means just that...you can't hear like other folks.
Just a thought.... If it's simply a sleeping issue, there are lots of ways to cancel out ambient noise, when trying to sleep. We are currently living in Germany, in the heart of the city....lots of noise and activities at all hours of the night and day. We simply have a stand fan in our bedroom, which essentially eliminates all of the outside noise.
Ironically, we are struggling a little bit with all the quiet in TV! Personally, I would prefer a little more noise pollution.
Just my 2 cents and i hope you get your issue resolved soon....