I agree with all the things the other posters say. One of the most important things during your learning period is to ask him to repeat or explain what he just said when you don't understand. Asking him to explain what certain words and expressions mean is also helpful.

I still have a hard time understanding my husband when he is talking to his friends. I get bits and pieces, but not every word. He talks in a mix of patois and English to me, definetly different than his friends or other tourists. When he gets mad he slips into heavy patios to me, but I just let him go off and tell myself ignorance is bliss. Or sometimes when I do want to understand what he is saying, I tell him "Speak English".