There is a quote that says "Drunk words are sober thoughts". You need to have a serious talk with him and find out if this is how he really feels, dont let him hold anything abck from you.