This is a hard one ......but if you dont like confrontation, i would move out when hes at work find somewhere else to live and do it through the solicitors, you dont owe him a bean of explanation, i my eyes.
If you dont mind confrontation and want to get it off your chest, tell him straight , take no prisoners, then pack his gear up and kick him out,
Ive been there its a horrible time no love, bitterness, etc, Good luck whatever you decide to do.........