My bf singed a lease w me on this rental house?

And I caught him red handed cheating. And I asked him to leave and he wount..how do I get him off the lease? Monday when he goes to work I'm going to set all his things outside of the yard. Will I get into trouble? I am not going to be living in fear..??help?????