You have to live together with his bad behavior for you'd like of your own time with your boyfriend.
Rather you have a "den" that they may be comfortable in and see as a good place, available to them whenever would like time on my own.