Should I end my relationship?

I've never had to end a relationship before but this time is different. I've been with my boyfriend since january. He smokes weed consistently, dropped out of a community college and i do all the traveling to see him. I gave up my military dream because he refuses to support me in it. I'm very controlled and He talks to a lot of girls. And hes 'allergic to latex' and if i get pregnant its my fault. But i need to protect my body, i know that. His mom asked me to go to SC in a week and shes already paid, should i go? and dump him after? and what should i say when i do it? I feel bad because hes been doing better and trying harder since hes met me but I need to live my life. Its my senior year and i want to have fun.