Is it worth me waiting after all of this?

no. this guy hit you when you had not seen each other in a long time and he's acting shady this guy is not only a beater but a cheater as well. he needs to go. you need to find someone closer to home that you closer to home who you can trust and see more often