How do I hold on or move on to a love I'm unsure of?

I been with my sons father for six yrs n we had a disasterous breakup with him cheatin on me... He never knew that I cheated on him too but I moved 3 hrs away n now he's beggin for me n our son to come back. He wants us to still be together but within the mist of that Ive been gettin into wit his family mostly females alot.. It makes me feel more distant because I'm not close or cool with his sisters anymore or cousins they all wanna fight me over small stuff cuz there grown kids.. Anyway he always sticks up for me but at the same time says he's not in it cuz he hates drama but that's the main reason y I don wanna continue because I don wanna b into it with his Fam even though were cool I don know if he will change what should I do?