What should I do in this situation? Advice please!?

To give you the best explanation i will have to start at the beginning. I was with someone, we'll call him charlie, for four months. Not the greatest decision in my life. Was not the best boyfriend, but didn't really hurt me. Only financially. We had a friend, we'll call him Malcolm, and we all worked together. Towards the end of our (Charlies and me) relationship i started having feelings for Malcolm. I never did anything about it cause even though Charlie was not the best i will always be faithful to whoever im with. I pushed the feelings aside thinking that it was nothing. But the feelings never went away. About a month after me and charlie broke up me and Malcolm hung out one night and i spilled my guts to him. We ended up going to the beach. Nothing out of the ordinary (except for the beach). Before we left he kissed me. We got promoted at the same time but he went to a different location and different shift (overnights) and i stayed at the same location with the same shift (days). His new position is turning out to be more stressful than mine, he's actually thinking about quiting. About two months ago he moved in with Charlie cause he had to. Because of this we don't see each other a lot.But almost every time we hang out we end up kissing (does not go further than that, he usually the one to stop first). We hung out the last two days and something was different, don't know what though. Today i asked him if he ever thought about me and us. His answer was yes but he can't and doesn't let it consume everything because of work. He also mentioned Charlie and "the bro code". I asked him why he keeps his distance he said if it doesn't work out he doesn't want to lead me on and hurt me. My question is: should i hang on or let go? Any advice will help, guys, girls, anybody! Thank you for taking the time to read this!