I was at the gym with Sarah, we were exercising when we heard Tom talking about it with John.

exercising 是动词 exercise 的现在分词形式。exercise 的意思是"锻炼、运动"，指通过身体活动来增强体质或保持健康。现在分词形式表示动作正在进行中。