I'm asking this because quite frankly, it's the part of the festival that my friend and I enjoyed the most.

frankly 是形容词 frank（坦率的、直率的）加上副词后缀 -ly 构成的副词形式，意思是"坦率地说"或"老实说"，用来强调说话者要表达真实想法。