Cold weather killed off most of our leaves

Hi all – looking for some advise on our rather sad looking fiddle fig.

We were recently out of town for a couple of weeks as the weather turned cold and without the heat running, I think that our fiddle fig encountered some cold shock as most of the leaves dropped and ultimately fell.

Looking for advise on what to do now. Is it time to trim and repot into a smaller pot?