Accidentally sunburnt my figgy (2 years growth)

1st pic is when he was a baby and the next 2 are the damage now

Got my first fiddle leaf fig tree about 2 years ago and it thrived and grew many new leaves and height.

I went on a 4 day trip few weeks ago and accidentally left him outside on the balcony. I had just moved to a new place and left all the plants outside while I was still getting all the furnitures and stuff set up.

Came home to bunch of brown spots on the leaves and I immediately took it in but the damages has been done.

It seems like the damaged leaves will never recover so I’ve been just letting it be and hoping it will fall off on its own.

Disappointment in myself for this mistake and wondering if there is anything else I can do.