Is this cold damage citrus fruit?

I have two large luscious citrus trees I’ve been growing for a few years in my garden. They produce copious amounts of beautiful looking fruit. The problem is it’s late ripening, in the spring. By the time it’s ripe, most of the fruit are dry and woody on the inside. I’m assuming this is because of freezing during the coldest part of the winter, damaging the cells in the fruit? No way around this than passive heating / greenhouse type solutions? It’s a shame, but I’m thinking to cut these trees down as I never get to use any of the fruit.
By contrast, my trees that are able to ripen before January have normal looking fruit.

Dry fruits like this mean that the fruit has ripened (seeds maturation is completed) and stayed hanging in the tree for months until it became like this. Common in orange producing areas…


But I had the same issue with all the fruit on 2 different varieties, picking earlier in the season well within ripening time. Only 1 fruit looked normal - it had been half buried in the ground. Thus my theory of protection from freezing.