I just read about the Toronto weather and I must not understand you. You keep trees in pots outside, above the ground without winter protection? I just read that on cold winters you do get temps below 0 Fahrenheit.
That said, you sure are in one of the best areas in Canada outside British Columbia for growing fruit.