From another garden blog:
Almonds are originally from the Middle East and will not grow in cold climates. You’ll need to be in at least zone 6 to get almonds to thrive. In the United States, there are commercial crops of almonds in California and not many other regions.
I can’t see them making it in your climate.
Further info:
The almond is a deciduous tree, growing 4–10 m (13–33 ft) in height, with a trunk of up to 30 cm (12 in) in diameter. The young twigs are green at first, becoming purplish where exposed to sunlight, then grey in their second year. The leaves are 3–5 inches long,[3] with a serrated margin and a 2.5 cm (1 in) petiole. The flowers are white to pale pink, 3–5 cm (1–2 in) diameter with five petals, produced singly or in pairs and appearing before the leaves in early spring.[4][5] Almond grows best in Mediterranean climates with warm, dry summers and mild, wet winters. The optimal temperature for their growth is between 15 and 30 °C (59 and 86 °F) and the tree buds have a chilling requirement of 300 to 600 hours below 7.2 °C (45.0 °F) to break dormancy.[6]
Almonds begin bearing an economic crop in the third year after planting. Trees reach full bearing five to six years after planting. The fruit matures in the autumn, 7–8 months after flowering.[5][7]