Looks like the work of a sapsucker. Our wild trees here are covered in those holes but the trees seem unaffected. I can understand why you wouldn’t like it on your tree though.
I’ve had sapsuckers nearly kill sections of apple and pear trees due to girdling. I wrap the target areas with aluminum window screen using a household stapler to hold it in place. Problem solved