Fruitless Olive Tree: Allergenic?

Hello,

I bought a home with a mature fruitless olive tree and my wife has an allergy to something in our yard, or a neighbor’s.

I’ve looked online for information, but it doesn’t seem clear to me if all fruitless olive tree are generally non-allergenic, or just certain ones. Because I did not plant the tree, I’m not sure of the cultivar.

I just thought I would add that the house has a guava tree that doesn’t do well because we are in San Francisco; however, it does have some flowers every year and tries to make fruit. I’m not sure if this is the problem – all of the information online about guava trees is related to eating guavas.
Any info is appreciated.
Thanks for reading