There is no hard and fast rule there as it depends on what other fruits are available, etc. But for apples I would say by dime-size there is very little activity, and even by chick pea size there is less interest than pea-size. For plums, round plums they can like at a bit bigger size but by nickel they are really losing interest. Plums that are not round they are willing to go after much later, often biting by the neck on quarter-sized fruits. Coe’s Golden Drop is one they really like to give neck bites on.
Since Surround is a pain to spray I like to stop as early as I can, so I pay attention to this. It is raining now and I have a few apples that are still not big enough and I plan on coating them along with the non-round plums and some peaches still too small.