Andrew, sorry you’re having these issues. Some of the symptoms strongly resemble “web blight” aka rhizoctonia aerial blight. I’ve seen similar lesions on figs. The centers often fall out of the affected lesions—and, in bad cases, infected leaves will shrivel and adhere to other leaves and stems. R. solani is an opportunist and will infect a lot of different species. Can infect fruit, too.
Brent @hoosierbanana posted some good pictures of the disease on figs a few years back: Show Off Your Figs and "This year Harvest" - #37 by hoosierbanana