I was able to do it after changing my strategy a bit. Upon claiming the last trebuchet where you first enter the courtyard just find the acolytes (summoners of silly level 61 risen) and focus them both down first. After doing this I cleaned it up with little to no problems at all.
I guess it’s just the way you tackle it, but it was insanely annoying and maybe needs a little tweaking.