I just managed to get through by doing the following, don’t know if it will help, I might have gotten lucky but hey you never know.
Mine seemed to keep bugging when I was in combat or when others were standing near it.
I made sure I was out of combat before approaching each of the rocks and that no one was near it.
Hope it helps