What he is trying to say is how to get into the actual area.
You can get into the area by going to the other gate oppersite from the waypoint and start heading over to the cliffs. Get on top of the cliff and go around to the back wall of the fort and there you go.
(You may need to jump on a few buildings to get there)