Either—1 move it from its current position rite next to found chests, or 2- have a double check on it, ie—are you sure you want to leave this area. Having it rite next to the chest it is currently so easy to mis click on the leave area button, its not funny.