I am guessing this may be to stop pets from drawing aggro from random yellow animals.. but there are yellow elements that I want my pet to attack – such as the catapults at entrance to the temple of Arah – and even when the yellow element is called as a target and the pet is in aggressive, it will never attack the yellow target.