You’re doing it wrong. Elite specs have nothing to do with the events, you unlock your elite specialization traits and skills from hero challenges and you only do those once.
Too bad that to get some hero challenges you need masteries, aka getting xp or often doing events. Perfect example is in Verdant the northern Hero Challenge requires you know the language (I forget the exact name). Oh and in Auric (I believe) there’s one where you need toxic resistance.