Returning Player - is HoT needed?
You should be fine for fractals. Depending on your profession you will miss something compared to others, but it wont render you unable to play endgame content.
In Spvp getting anywhere without elitespecs is possible but extremely hard. If you want to be truly competitive, you probably need them.
But todays patch may finally change that.
Ascended and legendary gear is on par- this is still the highest tier in the game.
The vast majority of the PVE player base is in the HoT areas and raids.
The only thing you will be “ok” for is fractals.
You are at a HUGE disadvantage in PVP without elite specs as every metabuild is currently an elite spec and that isn’t likely to change.
I would recommend just buying the expansion as you will enjoy the game much more with it.