For anyone who is trying to get their phantasmal residue to upgrade with the skill point – if you get a notice to fuse quartz crystals, simply send the quartz on your character to the vault and try again.
If you have any amount of quartz it will only give you the fuse quartz option.