If I make a new tag, then the question is deleted, does the tag disappear?
Or does the tag wonder around cyberspace?
The tag removal process is simple, as shown in an FAQ post on the Main Meta:
How can we get rid of misspelled and unused (or "zombie") tags?
Tags that have no associated open question are deleted by a script that runs overnight.