Native English speaker here. This is incorrect, the “n” is added for phonetic help “a elephant” involves an awkward break between the two words, so enter “n” to help mouth muscles work around that.

This is the same reason for weird artifacts like: “a unicorn” because unicorn starts with. “Yoo” sound and so mouths don’t need the help of the “n” to break up the awkwardness.