It's called a "grave accent" or a "backtick" and used to insert output into a command in Unix and several programming languages.
Misusing it as a weird-looking quote sticks out like a sore thumb. Not sure why you'd intentionally go to the opposite side of the keyboard to use it; it's like if I were to replace all my 'A's with @ signs.