In ancient times, people used electric typewriters, which had both open- and close-quote keys that slanted in or out to show the beginning or end of a quotation. However, in the 21st century, curly quotes cause all kinds of problems when entered into Web forms, used in HTML or otherwise appropriated for online use. Unfortunately, Microsoft still doesn't get it, automatically turning all quotes into "smart" quotes, which can wreak havoc when copied and pasted into other applications.
To disable smart quotes in Word 2013, select Options from the File menu, click Proofing and hit the AutoCorrect Options button. Uncheck the "Straight quotes with curly quotes option" under the AutoFormat tab.