It is widely accepted that the first apostrophes were marks of elision which indicated that something had been taken out of the word. Here's where things begin to get confusing: the apostrophe would be stuck into a word to indicate the removal of a letter (usually a vowel) which was not pronounced, such as the e in “walk’d.”