Larry Tesler, the creator of copy/paste, explains:
The Lisa was the first system to assign XCVZ to cut, copy, paste and undo (shifted with the “apple” key). I chose them myself. X was a standard symbol of deletion. C was the first letter of Copy. V was an upside down caret and apparently meant Insert in at least one earlier editor.