Origin unclear, but typically explained as being stuck between something above (上) and something below (下). The uses of 卡 to mean "card" or "calorie" are foreign phonetic loans.

Phonosemantic compound. 巾 represents the meaning and 白 represents the sound.