Because listeners can hear a smile
Smiling reshapes the vocal tract and brightens your tone, and people on the other end of a phone reliably hear the difference as warmth. It is the cleanest proof that on audio your delivery, not your face, carries the feeling.
