No — perceived pitch can be trained lower
Pitch is partly a habit, not just anatomy. By relaxing the throat and using more chest resonance, most people can settle into the lower end of their natural range, which is why coached speakers often sound noticeably deeper without straining. Lower pitch is widely, though not universally, preferred by listeners.
