No — many people rarely or never do
Research on aesthetic chills (frisson) finds that a substantial share of people experience them rarely or not at all. Susceptibility tracks with the personality trait openness to experience: people high in that trait, who tend to be more absorbed in art and ideas, are the most likely to feel the shiver.
