The study proposes a Bayesian modeling framework to analyze and examine the mapping between emotions and speech prosody. The models are fitted to a large collection of emotional prosody recordings, and the study reveals that the mapping varies across corpora, individuals, cultures, and sexes. The study suggests that models accounting for mapping differences across these factors outperform models assuming a global mapping.