Symbolic Ideology

A Politico-Psychological Analysis

1 Study Characteristics

1.1 Items: Symbolic Ideology

Overall: Overall, where would you place yourself, on the following scale of liberalism-conservatism?

Social and Cultural: How about in terms of social and cultural issues? (e.g., abortion, separation of church and state, affirmative action)

Economic: How about in terms of economical issues? (e.g., taxation, welfare, privatization of social security)

Possible values: Strongly liberal (1) (left) - Strongly conservative (9) (right)

Source: Azevedo, F., Jost, J. T., & Rothmund, T. (2017). “Making America great again”: System justification in the US presidential election of 2016. Translational Issues in Psychological Science, 3(3), 231. https://doi.org/10.1037/tps0000122

1.2 Samples

N=1500

To conduct a exploratory and a confirmatory large surveys during the general election, we hired a professional survey firm (SSI, a US-based market research company that recruits participants from a panel of 7,139,027 American citizens; more information can be found at www.surveysampling.com (now https://www.dynata.com/) to recruit a nationally representative sample of 1,500 Americans (50.7% women) who completed study materials during the general election from August 16-September 9, 2016. (Information about sampling and exclusion criteria is included in the Supplement). The age distribution was as follows: 18-24 (12.9%), 25-34 (17.6%), 35-44 (17.5%), 45-54 (19.5%), 55-65 (15.6%) and older than 65 (16.9%). The ethnic breakdown was: White/European American (82.5%), Black/African American (7.7%), Latino (5.9%) and “Other” (4.0%). Concerning religion, 67.6% identified as Christian, 17.1% as religiously affiliated but not Christian, and 15.3% as Atheist/Agnostic. With respect to education 35.1% indicated “high school only or lower,” 31.4 % indicated “some college,” and 33.6% indicated having received a “Bachelor” or “Graduate” degree. 2424 participants were directed to the survey,1885 of which finished the survey (attrition rate 22%).

We followed recommendations to minimize the problem of careless responding in online studies. Specifically, we employed 10 random attention questions and time controls to check for data quality. There were 385 participants who failed more than one attention check or finished the survey in under ~22 minutes and were therefore excluded from the sample. For the 1500 participants who successfully finished the survey, completion time was 67 minutes on average (MD: 51min).

N=2119

Also through SSI we also recruited 2,119 American adults (21.5% women), who completed study materials from August 20-September 13, 2016. (Information about sampling and exclusion criteria is included in the Supplement). Age was distributed as follows: 18-24 (9.1%), 25-34 (13.8%), 35-44 (11.4%), 45-54 (2.7%), 55-65(3.6%), 65 and older (59.3%). The ethnic breakdown was: White/European American (85.9%), Black/African American (5.1%), Latino (4.1%), and “Other” (5.0%). In terms of religion, 70.7% identified as Christian, 15.7% as religiously affiliated but not Christian, and 13.7% as Atheist/Agnostic. With respect to educational status, 16.2% chose “high school or lower,” 40.4% reported “some college” and 43.4% had attained a “Bachelor” or “Graduate” degree. The median income category was $50,000-$74,999. 3425 participants were directed to the survey, 2,262 of which finished the survey (attrition rate 22 %).

We followed recommendations to minimize the problem of careless responding in online studies (Meade & Craig, 2012). Specifically, we employed 10 random attention questions and time controls to check for data quality. There were 543 participants who failed more than one attention check or finished the survey in under ~22 minutes and were therefore excluded from the sample. For the 2,119 participants who successfully finished the survey, completion time was 92 minutes on average (MD: 57min).

2 Descriptives

2.1 Means, SD, Range, & SE

Table 1: Descriptives
Descriptives for Symbolic Ideology Items
vars n mean sd median min max range se
Overall 1 1500 5.31 2.45 5 1 9 8 0.06
Social_and_Cultural 2 1500 4.93 2.76 5 1 9 8 0.07
Economic 3 1500 5.48 2.63 5 1 9 8 0.07
Self-Placement Political Ideology 4 1500 5.24 2.42 5 1 9 8 0.06

2.2 Proportions

Figure 1: Proportion of each response categories for Symbolic Ideology Items

2.3 Distributions

Figure 2: Distribution of reponses for Symbolic Ideology Items

2.4 Correlations

Figure 3: Bivariate Spearmans’ correlations for Symbolic Ideology
Figure 4: Bivariate Spearmans’ correlations for Symbolic Ideology
Figure 5: Correlation Matrix of Symbolic Ideology items, Spearman’s rank correlations

3 Demographics

3.1 Social Class

Figure 6: Symbolic Ideologyas grouped by SES


Figure 7: Raincloud Plots showing Symbolic Ideology grouped by Social Class


Note on the Raincloud Plots

  • Statistical summary (top): Welch’s t-test (or ANOVA) results, effect size, confidence intervals, p-values, and sample sizes are shown above each plot.
  • Bayesian analysis (bottom): Log Bayes factor and credible intervals are reported below each plot.


Table 2: Symbolic Ideology as grouped by SES
Symbolic Ideology as grouped by SES
SES N Mean SD
Poor 38 -0.18 1.05
Lower Middle Class 298 -0.13 0.99
Middle Middle Class 679 0.06 1.01
Upper Middle Class 395 -0.02 1.00
Rich 90 0.17 0.93


3.2 Gender

Figure 8: Symbolic Ideologyas grouped by Gender


Figure 9: Raincloud Plots showing Symbolic Ideology grouped by Gender


Table 3: Symbolic Ideology as grouped by Gender
Symbolic Ideology as grouped by Gender
Gender N Mean SD
Female 760 -0.19 0.98
Male 740 0.20 0.98

3.3 Age

Figure 10: Symbolic Ideology as grouped by Age


Figure 11: Raincloud Plots showing Symbolic Ideology grouped by Age


Table 4: Symbolic Ideology as grouped by Age
Symbolic Ideology as grouped by Age
Age N Mean SD
18-24 years 193 -0.21 0.96
25-34 years 264 -0.30 0.96
35-44 years 263 -0.13 0.98
45-54 years 292 0.00 1.00
55-64 years 234 0.09 0.95
65+ 254 0.53 0.91

3.4 Education

Table 5: Symbolic Ideology as grouped by Education


Figure 12: Raincloud Plots showing Symbolic Ideology grouped by Education


Table 6: Symbolic Ideology as grouped by Education
Education N Mean SD
Less than High School 51 -0.16 1.00
High School 475 -0.03 0.98
Some College 471 0.04 1.02
Bachelor 310 0.01 0.98
Graduate 193 -0.01 1.03


3.5 Income Levels

Figure 13: Symbolic Ideology as grouped by Income Levels


Figure 14: Raincloud Plots showing Symbolic Ideology grouped by Income Levels


Table 7: Symbolic Ideology as grouped by Income Levels
Symbolic Ideology as grouped by Income Levels
Income Levels N Mean SD
Less than $15,000 178 -0.11 0.99
$25,000-$34,999 176 -0.07 1.00
$50,000-$74,999 292 -0.07 1.04
$35,000-$49,999 227 -0.05 0.98
$15,000-$24,999 180 -0.03 1.04
$75,000-$99,999 192 0.12 0.97
$100,000-$149,999 160 0.17 1.01
$150,000 + 95 0.19 0.87

3.6 Ethnicity

Figure 15: Symbolic Ideology as grouped by Ethnicity

Note on the Okabe-Ito color palette The Okabe-Ito color palette (seen above) is a set of colorblind-friendly categorical colors available in R. We are using this palette for graphs with non-ordered variables (e.g., groups, categories) for accessibility.

Figure 16: Raincloud Plots showing Symbolic Ideology grouped by Ethnicity


Table 8: Symbolic Ideology as grouped by Ethnicity
Symbolic Ideology as grouped by Ethnicity
Ethnicity N Mean SD
Caucasian/European origin 1237 0.08 1.00
Black/African American 115 -0.45 0.85
Latino 88 -0.37 0.91
Asian/Pacific Islander 29 -0.39 0.92
Native American 13 -0.24 1.00
Other 18 -0.30 1.03

3.7 Occupation

Figure 17: Symbolic Ideology as grouped by Occupation


Figure 18: Raincloud Plots showing Symbolic Ideology grouped by Occupation


Table 9: Symbolic Ideology as grouped by Occupation
Symbolic Ideology as grouped by Occupation
Occupation N Mean SD
Employed 768 -0.08 0.98
Retired 268 0.42 0.93
Unemployed 146 -0.20 0.96
Parent 104 0.04 1.00
Disabled 98 0.03 1.04
Student 85 -0.34 1.05
Full-time caregiver 31 -0.09 1.01

3.8 Area

Figure 19: Symbolic Ideology as grouped by Area


Figure 20: Raincloud Plots showing Symbolic Ideology grouped by Area


Table 10: Symbolic Ideology as grouped by Area
Symbolic Ideology as grouped by Area
Area N Mean SD
Urban 955 -0.11 1.00
Rural 545 0.19 0.97


3.9 Religious Affiliation

Figure 21: Symbolic Ideology as grouped by Religious Affiliation


Figure 22: Raincloud Plots showing Symbolic Ideology grouped by Religious Affiliation


Table 11: Symbolic Ideology as grouped by Religion
Symbolic Ideology as grouped by Religious Affiliation
Religious Affiliation N Mean SD
Christian 1014 0.26 0.94
Jewish 52 -0.36 1.00
Muslim 9 -0.40 0.47
Atheist/Agnostic 230 -0.70 0.88
No religion 195 -0.38 0.87



4 Political Behavior

4.1 Political Orientation

Figure 23: Correlation Matrix - Political Orientation



Figure 24: Political Orientation



Table 12: Models of Political Orientation (SPRI) & Symbolic Ideology
  Political Orientation Social Political Orientation Economic Political Orientation Composite Political Orientation
Predictors Estimates CI p Estimates CI p Estimates CI p Estimates CI p
(Intercept) 5.31 5.27 – 5.34 <0.001 4.93 4.87 – 4.98 <0.001 5.48 5.42 – 5.53 <0.001 5.24 5.24 – 5.24 <0.001
Symbolic Ideology 2.33 2.30 – 2.37 <0.001 2.54 2.49 – 2.60 <0.001 2.39 2.34 – 2.45 <0.001 2.42 2.42 – 2.42 <0.001
Observations 1500 1500 1500 1500
R2 / R2 adjusted 0.905 / 0.905 0.848 / 0.848 0.829 / 0.828 1.000 / 1.000



Table 13: Models of Ideo_SP_JJ and SRPI_CM, and Symbolic Ideology Age + Inc + Religiosity + Edu
  Political Orientation Social Political Orientation Economic Political Orientation Composite Political Orientation
Predictors Estimates CI p Estimates CI p Estimates CI p Estimates CI p
(Intercept) 0.31 0.16 – 0.46 <0.001 -0.26 -0.47 – -0.06 0.013 -0.05 -0.26 – 0.16 0.652 -0.00 -0.00 – -0.00 <0.001
SRPI_CM 0.96 0.94 – 0.98 <0.001 1.00 0.97 – 1.02 <0.001 1.04 1.02 – 1.07 <0.001 1.00 1.00 – 1.00 <0.001
Age 0.00 -0.02 – 0.03 0.699 -0.00 -0.04 – 0.03 0.925 -0.00 -0.04 – 0.03 0.849 -0.00 -0.00 – 0.00 0.471
Income 0.02 -0.01 – 0.04 0.134 -0.07 -0.10 – -0.04 <0.001 0.06 0.03 – 0.09 <0.001 0.00 -0.00 – 0.00 0.923
Religiosity 0.00 -0.01 – 0.02 0.873 0.11 0.08 – 0.13 <0.001 -0.11 -0.13 – -0.09 <0.001 -0.00 -0.00 – 0.00 0.431
Education -0.04 -0.08 – -0.00 0.039 -0.08 -0.14 – -0.03 0.004 0.12 0.07 – 0.18 <0.001 -0.00 -0.00 – 0.00 0.483
Observations 1500 1500 1500 1500
R2 / R2 adjusted 0.905 / 0.905 0.864 / 0.863 0.846 / 0.845 1.000 / 1.000

4.2 Religiosity



Figure 25: Religiosity



4.3 Religiosity & Political Orientation

Figure 26: Religiosity - Correlation Matrix



4.4 Candidate Preferences



Figure 27: Candidate Preferences



Table 14: Candidate Preferences (centered)
Candidate Preferences and Symbolic Ideology [centered]
Candidate Preference N Mean SD
Donald Trump 444 0.69 0.70
Hillary Clinton 371 -0.60 0.79
Bernie Sanders 362 -0.76 0.76
Ted Cruz 122 0.90 0.65
Jeb Bush 83 0.57 0.64
Gary Johnson 68 0.12 0.67
Rand Paul 44 0.60 0.79



Table 15: Candidate Preferences (raw means)
Candidate Preferences and Symbolic Ideology [raw means]
Candidate Preferences N Mean SD Range
Donald Trump 444 0.69 0.70 1-9
Hillary Clinton 371 -0.60 0.79 1-9
Bernie Sanders 362 -0.76 0.76 1-9
Ted Cruz 122 0.90 0.65 1-9
Jeb Bush 83 0.57 0.64 1-9
Gary Johnson 68 0.12 0.67 1-9
Rand Paul 44 0.60 0.79 1-9



4.5 Party Preferences


Figure 28: Party Preferences



Table 16: Party Preferences (centered)
Party Preferences and Symbolic Ideology [centered]
Party Preference N Mean SD
Green Party 40 -1.08 0.70
Democratic Party 560 -0.73 0.79
None 120 -0.06 0.69
Don't know 90 -0.06 0.72
Libertarian Party 100 0.05 0.77
Republican Party 508 0.72 0.65
Constitution Party 14 0.86 0.95
Tea Party 68 1.18 0.57



Table 17: Party Preferences (raw means)
Party Preferences and Symbolic Ideology [raw means]
Party Preferences N Mean SD Range
Green Party 40 -1.08 0.70 1-9
Democratic Party 560 -0.73 0.79 1-9
None 120 -0.06 0.69 1-9
Don't know 90 -0.06 0.72 1-9
Libertarian Party 100 0.05 0.77 1-9
Republican Party 508 0.72 0.65 1-9
Constitution Party 14 0.86 0.95 1-9
Tea Party 68 1.18 0.57 1-9



4.6 Voting Preferences

Table 18: Voting Preferences
  2016 [Trump vs. Clinton] 2016 [Trump vs. Clinton] + Supporters 2012 [Romney vs. Obama] 2008 [McCain vs. Obama]
Predictors Odds Ratios CI p Odds Ratios CI p Odds Ratios CI p Odds Ratios CI p
(Intercept) 144.78 83.02 – 263.68 <0.001 117.48 69.46 – 206.53 <0.001 189.68 109.31 – 342.30 <0.001 124.57 74.13 – 216.84 <0.001
Symbolic Ideology 0.39 0.35 – 0.44 <0.001 0.41 0.37 – 0.45 <0.001 0.39 0.36 – 0.43 <0.001 0.43 0.39 – 0.47 <0.001
Observations 1103 1148 1236 1206
R2 Tjur 0.528 0.506 0.501 0.457



Figure 29: Logistic Regression, Symbolic Ideology & Voting Preferences

4.7 Party Identity



Figure 30: Party Identity



Figure 31: Party Identity and Voting



Table 19: Party Identity & Voting
Donald Trump Hilary Clinton
Strong Republican 282 7
Republican 166 24
Leaning Republican 58 7
Independent 17 16
Leaning Democrat 10 65
Democrat 27 129
Strong Democrat 4 323

4.8 Voting & Party Identity

Figure 32: Predicted, Voting & Party Identity



Table 20: Supporters
  2016 [Clinton vs. Trump] 2016 [Trump vs. Clinton] + Supporters
Predictors Odds Ratios CI p Odds Ratios CI p
(Intercept) 101.87 51.13 – 216.20 <0.001 77.83 41.30 – 154.68 <0.001
Party Identity (dichotomous) 0.02 0.01 – 0.03 <0.001
Party Identity (dichotomous) 0.62 0.54 – 0.70 <0.001 0.63 0.56 – 0.71 <0.001
Symbolic Ideology 0.02 0.01 – 0.03 <0.001
Observations 1103 1148
R2 Tjur 0.760 0.734



4.9 Likeability

4.10 Trump’s Likebility


Figure 33: Trump’s Likeability



4.11 Clinton’s Likebility


Figure 34: Clinton’s Likeability



4.12 Johnson’s Likeability


Figure 35: Johnson’s Likeability


5 Politico-Psychological correlates of Symbolic Ideology



5.1 Ideologies and Partisanship


Figure 36: Correlates of Symbolic Ideology



5.2 Populism, Nationalism, Nativism, and Patriotism


Figure 37: Correlates - Populism



5.3 Political Psychology


Figure 38: Correlates - Political Psychology



5.4 Social Justice Concerns, Empathy, and Prejudice


Figure 39: Correlates - Social Concerns



5.5 Values


Figure 40: Correlates - Values



5.6 Pot-Pourri


Figure 41: Correlates - Constructs



5.7 Positive and Negative correlates of Symbolic Ideology


Figure 42: Correlates - Positive & significant associations



Figure 43: Correlates - Negative & significant associations

5.8 Section Summary


Table 21: Table of models 1
  Symbolic Ideology Symbolic Ideology Symbolic Ideology Symbolic Ideology Symbolic Ideology
Predictors Estimates CI p Estimates CI p Estimates CI p Estimates CI p Estimates CI p
(Intercept) 2.22 1.92 – 2.52 <0.001 -0.39 -0.73 – -0.05 0.024 3.80 3.32 – 4.28 <0.001 -1.12 -1.61 – -0.64 <0.001 0.65 0.20 – 1.09 0.004
Social Dominance Orientation 0.81 0.73 – 0.88 <0.001
Right-Wing Authoritarianism 1.08 1.02 – 1.15 <0.001
System Justification 0.28 0.19 – 0.38 <0.001
Economic System Justification 1.32 1.22 – 1.42 <0.001
Gender-specific System Justification 0.84 0.77 – 0.92 <0.001
Observations 1500 1500 1500 1500 1500
R2 / R2 adjusted 0.229 / 0.228 0.431 / 0.431 0.024 / 0.024 0.319 / 0.318 0.226 / 0.226


Table 22: Table of models 2
  Symbolic Ideology Symbolic Ideology Symbolic Ideology Symbolic Ideology Symbolic Ideology
Predictors Estimates CI p Estimates CI p Estimates CI p Estimates CI p Estimates CI p
(Intercept) 1.06 0.54 – 1.58 <0.001 0.15 -1.31 – 1.60 0.844 3.80 3.32 – 4.28 <0.001 -1.12 -1.61 – -0.64 <0.001 0.65 0.20 – 1.09 0.004
SDO7_Dominance 0.52 0.35 – 0.69 <0.001
SDO7_AntiEgal 1.03 0.88 – 1.17 <0.001
SDO7_Dominance:SDO7_AntiEgal -0.11 -0.15 – -0.07 <0.001
RWA_Agression 0.34 0.01 – 0.68 0.044
RWA_Conventionalism 0.51 0.13 – 0.90 0.009
RWA_Submission -0.09 -0.52 – 0.35 0.696
RWA_Agression:RWA_Conventionalism -0.00 -0.07 – 0.06 0.897
RWA_Agression:RWA_Submission 0.02 -0.07 – 0.10 0.697
RWA_Conventionalism:RWA_Submission 0.05 -0.03 – 0.13 0.229
RWA_Agression:RWA_Conventionalism:RWA_Submission -0.00 -0.02 – 0.01 0.485
SJ_Gen 0.28 0.19 – 0.38 <0.001
SJ_Eco 1.32 1.22 – 1.42 <0.001
SJ_Gender 0.84 0.77 – 0.92 <0.001
Observations 1500 1500 1500 1500 1500
R2 / R2 adjusted 0.277 / 0.276 0.454 / 0.452 0.024 / 0.024 0.319 / 0.318 0.226 / 0.226


Figure 44: Interaction with facets of SDO


Table 23: Linear Regression
Observations 1500
Dependent variable facet
Type OLS linear regression
F(1,1498) 444.46
R² 0.23
Adj. R² 0.23
Est. S.E. t val. p
(Intercept) 2.22 0.15 14.46 0.00
SDO 0.81 0.04 21.08 0.00
Standard errors: OLS