R-E-S-P-E-C-T, Find Out What It Means to Me . . . Or Not

July 8, 2018
Posted by Jay Livingston

In the previous post, I wondered why Republican women surveyed by Pew saw Donald Trump as having “a great deal” or “a fair amount” of respect for women. One of the explanations I didn’t consider is that people don’t always answer the question that researchers are asking. The Pew survey asked dozens of questions. Several were about respect — how much respect does Trump have for women, men, Blacks, Hispanics, Evangelicals, and more. Others asked how believable Trump is, whether he keeps his business interests separate from his presidential decisions, whether he respects democratic institutions. (Results from the survey are here.)

But maybe to the people being interviewed, these were all the same question: Trump – good or bad?

Claude Fischer blogged recently (here) about this difference between questions researchers think they are asking and the questions people are actually responding to. Sometimes people give incorrect answers to basic factual questions. But it’s not that these respondents are ignorant.

an interesting fragment of respondents treat polls not as a quiz to be graded on but as an opportunity for what survey scholars have termed “expressiveness” and partisan “cheerleading.” I would broaden this kind of poll responding to include “self-presentation” or, more simply, “sending a message.” That is, there are respondents who treat some factual questions not as chances to show what they know but as chances to tell the interviewer, or data analyst, or reader, or even themselves something more important than facts.

If expressing feelings or sending a message underlie people’s responses to factual questions, those same purposes should have even more importance when it comes to subjective judgments, like whether Trump has a lot of respect for women.

Fischer seems to side with the “sending a message” explanation. But that phrase suggests, to me at least, an intention to have some specific effect. For example, proponents of harsher criminal penalties claim that these will “send a message” to potential criminals. The obvious corollary is that these punishments will have an actual effect – less crime.

When pollsters call me, I’m often tempted to send a message. I consider what the implications of my answer will be when it’s reported in the survey and how that might affect politicians’ decisions. I’m even tempted to lie on demographic questions (age, income, party affiliation). Maybe my preferences will swing more weight coming from a young Independent.

But my hunch is that in most of the Pew questions about respect, people are not trying to influence policy. They’re just expressing a global feeling about Trump. The message, as Fischer says, is that they want others to know how they feel.        

Which is it — a deliberate strategy or an expression of sentiment? The trouble is that the only way to know what people are thinking when we ask them whether Trump respects women is to ask them and to listen to their answers instead of giving them four choices and then moving on to the next question. That is the great limitation of questionnaire surveys.