Posted by Jay Livingston
Not exactly “it depends on what the meaning of is is,” but relevant to the problem of constructing questions. Andrew Gelman posted this a few days ago.
When preparing our GSS survey questions on social and political polarization, one of our questions was, “How many people do you know who have a second home?” This was supposed to help us measure social stratification by wealth– we figured people might know if their friends had a second home, even if they didn’t know the values of their friends’ assets. But we had a problem – a lot of the positive responses seemed to be coming from people who knew immigrants who had a home back in their original countries.Put that in your pipe and use it in your methods class.
I’ve been phone-surveyed (not by the GSS), and several times I have asked the interviewer what some part of a question meant. The response was usually, in so many words, “Hey, I didn’t write these questions. I just get paid $6.50 an hour to read ’em.” OK, I would think, but I know that my answer doesn’t mean what your employers think it means.
No comments:
Post a Comment