tag:blogger.com,1999:blog-35248477.post1853037893943582912..comments2024-03-27T14:20:05.905-04:00Comments on Montclair SocioBlog: Methodology in the NewsJay Livingstonhttp://www.blogger.com/profile/06652075579940313964noreply@blogger.comBlogger4125tag:blogger.com,1999:blog-35248477.post-40620257978619817402012-04-28T14:59:45.865-04:002012-04-28T14:59:45.865-04:00See, for instance, this grocery store.See, for instance, <a href="http://www.nydailynews.com/new-york/brooklyn/police-arrest-14-drug-ring-operating-brooklyn-bodegas-article-1.1068616" rel="nofollow">this grocery store</a>.PCMhttps://www.blogger.com/profile/13647097472236933108noreply@blogger.comtag:blogger.com,1999:blog-35248477.post-744990173333390022012-04-27T11:24:02.398-04:002012-04-27T11:24:02.398-04:00I impugn quantitative studies that make the same k...I impugn quantitative studies that make the same kinds of fatal errors again and again. I do not and have never impugned studies because they come out of RAND (besides, some of my best friends work for RAND). RAND conducts lots of good studies; this isn't one of them.<br /><br />You're right that 445 includes different subcategories. But the problem is still found in those more detailed coding you mention. So indeed, Whole Foods would not be classified the same as a bullet-proof bodega, and you're right to call me out on this semantic slight-of-hand. <br /><br />I used Whole Foods as shorthand in my blog post because there is no well recognized national chain of small upscale grocers. Whole Foods *is* classified the same as, say, the Stop Shop N Save grocery store ("Stop, Shop, and Steal" in cop lingo, and also no longer in existence). Since (I assume) they both have annual sales above $5 million, the NAICS says they're the same. The study then assumes people have the same food choices as long as they live near ether of them. Absurd. Whole Foods and Stop Shop N Save are qualitatively different retail experiences, to put it mildly. <br /><br />More to the point, a bullet-proof bodega in the ghetto <i>is</i> classified the same as a small upscale grocery store in a "nice" neighborhood... even though the former does not actually sell food! It is classified as a small grocery store because at one time, many decades ago, it probably actually was. The Hopkins's Baltimore study supports this point very well. <br /><br />The RAND study conflates extreme disparate retail because the NAICS classification doesn't look at what a store actually sells (as long as the "food" store doesn't have gas pumps). This is a fatal flaw in the data that An and Sturm fail to confront (acknowledging this matter as a "limitation" is not sufficient). <br /><br />Flawed data leads to gross statistical errors, particularly when the validity errors in the independent variables (NAICS classification) are not random and highly correlated with the dependent variable (an area being called a food desert). <br /><br />This error kills me because it's so damn common in quantitative analysis, particularly from researchers who don't see the benefit of actually leaving their well upholstered offices and taking a look around.<br /> <br />NAICS classifies dozens of food outlets in the Eastern District. This simply is not true. And anybody who talked to people trying to buy fresh ingredients for dinner could tell you this.PCMhttps://www.blogger.com/profile/13647097472236933108noreply@blogger.comtag:blogger.com,1999:blog-35248477.post-41905884638197207062012-04-26T23:50:23.307-04:002012-04-26T23:50:23.307-04:00Hi Mike. Long time, no see. Obviously, I had not...Hi Mike. Long time, no see. Obviously, I had not read the RAND report, so I appreciate the additional information. (How do you happen to know about this stuff?) I agree with you that we shouldn't a study purely on an ad hominem basis. If it comes from a source whose politics you don't like, that just means you have to look closely at the data. Still, I'm not sure how much weight to attribute to individual food preferences and how much to food availability. And I'm a bit skeptical about Sturm's notion that "Within a couple of miles of almost any urban neighborhood,you can get basically any type of food,'” (quoted in the NYT article). The only city-dwellers I know who travel "a couple of miles" to do grocery shopping are middle class (or upper middle class) people with cars who drive to a big box discount store to by big boxes of stuff.Jay Livingstonhttps://www.blogger.com/profile/06652075579940313964noreply@blogger.comtag:blogger.com,1999:blog-35248477.post-24469357911580281142012-04-26T23:20:19.398-04:002012-04-26T23:20:19.398-04:00Jay -- I think that there are a couple of errors i...Jay -- I think that there are a couple of errors in your write-up of the RAND study. First, the RAND study examined kids in California, not nationwide. The story talks about two studies and it was the second, by Helen Lee of Public Policy Institute that did the nationwide analysis. <br /><br />Second, Moskos is incorrect about how An and Sturm coded their data. The NAICS system is developed to provide increasing levels of detail with each group of digits added. The first two digits represent broad industry (44-45 are retail establishments); the next digit indicates subordinate industries (445 are food and beverage retail establishments); the next digit is the trade industry (4451 are grocery stores); the next one to two digits represent specializations (445110 are grocery stores and supermarkets). Beyond these codes required for all data on industry collected by the federal government, the data proprietor An and Sturm used also provide more detailed classifications and sales data that they use to classify stores into three categories: small stores, grocery stores, and large supermarkets. The relevant section of their paper reads: "and small food stores (annual sales <$1 million); midsize grocery stores (annual sales $1–$5 million); and large supermarkets (annual sales >$5 million) are identified as NAICS codes 44511001-3." Therefore, Moskos' claim is just flat wrong that they conflated Whole Foods with shatterproof glass bodegas. It is also worth noting that these classifications fall very closely in line with the study of Baltimore food stores that Moskos praises. <br /><br />I find it disturbing that Moskos, and especially those commenting on his blog, seem to impugn the research because it comes out of RAND. This, I see, as no different than right-wingers denying scientific evidence because it comes out of "liberal universities." One cannot expect that the truth will always be inconvenient for the other guy.mike3550https://www.blogger.com/profile/00201618187841575433noreply@blogger.com