EDIT: Let’s cool it with the downvotes, dudes. We’re not out to cut funding to your black hole detection chamber or revoke the degrees of chiropractors just because a couple of us don’t believe in it, okay? Chill out, participate with the prompt and continue with having a nice day. I’m sure almost everybody has something to add.
Appreciate the thoughtful and in-depth response. My worry is more that a science article’s editorialized interpretation of the paper may be wrong or misleading, than that the public isn’t very able to scrutinize the quality of science in the paper itself. Waiting for a possible email response from a researcher is pretty much always going to be a little too high effort for someone wanting to spend a few minutes comparing claims in the article and claims in the paper to potentially call bullshit on discrepancies between them in an online comment.
I absolutely agree with you there. I just commented a short time ago on an article about the effects of primate vocalizations on the human brain. The article not only got the conclusion of the paper wrong, they got the very nature of evolution wrong. I didn’t even have to read the paper - I haven’t gotten to it yet. It’s admittedly the kind of mistake non-biologists make. Journalists should probably avoid drawing conclusions that aren’t specifically in the source material. My point is that, going off of the author’s quotes the pulled and my own knowledge of evolutionary dynamics, I knew it was wrong. However, I am not at all sure that someone without a background in biology would be able to understand the paper well enough to catch the error in the article.
I am all for open access, and I share your frustration. I think you should be able to access any paper you want for free. But I’ll also say that if you don’t have the background in the subject to know what the underlying paper will have said, the chances are pretty good that you’re not going to understand the paper well enough to find the flaws.
I used to talk to a physicist named Lee Smolin who proposed a Darwinian model for universe formation. I can follow the evolutionary part, but when it gets down to the physics of it, I’m lost at sea. So when I read an article about him - I read something about him recently - I mostly have to go on my basic understanding because there’s no way I’d make it through that paper.
And literally the only reason I’m throwing this out there at all is that, unlike a physics paper that’s totally incomprehensible and obviously so, people believe in their own interpretations on social science or public health papers. I see more kinds of cherry-picking abuses and simple misunderstandings there than elsewhere.
It’s great to see people so inquisitive though.
I think most of the time it’s really not going to be as hard as all that, because the problem is something like, article makes broad claim based on a very easy to understand study where the data is results of survey questions. The paper clearly and explicitly outlined caveats and qualifications for their results, but the article chose to ignore these, so all that would be required to call them out on it is basic reading comprehension and the ability to copy paste a brief quote from the paper. Or maybe there are stark, obvious differences between the question asked in a survey and the claim of a clickbait headline.
Even for something more complex, if the paper is well written I think people without a background in the field could get stuff out of it, at least enough to spot direct contradictions between it and a summary. It’s just reading. A lot of people can read and have some higher education.
For that wikipedia article, I think it would make more sense if it expanded on “may differ slightly” and how that interacts with this criticism of black hole information transfer being impossible. Would that criticism imply the parameters for new universes must be always the same? Have infinite variance with no reference point? Not exist at all? Is “may differ slightly” a claim that each universe is a reference point around which the cosmological constants of child universes randomly vary a little bit and then there could be drift based on which constants result in a universe with more black holes? If that stuff was concisely clarified it would probably seem less arcane.