Everyone gets things wrong sometimes. As important as getting things right is, nobody is perfect. Then, how you react when you make a mistake matters. You can cover up the truth, dissemble, point fingers, or—best of all—be humble and honest and apply the lessons learned in the future.
Kudos to Ira and his team for doing the right thing after realizing they did the wrong thing.
And to your point, if you are watching this, and trying to cynically use a one-off example to discredit years of reliable journalism, that too is a moment of character, and I think as important as the story itself.
It would be telling, however, to quantify the reliability of those “years of reliable journalism” by fact checking a random sample of the stories told over those years. According to the article we are discussing, TAL started using professional fact checkers only after the discovery of the Daisey incident. We’re assuming that stories aired prior to that event are reliable, but we haven’t verified that belief, have we?
So that's exactly the kind of over correction in the wrong direction that I'm talking about. I don't think I agree that that's the pertinent extrapolation here. We absolutely would benefit from that spot checking. But I don't think the implication should be that 100% or something near it of the previous articles are fabricated, or under the cloud of deep suspicion until proven otherwise. The same things that led to this particular story unraveling, are vulnerabilities that could have led to other stories unraveling.
If we get a second and a third, I think you might be right to have that cloud of suspicion. That would be like a Shattered Glass scenario and we're not there yet.
I made no extrapolation. I said that we haven't measured the reliability of the earlier stories. Instead of having a reliable measurement, we're going with our much-less-reliable assumptions (prior beliefs).
The interesting thing, I think, is those prior beliefs. Your prior beliefs, it would seem, include the belief TAL's stories are generally reliable. You believe it strongly enough that you write that doubting the reliability of earlier TAL stories is an "over correction in the wrong direction."
I don't think it's an overcorrection. When we find evidence of one fabrication from a trusted source, that source ought to lose trust. If we want to know how much trust it should lose, we have to measure. When we don't measure, when we don't take seriously the responsibility to ground our beliefs, that's how we end up with things like the replication crisis in psychology.
You're extrapolating from the Daisy incident to doubt of their previous reporting. And believe that the Daisy incident merits responding by holding TAL to a newly escalated standard for verification. From this most recent comment of yours, you seem comfortable with "doubting the reliability of earlier TAL stories" as a position you view to be not an over correction. I think you're underestimating how an extreme a position that is, and kind of equivocating between ordinary skepticism and doubting the veracity of their previous stories.
You're right that I believe TAL's stories are generally reliable, that I believe doubting them is an over-correction in the wrong direction.
I also don't think I agree that it's simply a matter of checking or not checking because I believe the vast body of work that's been free from error, although exposed to the same conditions of public scrutiny that could have revealed error in just the same way as with the Daisy story, is part of the body of evidence that actively testifies in favor of TAL. And I do think if there was more of a rocky track record, or if there proves to be more of one in the future, it absolutely could merit spot checking. And as I've said twice now already, I've given the example of Stephen Glass as a case where that skepticism was warranted.
You seem to be implying that I have a categorical opposition to spot checking which couldn't be further from the truth. I just don't think it's warranted in this instance, because it's not a reasonable extrapolation from what happened with the Daisy story.
You're inferring a lot that I didn't write or even imply. I'll be clear about my beliefs:
1. I just learned from the article about the fabricated Daisey episode and that TAL started using professional fact checkers only afterward. I was surprised on both counts.
2. I saw your comment that it would be in poor character to discredit TAL's prior reporting on the basis of this one failure.
3. I responded that it would be telling to actually estimate the reliability of earlier episodes because, right now, we're just going off our personal beliefs (and these probably vary widely from person to person).
4. You and I had a back and forth, mainly talking past one another.
5. I think that if we did actually measure the reliability of prior episodes, it would be less than a lot of TAL defenders expect and greater than a lot of TAL doubters expect.
6. As for what's reasonable vs. over correction to take away from the article, that depends largely on your prior beliefs about TAL and how the world functions in general.
Note that point 5, being a product of my prior beliefs about TAL and how the world functions in general, is actually an example of point 6 in action.
You never had a reason to trust TAL's reporting before the Daisey incident. You maybe trusted it because it is on the radio, and you trust people who can afford a radio station; or because it was on an NPR station, and you trust NPR.
This is pragmatic as long as you have no evidence either way and you're not basing any serious decisions on this "trust." But the fact that they didn't bother to fact check Daisey, and in fact had never fact-checked before that: this is actually the first information you have about TAL's internal processes. It should vastly outweigh it being on the radio.
This comes off like fandom. You seem to have an interest in this incident not affecting people's perception of the quality of TAL, but I have no idea what that interest would be. It shouldn't bother you that people see the show as a place whose facts should be checked if one is considering spreading them.
Suggesting that something is unreliable is not the same as saying that it is consistently fabricated. As they say, a broken clock is still correct twice a day. To choose something less extreme: an unreliable employee may still show up for work 80% of the time.
When their methodology prior to a particular point of time was shown to be weak, and the programs from that time are still available (the archives go back 30 years), I think that asking for spot checking of those old episodes is legitimate. The key thing here are the archives. If the archives weren't available it would be much easier to shrug and say, "live and learn."
There's reason to be more optimistic than this. There is, to some extent, an automatic post-hoc fact checking process built in to being such a high profile publication. For example, the Daisy narrative was challenged because someone with some personal knowledge of the subject heard the show.
It's much better and less embarrassing to get the fact checking right before publication, but the truth generally comes out one way or another. So I'm willing to give historic TAL... not certainty, but at least the benefit of the doubt.
>Suggesting that something is unreliable is not the same as saying that it is consistently fabricated.
I generally understand that to be true, but that was not the upshot of the point being made by the other commenter. Their extrapolation was a much more along the lines of treating it like an open question whether the other stories were fabricated at a level of elevated suspicion that calls for spot checking.
All the other stories were vulnerable to being upended just like this one and seem to have withstood the test of time. I also think that despite this particular story falling apart, TAL has a track record of credibility and vetting that is more legitimate than is being implied by casting doubt over the history of theirs, and I did contrast it to the case of Stephen Glass, which model conditions where that degree of skepticism is more appropriately warranted.
Perhaps instead of fact checking, we could compare the previous narratives with known public knowledge of the events, to determine if the narratives provided an accurate view of reality. It is easy to distort the truth and still tell no lies.
So... I can speak to this because I've listened to almost the entire TAL back catalog, lol.
The show has a stronger journalistic focus now than it did 10 years ago and _way_ more than it did 20 or (almost!) 30 years ago. It's always been part of the show—people who complain that TAL "didn't used to be political" clearly don't remember how many segments they ran about the Iraq war—but for the first decade or so the show had a very strong focus on the arts; they'd have a lot of guests sharing personal essays, short fiction, etc.
The serious journalism-type stories were generally either (1) on-the-ground reporting from their own staff, like a really great episode where they toured an aircraft carrier (https://www.thisamericanlife.org/206/somewhere-in-the-arabia...), (2) stories sourced from other journalists or professional organizations who had serious reputation to lose if they were caught in the supply chain of misinformation, or (3) "this is a thing that happened to me"-type firsthand accounts and observations. And I guess the now-debunked Apple factory story falls into the third category, but the types of stories that had previously fallen into that category tended to be far smaller in scale and/or were presented as more subjective than the Apple story had been.
All of that to say that I think you raise a valid question, and I'm sure some stuff slipped through the cracks over the years, but I also think the implication of that crack-slipping was far less dire in the show's earlier days, and there were just fewer news-ish stories overall.
I think this is different. Getting something wrong in journalism is not like a mistake practicing an instrument: reputations and careers are at stake. it calls into doubt the integrity of the whole program.
>You can cover up the truth, dissemble, point fingers, or—best of all—be humble and honest
If covering up the truth works, why would you risk telling the truth? At worst, the outcome is the same (minor scandal). At best, in most cases, nobody ever learns about the lie. The rational choice is to never tell the truth until it's completely obvious you lied, they e okay dumb.
(Sorry for cynicism. I don't really think like that)
Kudos to Ira and his team for doing the right thing after realizing they did the wrong thing.