Picking the 'truthiest' podcast ranking

In my previous blog entry, I dissected some obvious flaws in the new Podtrac monthly ranking of a top 10 podcasts. Since then, it’s been found that there are several respected podcast groups, including The Ringer, Earwolf and Maximum Fun in the comedy and culture genres, as well as CNN news podcasts, that are not being evaluated or considered for inclusion in the ranking. Apparently Podtrac chooses what podcasters to include in their sampling, or maybe the podcaster have to respond to their inquiries.

So, what are the alternatives? There’s the Stitcher top 100 podcast list. Although that list seems like a more relevant cross-section of podcasts that people are talking about, it does not disclose its methodology or what the rankings are based on. Stitcher does have two other top 100 lists where some indication of their methods is given – one for “top movers,” which have risen the most in Stitcher’s rankings. But you can’t see the full rankings, and many of these top movers do not appear in the overall top 100 list. Lastly, Stitcher also has a top 100 for the “most shared” podcasts, which looks more similar to the overall top 100. Overall, the assumption is that the Stitcher top 100 lists are all based on – and only based on – what is being heard through Stitcher’s app, which discounts all the other distribution methods available.

Another ranking, iTunesCharts.net, inspires more confidence. iTunesCharts.net operates by culling Apple’s published iTunes rankings of podcasts at the end of each day. Apple’s rankings are fluid and can change in real time – and Apple does not publish past ranking data, so iTunesCharts.net’s records are the only available history. The major attribute of iTunesCharts.net is that its measurement is based on a more universal means of podcast, so its rankings are likely more representative of the listener following that podcasts on its list actually have.

At this relatively early stage in the development of the podcasting industry, without a truly universally accepted standard for measuring the listenership of podcasts or ranking their popularity, the best any observer may be able to do is choose a ranking that feels like it has “truthiness” (the Stephen Colbert-coined word for something that most seems like it is true, even if might not be completely true). So, for now, iTunesCharts.net has the truthiness crown.