Peloton’s Calibration Problem

If you’ve been a Peloton member for any length of time, you probably have been hearing about “calibration”. Not from Peloton, no, but it’s a topic in social media, and it could be a problem for Peloton that they may not have any way of getting on top of. Potentially a couple hundred thousand of these bikes are essentially out of whack, and there’s no obvious fix.

Calibration, broadly, relates to the data coming back from the equipment that is used (either directly or as part of a calculation) to give the rider feedback on his or her efforts. Calibration could involve the measurements of cadence, heart rate, etc., but when you hear “Peloton” and “calibration” in the same sentence, it is the bike’s resistance that is the topic.

If you need a quick refresher on cadence, resistance, and the other Peloton metrics, click over to this explanation of Peloton cadence, resistance, and output.

Resistance is the measurement of how difficult it is to turn the Peloton flywheel, and is displayed as a percentage. You’d think that this would be essentially linear, with 0 being no resistance and 100 being complete resistance, and that 50 resistance is twice as strong as 25 resistance. If that were the case, this would be a fairly short post.

What’s really important to understand is that resistance is at the heart of pretty much everything else that is measured (besides time and heart rate). I’m speaking specifically of power generated (watts), work done (kilojoules) and calories burned. These (particularly the second) are the metrics by which Peloton riders compare themselves to one another. If resistance is not accurate, then there isn’t much left in the metrics you can trust.

So, how reliable is the resistance number? That is the million dollar question. There is evidence to suggest that some bike’s resistance numbers are questionable.

Graph showing 100% resistance - and more
This user rode more than two minutes at 100% resistance (and, evidently a short time ABOVE 100%)

Exhibit A: Social media posts in which people talk about how challenging a ride based on how many times they got to 100 resistance. Now, by definition, 100% resistance means that the wheel is completely resisted. That is, it cannot be turned. If it can be turned, then it is by definition not fully resisted. Yet notice the results graph in the accompanying photo in which the rider apparently rides for two minutes at 100% (and then proceeds to exceed 100%, at which point I guess the bike should actually be forcing your pedals backwards, or something).

There are many anecdotes about broken bikes that show 100% regardless of how much resistance is actually added, but it’s probably safe to assume that they are a pretty small minority. If, however, there are some percentage of bikes that people can pedal at 100% resistance (with difficulty, as the proud social media posters note), it begs the question of whether your 100% resistance is the same as my 100% resistance.

It’s like the koan-like question: how can we be sure that when I see the color “blue”, it doesn’t look to you like the color I see as “red”? I know something is blue because it is the same color as other things that I also identify as blue. But I have never seen anything with your eyes, and I have no idea what the color blue looks like to you. It is a bit easier (but not so easy) for me to determine if your 40% resistance is the same as my 40% resistance. If it’s wildly different, then I can perceive of the difference, but if it’s close, then it’s not likely I’d be able to tell the difference.

I have personally ridden on about five Peloton bikes, and I’d have to say that the ones I rode in the Peloton store, my own bike at home, and my brother’s bike all felt about the same to me. The bike I rode in the Peloton studio, on the other hand, was conspicuously easier than any of the others. Yes, maybe I was pumped up for the ride at the Mothership (SO to JJ!), but I don’t think that accounts for the difference. The PRs I set that day still stand, and my next best effort isn’t close.

This all comes back to “calibration”. Calibration is the act of accurately setting the measuring devices, and it is performed at the factory. Presumably, there can be some change over time (“drift” is what it’s called), so the calibration tools are included with your bike when it is delivered to you. (Anybody have their bike calibrated by the installers? Didn’t think so. Anybody want those guys making adjustments on your bike? Didn’t think so.) I won’t go into the specifics of calibration, but you can do an internet search to find Peloton’s own instructional video. I’ve been through the video and, in my humble opinion, there remain opportunities for a fairly high degree of variance in their process.

So, how do you trust that the resistance numbers (and, by extension, the all-important output numbers) are the same from bike to bike? This would seem to be nearly impossible to know. To accurately determine if the amount of effort needed to turn one bike’s flywheel is equal to the effort required for another bike one would need additional equipment, such as replacement crank arms or pedals with power meters built-in. Of course, THOSE devices would need to be calibrated, too!

As it is, I don’t believe anyone has an accurate picture of the amount of variability there are in the power calculations across bikes, and I don’t believe there is really any way that Peloton could measure and correct for this, even if they wanted to. 

The good news is that if you bear in mind that your true competitor is yourself, then none of this should really matter. Your own bike’s resistance calibration is not likely to drift significantly over time, so if you are now cranking out 30% more KJs this year over last, you can be pretty sure you’ve made some serious progress. 

As for me, I just assume that anyone ahead of me on the leaderboard needs to get their bikes calibrated.

— #LeftShark

1 thought on “Peloton’s Calibration Problem”

  1. Great article – thanks for sharing. I have noticed F 20’s blow by me like I was standing still. I don’t claim to be a pro cyclist but some of the statistics on the leader board seem totally out of whack.

Leave a Reply

Your email address will not be published. Required fields are marked *