Measurement ParadoxOpen Access

Measurement Paradox

We enjoy experiences less when we track them

While measurement may increase our performance, it comes at the expense of how much we enjoy those measured activities and how much we want to keep doing them.

Etkin, J. (2016). The hidden cost of personal quantification. Journal of consumer research, 42(6), 967-984.

The study

Setup

Setup

95 university students spent the day leisurely walking. In the measurement group they were given the choice to wear a pedometer. In the control group, everyone used a sealed shut pedometer. Afterwards, they rated how much they enjoyed walking.

What’s a Rich Text element?

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

Static and dynamic content editing

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to customize formatting for each rich text

Headings, paragraphs, blockquotes, figures, images, and figure captions can all be styled after a class is added to the rich text element using the "When inside of" nested selector system.

Results

Results

Measuring led participants to walk more but decreased how much they enjoyed it – even for those who chose to be measured.

Study graph
np_read_2490885_000000

Etkin, J. (2016). The hidden cost of personal quantification. Journal of consumer research, 42(6), 967-984.

With the rise of wearable devices, personal quantification is easier than ever. It's not a surprise that self-tracking has a large adherence in a competitive, comparative culture where the individual is constantly improving his performance in every possible measure.

But it has a cost.

One of the responsibilities of product creators is to understand and examine the resultant behaviours that modifications to the product design will trigger. By adding certain features or changing their salience, you will inevitably change the behavioural dynamics.

It’s well studied that external rewards undermine intrinsic motivation, but now we know that the act of tracking can also impact it by reminding us of the output, making the activities seem like work. Thus, not everything that can be measured should be measured.

Peter Drucker said “What gets measured gets managed, even when it’s pointless to measure and manage it, and even if it harms the purpose of the organization to do so”.

It’s a warning from the father of management that it’s not often taken to heart, and this study reminds us of it.

Key Takeaways

1
1

Consider what you want your users to feel.

While measurement may improve performance, it comes at the expense of enjoyment. By adding a measurement option, the behaviour will feel like work instead of fun.

Takeaway image
2
2

Understand why users engage in an activity when deciding whether to measure it.

Sometimes the benefit of achieving more may outweigh the cost of users enjoying the experience. Does the end you’re looking to achieve justify the means of measuring its progress?

Takeaway image
3
3

Switch the motivation type by becoming pro-social and giving meaning to the measurement.

For example: If you reduce your calories, you could send the equivalent of those excess calories to someone in need of food.

Takeaway image
4
4

Prior data can set reference points that demotivate us

Our personal motivation can suffer in the face of prior data, setting unhelpful reference points about future expected efforts.

For instance, consider the following: "I can see that I ran 10k 3 times in a row, so if I don't run 10k this time, I feel that I'm doing worse. But I just don't feel like I can do 10k today, so I won't go at all."

However, in absolute terms, you're doing more in total by doing any more running at all, whether that's 1k, or even 100m, so you're best off ignoring the data and doing *something*.

A good counterbalance to this is to focus instead on the *experience* that running provides. This removes the quantifiable reference point and frees us to just enjoy the act for what it is. And who knows, maybe we'll end up running longer than 10k in the process!

Takeaway image

Prior data can set reference points that demotivate us

Our personal motivation can suffer in the face of prior data, setting unhelpful reference points about future expected efforts.

For instance, consider the following: "I can see that I ran 10k 3 times in a row, so if I don't run 10k this time, I feel that I'm doing worse. But I just don't feel like I can do 10k today, so I won't go at all."

However, in absolute terms, you're doing more in total by doing any more running at all, whether that's 1k, or even 100m, so you're best off ignoring the data and doing *something*.

A good counterbalance to this is to focus instead on the *experience* that running provides. This removes the quantifiable reference point and frees us to just enjoy the act for what it is. And who knows, maybe we'll end up running longer than 10k in the process!

Takeaway image
Currently being prepared...
Measurement Paradox

Measurement Paradox

We enjoy experiences less when we track them

While measurement may increase our performance, it comes at the expense of how much we enjoy those measured activities and how much we want to keep doing them.

The study

Setup

95 university students spent the day leisurely walking. In the measurement group they were given the choice to wear a pedometer. In the control group, everyone used a sealed shut pedometer. Afterwards, they rated how much they enjoyed walking.

Results

Measuring led participants to walk more but decreased how much they enjoyed it – even for those who chose to be measured.

study graph
np_read_2490885_000000

In detail

With the rise of wearable devices, personal quantification is easier than ever. It's not a surprise that self-tracking has a large adherence in a competitive, comparative culture where the individual is constantly improving his performance in every possible measure.

But it has a cost.

One of the responsibilities of product creators is to understand and examine the resultant behaviours that modifications to the product design will trigger. By adding certain features or changing their salience, you will inevitably change the behavioural dynamics.

It’s well studied that external rewards undermine intrinsic motivation, but now we know that the act of tracking can also impact it by reminding us of the output, making the activities seem like work. Thus, not everything that can be measured should be measured.

Peter Drucker said “What gets measured gets managed, even when it’s pointless to measure and manage it, and even if it harms the purpose of the organization to do so”.

It’s a warning from the father of management that it’s not often taken to heart, and this study reminds us of it.

Hungry for more?

Savour the full features of Coglode Cookbook

All Nuggets

Academic data

Key takeaways

Pairings

Cheat Sheets

Collect Nuggets

Nuggets In The Wild

Coglode Live monthly

Currently being sourced...
Nuggets

Snack on these...

Open access, foundational Nuggets

Scarcity

Scarcity

We value things more when they’re in limited supply

Social Proof

Social Proof

We copy the behaviors of others, especially in unfamiliar situations

Prospect Theory

Prospect Theory

A loss hurts more than an equal gain feels good

Reciprocity

Reciprocity

We’re hardwired to return kindness received

Framing

Framing

We make very different decisions based on how a fact is presented

Loss Aversion

Loss Aversion

We feel more negative when losing something than positive when we gain it

Default Effect

Default Effect

We tend to accept the option pre-chosen for us

Anchoring

Anchoring

What we see first affects our judgement of everything thereafter

Fast & Slow Thinking

Fast & Slow Thinking

We make knee-jerk spontaneous decisions that can cause regretful damage

Dynamic Norms

Dynamic Norms

We’re more likely to change if we can see a new behavior developing

Salience

Salience

Our choices are determined by the information we're shown

Connected to

Join Coglode Live!

March 29, 2023 16:00

GMT

Prospect Theory
A loss hurts more than an equal gain feels good

Prospect Theory's considered one of the most important (and confusing) concepts in Behavioural Science. We'll explore:

• The various mechanics of how it works

• Examples from the wild that use it well

• How you can use Prospect Theory in your work to improve experiences!

So join us. Tversky and Kahneman will be proud of you.

Show more
Prospect Theory
A loss hurts more than an equal gain feels good
Sign up to attend

Hungry for more?

Savour the full features of Coglode Cookbook

All Nuggets, data & takeaways

Academic data

Key takeaways

Pairings

Cheat Sheets

Collect Nuggets

Nuggets In The Wild

Monthly Coglode Live calls

Upgrade
© 2013-23 Coglode

Running workshops?

Measurement Paradox

is included in Box One of our physical workshop tool.
is included in Box Two of our physical workshop tool.
No items found.

Cookbook Changelog

Feature

Cookbook for Teams announced
Cookbook for Teams announced
This week
Mar 2023

New Nugget In The Wild

Deliveroo's tipping system, behaviourally deconstructed
Deliveroo's tipping system, behaviourally deconstructed
This week
Feb 2023

Improvement

Nuggets In The Wild component redesigned and rebuilt
Nuggets In The Wild component redesigned and rebuilt
This week
Feb 2023

Feature

Completed core of forthcoming Nuggets Library for Figma
Completed core of forthcoming Nuggets Library for Figma
This week
Feb 2023

New Nugget In The Wild

Flora case study into overcoming stagnant social proof
Flora case study into overcoming stagnant social proof
This week
Feb 2023

Coglode Live

Open Access Prospect Theory Event added
Open Access Prospect Theory Event added
This week
Feb 2023

New Nugget In The Wild

Case study that reframes product waste into a playful second life for cats
Case study that reframes product waste into a playful second life for cats
This week
Feb 2023

Improvement

Improved persistent login pane
Improved persistent login pane
This week
Feb 2023

New Pairing

New combo of Nuggets that reinforce the 'best' choice centrally
New combo of Nuggets that reinforce the 'best' choice centrally
This week
Feb 2023