Measurement ParadoxOpen Access

Measurement Paradox

We enjoy experiences less when we track them

While measurement may increase our performance, it comes at the expense of how much we enjoy those measured activities and how much we want to keep doing them.

Etkin, J. (2016). The hidden cost of personal quantification. Journal of consumer research, 42(6), 967-984.

The study

Setup

Setup

95 university students spent the day leisurely walking. In the measurement group they were given the choice to wear a pedometer. In the control group, everyone used a sealed shut pedometer. Afterwards, they rated how much they enjoyed walking.

What’s a Rich Text element?

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

Static and dynamic content editing

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to customize formatting for each rich text

Headings, paragraphs, blockquotes, figures, images, and figure captions can all be styled after a class is added to the rich text element using the "When inside of" nested selector system.

Results

Results

Measuring led participants to walk more but decreased how much they enjoyed it – even for those who chose to be measured.

Study graph
np_read_2490885_000000

Etkin, J. (2016). The hidden cost of personal quantification. Journal of consumer research, 42(6), 967-984.

With the rise of wearable devices, personal quantification is easier than ever. It's not a surprise that self-tracking has a large adherence in a competitive, comparative culture where the individual is constantly improving his performance in every possible measure.

But it has a cost.

One of the responsibilities of product creators is to understand and examine the resultant behaviours that modifications to the product design will trigger. By adding certain features or changing their salience, you will inevitably change the behavioural dynamics.

It’s well studied that external rewards undermine intrinsic motivation, but now we know that the act of tracking can also impact it by reminding us of the output, making the activities seem like work. Thus, not everything that can be measured should be measured.

Peter Drucker said “What gets measured gets managed, even when it’s pointless to measure and manage it, and even if it harms the purpose of the organization to do so”.

It’s a warning from the father of management that it’s not often taken to heart, and this study reminds us of it.

Key Takeaways

1
1

Consider what you want your users to feel.

While measurement may improve performance, it comes at the expense of enjoyment. By adding a measurement option, the behaviour will feel like work instead of fun.

Takeaway image
2
2

Understand why users engage in an activity when deciding whether to measure it.

Sometimes the benefit of achieving more may outweigh the cost of users enjoying the experience. Does the end you’re looking to achieve justify the means of measuring its progress?

Takeaway image
3
3

Switch the motivation type by becoming pro-social and giving meaning to the measurement.

For example: If you reduce your calories, you could send the equivalent of those excess calories to someone in need of food.

Takeaway image
4
4

Prior data can set reference points that demotivate us

Our personal motivation can suffer in the face of prior data, setting unhelpful reference points about future expected efforts.

For instance, consider the following: "I can see that I ran 10k 3 times in a row, so if I don't run 10k this time, I feel that I'm doing worse. But I just don't feel like I can do 10k today, so I won't go at all."

However, in absolute terms, you're doing more in total by doing any more running at all, whether that's 1k, or even 100m, so you're best off ignoring the data and doing *something*.

A good counterbalance to this is to focus instead on the *experience* that running provides. This removes the quantifiable reference point and frees us to just enjoy the act for what it is. And who knows, maybe we'll end up running longer than 10k in the process!

Takeaway image

Prior data can set reference points that demotivate us

Our personal motivation can suffer in the face of prior data, setting unhelpful reference points about future expected efforts.

For instance, consider the following: "I can see that I ran 10k 3 times in a row, so if I don't run 10k this time, I feel that I'm doing worse. But I just don't feel like I can do 10k today, so I won't go at all."

However, in absolute terms, you're doing more in total by doing any more running at all, whether that's 1k, or even 100m, so you're best off ignoring the data and doing *something*.

A good counterbalance to this is to focus instead on the *experience* that running provides. This removes the quantifiable reference point and frees us to just enjoy the act for what it is. And who knows, maybe we'll end up running longer than 10k in the process!

Takeaway image
np_read_2490885_000000
np_read_2490885_000000

In further detail

With the rise of wearable devices, personal quantification is easier than ever. It's not a surprise that self-tracking has a large adherence in a competitive, comparative culture where the individual is constantly improving his performance in every possible measure.

But it has a cost.

One of the responsibilities of product creators is to understand and examine the resultant behaviours that modifications to the product design will trigger. By adding certain features or changing their salience, you will inevitably change the behavioural dynamics.

It’s well studied that external rewards undermine intrinsic motivation, but now we know that the act of tracking can also impact it by reminding us of the output, making the activities seem like work. Thus, not everything that can be measured should be measured.

Peter Drucker said “What gets measured gets managed, even when it’s pointless to measure and manage it, and even if it harms the purpose of the organization to do so”.

It’s a warning from the father of management that it’s not often taken to heart, and this study reminds us of it.

Prior data can set reference points that demotivate us

Our personal motivation can suffer in the face of prior data, setting unhelpful reference points about future expected efforts.

For instance, consider the following: "I can see that I ran 10k 3 times in a row, so if I don't run 10k this time, I feel that I'm doing worse. But I just don't feel like I can do 10k today, so I won't go at all."

However, in absolute terms, you're doing more in total by doing any more running at all, whether that's 1k, or even 100m, so you're best off ignoring the data and doing *something*.

A good counterbalance to this is to focus instead on the *experience* that running provides. This removes the quantifiable reference point and frees us to just enjoy the act for what it is. And who knows, maybe we'll end up running longer than 10k in the process!

Takeaway image
Currently being prepared...
Measurement Paradox

Measurement Paradox

We enjoy experiences less when we track them

While measurement may increase our performance, it comes at the expense of how much we enjoy those measured activities and how much we want to keep doing them.

The study

Setup

95 university students spent the day leisurely walking. In the measurement group they were given the choice to wear a pedometer. In the control group, everyone used a sealed shut pedometer. Afterwards, they rated how much they enjoyed walking.

Results

Measuring led participants to walk more but decreased how much they enjoyed it – even for those who chose to be measured.

study graph
np_read_2490885_000000

In detail

With the rise of wearable devices, personal quantification is easier than ever. It's not a surprise that self-tracking has a large adherence in a competitive, comparative culture where the individual is constantly improving his performance in every possible measure.

But it has a cost.

One of the responsibilities of product creators is to understand and examine the resultant behaviours that modifications to the product design will trigger. By adding certain features or changing their salience, you will inevitably change the behavioural dynamics.

It’s well studied that external rewards undermine intrinsic motivation, but now we know that the act of tracking can also impact it by reminding us of the output, making the activities seem like work. Thus, not everything that can be measured should be measured.

Peter Drucker said “What gets measured gets managed, even when it’s pointless to measure and manage it, and even if it harms the purpose of the organization to do so”.

It’s a warning from the father of management that it’s not often taken to heart, and this study reminds us of it.

Hungry for more?

Currently being sourced...
Nuggets

Snack on these...

Open access, foundational Nuggets

Scarcity

Scarcity

We value things more when they’re in limited supply

Social Proof

Social Proof

We copy the behaviors of others, especially in unfamiliar situations

Prospect Theory

Prospect Theory

A loss hurts more than an equal gain feels good

Reciprocity

Reciprocity

We’re hardwired to return kindness received

Framing

Framing

We make very different decisions based on how a fact is presented

Loss Aversion

Loss Aversion

We feel more negative when losing something than positive when we gain it

Self-Expression

Self-Expression

We constantly seek out ways to communicate our identity to others

Default Effect

Default Effect

We tend to accept the option pre-chosen for us

Priming

Priming

Our decisions are shaped by memories recalled from things just seen or heard

Anchoring

Anchoring

What we see first affects our judgement of everything thereafter

Autonomy Bias

Autonomy Bias

We have a deep-seated need to control our situations

Fast & Slow Thinking

Fast & Slow Thinking

We make knee-jerk spontaneous decisions that can cause regretful damage

Status Quo Bias

Status Quo Bias

We tend to stick with our previous choices, even if the alternatives might be better

Dynamic Norms

Dynamic Norms

We’re more likely to change if we can see a new behavior developing

Round Pricing Preference

Round Pricing Preference

We prefer and trust whole numbers over those ending in a 9

Salience

Salience

Our choices are determined by the information we're shown

Connected to

All Nuggets, data & takeaways

Academic data

Key takeaways

Pairings

Cheat Sheets

Collect Nuggets

Nuggets In The Wild

Monthly Coglode Live calls

Hungry for more?

Savour all of Coglode Cookbook

Sign up

Running workshops?

Measurement Paradox

is included in Box One of our physical workshop tool
is included in Box Two of our physical workshop tool.
No items found.
© 2013-24 Coglode

What's Cooking?

New Nugget In The Wild

How Experian's CreditLock creates calm with well-designed control
How Experian's CreditLock creates calm with well-designed control
This week
Mar 2024

New Cheat Sheet

New "Overcoming Status Quo" Cheat Sheet
New "Overcoming Status Quo" Cheat Sheet
This week
Mar 2024

Improvement

Simplified navigation
Simplified navigation
This week
Mar 2024

Improvement

After ten years, just who is behind Coglode?
After ten years, just who is behind Coglode?
This week
Feb 2024

Feature

Interactive Defaults Tool released
Interactive Defaults Tool released
This week
Jan 2024

Coglode Live

Defaults Live video and deck now available
Defaults Live video and deck now available
This week
Jan 2024

Cure

Cancelling Amazon Prime - An interactive, behavioural remedy
Cancelling Amazon Prime - An interactive, behavioural remedy
This week
Aug 2023

New Nugget In The Wild

How new browser Arc overcomes Status Quo bias with Boosts and Zaps
How new browser Arc overcomes Status Quo bias with Boosts and Zaps
This week
Jul 2023

New Cheat Sheet

New "Overcoming Risk Aversion" Cheat Sheet
New "Overcoming Risk Aversion" Cheat Sheet
This week
Jul 2023

Feature

Cheat Sheets redesigned - Includes Checklists
Cheat Sheets redesigned - Includes Checklists
This week
Mar 2024

Coglode Live

Self-Expression Live video and deck now available
Self-Expression Live video and deck now available
This week
May 2023

Coglode Live

Self-Expression Live event announced
Self-Expression Live event announced
This week
Apr 2023

Coglode Live

Feedback Loops video and deck now available
Feedback Loops video and deck now available
This week
Apr 2023

Feature

Figma Behavioral Design System released
Figma Behavioral Design System released
This week
Apr 2023

Feature

Figma Behavioral Design System sneak-peek
Figma Behavioral Design System sneak-peek
This week
Apr 2023

Coglode Live

Feedback Loops Live event announced
Feedback Loops Live event announced
This week
Mar 2023

Coglode Live

Prospect Theory video and deck now available
Prospect Theory video and deck now available
This week
Mar 2023

New Nugget In The Wild

Reframing service fees as benefits
Reframing service fees as benefits
This week
Mar 2023

Feature

Cookbook for Teams announced
Cookbook for Teams announced
This week
Mar 2023

New Nugget In The Wild

Deliveroo's tipping system, behaviourally deconstructed
Deliveroo's tipping system, behaviourally deconstructed
This week
Feb 2023

Improvement

Nuggets In The Wild component redesigned and rebuilt
Nuggets In The Wild component redesigned and rebuilt
This week
Feb 2023

Feature

Completed core of forthcoming Nuggets Library for Figma
Completed core of forthcoming Nuggets Library for Figma
This week
Feb 2023

New Nugget In The Wild

Flora case study into overcoming stagnant social proof
Flora case study into overcoming stagnant social proof
This week
Feb 2023

Coglode Live

Open Access Prospect Theory Event added
Open Access Prospect Theory Event added
This week
Feb 2023

New Nugget In The Wild

Case study that reframes product waste into a playful second life for cats
Case study that reframes product waste into a playful second life for cats
This week
Feb 2023

Improvement

Improved persistent login pane
Improved persistent login pane
This week
Feb 2023

New Pairing

New combo of Nuggets that reinforce the 'best' choice centrally
New combo of Nuggets that reinforce the 'best' choice centrally
This week
Feb 2023