Latest / This Week In Wellbeing Measurement / Beyond GDP? Plus: thermal well-being and LLM stress metrics

Transcript

Beyond GDP? Plus: thermal well-being and LLM stress metrics · This Week In Wellbeing Measurement

• 0:00
  Davis: When you say a place is doing well, what do you actually mean?
• 0:04
  Jenny: I mean, I want to say clean air, decent clinics, people not getting cooked on the walk home, but then someone has to measure that without flattening everybody into one happy-or-not score.
• 0:15
  Davis: Right, and this week keeps poking that bruise, because the measure changes depending on whether you're a new mother in a hospital, a city planner looking at a park, or just a person trying to find shade.
• 0:26
  Jenny: Okay, but if the park example is people leaving online reviews, I have questions, because typing that a wetland felt nice is not the same thing as measuring comfort.
• 0:37
  Davis: No, but when the heat maps say one thing and the reviews say another, that gap may be the story: access, shade, memory, and who actually gets to feel cooler...welcome to This Week In Wellbeing Measurement on paperboy.fm.
• 1:07
  Davis: This week we started with 951 search hits, narrowed that to 114 qualified papers, and saw 559 unique authors across 31 countries, so the feed is smaller than the raw search but pretty wide once the screening is done.
• 1:22
  Jenny: The funny part is the direction of travel: qualified papers rose from 98 to 114, up 16.3%, even though total hits fell from 1,013 to 951, so I want to know if the search got cleaner, or if measurement papers just clustered more tightly around wellbeing this week.
• 1:43
  Davis: The method mix gives one clue, but not the whole answer: 29 surveys, 15 qualitative studies, 14 cross-sectional studies, and 6 longitudinal papers, which means a lot of this week is people asking, interviewing, and comparing groups at one point in time, rather than testing interventions.
• 2:01
  Jenny: Country coverage jumped harder, from 21 countries to 31, a 47.6% increase, and the top country counts are still modest: China had 9 papers, the UK 7, and the U.S. 6, so this looks less like one country dominating and more like a wider tail.
• 2:19
  Davis: The author mix also fits that wider-tail story: out of 559 authors, 131 were first-time authors, meaning their first-ever paper in the metadata, not just new to this feed; 196 were emerging researchers, and 232 were experienced.
• 2:36
  Jenny: Theme-wise, mental health led with 16 papers, psychological wellbeing had 8, and wellbeing had 6, with burnout and public health at 5 each, so the through-line is measurement getting less generic and more attached to real settings, real people, and real tradeoffs.
• 2:55
  Davis: Alright, let's get into the papers with the big umbrella one: A Review of Beyond GDP: History, Barriers, Opportunities, and Cautions, by Joseph Eastoe, Ida Kubiszewski, Robert Costanza, Rutger Hoekstra, and colleagues in Annual Review of Environment and Resources in twenty twenty-six.
• 3:13
  Davis: The plain claim is that GDP is still the scoreboard governments watch, even though it leaves out three huge things: environmental sustainability, inequality, and social well-being. The review says there are hundreds of alternatives now, and the interesting twist is that many of them are starting to point in the same direction, toward prosperity as something wider than market output.
• 3:34
  Jenny: If the alternatives are starting to look similar, what is still stopping governments from using them?
• 3:40
  Davis: The authors synthesize the literature rather than testing one new metric, and they name three blockers: vested interests, institutional buy-in, and fragmentation among alternatives. So the limitation is clear: this is a review and an argument, not a fresh empirical trial of one replacement dashboard.
• 3:58
  Jenny: That makes the takeaway feel practical, not dreamy: if you're proposing a well-being dashboard, you can't just pick better indicators and walk away. You need a plan for ministries, budgets, statistical offices, and politics, because this whole Beyond One Number thread is really asking who gets to decide what counts as progress.
• 4:19
  Jenny: That line about ministries and budgets carries straight into S. Chakrabartty's twenty twenty-six paper, Respectful Maternity Care Measurement: Two Indices. Here the institution is maternity care, and the question is painfully practical: how do you measure whether women are treated with dignity during pregnancy, birth, and immediate postpartum care?
• 4:40
  Jenny: The measurement snag is that respectful maternity care data come in mismatched shapes. Patient experience tools often give ordinal scores, meaning ranked answers like never, sometimes, or always, while facility and clinical data are ratio-scale numbers, meaning counts or rates where zero has a real meaning, like maternal mortality or staffing levels. Chakrabartty proposes two composite indices, which are blended scores built from several measures: one for women's respectful-care status, and one for a country's overall respectful-maternity-care health.
• 5:15
  Davis: So what would make these two new indices trustworthy once they leave the method paper and hit real maternity data from actual service centers?
• 5:22
  Jenny: The author's move is to transform each secondary-data item into a continuous score that follows a normal distribution, so the pieces can be added and compared across time, regions, and maternity service centers. That setup is meant to test progress or decline, compare average performance, check consistency across centers, and even fit regressions linking the indicators to maternal mortality or neonatal mortality. But the big limitation is right there: this is a proposed method, and it still needs empirical testing with live data, especially with separate index calculations for vulnerable groups at higher risk of maternal mortality.
• 6:02
  Davis: That feels like the Composite Metrics At Work thread in its highest-stakes version. If a health ministry compares hospitals with one respectful-care score, it has to say exactly how patient voice, facility capacity, clinical risk, and outcomes got combined. Otherwise the index can look clean while hiding the very socioeconomic barriers it was supposed to expose.
• 6:24
  Davis: That warning about a clean index hiding messy barriers is exactly where this next paper lands, just in a very different system: Metric Selection Framework: A Method for Optimizing Multidimensional Value Assessment of Resource Recovery Systems. Iacovidou, Gerassimidou, Purnell, and Ebner are looking at England's plastic packaging system, and they're asking how you choose sustainability metrics before the score hardens into policy.
• 6:49
  Davis: The useful move is that the metric selection framework sits inside CVORR+, a systems-based evaluation toolkit, which just means it maps how the whole recovery system works before picking what to measure. Instead of saying, here are our recycling rates, the framework tries to identify inefficiencies and leverage points across environmental, economic, social, and technical domains.
• 7:11
  Jenny: How do we know these are the right metrics rather than the easiest ones to get agreement on?
• 7:16
  Davis: They try to guard against that by combining expert elicitation, which is a structured way to ask specialists what matters, with stakeholder engagement, which brings in people who deal with the system in practice. The authors also use value-focused decision-making, meaning they start with the decisions and values the metrics have to serve, then test that process in the England plastic packaging case; but the limit is real, because one case study can show the method has practical traction without proving it transfers cleanly to every recovery system.
• 7:45
  Jenny: That makes this a very Composite Metrics At Work paper, because the score is not the hero here. The hero is the messy pre-work: mapping who makes decisions, where plastic value leaks out of the system, and which metric would actually change a policy choice rather than just decorate a dashboard.
• 8:05
  Paperboy.fm: This is the free version of the podcast. Subscribe at paperboy.fm to access a dozen different paper review podcasts for five dollars a month.