wellbeing-psychometrics-measurement

name: Wellbeing Psychometrics & Measurement description: Design and interpret validated psychometric instruments for measuring wellbeing outcomes. Use when creating measurement frameworks, selecting assessment tools, designing surveys, or analyzing wellbeing data. Covers reliable scales with strong psychometric properties for research and evaluation.

Wellbeing Psychometrics & Measurement

Rigorous measurement of wellbeing requires validated instruments with strong psychometric properties. This skill guides selection, implementation, and interpretation of evidence-based measurement tools.

Core Psychometric Principles

Validity Types

• Construct Validity: Does the instrument measure what it claims to measure?
• Criterion Validity: Does it predict relevant outcomes?
• Content Validity: Does it comprehensively cover the domain?
• Discriminant Validity: Does it distinguish from related but different constructs?

Reliability Indicators

• Cronbach's Alpha: Internal consistency (0.7-0.9 is acceptable, 0.6+ for exploratory)
• Test-Retest Reliability: Stability over time (typically ICC > 0.7)
• Inter-rater Reliability: Agreement between raters (Cohen's kappa, ICC)

Measurement Model Fit

• CFI/TLI: Comparative fit indices (>0.90 is good)
• RMSEA: Root Mean Square Error of Approximation (<0.08 is acceptable)
• SRMR: Standardized Root Mean Square Residual (<0.08 is good)

Validated Wellbeing Instruments

Multidimensional Wellbeing Scales

PERMA-Profiler (Kern et al., 2015)

Structure: 23 items across 6 domains

• Positive Emotion (hedonic wellbeing)
• Engagement (flow, absorption)
• Relationships (social connection)
• Meaning (life purpose)
• Accomplishment (achievement, mastery)
• Negative Emotion (reverse-scored)

Strengths: Brief, validated across cultures, theory-grounded (Seligman's PERMA model) Use for: General wellbeing assessment, product/experience evaluation Psychometrics: α ≈ 0.70-0.85 across domains Administration: 5-10 minutes

Personal Wellbeing Index (PWI-8) (International Wellbeing Group)

Structure: 8 life satisfaction domains

• Standard of living
• Health
• Life achievement
• Personal relationships
• Personal safety
• Community connectedness
• Future security
• Life satisfaction (overall)

Strengths: Short, universal, used in major population studies Use for: Population-level monitoring, longitudinal tracking Psychometrics: α ≈ 0.80-0.85 Administration: 3-5 minutes

Hedonic & Eudaimonic Wellbeing

Scale of Positive and Negative Experience (SPANE) (Diener et al., 2010)

Structure: 12 items in 2 factors

• Positive experiences (positive, negative reversed, good, bad reversed, etc.)
• Negative experiences (negative, worried, sad, etc.)

Strengths: Brief, captures both dimensions, good cross-cultural validity Use for: Affective wellbeing, emotional state tracking Psychometrics: α ≈ 0.81-0.89 Administration: 2-3 minutes

Meaning in Life Scale (MLQ) (Steger et al., 2006)

Structure: 5 items in 2 dimensions

• Presence of meaning
• Search for meaning

Strengths: Concise eudaimonic measure, validated widely Use for: Purpose and meaning assessment Psychometrics: α ≈ 0.73-0.90 Administration: 2 minutes

Flourishing & Flourishing Specific Scales

Psychological Wellbeing Scale (PWB-18) (Ryff, 1989)

Dimensions: 6 core elements (3 items each)

• Autonomy
• Competence (mastery)
• Personal growth
• Purpose in life
• Positive relationships
• Self-acceptance

Strengths: Theoretically grounded in human potential, eudaimonic focus Use for: Comprehensive psychological wellbeing assessment Psychometrics: α ≈ 0.83-0.87 Administration: 10-15 minutes

Flourishing Scale (FS) (Diener et al., 2009)

Structure: 8 items across psychological flourishing

• Purpose, engagement, relationships, competence, optimism, self-respect

Strengths: Brief, robust factor structure, used widely in research Use for: General flourishing assessment Psychometrics: α ≈ 0.87-0.90 Administration: 3 minutes

Domain-Specific Measures

Satisfaction With Life Scale (SWLS) (Diener et al., 1985)

Structure: 5 items measuring global life satisfaction Strengths: Gold standard for life satisfaction, extensive validation Psychometrics: α ≈ 0.79-0.89 Administration: 2 minutes

UCLA Loneliness Scale (ULS-8) (Hughes et al., 2004)

Structure: 8 items measuring perceived social isolation Strengths: Short form, validated, predictive of health outcomes Psychometrics: α ≈ 0.82 Administration: 2 minutes

Rosenberg Self-Esteem Scale (RSE) (Rosenberg, 1965)

Structure: 10 items measuring global self-worth Strengths: Most widely used self-esteem measure, culturally adapted Psychometrics: α ≈ 0.77-0.88 Administration: 3 minutes

Experience Sampling & Real-time Measures

Experience Sampling Method (ESM) / Ecological Momentary Assessment (EMA)

Structure: Brief surveys delivered via app in real context

• Current activity and location
• Social context
• Emotional state (affect grid or PANAS)
• Engagement and stress levels

Strengths: Captures real-time experience, reduces recall bias Use for: Product experience evaluation, diary-style wellbeing tracking Consideration: Higher participant burden, data analysis complexity

Measurement Design Best Practices

Scale Selection Criteria

• Validity: Evidence of measuring intended construct
• Reliability: Adequate internal consistency and stability
• Responsiveness: Sensitive to meaningful changes
• Brevity: Minimizes participant burden
• Cross-cultural: Available translations and validation
• Theory-alignment: Matches your wellbeing framework
• Licensing: Open access or affordable permissions

Administration Considerations

Frequency:

• Baseline: Before intervention/new design
• Post-test: Immediately after experience (1-7 days)
• Follow-up: Long-term effects (weeks to months)

Response Mode:

• Online/mobile preferred for research-through-design
• Paper for in-person contexts
• Experience sampling for real-time tracking

Anchoring Scales:

• Consistent 1-10 or 1-7 Likert scales
• Clear labeling ("Strongly Disagree" to "Strongly Agree")
• Avoid neutral mid-point for forced choice contexts

Data Quality Assurance

• Attention checks: Reverse-coded or logic questions
• Completion rates: Monitor for incomplete responses
• Response time: Identify rushed or suspicious patterns
• Missing data: Document and handle appropriately

Analysis & Interpretation

Descriptive Statistics

• Mean, median, standard deviation by subscale
• Floor/ceiling effects (>15% responses at extremes)
• Skewness and kurtosis

Inferential Analysis

• t-tests/ANOVA: Compare groups (e.g., treatment vs. control)
• Paired tests: Pre-post comparisons
• Correlation: Relationships between wellbeing dimensions
• Regression: Predictive relationships

Effect Sizes

• Cohen's d: 0.2 (small), 0.5 (medium), 0.8 (large)
• ηp²: 0.01 (small), 0.06 (medium), 0.14 (large)
• Report alongside p-values for practical significance

Qualitative Integration

• Triangulate quantitative findings with interview data
• Use scores to guide depth interviews with high/low scorers
• Contextualize numerical changes with lived experience

Quick Reference: Instrument Selection Matrix

Common Pitfalls to Avoid

• Cherry-picking scales: Choose based on theory, not convenience
• Ignoring psychometrics: Always verify reliability/validity for your population
• Over-interpretation: Acknowledge measurement error and confidence intervals
• Single measure: Combine multiple instruments for comprehensive picture
• Ignoring context: Same score means differently in different populations
• Neglecting qualitative data: Numbers without stories miss crucial nuance

Resources

• Open Science Framework (OSF): Repository of validated instruments and protocols
• PubMed/Google Scholar: Search for validation studies in your population
• COSMIN: Guidelines for selecting Patient-Reported Outcome Measures
• International Wellbeing Group: PWI and related resources