Rarity-Weighted Change Score: An Integrative, Distribution-Aware Measure of Pre-Post Outcomes in Psychotherapy Research.

In psychotherapy outcome research, the gold standard to measure the effectiveness of any psychotherapy is to determine the extent of change or difference in the outcome variable at post-intervention compared to pre-intervention assessment. Depending on the type of distribution, analysis of the change score is generally carried out using paired t tests and/or repeated measures ANOVA for within-group analysis. If there is more than one group, such as intervention and control groups, then usually a two-way repeated-measures ANOVA or mixed-effects model is used. These standard analysis procedures are followed with the assumption that all change scores are equivalent in terms of difficulty and magnitude. However, a simple change score does not characterize the complexity involved in the outcome of an intervention. A few methods - such as the Reliable Change Index, calculating proportional change, and calculating percentile norms - capture some of the complexities involved but do not include most of them, such as accounting for baseline difficulty, distribution of pre-post scores, and how common or rare a given improvement is. This methodological gap in evaluating psychotherapy outcome research necessitated the development of the Rarity-Weighted Change Score (RWCS) approach. This integrative approach incorporates percentile-based rarity of change, baseline difficulty, and outcome extremity adjustment into a single composite score. This approach yields comprehensive, standardized, distribution-aware scores that are suitable for both simple descriptive and complex inferential statistical analysis. This approach is intuitive, easier to calculate, and adds value to the psychotherapy outcome research.