Development and psychometric validation of a novel patient survey to assess perceived quality of substance abuse treatment in South Africa.

Subst Abuse Treat Prev Policy 2015 Nov 6;10:44. Epub 2015 Nov 6.

Alcohol, Tobacco and Other Drug Research Unit, South African Medical Research Council, Cape Town, South Africa.

Background: A hybrid performance measurement system that combines patient-reported outcome data with administrative data has been developed for South African substance abuse treatment services. This paper describes the development and psychometric validation of one component of this system, the South African Addiction Treatment Services Assessment (SAATSA).

Methods: First, a national steering committee identified five domains and corresponding indicators on which treatment quality should be assessed. A decision was made to develop a patient survey to assess several of these indicators. A stakeholder work group sourced survey items and generated additional items where appropriate. The feasibility and face validity of these items were examined during cognitive response testing with 16 patients. This led to the elimination of several items. Next, we conducted an initial psychometric validation of the SAATSA with 364 patients from residential and outpatient services. Exploratory (EFA) and confirmatory factor analyses (CFA) were conducted to assess the latent structure of the SAATSA. Findings highlighted areas where the SAATSA required revision. Following revision, we conducted another psychometric validation with an additional sample of 285 patients. We used EFA and CFA to assess construct validity and we assessed reliability using Cronbach's measure of internal consistency.

Results: The final version of the SAATSA comprised 31 items (rated on a four-point response scale) that correspond to six scales. Four of these scales are patient-reported outcome measures (substance use, quality of life, social connectedness and HIV risk outcomes) that together assess the perceived effectiveness of treatment. The remaining two scales assess patients' perceptions of access to and quality of care. The models for the final revised scales had good fit and the internal reliability of these scales was good to excellent, with Cronbach's α ranging from 0.72 to 0.89.

Conclusion: A lack of adequate measurement tools hampers efforts to improve the quality of substance abuse treatment. Our preliminary evidence suggests that the SAATSA, a novel patient survey that assesses patients' perceptions of the outcomes and quality of substance abuse treatment, is a psychometrically robust tool that can help fill this void.

Download full-text PDF

Source
http://substanceabusepolicy.biomedcentral.com/articles/10.11
Publisher Site
http://dx.doi.org/10.1186/s13011-015-0040-3DOI Listing
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4636825PMC
November 2015
28 Reads

Publication Analysis

Top Keywords

substance abuse
16
abuse treatment
16
psychometric validation
16
patient survey
12
quality substance
12
assess perceived
8
survey assess
8
novel patient
8
patients' perceptions
8
development psychometric
8
scales good
8
treatment services
8
patient-reported outcome
8
south african
8
treatment
7
quality
6
assess
6
saatsa
5
scales
5
substance
5

References

(Supplied by CrossRef)

AA Herman et al.
South Afr Med J 2009

M Cesare Di et al.
Lancet 2013

O Shisana et al.
2014

B Myers et al.
SATPP 2010

B Myers et al.
Afr J Psychiatry 2009

B Myers et al.
BMC Psychiatry 2014

Institute of Medicine et al.
2005

A Quanbeck et al.
J Behav Health Ser R 2012

F McCorry et al.
Jt Comm J Qual Improv 2000

Similar Publications