Fidelity Assessment of the Treatnet family (TF): A family-based intervention for adolescents with substance use disorders and their families

Busse A., Kashino W., Suhartono S., Narotama N., Campello G., Irwanto, Pelupessy D., Piercy F.P., Essau C.A.

Prevention, Treatment and Rehabilitation Section, Drug Prevention and Health Branch, United Nations Office on Drugs and Crime, Vienna, Austria; Atma Jaya Indonesian Catholic University, Jakarta, Indonesia; Faculty of Psychology, Universitas Indonesia, Jakarta, Indonesia; Virginia Polytechnic Institute and State University, United States; Department of Psychology, Roehampton University, London, United Kingdom; United Nations Office on Drugs and Crime, Programme Office Indonesia, Jakarta, Indonesia


Introduction: In transporting family-based interventions to community settings, establishing and maintaining fidelity to intervention is important. This exploratory study was implemented in the framework of a United Nations Office on Drugs and Crime (UNODC) global programme on Drug Dependence Treatment and Care. It is the first to examine an evidence-informed family-based intervention (“Treatnet Family”; TF) adherence for the treatment of adolescents with substance use disorders (SUD) among practitioners in community settings in Jakarta, Indonesia. Method: Twenty-three practitioners at five community-based counselling centres were trained in Treatnet Family and delivered it to 19 adolescents with SUD and their family members over a 6-week period. One of the five local Treatnet Family-trained supervisors randomly selected one session of the family-based intervention (TF) and observed the extent to which the practitioner’s adhered to the TF manual. Results: According to the supervisors’ observation, all the practitioners used the Treatnet Family core skills such as positive reframing, positive relational reframing, perspective taking, relational questions, and going with resistance. There was a high level of agreement between practitioners’ and supervisors’ rating on the practitioners’ use of specific therapeutic skills as measured using the Inventory of Therapy Techniques (ITT). Conclusion: Results suggest that Treatnet Family can be delivered with adherence by practitioners in community-based settings. © 2021 The Authors

Adolescents; Community settings; Family-based intervention; Substance use; Treatnet Family


Addictive Behaviors Reports

Publisher: Elsevier Ltd

Volume 14, Issue , Art No 100363, Page – , Page Count

Journal Link:

doi: 10.1016/j.abrep.2021.100363

Issn: 23528532

Type: All Open Access, Gold, Green


Barber, J.P., Gallop, R., Crits-Christoph, P., Frank, A., Thase, M., Weiss, R.D., The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the National Institute on Drug Abuse Collaborative Cocaine Treatment Study (2006) Psychotherapy Research, 16, pp. 229-240; Baer, J.S., Ball, S.A., Campbell, B.K., Miele, G.M., Schoener, E.P., Tracy, K., Training and fidelity monitoring of behavioral interventions in multi-site addictions research (2007) Drug and Alcohol Dependence, 87 (2-3), pp. 107-118; Breitenstein, S.M., Gross, D., Garvey, C.A., Hill, C., Fogg, L., Resnick, B., Implementation fidelity in community-based interventions (2010) Research in nursing & health, 33 (2), pp. 164-173; Bishop, D.C., Pankratz, M.M., Hansen, W.B., Albritton, J., Albritton, L., Strack, J., Measuring fidelity and adaptation: Reliability of an instrument for school-based prevention programs (2013) Evaluation & the Health Professions, 37 (2), pp. 1-27; Borrelli, B., The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials (2011) Journal of Public Health Dentistry, 71, pp. S52-S63; Collyer, H., Eisler, I., Woolgar, M., Systematic literature review and meta-analysis of the relationship between adherence, competence and outcome in psychotherapy for children and adolescents (2020) Eur Child Adolesc Psychiatry, 29 (4), pp. 417-431; Dane, A.V., Schneider, B.H., Program integrity in primary and early secondary prevention: Are implementation effects out of control? (1998) Clinical Psychology Review, 18 (1), pp. 23-45; Dimitropoulos, G., Lock, J.D., Agras, W.S., Brandt, H., Halmi, K.A., Jo, B., Therapist adherence to family-based treatment for adolescents with anorexia nervosa: A multi-site exploratory study (2020) European Eating Disorders Review, 28 (1), pp. 55-65; Dusenbury, L., Brannigan, R., Falco, M., A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings (2003) Health Education Research, 18, pp. 237-256; Ehrenreich-May, J., Southam-Gerow, M.A., Hourigan, S.E., Wright, L.R., Pincus, D.B., Weisz, J.R., Characteristics of anxious and depressed youth seen in two different clinical contexts (2011) Administration and Policy in Mental Health and Mental Health Services Research, 38 (5), pp. 398-411; Essau, C.A., Delfabbro, P., (2020) Adolescent addiction: Epidemiology, assessment, and treatment –, , second edition Elsevier Inc. New York; Feehan, M., McGee, R., Raja, S.N., Williams, S.M., DSM-III-R disorders in New Zealand 18-year-olds (1994) Australian and New Zealand Journal of Psychiatry, 28 (1), pp. 87-99; Fergusson, D.M., Horwood, L.J., Lynskey, M.T., Prevalence and comorbidity of DSM-III-R diagnoses in a birth cohort of 15-year olds (1993) Journal of the American Academy of Child and Adolescent Psychiatry, 32 (6), pp. 1127-1134; Hailemariam, M., Bustos, T., Montgomery, B., Barajas, R., Evans, L.B., Drahota, A., Evidence-based intervention sustainability strategies: A systematic review (2019) Implementation Sci, 14 (1); Henggeler, S.W., Melton, G.B., Brondino, M.J., Scherer, D.G., Hanley, J.H., Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination (1997) Journal of Consulting and Clinical Psychology, 65 (5), pp. 821-833; Hill, L.G., Maucione, K., K. Hood, B., A focused approach to assessing program fidelity (2007) Prevention sciences, 8 (1), pp. 25-34; Hogue, A., Dauber, S., Assessing fidelity to evidence-based practices in usual care: The example of family therapy for adolescent behavior problems (2013) Evaluation and Program Planning, 37, pp. 21-30; Hogue, A., Dauber, S., Samuolis, J., Liddle, H., Treatment techniques and outcomes in multidimensional family therapy for adolescent behavior problems (2006) Journal of Family Psychology, 20, pp. 535-543. , [PubMed: 17176187]; Hogue, A., Henderson, C.E., Dauber, S., Barajas, P.C., Fried, A., Liddle, H.A., Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems (2008) Journal of Consulting and Clinical Psychology, 76, pp. 544-555. , [PubMed: 18665684]; Hogue, A., Bobek, M., Dauber, S., Henderson, C.E., McLeod, B.D., Southam-Gerow, M.A., Core elements of family therapy for adolescent behavior problems: Empirical distillation of three manualized treatments (2019) Journal of Clinical Child and Adolescent Psychology, 48 (1), pp. 29-41; Lindstrøm, M., Saidj, M., Kowalski, K., Filges, T., Rasmussen, P.S., Jørgensen, A.K., Family Behavior Therapy (FBT) for young people in treatment for nonopioid drug use (2015) Campbell Systematic Reviews, 2015, p. 9; Lewinsohn, P.M., Hops, H., Roberts, R.E., Seeley, J.R., Andrews, J.A., Adolescent psychopathology: I. Prevalence and incidence of depression and other DSM-III-R disorders in high school students (1993) Journal of Abnormal Psychology, 102 (1), pp. 133-144; McHugh, R.K., Barlow, D.H., The dissemination and implementation of evidence-based psychological treatments. A review of current efforts (2010) The American Psychologist, 65 (2), pp. 73-84; Merikangas, K., Jian-ping, H., Burstein, M., Swanson, S., Avenevoli, S., Lihong, C., Lifetime Prevalence of Mental Disorders in US Adolescents: Results from the National Comorbidity Study-Adolescent Supplement (2011) Journal of the American Academy Children Adolescent Psychiatry, 49 (10), pp. 980-989; (2017),, National Academies of Sciences, Engineering, and Medicine. Implementing Evidence-Based Prevention by Communities to Promote Cognitive, Affective, and Behavioral Health in Children: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi:; Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda (2011) Administration and Policy in Mental Health and Mental Health Services Research, 38 (2), pp. 65-76; Rigter, H., Henderson, C.E., Pelc, I., Tossmann, P., Phan, O., Hendriks, V., Multidimensional family therapy lowers the rate of cannabis dependence in adolescents: A randomised controlled trial in Western European outpatient settings (2013) Drug and Alcohol Dependence, 130 (1-3), pp. 85-93; Schoenwald, S.K., Chapman, J.E., Kelleher, K., Hoagwood, K.E., Landsverk, J., Stevens, J., A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs) (2008) Administration and Policy in Mental Health, 35 (1-2), pp. 84-97; Schoenwald, S.K., Garland, A.F., Chapman, J.E., Frazier, S.L., Sheidow, A.J., Southam-Gerow, M.A., Toward the effective and efficient measurement of implementation fidelity (2011) Administration and Policy in Mental Health, 38 (1), pp. 32-43; Southam-Gerow, M.A., McLeod, B.D., Advances in applying treatment integrity research for dissemination and implementation science: Introduction to special issue (2013) Clinical Psychology: Science and Practice, 20 (1), pp. 1-13; Tambling, R.R., Russell, B., (2021),, D’Aniello, C. Where is the Family in Young Adult Substance Use Treatment? The Case for Systemic Family Therapy for Young Adults with Substance Use Disorders. International journal of mental health and addiction, 1–12. Advance online publication; Toomey, E., Matthews, J., Hurley, D.A., Using mixed methods to assess fidelity of delivery and its influencing factors in a complex self-management intervention for people with osteoarthritis and low back pain (2017) BMJ open, 7 (8), p. e015452; Smith, M.M., McLeod, B.D., Southam-Gerow, M.A., Jensen-Doss, A., Kendall, P.C., Weisz, J.R., Does the delivery of CBT for youth anxiety differ across research and practice settings? (2017) Behavior Therapy, 48 (4), pp. 501-516; Schoenwald, S.K., Garland, A.F., A review of treatment adherence measurement methods (2013) Psychological Assessment, 25, pp. 146-156; Swendon, J., Burstein, M., Case, B., Conway, K.P., Dierker, L., Je, J., Use and Abuse of Alcohol and Illicit Drugs in US Adolescents (2012) Archives of General Psychiatry, 69 (4), p. 390; Szapocznik, J., Muir, J.A., Duff, J.H., Schwartz, S.J., Brown, C.H., Brief Strategic Family Therapy: Implementing evidence-based models in community settings (2015) Psychotherapy research: Journal of the Society for Psychotherapy Research, 25 (1), pp. 121-133; United Nations Office on Drugs and Crime (UNODC), The Treatnet Family training package (2019), Austria UNODC Vienna; Waltz, J., Addis, M.E., Koerner, K., Jacobson, N.S., Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence (1993) Journal of Consulting and Clinical Psychology, 61 (4), pp. 620-630; Weisz, J.R., Weiss, B., Donenberg, G.R., The lab versus the clinic: Effects of child and adolescent psychotherapy (1992) American Psychologist, 47 (12), pp. 1578-1585; Weisz, J.R., Weiss, B., Han, S.S., Granger, D.A., Morton, T., Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies (1995) Psychological Bulletin, 117 (3), pp. 450-468

Indexed by Scopus

Leave a Comment