Practice Oriented Research
Clinical Implications and Benefits
The practice of psychotherapy is not an easy task. Many psychotherapists are balancing multiple responsibilities and roles at any given moment. As clinicians, they have to conduct assessments, develop case conceptualizations and treatment plans, relate to their patients therapeutically, and deliver interventions effectively. As mental health providers, they have to find time to manage responsibilities such as paperwork and documentation, communication and coordination of care, and insurance issues. When dealing with these competing demands, therapists generally resort to knowledge and expertise derived from their own training, clinical experience, colleagues, and supervisors—and, much less so, to research. There is a well-recognized divide between research and clinical practice, and many psychotherapists do not rely substantially on empirical results in their clinical practice (Castonguay, Youn, Xiao, Muran, & Barber, 2015). For many clinicians, these findings are viewed as not applicable to the everyday clinical reality (Castonguay, Locke, & Hayes, 2011).
One way to address the gap between science and practice is through practice-oriented research (POR), a bottom-up approach that encourages a sense of joint ownership, mutual collaboration, and respect between researchers and clinicians when conducting psychotherapy research, so that it is clinically informative and scientifically rigorous (Castonguay, Barkham, Lutz, & McAleavey, 2013). In POR, practitioners, in collaboration with researchers, can be actively involved in all aspects of research, including the design and implementation of research protocols, collection of data, analysis, and dissemination of results. By emerging from, and taking place in, the setting in which therapists practice their clinical work, POR is a way to “confound” research and practice (Castonguay, 2011) by involving specific tasks that simultaneously meet both research and clinical purposes. At a broader level, because it is based on complementary expertise, POR allows for innovative methods of conducting psychotherapy research that embed and enhance the vision of both researchers and clinicians.
A variety of POR studies have already been conducted in different naturalistic settings across the world and have addressed several topics, such as the effectiveness of psychotherapy, client and therapist characteristics, utilization of services, process studies, including the therapeutic alliance and principles of change, as well as supervision and training initiatives (Castonguay et al., 2015). The patient-focused approach has been a particular focus of naturalistic research. It involves the careful assessment and tracking of patients’ progress over the course of treatment, using standardized outcome measures, and providing clinically relevant feedback to therapists that can be useful to their practice (Boswell, Kraus, Miller, & Lambert, 2015). This type of research aims to provide clinicians with tools that can be used to augment clinical decision making with results that are directly applicable to day-to-day practice.
How Can Outcome Monitoring Inform Clinical Practice?
Drapeau (2012) has identified 10 different measures/systems developed to track mental health change in routine care, each with its own strengths and limitations. Regardless of the system used, the most common use of outcome monitoring has been to track symptomatology change. By administering an outcome measure pre- and post-treatment, clinicians can have access to data from the client to supplement their clinical judgment as to when to conclude treatment. Outcome monitoring can also provide more frequent information regarding the patient’s progress when administered at shorter intervals, such as after each session. Not only can this information be helpful for therapists in terms of treatment planning and implementation, it can also serve as a powerful tool for patients to have information regarding their own improvement—which can further improve the therapeutic alliance, as well as their adherence to and belief in treatment (Youn, Kraus, & Castonguay, 2012).
Regularly monitoring outcomes can also aid therapists in detecting when patients are “off-track” in their treatment. For example, if clinicians are alerted to the fact that a patient’s progress is slower than expected when compared to other patients who shared similar demographics and initial severity status, they can use this information to inform treatment, discuss it with the patient, and/or seek supervision. Additionally, some feedback systems have also shown to accurately predict potential treatment failure, risk of hospitalization, or other negative outcomes, such as drop-out (Boswell, et al., 2015; Xiao et al., 2013). It is difficult for psychotherapists to predict who will deteriorate or be at risk for experiencing negative outcomes during treatment (Lambert, 2010). Therefore, clinical tools that can aid judgment and decision making surrounding this type of care for patients can help to intervene effectively, while reducing the probability of premature termination or harm during treatment.
In addition to tracking symptomatology change, the inclusion of standardized outcome measures in routine care can serve a diverse range of clinical functions. For example, for various reasons, such as embarrassment, ambivalence about areas of distress, or unawareness, patients may be reluctant to verbally discuss or bring up difficulties with psychotherapists during session. In these situations, outcome measures can provide alternative communication outlets through which patients express distress to their providers (Youn, Kraus, & Castonguay, 2012; Youn et al., 2015). Additionally, ongoing assessments can provide clients feedback about their progress, which can also be discussed with providers in relation to treatment goals and various clinical interventions, such as development of new perspective of self. For example, seeing improvements in outcome scores, or areas of strength if using a multidimensional outcome measure, can help clients increase their sense of agency in their development, as well as highlight positive attributes (Youn et al., 2015).
Challenges Conducting Practice Oriented Research
As is the case with the implementation of any kind of research, a number of obstacles and challenges have been identified when trying to build clinician-researcher partnerships, as well as conducting POR (Castonguay et al., 2013). One of the biggest challenges is encountered when POR is perceived as irrelevant, or even hindering the clinical work. For example, from the practitioners’ perspective, if outcome monitoring is viewed as impeding the therapeutic relationship, increasing client resistance, or resulting in negative evaluation of services (and potentially decreasing referrals or income), then the likelihood that the research is actually conducted in clinical practice decreases substantially (Boswell et al., 2015; Fernández-Álvarez, Gómez, & García, 2015; Holmqvist, Philips, & Barkham, 2015; Strauss et al., 2015). Additionally, as is the case with any partnership, problems of collaboration and communication can impact the sense of shared ownership that is the backbone of all POR (Castonguay et al., 2015). Last but not least, there are pragmatic obstacles, such as availability of time, staff, and resources to implement the research procedures, especially if there are incompatibilities between research and clinical tasks.
Benefits of Conducting POR
Despite some of the challenges in conducting research in private practice, clinicians have reported benefits in conducting POR. For example, some therapists have found it professionally validating to investigate phenomena that occur in their day-to-day routine (Koerner & Castonguay, 2015). Clients have reported experiencing a feeling of pride in their contribution to projects that increase our understanding of psychotherapy (Castonguay, Nelson et al., 2010). The implementation of different research protocols can also lead to immediately useful clinical information. For example, clients’ feedback about helpful and hindering events in session has allowed clinicians to be more attuned to their clinical needs while also collecting research data (Castonguay, Boswell et al., 2010). Training studies provide therapists with tools to implement evidence based treatment procedures (Koerner & Castonguay, 2015). Additionally, if desired, clinicians can use their own outcome data for quality control, as well as for making referral decisions, and even to advocate for increased reimbursement for their services (Adelman, Castonguay, Kraus, & Zack, 2015). Across varied naturalistic settings, POR can not only be clinically informative, but can also seamlessly integrate and potentially bridge the gap between research and practice.
Cite This Article
Youn, S. J., Xiao, H., & Castonguay, L. G. (2016). Practice oriented research: Clinical implications and benefits. Psychotherapy Bulletin, 51(1), 24-26.
Adelman, R. W., Castonguay, L. G., Kraus, D. R., & Zack, S. E. (2015). Conducting research and collaborating with researchers: The experience of clinicians in a residential treatment center. Psychotherapy Research, 25(1), 108-120. doi: 10.1080/10503307.2014.935520
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6–19. doi:10.1080/10503307.2013.817696
Castonguay, L. G. (2011). Psychotherapy, psychopathology, research and practice: Pathways of connections and integration. Psychotherapy Research, 21(2), 125-140. doi: 10.1080/10503307.2011.563250
Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and application. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). New York, NY: John Wiley & Sons.
Castonguay, L. G., Boswell, J. F., Zack, S. E., Baker, S., Boutselis, M. A., Chiswick, N. R.,… Holtforth, M. G. (2010). Helpful and hindering events in psychotherapy: A practice research network study. Psychotherapy, 47(3), 327–344. doi: 10.1037/a0021164
Castonguay, L., Nelson, D., Boutselis, M., Chiswick, N., Damer, D., Hemmelstein, N., … Borkovec, T. (2010). Clinicians and/or researchers? A qualitative analysis of therapists’ experiences in a practice research network. Psychotherapy: Theory, Research, Practice, and Training, 47, 345–354.
Castonguay, L. G., Locke, B. D., & Hayes, J. A. (2011). The Center for Collegiate Mental Health: An example of a practice-research network in university counseling centers. Journal of College Student Psychotherapy, 25(2), 105–119. doi: 10.1080/87568225.2011.556929
Castonguay, L. G., Youn, S., Xiao, H., Muran, J. C., & Barber, J. P. (2015). Building clinicians-researchers partnerships: Lessons from diverse natural settings and practice-oriented initiatives. Psychotherapy Research, 25(1), 166–184. doi:10.1080/10503307.2014.973923
Drapeau, M. (2012). The value of tracking in psychotherapy. Integrating Science & Practice, 2, 2-6.
Fernández-Álvarez, H., Gómez, B., & García, F. (2015). Bridging the gap between research and practice in a clinical and training network: Aigle’s program. Psychotherapy Research, 25(1), 84-94. doi: 10.1080/10503307.2013.856047
Holmqvist, R., Philips, B., & Barkham, M. (2015). Developing practice-based evidence: Benefits, challenges, and tensions. Psychotherapy Research, 25(1), 20-31. doi: 10.1080/10503307.2013.861093
Koerner, K., & Castonguay, L. G. (2015). Practice-oriented research: What it takes to do collaborative research in private practice. Psychotherapy Research, 25(1), 67–83. doi:10.1080/10503307.2014.939119
Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. Washington, D. C.: American Psychological Association Press. doi: 10.1037/12141-000
Strauss, B. M., Lutz, W., Steffanowski, A., Wittmann, W. W., Böhnke, J. R., Rubel, J.,…Kirchmann, H. (2015). Benefits and challenges in practice-oriented psychotherapy research in Germany: The TK and the QS-PSY-BAY projects of quality assurance in outpatient psychotherapy. Psychotherapy Research, 25(1), 32-51. doi: 10.1080/10503307.2013.856046
Xiao, H., McAleavey, A. A., Youn, S., Castonguay, L. G., Hayes, J. A., & Locke, B. D. (2013, October). Predictor of premature termination: Modeling data to reduce drop outs. Paper presented as part of panel at the 2013 North American Society for Psychotherapy Research (NASPR), Memphis, TN.
Youn, S., Kraus, D. R., & Castonguay, L. G. (2012). The Treatment Outcome Package: Facilitating practice and clinically relevant research. Psychotherapy, 49(2), 115–122. doi: 10.1037/a0027932
Youn, S., Castonguay, L. G., Xiao, H., Janis, R., McAleavey, A. A, Lockard, A. J., … Hayes, J. A. (2015). The Counseling Center Assessment of Psychological Symptoms (CCAPS): Merging clinical practice, training, and research. Psychotherapy, 52(4), 432–441. doi: 10.1037/pst0000029