Project Activities
In this project, the researchers will use a user-centered design to iteratively develop CLS-D; test its usability, feasibility, and acceptability for school mental health providers (SMHPs), teachers, parents, and students; use a pilot randomized trial to evaluate the feasibility of implementation and potential impact of CLS-D on student outcomes; and determine cost effectiveness.
Structured Abstract
Setting
The research will take place in urban elementary schools in California that receive Title 1 funds to support students who qualify for free or reduced lunch.
Sample
Participants will be SMHPs (one per school) who work half or full time in a school with limited resources that serve students from predominantly low-SES backgrounds, students in grades 2-5 who have ADHD-related impairments (referred to as with or at risk for ADHD), and their parents. In the discovery and design phase, 8 SMHPs, 12 teachers, 12 students, and 12 parents will participate. In the test and refine phase, 4 SMHPs, 24 students, and their parents and teachers, will participate. In the evaluation phase, 12 SMHPs and 72 students and their parents and teachers will participate.
The CLS-D intervention, which will be designed to maximize usability, feasibility, and acceptability in schools with limited resources, will include CLS's three evidence-based behavioral treatments for ADHD: behavioral parent training, daily report card with teacher consultation, and child skills training. CLS-D's dHealth tool will consist of a web-based portal with user interfaces for SMHPs, teachers, parents, and students that will be designed to mitigate traditional barriers to accessing services among students with ADHD from low-SES backgrounds. CLS-D will be implemented over a 10-week period and be compatible with various operating systems and devices, including smart phones, tablets, and computers.
Research design and methods
During the discovery and design phase, researchers will conduct focus groups with panels of SMHPs, teachers, and students with or at risk for ADHD from low-SES backgrounds and their parents to inform CLS adaptations and dHealth tool development. Researchers and consultants will design an initial prototype of the dHealth tool and adapt CLS-D training, fidelity monitoring, and cost evaluation protocols. During the test and refine phase, researchers will refine the prototype through iterative usability testing with stakeholder panels. Researchers will conduct open trials with SMHPs, students with or at risk for ADHD, and their parents and teachers to test the usability, feasibility, and acceptability of CLS-D, training, fidelity monitoring, and cost evaluation tools. Researchers will also conduct focus groups with participants following the open trials and make final refinements to CLS-D protocols. During the evaluation phase, researchers will use a pilot randomized trial, assigning SMHPs/schools to the CLS-D or control condition, to evaluate the feasibility and promise of CLS-D and the associated costs. The pilot will include two staggered cohorts (fall, spring) in which researchers match pairs of schools based on the proportion of students eligible for free or reduced lunch, the number of students, and racial/ethnic composition. In fall of the school year after the pilot randomized trial, researchers will collect follow-up data on student outcomes.
Control condition
Students in the control condition will receive the usual services their schools provide to students with or at risk for ADHD in grades 2–5.
Key measures
Key measures during the discovery and design phase will include a psychometrically validated System Usability Scale (SUS) that SMHPs, teachers, and parents will complete, and a researcher-designed satisfaction scale for SMHPs. During the test and refine phase, key measures will include the SUS, CLS-D usage analytics, and researcher-designed pre/post acceptability and feasibility scales that parents, students, teachers, and SMHPs will complete. During the evaluation and follow-up phase, key measures will include the SUS, acceptability, and feasibility scales; a researcher-developed SMHP fidelity checklist; student-level school records of grades, discipline, and services received; and standardized achievement test scores.
Data analytic strategy
For the discovery and design phase, researchers will conduct rapid qualitative content analyses of focus group data using the Rigorous and Accelerated Data Reduction (RADaR) technique and analyze quantitative ratings from the focus groups using descriptive statistics. In the test and refine phase, researchers will use the RADaR technique to analyze qualitative data; use descriptive statistics to analyze process measures, cost measures, and usage analytics; and calculate within-subjects mean differences and Cohen's d effect sizes for pre- and post-assessment data. For the evaluation phase and follow up, researchers will conduct an intent-to-treat analysis using hierarchical linear modeling to examine between-group differences in student outcomes.
Cost analysis strategy
Researchers will conduct a cost analysis based on a societal perspective using the ingredients approach. They will include information from the cost evaluation tools they will develop during the project, and they will calculate total costs, average cost per student served, the range of costs per student served, and marginal costs per student added once CLS-D is established.
People and institutions involved
IES program contact(s)
Project contributors
Products and publications
Products: This project will produce an adaptation of CLS with a fully functional dHealth tool (CLS-D) for maximum feasibility in schools that have limited resources. Products will also include presentations, peer-reviewed publications, and additional dissemination products that reach education stakeholders, such as practitioners and policymakers.
ERIC Citations: Find available citations in ERIC for this award here.
Related projects
Questions about this project?
To answer additional questions about this project or provide feedback, please contact the program officer.
