Randomized control trial FAQs
COOP is providing this information to ensure our recruiting and employer partners, as well as our alumni community, have a basic understanding of what a randomized control trial is and why it is important to COOP’s future.
-
An RCT, or Randomized Controlled Trial, is a type of scientific study used to rigorously evaluate the effectiveness of an intervention or program. An RCT uses a lottery-like process to compare the outcomes of individuals who participate in an intervention or program compared to those who do not.
-
The goal of the study is to learn how the fellowship program helps underemployed first-gen and low-income college graduates find better jobs and earn more, compared to individuals who did not participate in the fellowship. Ultimately, COOP’s goal is to learn about and enhance the effectiveness of the fellowship program, so any results —positive or negative — will be valuable for future program design.
-
An RCT or randomized controlled trial, is considered the gold standard in program evaluation, and the method is widely used to help establish solid evidence of how programs work and for whom. The lottery-like process used in an RCT allows for a comparison of the outcomes between those individuals assigned to the COOP group and those assigned to the control group. This type of study can help improve the fellowship and potentially lead to its expansion, benefiting more people in the future. We are investing in study of this caliber because we take learning seriously and are committed to ensuring our fellowship achieves the impact we aspire to.
-
The study is being conducted by MDRC, a nonprofit research organization with over 50 years of experience conducting research studies. To learn more about MDRC, visit their website at: www.mdrc.org.
-
Recruiting for the study will officially kick off in mid-March 2025 for the fall 2025 fellowship cycle.
-
Participating in the study is voluntary. However, prospective fellows will need to agree to participate in the study to be considered for the COOP Careers Fellowship. If they agree to participate in the study and COOP accepts their application, they will be assigned via the lottery to either the COOP group (those who can take part in the fellowship) or the control group (those who cannot take part in the fellowship). Members of both the COOP group and control group may be contacted to participate in follow-up surveys, interviews, or focus groups, for which they will receive gift card “thank yous” for their time and input.
-
Members of the control group will not be able to participate in the COOP Careers Fellowship for two years from their study enrollment date. They will receive information on other services and resources available in their community. Members of both the COOP group and control group may be contacted to participate in follow-up surveys, interviews, or focus groups, for which they will receive gift card “thank yous” for their time and input.
-
Assignment to the COOP group or control group is done through a random lottery-like process. After an applicant completes the study registration and is accepted by COOP, they are randomly assigned to one of the two study groups.
-
All prospective COOP study participants will go through a consent process before enrolling in the study and before any research activity. The informed consent process ensures that research participants have all the information about a study, including its purpose, procedures, risks, benefits, and confidentiality measures, so they can make a voluntary and informed decision about participation. Participants are also assured of their right to withdraw at any time.
-
MDRC follows strict rules to protect participants' information:
Data is only used for research purposes
Secure computers and data storage systems are used
Names or identifying information is never used when reporting study conclusions
Information may be shared with other researchers, but without identifying details
Any data shared between COOP and MDRC will be shared using secure transfer protocols
-
If an applicant does not consent to participate in the study, they will not be able to move forward with their application for the COOP Careers Fellowship while the study is underway. Participation in the study is a requirement for fellowship consideration during this period.
-
Formal study results will be summarized in a report in early 2029. MDRC will provide COOP with feedback throughout the study period before the final report is produced.
-
If the study results aren't conclusive or compelling, we will use this information as part of our continued commitment to refine and strengthen the fellowship. Ultimately, COOP’s goal is to learn about and enhance the effectiveness of the program, so any results —positive or negative — will be valuable for future program design.
-
This RCT study is a more rigorous and comprehensive evaluation than COOP's usual data collection efforts. It will provide more definitive evidence of the fellowship's impact. COOP is also implementing a comprehensive data and evaluation strategy to lay the foundation for a strong study and COOP’s ability to collect and share the data we need with the researchers. It is also laying the foundation for COOP to be more data-driven in its work in the future.
For any partner or staff questions about the study that you cannot find in this FAQ document, reach out to Jess Britt, Evaluation Strategy & RCT consultant at jbritt@coopcareers.org or Managing Director of Recruiting, Stephanie Cafaro at stephanie@coopcareers.org.
For prospective fellows:
For detailed questions about the study process or participant rights, direct them to contact the COOP Careers study team at (877) 376-9419 or coopstudy@mdrc.org.
For questions about the COOP application process, direct them to the Recruiting team or recruiting@coopcareers.org.