This paper complements existing power analysis tools by offering tools to compute minimum detecta... more This paper complements existing power analysis tools by offering tools to compute minimum detectable effect sizes (MDES) for existing studies and to estimate minimum required sample sizes (MRSS) for studies under design. The tools that accompany this paper support estimates of MDES or MSSR for 21 different study designs that include 14 random assignment designs (6 designs in which individuals are randomly assigned to treatment or control condition and 8 in which clusters of individuals are randomly assigned to condition, with models differing depending on whether the sample was blocked prior to random assignment and by whether the analytic models assume constant, fixed, or random effects across blocks or assignment clusters); and 7 quasi-experimental designs (an interrupted time series design and 6 regression discontinuity designs that vary depending on whether the sample was blocked prior to randomization, whether individuals or clusters of individuals are assigned to treatment or ...
Institute for Research on Poverty, major aspects of the evaluation of the national demonstration ... more Institute for Research on Poverty, major aspects of the evaluation of the national demonstration of Supported Work. Funding for this national demon-stration comes from a number of federal agencies, but is channeled through the Employment and Training Administration, U.S. Department of Labor, as the lead federal agency, under Grant No. 33-36-76-01 and Contract Nos. 30-36-75-01 and 30-34-75-02. Researchers ~ndertaking such projects under government sponsorship are encouraged to express their professional judgements freely. Therefore, points of view or opinions stated in this document do not neces--sari1y represent_the official position or policy of the federal government or tne sponsors of the demonstration.------------~~._-----------_._._-The national Supported Work demonstration is a transitional public employment program for those with severe labor market disadvantages--lang-term AFDC recipients, ex-addicts, ex-offenders, and young school dropouts. In this paper we discuss the prog...
The practice of prospectively registering the details of intervention studies in a public databas... more The practice of prospectively registering the details of intervention studies in a public database or registry is gaining momentum across disciplines as a strategy for increasing the transparency, credibility, and accessibility of study findings. In this article, we consider five registries that may be relevant for registration of intervention studies in the field of prevention science: ClinicalTrials.gov, the American Economic Association Registry of Randomized Controlled Trials (AEA RCT Registry), the Open Science Framework Preregistration (OSF Preregistration), the Registry for International Development Impact Evaluations (RIDIE), and the Registry of Efficacy and Effectiveness Studies (REES). We examine the five registries in terms of substantive focus, study designs, and contents of registry entries. We consider two paths forward for prospective registration of intervention studies in the field of prevention science: Path A: register all studies in ClinicalTrials.gov and Path B: allow individual researchers to select the registry with the “best fit.” Lastly, we consider how the field might begin to establish norms around registration.
The following is based on a keynote address presented at III Congresso Nazionale Dell’Associazion... more The following is based on a keynote address presented at III Congresso Nazionale Dell’Associazione Italiana Di Valutazione, Torino, Villa Gaulina, 24 March, 2000.
We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WW... more We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WWC), to Alan Schoenfeld's article about that organization. The article sets forth his concerns regarding outcome measurement used by the WWC and claims that his contributions to ...
We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WW... more We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WWC), to Alan Schoenfeld's article about that organization. The article sets forth his concerns regarding outcome measurement used by the WWC and claims that his contributions to ...
We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WW... more We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WWC), to Alan Schoenfeld's article about that organization. The article sets forth his concerns regarding outcome measurement used by the WWC and claims that his contributions to ...
This paper complements existing power analysis tools by offering tools to compute minimum detecta... more This paper complements existing power analysis tools by offering tools to compute minimum detectable effect sizes (MDES) for existing studies and to estimate minimum required sample sizes (MRSS) for studies under design. The tools that accompany this paper support estimates of MDES or MSSR for 21 different study designs that include 14 random assignment designs (6 designs in which individuals are randomly assigned to treatment or control condition and 8 in which clusters of individuals are randomly assigned to condition, with models differing depending on whether the sample was blocked prior to random assignment and by whether the analytic models assume constant, fixed, or random effects across blocks or assignment clusters); and 7 quasi-experimental designs (an interrupted time series design and 6 regression discontinuity designs that vary depending on whether the sample was blocked prior to randomization, whether individuals or clusters of individuals are assigned to treatment or ...
Institute for Research on Poverty, major aspects of the evaluation of the national demonstration ... more Institute for Research on Poverty, major aspects of the evaluation of the national demonstration of Supported Work. Funding for this national demon-stration comes from a number of federal agencies, but is channeled through the Employment and Training Administration, U.S. Department of Labor, as the lead federal agency, under Grant No. 33-36-76-01 and Contract Nos. 30-36-75-01 and 30-34-75-02. Researchers ~ndertaking such projects under government sponsorship are encouraged to express their professional judgements freely. Therefore, points of view or opinions stated in this document do not neces--sari1y represent_the official position or policy of the federal government or tne sponsors of the demonstration.------------~~._-----------_._._-The national Supported Work demonstration is a transitional public employment program for those with severe labor market disadvantages--lang-term AFDC recipients, ex-addicts, ex-offenders, and young school dropouts. In this paper we discuss the prog...
The practice of prospectively registering the details of intervention studies in a public databas... more The practice of prospectively registering the details of intervention studies in a public database or registry is gaining momentum across disciplines as a strategy for increasing the transparency, credibility, and accessibility of study findings. In this article, we consider five registries that may be relevant for registration of intervention studies in the field of prevention science: ClinicalTrials.gov, the American Economic Association Registry of Randomized Controlled Trials (AEA RCT Registry), the Open Science Framework Preregistration (OSF Preregistration), the Registry for International Development Impact Evaluations (RIDIE), and the Registry of Efficacy and Effectiveness Studies (REES). We examine the five registries in terms of substantive focus, study designs, and contents of registry entries. We consider two paths forward for prospective registration of intervention studies in the field of prevention science: Path A: register all studies in ClinicalTrials.gov and Path B: allow individual researchers to select the registry with the “best fit.” Lastly, we consider how the field might begin to establish norms around registration.
The following is based on a keynote address presented at III Congresso Nazionale Dell’Associazion... more The following is based on a keynote address presented at III Congresso Nazionale Dell’Associazione Italiana Di Valutazione, Torino, Villa Gaulina, 24 March, 2000.
We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WW... more We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WWC), to Alan Schoenfeld's article about that organization. The article sets forth his concerns regarding outcome measurement used by the WWC and claims that his contributions to ...
We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WW... more We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WWC), to Alan Schoenfeld's article about that organization. The article sets forth his concerns regarding outcome measurement used by the WWC and claims that his contributions to ...
We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WW... more We appreciate the opportunity to respond, as represen-tatives of the What Works Clearinghouse (WWC), to Alan Schoenfeld's article about that organization. The article sets forth his concerns regarding outcome measurement used by the WWC and claims that his contributions to ...
Uploads