The variability among types of juvenile sanctions means that youth may receive any of a range of juvenile court sanctions that include dismissal or release, probation, placement in a residential or custodial facility, or "other" sanction. Within these broad categories of dispositions are multiple variations in programming. Few evaluations take into account the significant but subtle variations in program components and outcomes for the types of offenders assigned to various program types. Given these circumstances, this paper cites six reasons for questioning the reliability of what passes as evidence-based programming. First, there is no established set of criteria for how different juvenile justice sanctions and various court-ordered programs and interventions should be classified. Second, new types of sanctioning approaches, including particular programs or interventions, often evolve in contexts that themselves may account for an identified effect rather than the sanction itself. Third, the external validity of many sanctions, including those examined in leading meta-analyses and reviews, remains largely unknown. There is limited empirical evidence regarding the impact of various interventions on diverse offender populations in diverse settings in association with diverse outcomes. Fourth, evidence regarding the internal validity of sanctions does not objectively represent social scientific consensus. Fifth, evidence on the effects of various sanctions on a diverse set of outcomes is rare. Sixth, few rigorous studies have examined the relative effectiveness of various incarceration sanctions compared to specific non-custodial sanctions. 3 tables and 100 references