Image Recognition
About 11 states have agencies that use risk modeling in the child welfare system, and about half the states in the country have considered using it in their child welfare agencies, according to an ACLU report. AdvertisementYet NYC has pushed forward with its use of predictive modeling in child welfare and has made efforts to head off criticism that its models are biased. Predictive models, including SHM, are trained on historical data that advocates say is already biased because of the biases in the child welfare system. “You can never create guardrails sufficient to counteract the bias inherent in predictive analytics algorithms in child welfare. As with the criminal justice system, politicians are pressured to widen the net of surveillance in the child welfare system when an act of violence occurs.