Skynet, But For Welfare: Automating Social Services Is Killing People

By Tim Cushing: For More Info, Go Here…

ngd- This approach is gradually becoming a reality here, as well…

We’ve talked before about the over-reliance on tech to do certain jobs that cannot be simplified to the sum of mathematical parts. The criminal justice system is starting to turn over sentencing to algorithms — something that seems like the smart thing to do but removes judicial and prosecutorial discretion from the mix, leaving defendants with the unpalatable option of challenging software they’re never allowed to examine.

Police departments are also moving towards predictive policing. Relying on historical data, cops are hoping to head off future crimes by allocating resources to areas where crime appears to be more likely to be committed. Sounds good on paper, but in reality, all it does is reinforce biases and push law enforcement to treat everyone in targeted areas as criminals. If the data being fed in reflects biased policing, crunching the numbers even harder isn’t going to erase that. It’s only going to reinforce it. And, again, suspected criminals aren’t able to access the data or software that puts them in law enforcement’s crosshairs.

A certain amount of automation is expected as government agencies seek to streamline public services. The problem isn’t necessarily the tech. It’s the removal of human interaction. As has been stated here frequently, moderation at scale is impossible. So is automated governing. Automated processes are as prone to failure as the people overseeing them. But when you decide software is going to do almost all of the work, those who need the assistance of other humans most are cut out of the loop.

Citizens looking for government assistance have grown accustomed to jumping through red tape hoops. Now, the hoops are inaccessible, but still must be jumped through. The most marginalized members of society are given URLs instead of contact names and numbers when many of them have no reliable access to the internet or a computer. A new series by The Guardian shows the human cost of going paperless. It’s happening all over the world, and it’s literally killing people.

 Governments aren’t looking to defense budgets or law enforcement agencies to make cuts. Instead, they’re adding to their bottom lines by pursuing citizens they think have screwed the government. Another process being automated is governments’ attempts to collect alleged overpayments of social services funds. There’s a statute of limitations on most debt, but software is being used to resurrect ancient debt governments feel they’re owed. This is resulting in the destruction of people’s lives and finances as they find themselves unable to challenge these automated determinations.

In Illinois, the Guardian has found that state and federal governments have joined forces to demand that welfare recipients repay “overpayments” stretching back in some cases 30 years. This system of “zombie debt”, weaponized through technology, is invoking fear and hardship among society’s most vulnerable.

As one recipient described it: “You owe what you have eaten.”

It’s not just “zombie debt.” It’s also “robodebt.” The determinations of owed debt are made by automated processes. The collection process is also automated, separating those suddenly facing possibly undeserved clawbacks from the human assistance they need to determine whether or not the claim is valid. Bureaucracies have always been faceless. With the addition of cold calculations, they’ve weaponized this facelessness to deter citizens from pushing back against a decision-making process composed of 1s and 0s. This, too, is linked to a rising human cost.

Leave a Reply