DOGE Developed Error-Prone AI Tool to “Munch” Veterans Affairs Contracts
The AI Report
Daily AI, ML, LLM and agents newsProPublica has revealed that the Trump administration's Department of Government Efficiency (DOGE), led by Elon Musk, used an error-prone artificial intelligence tool developed by a staffer with no medical or government experience to identify Veterans Affairs contracts for cancellation, labeling them "MUNCHABLE."
The AI tool, built quickly using outdated and inexpensive models, produced results with glaring mistakes. It frequently misread contract values, in one instance concluding over a thousand deals were each worth $34 million when some were as low as $35,000. Experts who reviewed the code unanimously called the script and approach flawed and "deeply problematic," stating that AI is "absolutely the wrong tool for this."
The system was programmed to make intricate judgments based on only the first few pages of contracts, containing sparse summary information. Its underlying instructions were deeply flawed, lacking context about VA operations, essential services, or legal requirements. While directed to spare "direct patient care," experts noted this ignores the vital support services doctors and nurses rely on.
Sahil Lavingia, the engineer behind the tool, acknowledged mistakes, stating, "I would never recommend someone run my code and do what it says. It’s like that ‘Office’ episode where Steve Carell drives into the lake because Google Maps says drive into the lake. Do not drive into the lake."
Despite VA claims of human review, internal records and staff accounts indicate employees were given severely limited time and space (sometimes just hours and 255 characters) to justify keeping contracts flagged by DOGE. Some canceled contracts include those for cancer treatment research, blood sample analysis, and tools to improve nursing care, contradicting VA assurances that direct care wouldn't be cut.
The VA has not explained how it plans to move services in-house while also slashing staff. The opaqueness of the process has even left VA staff and contractors unsure of who made final cancellation decisions or how to prevent their contracts from being cut. Lavingia open-sourced his code for transparency, a move he says may have led to his dismissal.
ProPublica encourages anyone with information about the misuse of AI in government or issues within the VA to contact reporters Brandon Roberts, Vernal Coleman, or Eric Umansky securely.
The AI Report
Author bio: Daily AI, ML, LLM and agents news