India’s top court angry after junior judge cites fake AI-generated orders

New Delhi, India – In a scathing indictment of the burgeoning use of artificial intelligence in the legal arena, India’s Supreme Court has expressed profound anger and concern after a junior judge was found to have relied on fabricated, AI-generated legal orders to adjudicate a property dispute. The apex court, taking up an appeal by the defendants, has vowed to scrutinize the ruling delivered by the lower court in the southern state of Andhra Pradesh, emphasizing that the proliferation of such "hallucinated" judicial pronouncements poses a grave threat to the very integrity of the Indian justice system.

The incident, which has sent shockwaves through the legal fraternity, unfolded in August of the previous year in Vijayawada, a city in Andhra Pradesh. A junior civil judge, presiding over a contentious property dispute, dismissed an objection raised by the defendants regarding a court-commissioned property survey. In justifying this dismissal, the judge cited four preceding legal judgments, which, upon later examination, were discovered to be entirely fictitious, conjured by an artificial intelligence program. This revelation has brought into sharp focus the potential for AI, while a powerful tool for efficiency, to also become a conduit for significant misinformation and judicial malpractice.

The defendants, understandably aggrieved, challenged the lower court’s order in the state’s High Court. They presented evidence that the cited judgments were not only non-existent but were likely fabricated by an AI. The High Court, while acknowledging the error, surprisingly took a lenient view, attributing the junior judge’s actions to "good faith." Astonishingly, the High Court upheld the trial court’s decision, arguing that even if the citations were incorrect or non-existent, the underlying legal principles and their application to the facts of the case were sound. This stance, while attempting to salvage the judicial process, has been heavily criticized for downplaying the severity of using fabricated evidence.

In its defense, the junior judge, when called upon to provide an explanation to the High Court, stated that this was her inaugural use of an AI tool. She claimed to have genuinely believed the AI-generated citations to be authentic and had no intention of misrepresenting or fabricating legal precedents. The High Court, in its written submission, relayed that the mistake was solely a consequence of "reliance on an automatic source." The High Court, in a notable observation, also advocated for the "exercise of actual intelligence over artificial intelligence," a sentiment that has resonated deeply in the wake of this controversy.

However, the defendants, unsatisfied with the High Court’s lenient approach, escalated the matter to the Supreme Court. The apex court, unlike its High Court counterpart, did not mince words. Coming down with exceptional sternness on the use of fake AI-generated judgments, the Supreme Court on Friday of last week issued a stay on the lower court’s order concerning the property dispute. The court unequivocally stated that the utilization of AI in generating judgments was not merely an "error in decision making" but constituted a serious act of "misconduct."

The Supreme Court emphasized the far-reaching implications of this incident, declaring it a matter of "considerable institutional concern." The court’s focus was not on the merits of the property dispute itself, but rather on the fundamental processes of adjudication and determination that form the bedrock of the judicial system. The judges recognized that allowing fabricated evidence, even if unintentionally presented, to influence judicial decisions could erode public trust and undermine the rule of law.

In its proactive approach to addressing this systemic vulnerability, the Supreme Court announced its intention to delve deeper into the case. To facilitate this comprehensive examination, the court has issued formal notices to the Attorney General and the Solicitor General of India, as well as the esteemed Bar Council of India. This broad consultation signals the Supreme Court’s commitment to establishing robust guidelines and mechanisms to prevent future occurrences of AI-driven judicial malpractice.

This high-profile case is not an isolated incident. In a related development last month, the Supreme Court had already voiced its apprehension regarding the increasing trend of lawyers employing AI tools for drafting legal petitions. The court had reportedly described this practice as "absolutely uncalled for," highlighting concerns about the accuracy and reliability of AI-generated legal arguments and citations.

India’s struggle with the integration of AI into its legal framework is part of a global phenomenon. In the United States, two federal judges were recently censured for utilizing AI tools that led to factual inaccuracies in their rulings. Similarly, in June of the previous year, the High Court of England and Wales issued a stern warning to legal practitioners against the use of AI-generated case material after a series of instances where fictitious or partially fabricated rulings were cited in court proceedings. These global examples underscore the urgent need for a unified and effective approach to regulating AI in the judicial sphere.

In response to these emerging challenges, India’s judicial institutions are actively engaged in developing strategies for responsible AI adoption. Last year, the Supreme Court took a significant step by publishing a comprehensive white paper on the use of AI in India’s judiciary. This document outlines best practices and provides crucial guidelines for the ethical and effective use of AI by judicial institutions, lawyers, and court staff. A central tenet of these guidelines is the imperative of "human oversight," ensuring that AI serves as an assistive tool rather than a replacement for human judgment. The court has consistently stressed the importance of maintaining "institutional safeguards firmly in place" to preserve the integrity and credibility of the justice delivery system in the age of artificial intelligence. The recent ruling underscores the critical need for vigilance and the application of robust due diligence when integrating advanced technologies into the sensitive domain of law.