Can algorithms replace judges? Between promises of efficiency and constitutional limits: how automated decision-making systems are transforming the judiciary and why Art. 101 of the German Basic Law sets strict boundaries for the digital judge.
Table of Contents
- When Algorithms Judge: Vision or Constitutional Violation?
- Art. 22 GDPR: The Prohibition on Automated Individual Decisions
- Exceptions and Their Limits
- Art. 101 GG: The Lawful Judge as a Constitutional Boundary
- Can an Algorithm Be a "Lawful Judge"?
- Predictive Justice: International Experiments
- France: The Ban on Judicial Analytics
- Estonia: The "Robot Judge" for Small Claims
- China: Smart Courts as a Future Model?
- German e-Justice Initiatives: Measured Digitalisation
- Electronic Legal Communication (ERV)
- AI as a Support Tool
- The Tension Between Efficiency and Fundamental Rights
- Practical Recommendations
- Conclusion: Humans Must Remain Judges
When Algorithms Judge: Vision or Constitutional Violation?
Imagine your next court hearing being conducted not by a judge of flesh and blood, but by an algorithm. What sounds like science fiction is already reality in some countries -- and raises fundamental questions that touch the very foundations of the rule of law.
The digitalisation of the judiciary is no longer a topic for the future. In China, AI-supported systems already handle thousands of cases, Estonia experimented with a so-called "robot judge" for small claims, and France has pre-emptively criminalised the algorithmic analysis of judicial decisions. Meanwhile, Germany is advancing the digitalisation of judicial proceedings through the electronic legal communication system (ERV) -- but where do the constitutional boundaries lie?
Art. 22 GDPR: The Prohibition on Automated Individual Decisions
The European General Data Protection Regulation contains a central protective provision in Art. 22 GDPR: data subjects have the right not to be subjected to a decision based solely on automated processing that produces legal effects concerning them or similarly significantly affects them.
This provision targets situations where algorithms decide on creditworthiness, insurance claims, or -- and this is where it becomes critical -- on the rights and obligations of citizens without human intervention. The European Court of Justice significantly expanded the scope of this provision in the landmark SCHUFA Scoring decision (C-634/21, judgment of 7 December 2023), clarifying that even the creation of a scoring value can constitute an automated decision within the meaning of Art. 22(1) GDPR.
Exceptions and Their Limits
Art. 22(2) GDPR provides three exceptions to the general prohibition:
- The decision is necessary for entering into or performing a contract
- The decision is authorised by Union or Member State law
- The decision is based on the explicit consent of the data subject
Even where an exception applies, appropriate measures to safeguard the rights and freedoms must be implemented, in particular the right to obtain human intervention, to express one's point of view, and to contest the decision.
Art. 101 GG: The Lawful Judge as a Constitutional Boundary
Even more fundamental than the data protection framework is the constitutional dimension. Art. 101(1) sentence 2 of the German Basic Law (Grundgesetz, GG) guarantees: "No one may be removed from the jurisdiction of their lawful judge."
This principle is one of the supporting pillars of the rule of law. It protects against arbitrary manipulation of jurisdiction and ensures that judges are determined in advance according to abstract, general criteria. The lawful judge is a human being -- with conscience, experience, and the capacity for empathy.
Can an Algorithm Be a "Lawful Judge"?
The prevailing opinion in legal scholarship clearly answers in the negative. The concept of "judge" within the meaning of the Basic Law presupposes:
- Personal independence (Art. 97(2) GG)
- Substantive independence (Art. 97(1) GG) -- judges are subject only to the law
- Individual conscience as the basis for decision-making
- Personal accountability for the decision rendered
An algorithm fulfils none of these requirements. It is neither independent nor does it possess a conscience. It follows programmed rules and statistical patterns, not the law in the constitutional sense.
Predictive Justice: International Experiments
France: The Ban on Judicial Analytics
In 2019, France took a remarkable step: Art. 33 of the Justice Reform Act criminalised the statistical analysis of judicial decision-making patterns -- with penalties of up to five years' imprisonment. No personal data of judges may be reused for the purpose of evaluating, analysing, comparing, or predicting actual or supposed professional practices.
The background: legal tech companies had begun to systematically evaluate the decision-making behaviour of individual judges and to recommend to clients before which court they would have the best chances. The French legislature saw this as a threat to equality before the law and judicial independence.
Estonia: The "Robot Judge" for Small Claims
Estonia made international headlines in 2019 with its plan to deploy an AI-supported "robot judge" for disputes under EUR 7,000. The Estonian Ministry of Justice later put the project into perspective: it was not about a "robot judge" replacing human judges but about automating specific procedural steps in payment order proceedings. Human judges retain final decision-making authority.
This clarification is telling: even in one of the world's most digital countries, algorithmic justice encounters fundamental rights boundaries.
China: Smart Courts as a Future Model?
China is pursuing the most ambitious approach. The internet court opened in Hangzhou in 2017 handles digital legal disputes using AI-supported systems. Holographic judge avatars conduct hearings, set schedules, and receive evidence. In the first two years, approximately 20,000 judgments were delivered, with average hearing times reduced by 65 per cent.
However, the Chinese model cannot simply be transferred to European legal systems. It lacks:
- Independent judicial oversight in the Western sense
- Transparency regarding the algorithms deployed
- Rule-of-law guarantees such as the right to be heard
German e-Justice Initiatives: Measured Digitalisation
Germany is pursuing a considerably more restrained course. The focus is on digitalising judicial proceedings, not on automating judicial decision-making.
Electronic Legal Communication (ERV)
Since 1 January 2018, electronic legal communication between the judiciary and the legal profession has been mandatory. The Act on the Expansion of Electronic Legal Communication has required virtually all courts and prosecutors' offices to maintain electronic case files since 1 January 2026. The European e-Justice Strategy 2024--2028 supports this development at EU level with the aim of improving cross-border access to digital justice.
AI as a Support Tool
The German debate focuses on the use of AI as an assistive system for judges:
- Research support: AI-powered case law databases
- File management: Automatic categorisation and prioritisation of proceedings
- Text analysis: Evaluation of extensive briefs and evidence
- Anonymisation: Automatic redaction of personal data in judgments
The crucial difference: the decision itself remains with the human judge. AI serves as a tool, not as a decision-maker.
The Tension Between Efficiency and Fundamental Rights
Proponents of algorithmic justice advance weighty arguments:
- Efficiency: Faster proceedings in overburdened courts
- Consistency: Algorithms (theoretically) decide like cases alike
- Objectivity: No unconscious biases (cognitive biases) of human judges
- Availability: 24/7 access to dispute resolution mechanisms
Against these stand fundamental concerns:
- Bias in training data: Algorithms reproduce historical patterns of discrimination
- Lack of transparency: "Black box" problem with neural networks
- No individual case justice: Algorithms fail to recognise atypical circumstances
- Accountability gap: Who is liable for algorithmic misjudgments?
- Democratic deficit: Judicial development of the law requires human value judgments
Practical Recommendations
For businesses and citizens confronted with automated administrative decisions, the following recommendations apply:
- Examine the legal basis: Automated decisions are generally impermissible under Art. 22 GDPR. Demand a reasoned decision by a human being.
- Exercise your right to object: Under Art. 22(3) GDPR, you have the right to demand human review.
- Demand transparency: Authorities must inform you under Arts. 13 and 14 GDPR whether and how automated decision-making systems are being used.
- Document anomalies: If you suspect that a decision was made algorithmically and erroneously, preserve evidence.
- Seek legal advice: The intersection of technology and fundamental rights requires specialised legal counsel.
Conclusion: Humans Must Remain Judges
The digitalisation of the judiciary is inevitable and in many areas desirable. Electronic files, digital communication, and AI-supported research tools increase efficiency and improve access to justice. Yet the judicial decision itself must remain in human hands.
Art. 101 GG is not an anachronistic formal requirement but a living bulwark against the dehumanisation of jurisprudence. The lawful judge is a human being -- with the ability not merely to apply the law but to develop it, to achieve individual justice, and to sustain the trust of those subject to the law in the rule of law.
The future of the judiciary lies not in the digital judge but in the digitally supported judge -- a human being who uses modern technology without being replaced by it.
At compleneo, we support you with all questions concerning automated decision-making systems, data protection law, and the enforcement of your fundamental rights against algorithmic administrative decisions. Get in touch with us.