Critical Software, the Coimbra-based tech firm known for high-stakes systems in aviation and automotive, is undergoing a radical structural shift. Co-founder and chairman Gonçalo Quadros declared to Lusa and Público that the company is "refounding" itself because of artificial intelligence, drawing a hard line between the pre-AI and post-AI eras. While Quadros declined to specify the exact number of employees let go, reports indicate roughly 200 staff have been cut as the company pivots away from traditional software development roles.

The Shift from Creation to Verification

The core of this restructuring is a move away from humans writing code for routine tasks. Quadros explained that AI now handles testing and system behavior checks with "absolutely brutal" effectiveness, a capability that didn't exist two to three years ago. More significantly, AI is now producing code of "brutal" quality, leading Quadros to predict that in the near future, most software will be made by machines. The human role is being redefined from creator to verifier, specifically for critical systems where failure is not an option. Quadros emphasized that while AI might multiply productive capacity tenfold, the human element remains essential for design, verification, and validation in safety-critical domains. A system that prevents a train from passing a red signal or controls an aircraft cockpit still requires human oversight, even if the underlying software is generated by an algorithm. This isn't about replacing engineers entirely, but about making the organization "agile and fast" by cutting roles that don't fit the new AI-centric workflow.

The Abyss of Recursive Self-Improvement

Beyond the operational changes, Quadros voiced a philosophical concern about the trajectory of AI development. He warned that if machines achieve recursive self-improvement—where a system can optimize itself without human input—and control is lost, "we may be on the edge of the abyss." He noted that the probability of a dystopian outcome is higher than ever before, though he stopped short of quantifying that risk. This sentiment reflects a growing anxiety in the industry: efficiency gains are massive, but the safety rails are becoming increasingly theoretical.

Key Takeaways

  • Critical Software is cutting roughly 200 jobs to pivot from traditional dev to AI-assisted verification.
  • Co-founder Gonçalo Quadros claims AI now writes code of "brutal" quality, a capability absent just years ago.
  • The company predicts a ten-fold productivity boost, making previously uneconomical systems viable.
  • Human roles are shifting to design and validation for safety-critical aviation and automotive systems.
  • Quadros warns of "the edge of the abyss" if AI achieves recursive self-improvement without control.

The Bottom Line

This is the canary in the coal mine for mid-tier dev shops: if you're not building safety-critical verification layers, you're just a cost center that AI is about to automate. The era of routine coding is ending; the era of human-led verification is here.