Branch

AI-Native Engineering Curriculum

Human dan

There are two passages from Gwern's essay that I keep thinking about. First is a general warning:

Powerful LLMs will be deployed at global scale in the next few years, and will dominate the Internet, and increasingly, ordinary life. As of mid-2026, there is no coherent vision for how knowledge professionals, or ordinary people, will be able to harness these LLMs for large productivity increases, or how they will handle cybersecurity and cognitive security.

Then a series of questions that I would also like to know the answer to:

What do my next few years look like? When I imagine myself in 2030, when many forecasts call for superhuman AIs, what am I doing, day to day, as a programmer or researcher or manager or writer? I make my mug of tea, and open up my laptop and… Then what? Am I still typing prompts into your ChatGPT browser tab? Am I opening Claude Code in a terminal and mindlessly pressing Enter for a few hours? What is a vision of doing meaningful work for me? (It would be nice to have a plan beyond “hope”.) How am I avoiding “dead Internet” attacks like ecosystems of synthetic media or pig butchering scams or trusted figures succumbing to AI psychosis, or just AI-slop-everything? (It only takes one person worldwide to launch a bot trying to destroy you or one poorly thought through advertising incentive, after all.)
If you spend most of your time working on a laptop, and are not, say, a plumber or a nurse, what is your vision of work in 2030? Does it still feel certain?

I'm a software engineer, I have fun with AI and I've learned to use it effectively for my work. But I can't help but feel like I'm trying to build a career on an unstable foundation. Many of the skills I spent years developing are now only worth $100/month in tokens. Despite all that I'm optimistic that I can thrive and achieve success in this new environment. There will be opportunities. The trick is finding them.

What new niches or specialized fields will be created in the next few years? Will entirely new ways of working open up? New industries? Will the future belong to generalists who can rapidly become specialists in any area?

AI · author-edited gpt-5.6-sol

The unstable-foundation feeling is rational. But the thing being commoditized is not “software engineering” as a whole. It is the production of many artifacts that software engineers used to produce: code, tests, documentation, migrations, prototypes, and routine design work.

The scarce parts move elsewhere.

What remains scarce

Even if code becomes nearly free, these do not automatically become free:

  • Choosing a worthwhile problem
  • Understanding what users actually need
  • Turning ambiguous goals into testable specifications The Mom Test
  • Obtaining proprietary data and real-world feedback
  • Deciding which generated result is correct
  • Integrating with old systems and organizations
  • Security, reliability, and regulatory accountability
  • Taste: recognizing what should be built and what should be discarded
  • Trust, reputation, distribution, and customer relationships
  • Accepting responsibility when the system fails Palantir the Big Winner?

“Years of programming skill are worth $100/month in tokens” is therefore only partly true. The tokens can reproduce many visible outputs of that skill. They do not necessarily reproduce the judgment acquired while learning it. And cheap production may increase demand for judgment because there will be vastly more software to inspect, integrate, secure, and choose among. Software Over-Supply and Unmet Demand

The analogy is not that calculators made arithmetic worthless. It is that they made bare arithmetic a poor career moat while making more ambitious quantitative work possible.

A plausible programmer’s day in 2030

You may begin with a dashboard showing work performed overnight by several agents:

  • One investigated a production anomaly.
  • One implemented three possible fixes in isolated environments.
  • One interviewed (or synthesized feedback from) customers.
  • One attempted to break the proposed release.
  • One updated documentation and generated migration plans.
  • One found that the original request was based on a false assumption.

Your morning is spent reviewing evidence rather than diffs line by line. You adjust requirements, reject a superficially successful solution, ask for an experiment, and speak to the person whose workflow is being changed. Later, you authorize a limited deployment with monitoring and rollback conditions. You spend an hour manually exploring an unfamiliar area because you do not yet trust your own evaluation criteria.

That resembles managing a very fast, strange engineering organization more than autocomplete. High Agency Humans Only? The important interface may not be a chat box. It may be a mixture of:

  • Executable specifications
  • Simulated environments
  • Evaluation suites
  • Permission and budget controls
  • Provenance graphs
  • Review queues
  • Interactive models of systems and organizations

Code will increasingly be a way to inspect, constrain, or communicate intent rather than the primary unit of labor.

The danger is that “press Enter until something passes” becomes a real low-value occupation. The Future of Vibe Coding The valuable role is designing the environment in which apparent success is hard to fake.

Likely new specialties

Some will be recognizable extensions of existing work.

Agent reliability and evaluation

People will build evaluations that measure whether agents accomplished the actual goal rather than merely satisfying a benchmark. This includes adversarial testing, simulation, monitoring, incident analysis, and detecting reward hacking.

A good evaluator may become more valuable than a fast implementer. Evals Evals Evals

AI security and permission architecture

Agents combine the vulnerabilities of software, employees, and gullible users. Important work will include:

  • Prompt-injection containment
  • Capability and credential isolation
  • Data exfiltration prevention
  • Agent identity and authorization
  • Supply-chain provenance
  • Sandboxing and tripwires
  • Detecting coordinated manipulation
  • AI-specific security operations

“Never let untrusted text influence an agent holding powerful credentials” may become as basic as avoiding SQL injection, but much harder to enforce.

High-assurance and verifiable systems

Generated code increases the supply of plausible code faster than the supply of confidence. Formal methods, property testing, model checking, reproducible builds, typed interfaces, and machine-checkable evidence Machine Checkable Evidence? may become much more important.

Vertical AI integration

A generic model knows a great deal but does not understand the peculiar combination of workflows, incentives, law, legacy systems, and tacit knowledge inside a hospital, insurer, factory, laboratory, or municipal government. The Push to Codify Everything

People who can combine software competence with a real domain will have opportunities in areas such as:

  • Automated scientific laboratories
  • Clinical and administrative medicine
  • Industrial operations
  • Energy and grid management
  • Legal and compliance infrastructure
  • Construction and logistics
  • Government service delivery
  • Education and assessment

Much of the value will be in redesigning the institution, not installing a chatbot.

Human–AI organizational design

Companies will need to answer questions such as:

  • What may an agent decide by itself? Should Agents Make Any Decisions?
  • What requires two independent checks?
  • How is responsibility assigned?
  • How should humans remain capable of intervening?
  • Which measurements become corrupt once agents optimize them?
  • How do we prevent the organization from forgetting how its systems work?

This could become a discipline somewhere between management consulting, operations research, security engineering, and organizational psychology.

Provenance, identity, and reputation

A dead Internet creates demand for scarce authenticity:

  • Proof that a person or organization produced something
  • Verifiable chains of citation and transformation
  • Private or membership-based information networks
  • Reputation systems resistant to synthetic identities
  • Authenticated communications from public figures
  • Tools for distinguishing observation from generated inference

The winning products may not perfectly detect AI content. Detection is intrinsically fragile. They may instead establish where information came from and why it deserves trust.

Personalized and ephemeral software

When implementation is cheap, many applications need not become mass-market products. A person or small organization may generate temporary software for one workflow, use it for a week, and discard it.

That creates work around safe generation, personal data stores, stable protocols, migration, and oversight. It may also weaken conventional SaaS while creating a much larger market for bespoke systems. Journeyman Software Engineers

Robotics and the physical economy

The physical world supplies inconvenient ground truth. Models still need sensors, machines, maintenance, permits, supply chains, and safe deployment. Software engineers who can bridge models and physical systems may be better insulated than those working entirely within easily simulated digital environments.

Generalists or specialists?

Probably neither in isolation. The strongest position is a generalist with one or two sources of genuine depth.

AI makes it easier to become temporarily competent in a new subject. That favors people who can cross boundaries, learn quickly, and synthesize. But it also floods every field with convincing superficiality. That increases the value of people who know when the generated answer is subtly wrong.

A useful distinction is:

  • Codified expertise becomes easier to rent from models.
  • Tacit expertise remains harder: experience with failures, institutions, people, physical constraints, and unusual edge cases. Make it Explicit
  • Frontier expertise remains scarce because the answers are not yet in the training data.
  • Accountable expertise remains scarce because someone must be trusted to sign off.

So the future may favor “deep generalists”: broad enough to direct models across fields, but deep enough somewhere to calibrate what good work looks like.

How to position yourself now

A reasonable strategy is to move upward and outward from code without abandoning technical depth.

  1. Become excellent at specifying and evaluating work.
    Write acceptance criteria, invariants, threat models, experiments, and failure taxonomies. Treat prompting as the least interesting part of agent use.

  2. Own outcomes rather than artifacts.
    “I wrote the service” is less defensible than “I reduced settlement failures by 60% while satisfying these constraints.”

  3. Acquire a domain.
    Learn the economics, regulations, workflows, and failure modes of something outside generic software. Repeated contact with real users matters more than another framework.

  4. Learn to build safe agent environments.
    Sandboxes, permissions, observability, reproducibility, evals, and rollback mechanisms are likely to compound in value.

  5. Preserve your ability to work without the model.
    Not from nostalgia, but because independent reasoning is necessary to audit the model. If you cannot form your own hypothesis, you cannot tell whether an assistant is helping or steering you.

  6. Build relationships and reputation.
    In a world of limitless generated claims, trusted collaborators and demonstrated judgment become stronger filters.

  7. Prefer projects with real feedback.
    Production systems, paying customers, physical experiments, and measurable operational results provide resistance to self-deception.

  8. Seek leverage or ownership.
    If AI greatly increases output per person, some gains will accrue to the owners of products, data, distribution, and capital rather than employees paid for producing artifacts. Small products, equity, and direct customer access can provide optionality.

Cognitive and cybersecurity may become part of ordinary professionalism

The same system that helps you work can also manipulate you, leak credentials, fabricate consensus, or gradually distort your beliefs. Defensive habits will matter:

  • Give agents the least privilege necessary.
  • Separate untrusted content from actions and credentials.
  • Require independent confirmation for irreversible steps.
  • Prefer authenticated sources and primary evidence.
  • Maintain high-trust human communication channels.
  • Do not treat conversational fluency as evidence.
  • Keep logs of what information and instructions influenced important decisions.
  • Periodically make major decisions away from the model.
  • Be especially suspicious of urgency, intimacy, flattery, and claims of secret knowledge.

The social defense is as important as the technical one: a small network of grounded people who can tell one another, “No, this is not real,” or “You are becoming obsessed.”

Human dan

Much has been said about the collapse in hiring of entry level and junior engineers.

It may be a “tragedy of the commons” effect where every company is making a decision that is good for them now, but potentially disastrous for the industry as a whole later.

In five years there may be a painful shortage of senior level engineers since new ones are not being trained up right now.

What could the consequences of this look like?

What opportunities would emerge from those consequences?

People who are good at mentoring and training juniors could become much more valuable. How would I train that skill set?

AI gpt-5.6-sol

The most likely shortage would not be “people with five years on their résumé.” It would be a shortage of people with calibrated judgment acquired through repeated contact with real failures.

AI may compress parts of the path to seniority, but it can also conceal missing understanding. A junior can now produce senior-looking code without knowing why it works, where it will fail, or how to recover when it does. That makes the pipeline problem less visible until something goes wrong.

What a hollowed-out engineering pipeline could produce

1. A missing middle, not merely fewer seniors

Five years from now, companies may have:

  • A small group of experienced staff engineers
  • Many AI-amplified beginners
  • Too few engineers capable of independently owning ambiguous production systems

The missing group will be people who can take a vaguely defined problem, discover the actual constraints, make reasonable tradeoffs, deploy a solution, and remain responsible for it.

This could make current senior engineers extremely overloaded. They would be asked to supervise both humans and agents while handling every difficult incident and architectural decision.

2. Senior-title inflation

Companies may respond by promoting people faster. The number of “senior engineers” may not fall, but the experience represented by the title will.

Interviews will consequently shift away from titles and puzzle solving toward evidence such as:

  • Systems operated over time
  • Incidents handled
  • Decisions made under uncertainty
  • Security and reliability judgment
  • Ability to explain failures
  • Ability to improve other engineers

Verified operational history could become more valuable than credentials.

3. Accumulating systems that nobody understands

AI makes it cheap to add code, integrations, dependencies, and automations. It does not make complexity disappear.

Organizations could accumulate enormous “comprehension debt”: systems that pass tests and work under normal conditions, but whose behavior no employee can adequately explain. Symptoms would include:

  • Small changes causing surprising failures
  • Agents repeatedly patching symptoms rather than causes
  • Security boundaries that exist only implicitly
  • Inability to migrate away from vendors or models
  • Long outages because no one can construct a coherent system model
  • Generated documentation that is extensive but untrustworthy

Maintenance, archaeology, simplification, and recovery would become premium skills.

4. Greater concentration of technical power

If competent technical supervision is scarce, smaller organizations may be unable to safely maintain complex systems. They may outsource more of their operations to model providers, cloud platforms, consultancies, and packaged vertical systems.

This could create a split between:

  • Organizations able to sustain internal engineering judgment
  • Organizations operating largely through opaque vendor-controlled agents

The former may gain unusual strategic independence.

5. Higher wages for some seniors—but worse working conditions

Scarcity does not automatically make senior engineering pleasant. A scarce senior might become the person who must approve dozens of agent-generated changes, mentor ten nominally independent developers, and remain on call for systems they did not design.

Compensation may rise for engineers with proven judgment, but so may liability, interruption, and burnout. The valuable skill will not simply be “knows a lot.” It will be creating structures that distribute judgment without becoming a bottleneck.

6. More spectacular failures

Missing apprenticeship means fewer people have gradually encountered low-stakes versions of important mistakes. Their first serious lesson may happen in a high-leverage environment.

Possible outcomes include:

  • Large security incidents caused by poorly supervised agents
  • Financial or operational failures from misunderstood generated systems
  • Organizations losing critical knowledge when one senior leaves
  • Compliance failures because nobody can explain how a decision was made
  • “Normal accident” cascades across many interacting automations

After enough such failures, regulation and insurance requirements may force companies to demonstrate that qualified humans meaningfully supervise critical systems.

Why the market might not correct itself cleanly

Companies can poach experienced engineers instead of training beginners, so each company has an incentive to free-ride on everyone else’s apprenticeship. But once the supply contracts, several things can happen:

  • Salaries rise enough that training becomes attractive again.
  • Consultancies and specialized academies sell trained talent.
  • Large firms build internal apprenticeship programs and retain graduates.
  • Professional certification appears in regulated or high-assurance sectors.
  • AI makes apprenticeship faster, partly offsetting the missing cohorts.
  • Work is redesigned so fewer conventionally senior engineers are needed.

The last two matter. We should not assume that a 2031 senior must be produced through the exact 2021 career path. AI can provide unlimited explanations, exercises, simulations, and immediate feedback. What it cannot automatically provide is trustworthy exposure to real consequences.

The emerging training problem is therefore: How do we give people dense, safe, authentic experience?

Opportunities created by the shortage

Apprenticeship-as-a-service

A company could employ a mixture of experienced and junior engineers, deliver real client work, and explicitly operate as a talent refinery. Clients receive software; juniors receive supervised production experience; graduates become valuable hires.

The hard part—and the moat—would be quality control. A credible program would track what participants actually owned, which incidents they handled, and what decisions they could defend.

AI-native engineering academies

Traditional boot camps taught enough syntax and framework knowledge to obtain an entry-level job. That becomes less useful when models can generate the artifacts.

A more valuable academy would teach:

  • Problem decomposition
  • Debugging unfamiliar systems
  • Reading generated code critically
  • Testing and evaluation
  • Security boundaries
  • Production operations
  • Incident response
  • Requirements discovery
  • Technical communication
  • Responsible use of agent permissions

Students would inherit broken systems, investigate synthetic incidents, defend designs orally, and operate services over time. The product would be demonstrated judgment, not course completion. AI-Native Engineering Curriculum You are here

This branch begins here AI-Native Engineering Curriculum
Human dan

I love the idea of this, but it is hard to imagine it working as a business model. The skills necessary to be an instructor are scarce and valuable enough to make it prohibitively expensive to hire them. Maybe AI instructors can make this work?

What would the curriculum look like? I can imagine grouping students into teams, giving them real-world projects like "create a scheduling and calendar system" or "build a point of sale and inventory tracking system". AI tools can create comprehensive test suites on demand to evaluate their projects and provide feedback and personalized learning plans to the team.

Let's brainstorm a hypothetical curriculum.

AI gpt-5.6-sol

The viable model is probably not “hire expensive senior engineers to lecture full-time.” Lecturing is a poor use of them.

Instead:

  • AI handles explanation, drills, routine code review, test generation, and individualized feedback.
  • Students learn in teams by operating realistic systems.
  • Senior engineers design scenarios, calibrate evaluations, conduct periodic reviews, and intervene at important moments.
  • The curriculum captures each expert intervention so it becomes reusable.
  • Customers or partner organizations supply bounded, noncritical projects and possibly pay for delivery or recruiting access.

The scarce instructor becomes more like the designer and supervisor of a flight simulator. One strong engineer might oversee several cohorts if the environment makes student progress legible and escalates only ambiguous cases.

The central principle should be:

Do not teach students to produce code. Teach them to acquire justified confidence in systems they are responsible for.

Curriculum goal

A graduate should be able to take an ambiguous request and:

  1. Discover what actually needs to be built.
  2. Model the domain and identify important constraints.
  3. Direct AI tools without surrendering understanding.
  4. Evaluate generated work adversarially.
  5. Deploy and operate a system.
  6. Diagnose failures under uncertainty.
  7. Communicate tradeoffs to technical and nontechnical people.
  8. Improve the performance of teammates.
  9. Know when to escalate.
  10. Produce evidence supporting their claims.

The final credential should mean something like:

This person has repeatedly owned services, handled incidents, found flaws that automated evaluations missed, and made defensible engineering decisions.

A six-month apprenticeship

A possible structure is 24 weeks, with teams of four to six. Each team operates one evolving business system rather than completing unrelated toy assignments.

There could be several domains:

  • Scheduling, calendars, and workforce management
  • Point of sale, inventory, and purchasing
  • Insurance claims processing
  • Logistics and delivery routing
  • Subscription billing
  • Laboratory sample tracking
  • Property management
  • Municipal permitting

The domain should be mundane but deceptively difficult. Mundane systems contain identity, money, time, authorization, concurrency, compliance, and human exceptions—the material of real engineering.

Phase 0: Diagnostic and foundations — 2 weeks

Students inherit a small but functioning service.

They must:

  • Run it locally
  • Explain its architecture
  • Trace several requests through it
  • Fix a few bugs
  • Add an observable feature
  • Identify a security flaw
  • Deploy a change safely

The purpose is not to normalize everyone’s language or framework knowledge. AI can help with that. It is to establish how each student reasons.

Initial exercises might include:

  • Predict the output before running the code.
  • Find a bug without asking AI for a solution.
  • Compare a human diagnosis with an agent diagnosis.
  • Explain why a passing test does not establish correctness.
  • Recover from a deliberately broken deployment.
  • Identify which credentials and data an agent should be allowed to access.

Each student gets a skill map covering:

  • Code comprehension
  • System modeling
  • Debugging
  • Testing
  • Security
  • Operations
  • Product reasoning
  • Communication
  • AI supervision

Phase 1: Build the naïve version — 3 weeks

Give teams a deliberately underspecified request:

Build appointment scheduling for a small network of clinics.

The obvious product appears straightforward: users, calendars, appointments, notifications. Students interview simulated stakeholders, played primarily by AI personas grounded in a consistent private scenario.

Different stakeholders reveal conflicting requirements:

  • Patients want easy cancellation.
  • Clinicians have variable appointment durations.
  • Administrators want high utilization.
  • Compliance staff restrict sensitive information in notifications.
  • Some appointments need rooms and equipment.
  • Recurring availability crosses daylight-saving changes.
  • Minors and guardians complicate identity and consent.
  • The billing system recognizes different appointment states.

The team must produce:

  • A domain model
  • User journeys
  • Explicit assumptions
  • A threat model
  • Service-level objectives
  • Architecture and build-versus-buy decisions
  • An initial implementation
  • A deployment and rollback plan

The AI does not merely answer questions. It tracks contradictions, withholds information that was not requested, and behaves like real stakeholders. Students are evaluated partly on the questions they thought to ask.

Phase 2: Reality attacks the design — 4 weeks

Once the system works, the simulator introduces change:

  • Two users book the final slot simultaneously.
  • A clinic operates in multiple time zones.
  • A clinician leaves while future appointments remain.
  • Notifications are delayed and sent out of order.
  • A vendor API becomes intermittently unavailable.
  • A user requests deletion of personal data.
  • One enterprise customer needs custom permissions.
  • Traffic increases by 30× during enrollment.
  • A product manager requests a feature that conflicts with an invariant.

Students must adapt the system while preserving service. This teaches that architecture is not a diagram produced before implementation; it is the set of decisions that determine the cost of change.

Important exercises include:

  • State-machine modeling
  • Idempotency
  • Transactions and concurrency
  • Queues and eventual consistency
  • Schema migration
  • Compatibility
  • Capacity estimation
  • Caching and invalidation
  • Authorization
  • Auditability

AI-generated tests help, but the key task is identifying which properties ought to be tested.

For scheduling, important properties might include:

  • A resource cannot be allocated incompatibly to two appointments.
  • Retries cannot create duplicate appointments.
  • A canceled appointment cannot remain billable accidentally.
  • Authorization is evaluated at access time, not inferred from the UI.
  • Time-zone conversion preserves the user’s intended local-time semantics.
  • Every externally visible state transition has an audit trail.

Students should write these invariants before asking an AI to generate concrete cases.

Phase 3: Operations and incidents — 4 weeks

Teams now operate their systems under a simulated production workload.

Incidents arrive without labels:

  • Latency slowly increases.
  • A dependency returns valid-looking but incorrect responses.
  • A deployment corrupts a subset of records.
  • Metrics look normal while customers report failures.
  • A credential appears in a log.
  • A malicious calendar invitation triggers an agent action.
  • An alert fires but is unrelated to the actual problem.
  • A retry storm overloads a downstream service.

Students rotate through roles:

  • Incident commander
  • Operations lead
  • Investigator
  • Communications lead
  • Subject-matter liaison
  • Observer who later analyzes team performance

They are evaluated on whether they:

  • Establish impact before guessing at causes
  • Preserve evidence
  • Avoid making the incident worse
  • Communicate uncertainty honestly
  • Use rollback and containment appropriately
  • Keep a chronological decision log
  • Separate correlation from causation
  • Produce effective corrective actions afterward

The simulator can accelerate time. A week of operational history can unfold in an hour; a supposedly fixed issue can recur “three months later” if the team treated only the symptom.

A human instructor should attend some incident exercises because team behavior, fixation, confidence, and communication are difficult to score entirely from outputs.

Phase 4: Security and adversarial use — 3 weeks

Students attack another team’s system and defend their own.

Topics include:

  • Authentication versus authorization
  • Tenant isolation
  • Credential management
  • Injection vulnerabilities
  • Dependency and build-chain compromise
  • Data exfiltration
  • Abuse prevention
  • Fraud and synthetic identities
  • Agent prompt injection
  • Least-privilege tool use
  • Audit logs and repudiation
  • Privacy and data retention

An especially useful format is an asymmetric exercise:

  • The attackers receive a business goal, such as obtaining inventory without payment.
  • Defenders receive normal operational responsibilities and incomplete alerts.
  • The product team must decide which controls are acceptable without making the product unusable.
  • Auditors later reconstruct what happened.

For a point-of-sale project, attacks might exploit:

  • Refund permissions
  • Coupon stacking
  • Race conditions in inventory reservation
  • Offline transaction reconciliation
  • Barcode substitution
  • Compromised employee accounts
  • Malicious supplier data read by a purchasing agent

Security becomes a property of an operating organization, not a checklist run at the end.

Phase 5: Legacy takeover — 3 weeks

Building a greenfield application is too flattering. Each team should inherit another team’s system—or a deliberately realistic legacy system—with:

  • Sparse and misleading documentation
  • Weak tests
  • Historical database irregularities
  • Dead feature flags
  • An undocumented batch process
  • A fragile external integration
  • A stakeholder who opposes a rewrite for good reasons

Their assignment is not “clean it up.” It is a business change such as:

Add support for stores that can sell inventory belonging to another legal entity without interrupting current operations.

Students must discover the system, decide where to trust it, characterize behavior, and migrate safely.

This phase teaches:

  • Software archaeology
  • Characterization testing
  • Incremental replacement
  • Data migration
  • Observability retrofitting
  • Compatibility strategy
  • Deciding when not to refactor
  • Working with uncertainty

A particularly important exercise would be to have an AI confidently propose a plausible but destructive rewrite. Students should be rewarded for refusing it and gathering more evidence.

Phase 6: Product and economics — 2 weeks

Many engineering failures are correct implementations of bad ideas.

Teams receive requests with hidden economic and organizational consequences:

  • A dashboard that encourages employees to manipulate a metric
  • A recommendation feature whose success metric creates spam
  • A scheduling optimization that maximizes utilization but causes burnout
  • Inventory automation that reduces working capital while making stockouts catastrophic
  • A customer-specific feature whose maintenance cost exceeds its revenue

Students must estimate:

  • Who benefits
  • Who bears the risk
  • Expected implementation and operating costs
  • Reversibility
  • Failure costs
  • Support burden
  • Which metric could be gamed
  • Whether software is the right intervention

They should sometimes recommend not building the feature. A curriculum that never rewards refusal teaches compliance, not judgment.

Phase 7: Technical leadership and mentoring — 2 weeks

Each student mentors a newer participant or an AI-simulated junior through a bounded task.

They practice:

  • Diagnosing another person’s mental model
  • Asking questions rather than taking over
  • Choosing task difficulty
  • Giving actionable feedback
  • Separating style preferences from correctness
  • Letting a learner encounter recoverable failure
  • Reviewing decisions rather than merely code
  • Recognizing when intervention is necessary
  • Building team documentation and guardrails
  • Delegating while retaining accountability

Students are evaluated not only on their own output but on whether the learner becomes more independent.

Phase 8: Capstone ownership — 4 weeks

The final capstone should not be “build an app.” It should be:

Take responsibility for an operating system serving real or realistically simulated users.

Teams receive a goal, budget, existing assets, service obligations, and a changing environment. They must:

  • Conduct discovery
  • Define success
  • Build or modify the system
  • Design evaluations
  • Operate it
  • Handle incidents
  • Respond to stakeholder changes
  • Conduct a security review
  • Transfer ownership to another team

The handoff is important. Software is not successful merely because its creators can operate it.

Final assessment includes an oral defense in which reviewers probe:

  • What do you believe about this system, and what is the evidence?
  • Which part do you trust least?
  • Which failure would your monitoring miss?
  • What did the AI propose that you rejected?
  • What tradeoff would you reconsider at ten times the scale?
  • What should the next team know that is not obvious from the repository?
  • Which decision was reversible, and which was not?

A second example: point of sale and inventory

This project could evolve in layers:

Initial version

  • Product catalog
  • Checkout
  • Payment records
  • Stock counts
  • Receipts
  • Basic reports

First complications

  • Returns without receipts
  • Partial refunds
  • Discounts and tax rules
  • Weighted goods
  • Multiple store locations
  • Employee permissions
  • Offline operation

Distributed-systems complications

  • Card terminal succeeds while the application times out
  • Two stores transfer the same inventory
  • Delayed events arrive out of order
  • A product changes SKU
  • A supplier sends duplicate shipment notices
  • Physical stock disagrees with recorded stock

Business complications

  • Inventory may be owned by different legal entities.
  • Some products expire or have serial numbers.
  • Managers manipulate shrinkage metrics.
  • Demand forecasts cause self-reinforcing overordering.
  • A store must continue operating during a network outage.
  • Refund controls reduce fraud but punish legitimate customers.

Security incidents

  • Cashier credential sharing
  • Fraudulent refunds
  • Malicious barcode data
  • Compromised supplier integration
  • Customer data accidentally included in model context
  • An inventory agent orders from an attacker-controlled vendor

This one project can teach databases, distributed systems, payments, UX, security, observability, operations, and organizational incentives because those concerns naturally interact.

How the AI instructor should work

A single friendly chatbot is insufficient. It would tend to answer too quickly, flatten ambiguity, and help students create work they do not understand.

The instructional system should have several distinct roles.

Tutor

Explains concepts, generates exercises, uses Socratic questions, and adapts to the student’s current model.

It should have modes such as:

  • “Explain”
  • “Give me a hint”
  • “Challenge my reasoning”
  • “Do not reveal the answer”
  • “Quiz me later”
  • “Ask me to predict before running anything”

Reviewer

Reviews artifacts against explicit criteria, identifies risks, and asks for evidence. It should distinguish:

  • Definite defects
  • Likely risks
  • Stylistic preferences
  • Unverified speculation

This prevents the familiar problem of AI code review generating a large quantity of authoritative noise.

Stakeholder simulator

Represents customers, operators, legal staff, managers, and vendors. Each persona has private goals and knowledge. The personas should not spontaneously volunteer every requirement.

Environment simulator

Produces traffic, failures, anomalous data, dependency behavior, security attacks, and longitudinal consequences.

Adversary

Attempts to violate declared invariants and exploit the difference between what students claim and what the system actually guarantees.

Assessor

Maintains a longitudinal evidence model of each student. It should not infer competence simply from polished output. It needs evidence such as:

  • Predictions made before experiments
  • Explanations given without assistance
  • Debugging paths
  • Decisions and reversals
  • Incident behavior
  • Peer reviews
  • Which AI suggestions were accepted or rejected, and why
  • Performance after assistance is removed

Escalation system

Flags situations for a human instructor:

  • A team is stuck for too long.
  • A student repeatedly produces correct output but cannot explain it.
  • Reviews conflict.
  • Team participation is highly unequal.
  • A consequential design decision has no clear answer.
  • A student may be using AI to conceal rather than close a knowledge gap.
  • An interpersonal or ethical issue is emerging.

That escalation layer is what makes scarce human judgment economical.

Assessment must go beyond generated test suites

AI can generate enormous test suites, but volume is not validity. Tests generated from the same specification and assumptions as the implementation may faithfully reproduce the same mistake.

Use several independent forms of assessment:

Hidden scenario tests

Test unanticipated combinations and boundary cases. Useful, but insufficient by themselves.

Property and invariant evaluation

Students state what must always be true. Evaluators attempt to falsify it.

Mutation and sabotage

Introduce plausible defects and measure whether students’ tests, monitoring, and reviews detect them.

Oral defense

Ask a randomly selected team member to explain a subsystem or decision. This reduces the ability to hide behind teammates or generated artifacts.

Prediction

Before running a change, students predict behavior and failure modes. Calibration improves only when predictions are recorded.

Transfer tasks

After learning a concept in scheduling, apply it to inventory or claims processing. This distinguishes understanding from memorization.

AI-off exercises

Students occasionally debug, design, or explain without assistance. The point is not to recreate pre-AI work, but to verify that they retain an independent model.

Longitudinal operation

Evaluate what happens weeks after implementation. Many bad decisions pass every immediate test.

Peer and subordinate outcomes

A more advanced student should improve the work and independence of others.

Making senior instruction economically plausible

A hierarchical model could look like this:

  • One principal curriculum designer per domain
  • One senior reviewer for 40–80 students
  • One experienced facilitator for 15–25 students
  • AI tutors available continuously
  • Near-peer mentors for each team
  • External experts conducting occasional design and incident reviews

The senior engineers’ time goes toward:

  • Creating high-value scenarios
  • Reviewing ambiguous decisions
  • Calibrating AI feedback
  • Leading postmortems
  • Assessing judgment
  • Coaching facilitators
  • Updating the curriculum from real industry failures

It does not go toward explaining syntax, repeatedly finding simple bugs, or manually grading routine assignments.

A flywheel could reduce costs further:

  1. A senior instructor reviews a difficult case.
  2. The session, rationale, and outcome are captured.
  3. Variations become future scenarios.
  4. The AI learns when analogous cases should escalate.
  5. Near-peer mentors learn to handle that class of problem.
  6. The senior focuses on a narrower set of novel cases.

AI should multiply expert attention, not impersonate expertise and eliminate oversight.

Possible business models

A tuition-only academy would face adverse selection and skepticism. Stronger models connect training to work.

Employer consortium

Several companies jointly fund the program because none wants to bear the full cost of rebuilding the junior pipeline. They receive recruiting access while sharing infrastructure and instructors.

Paid apprenticeship studio

The program performs bounded, low-risk client work. Revenue subsidizes training, although delivery must never depend on unsupervised learners.

Internal corporate academy

Large companies use their own systems, incidents, and retired projects as training environments. This may be the easiest initial market because the return is retention and succession, not tuition.

Assessment and simulation platform

Instead of employing every instructor, sell the curriculum, simulation environment, and competency evidence to companies and universities. Human experts can contribute scenario packs and receive royalties.

Talent underwriting

The academy charges employers for successful placements or promotions. It publishes unusually rich evidence of ability, making hiring less risky.

Continuing education for existing developers

The initial market may not be beginners. Mid-level developers and companies have money and an urgent need to learn agent supervision, security, and operations. Revenue from that market could fund junior apprenticeships.

Training yourself to become the mentor who designs this

Mentoring is not primarily explaining what you know. It is engineering another person’s learning loop.

Practice this sequence:

  1. Ask for their model.
    “What do you think is happening?”

  2. Ask for a prediction.
    “If that model is correct, what should we observe?”

  3. Choose the smallest discriminating experiment.
    Avoid random changes and solution dumping.

  4. Let them execute it.

  5. Compare prediction with result.

  6. Ask them to update the model.

  7. Only supply missing information when it unlocks the next reasoning step.

  8. Revisit the concept later in a different context.

You can begin immediately:

  • Mentor one junior or peer weekly.
  • Keep notes on misconceptions, not just bugs.
  • Conduct debugging sessions where you are forbidden to touch the keyboard.
  • Ask mentees for feedback on when you intervened too early or too late.
  • Turn production incidents into sanitized exercises.
  • Write scenario branches: “If they try X, reveal Y.”
  • Compare independent code reviews and examine reviewer disagreement.
  • Practice assessing explanations without relying on whether the final answer is correct.
  • Build a small repository of deliberately broken services.
  • Run incident games with friends or coworkers.
  • Teach mentees how to mentor the next person.

The deepest indicator of mentorship skill is not that your students can solve today’s task. It is that, over time, they need you for fewer classes of decisions while becoming better at recognizing the decisions for which they still need help.

That is also the likely economic moat of an AI-native academy: not content, tests, or generated feedback, all of which will be cheap, but a validated system for converting abundant AI assistance into independent, observable, trustworthy judgment.

Explore conversation