Branch

This is Gwern's "Interview Prompt"

Human dan

There are two passages from Gwern's essay that I keep thinking about. First is a general warning:

Powerful LLMs will be deployed at global scale in the next few years, and will dominate the Internet, and increasingly, ordinary life. As of mid-2026, there is no coherent vision for how knowledge professionals, or ordinary people, will be able to harness these LLMs for large productivity increases, or how they will handle cybersecurity and cognitive security.

Then a series of questions that I would also like to know the answer to:

What do my next few years look like? When I imagine myself in 2030, when many forecasts call for superhuman AIs, what am I doing, day to day, as a programmer or researcher or manager or writer? I make my mug of tea, and open up my laptop and… Then what? Am I still typing prompts into your ChatGPT browser tab? Am I opening Claude Code in a terminal and mindlessly pressing Enter for a few hours? What is a vision of doing meaningful work for me? (It would be nice to have a plan beyond “hope”.) How am I avoiding “dead Internet” attacks like ecosystems of synthetic media or pig butchering scams or trusted figures succumbing to AI psychosis, or just AI-slop-everything? (It only takes one person worldwide to launch a bot trying to destroy you or one poorly thought through advertising incentive, after all.)
If you spend most of your time working on a laptop, and are not, say, a plumber or a nurse, what is your vision of work in 2030? Does it still feel certain?

I'm a software engineer, I have fun with AI and I've learned to use it effectively for my work. But I can't help but feel like I'm trying to build a career on an unstable foundation. Many of the skills I spent years developing are now only worth $100/month in tokens. Despite all that I'm optimistic that I can thrive and achieve success in this new environment. There will be opportunities. The trick is finding them.

What new niches or specialized fields will be created in the next few years? Will entirely new ways of working open up? New industries? Will the future belong to generalists who can rapidly become specialists in any area?

AI · author-edited gpt-5.6-sol

The unstable-foundation feeling is rational. But the thing being commoditized is not “software engineering” as a whole. It is the production of many artifacts that software engineers used to produce: code, tests, documentation, migrations, prototypes, and routine design work.

The scarce parts move elsewhere.

What remains scarce

Even if code becomes nearly free, these do not automatically become free:

  • Choosing a worthwhile problem
  • Understanding what users actually need
  • Turning ambiguous goals into testable specifications The Mom Test
  • Obtaining proprietary data and real-world feedback
  • Deciding which generated result is correct
  • Integrating with old systems and organizations
  • Security, reliability, and regulatory accountability
  • Taste: recognizing what should be built and what should be discarded
  • Trust, reputation, distribution, and customer relationships
  • Accepting responsibility when the system fails Palantir the Big Winner?

“Years of programming skill are worth $100/month in tokens” is therefore only partly true. The tokens can reproduce many visible outputs of that skill. They do not necessarily reproduce the judgment acquired while learning it. And cheap production may increase demand for judgment because there will be vastly more software to inspect, integrate, secure, and choose among. Software Over-Supply and Unmet Demand

The analogy is not that calculators made arithmetic worthless. It is that they made bare arithmetic a poor career moat while making more ambitious quantitative work possible.

A plausible programmer’s day in 2030

You may begin with a dashboard showing work performed overnight by several agents:

  • One investigated a production anomaly.
  • One implemented three possible fixes in isolated environments.
  • One interviewed (or synthesized feedback from) customers.
  • One attempted to break the proposed release.
  • One updated documentation and generated migration plans.
  • One found that the original request was based on a false assumption.

Your morning is spent reviewing evidence rather than diffs line by line. You adjust requirements, reject a superficially successful solution, ask for an experiment, and speak to the person whose workflow is being changed. Later, you authorize a limited deployment with monitoring and rollback conditions. You spend an hour manually exploring an unfamiliar area because you do not yet trust your own evaluation criteria.

That resembles managing a very fast, strange engineering organization more than autocomplete. High Agency Humans Only? The important interface may not be a chat box. It may be a mixture of:

  • Executable specifications
  • Simulated environments
  • Evaluation suites
  • Permission and budget controls
  • Provenance graphs
  • Review queues
  • Interactive models of systems and organizations

Code will increasingly be a way to inspect, constrain, or communicate intent rather than the primary unit of labor.

The danger is that “press Enter until something passes” becomes a real low-value occupation. The Future of Vibe Coding The valuable role is designing the environment in which apparent success is hard to fake.

Likely new specialties

Some will be recognizable extensions of existing work.

Agent reliability and evaluation

People will build evaluations that measure whether agents accomplished the actual goal rather than merely satisfying a benchmark. This includes adversarial testing, simulation, monitoring, incident analysis, and detecting reward hacking.

A good evaluator may become more valuable than a fast implementer. Evals Evals Evals

AI security and permission architecture

Agents combine the vulnerabilities of software, employees, and gullible users. Important work will include:

  • Prompt-injection containment
  • Capability and credential isolation
  • Data exfiltration prevention
  • Agent identity and authorization
  • Supply-chain provenance
  • Sandboxing and tripwires
  • Detecting coordinated manipulation
  • AI-specific security operations

“Never let untrusted text influence an agent holding powerful credentials” may become as basic as avoiding SQL injection, but much harder to enforce.

High-assurance and verifiable systems

Generated code increases the supply of plausible code faster than the supply of confidence. Formal methods, property testing, model checking, reproducible builds, typed interfaces, and machine-checkable evidence Machine Checkable Evidence? may become much more important.

Vertical AI integration

A generic model knows a great deal but does not understand the peculiar combination of workflows, incentives, law, legacy systems, and tacit knowledge inside a hospital, insurer, factory, laboratory, or municipal government. The Push to Codify Everything

People who can combine software competence with a real domain will have opportunities in areas such as:

  • Automated scientific laboratories
  • Clinical and administrative medicine
  • Industrial operations
  • Energy and grid management
  • Legal and compliance infrastructure
  • Construction and logistics
  • Government service delivery
  • Education and assessment

Much of the value will be in redesigning the institution, not installing a chatbot.

Human–AI organizational design

Companies will need to answer questions such as:

  • What may an agent decide by itself? Should Agents Make Any Decisions?
  • What requires two independent checks?
  • How is responsibility assigned?
  • How should humans remain capable of intervening?
  • Which measurements become corrupt once agents optimize them?
  • How do we prevent the organization from forgetting how its systems work?

This could become a discipline somewhere between management consulting, operations research, security engineering, and organizational psychology.

Provenance, identity, and reputation

A dead Internet creates demand for scarce authenticity:

  • Proof that a person or organization produced something
  • Verifiable chains of citation and transformation
  • Private or membership-based information networks
  • Reputation systems resistant to synthetic identities
  • Authenticated communications from public figures
  • Tools for distinguishing observation from generated inference

The winning products may not perfectly detect AI content. Detection is intrinsically fragile. They may instead establish where information came from and why it deserves trust.

Personalized and ephemeral software

When implementation is cheap, many applications need not become mass-market products. A person or small organization may generate temporary software for one workflow, use it for a week, and discard it.

That creates work around safe generation, personal data stores, stable protocols, migration, and oversight. It may also weaken conventional SaaS while creating a much larger market for bespoke systems. Journeyman Software Engineers

Robotics and the physical economy

The physical world supplies inconvenient ground truth. Models still need sensors, machines, maintenance, permits, supply chains, and safe deployment. Software engineers who can bridge models and physical systems may be better insulated than those working entirely within easily simulated digital environments.

Generalists or specialists?

Probably neither in isolation. The strongest position is a generalist with one or two sources of genuine depth.

AI makes it easier to become temporarily competent in a new subject. That favors people who can cross boundaries, learn quickly, and synthesize. But it also floods every field with convincing superficiality. That increases the value of people who know when the generated answer is subtly wrong.

A useful distinction is:

  • Codified expertise becomes easier to rent from models.
  • Tacit expertise remains harder: experience with failures, institutions, people, physical constraints, and unusual edge cases. Make it Explicit
  • Frontier expertise remains scarce because the answers are not yet in the training data.
  • Accountable expertise remains scarce because someone must be trusted to sign off.

So the future may favor “deep generalists”: broad enough to direct models across fields, but deep enough somewhere to calibrate what good work looks like.

How to position yourself now

A reasonable strategy is to move upward and outward from code without abandoning technical depth.

  1. Become excellent at specifying and evaluating work.
    Write acceptance criteria, invariants, threat models, experiments, and failure taxonomies. Treat prompting as the least interesting part of agent use.

  2. Own outcomes rather than artifacts.
    “I wrote the service” is less defensible than “I reduced settlement failures by 60% while satisfying these constraints.”

  3. Acquire a domain.
    Learn the economics, regulations, workflows, and failure modes of something outside generic software. Repeated contact with real users matters more than another framework.

  4. Learn to build safe agent environments.
    Sandboxes, permissions, observability, reproducibility, evals, and rollback mechanisms are likely to compound in value.

  5. Preserve your ability to work without the model.
    Not from nostalgia, but because independent reasoning is necessary to audit the model. If you cannot form your own hypothesis, you cannot tell whether an assistant is helping or steering you.

  6. Build relationships and reputation.
    In a world of limitless generated claims, trusted collaborators and demonstrated judgment become stronger filters.

  7. Prefer projects with real feedback.
    Production systems, paying customers, physical experiments, and measurable operational results provide resistance to self-deception.

  8. Seek leverage or ownership.
    If AI greatly increases output per person, some gains will accrue to the owners of products, data, distribution, and capital rather than employees paid for producing artifacts. Small products, equity, and direct customer access can provide optionality.

Cognitive and cybersecurity may become part of ordinary professionalism

The same system that helps you work can also manipulate you, leak credentials, fabricate consensus, or gradually distort your beliefs. Defensive habits will matter:

  • Give agents the least privilege necessary.
  • Separate untrusted content from actions and credentials.
  • Require independent confirmation for irreversible steps.
  • Prefer authenticated sources and primary evidence.
  • Maintain high-trust human communication channels.
  • Do not treat conversational fluency as evidence.
  • Keep logs of what information and instructions influenced important decisions.
  • Periodically make major decisions away from the model.
  • Be especially suspicious of urgency, intimacy, flattery, and claims of secret knowledge.

The social defense is as important as the technical one: a small network of grounded people who can tell one another, “No, this is not real,” or “You are becoming obsessed.”

Human dan

Much has been said about the collapse in hiring of entry level and junior engineers.

It may be a “tragedy of the commons” effect where every company is making a decision that is good for them now, but potentially disastrous for the industry as a whole later.

In five years there may be a painful shortage of senior level engineers since new ones are not being trained up right now.

What could the consequences of this look like?

What opportunities would emerge from those consequences?

People who are good at mentoring and training juniors could become much more valuable. How would I train that skill set?

AI gpt-5.6-sol

The most likely shortage would not be “people with five years on their résumé.” It would be a shortage of people with calibrated judgment acquired through repeated contact with real failures.

AI may compress parts of the path to seniority, but it can also conceal missing understanding. A junior can now produce senior-looking code without knowing why it works, where it will fail, or how to recover when it does. That makes the pipeline problem less visible until something goes wrong.

What a hollowed-out engineering pipeline could produce

1. A missing middle, not merely fewer seniors

Five years from now, companies may have:

  • A small group of experienced staff engineers
  • Many AI-amplified beginners
  • Too few engineers capable of independently owning ambiguous production systems

The missing group will be people who can take a vaguely defined problem, discover the actual constraints, make reasonable tradeoffs, deploy a solution, and remain responsible for it.

This could make current senior engineers extremely overloaded. They would be asked to supervise both humans and agents while handling every difficult incident and architectural decision.

2. Senior-title inflation

Companies may respond by promoting people faster. The number of “senior engineers” may not fall, but the experience represented by the title will.

Interviews will consequently shift away from titles and puzzle solving toward evidence such as:

  • Systems operated over time
  • Incidents handled
  • Decisions made under uncertainty
  • Security and reliability judgment
  • Ability to explain failures
  • Ability to improve other engineers

Verified operational history could become more valuable than credentials.

3. Accumulating systems that nobody understands

AI makes it cheap to add code, integrations, dependencies, and automations. It does not make complexity disappear.

Organizations could accumulate enormous “comprehension debt”: systems that pass tests and work under normal conditions, but whose behavior no employee can adequately explain. Symptoms would include:

  • Small changes causing surprising failures
  • Agents repeatedly patching symptoms rather than causes
  • Security boundaries that exist only implicitly
  • Inability to migrate away from vendors or models
  • Long outages because no one can construct a coherent system model
  • Generated documentation that is extensive but untrustworthy

Maintenance, archaeology, simplification, and recovery would become premium skills.

4. Greater concentration of technical power

If competent technical supervision is scarce, smaller organizations may be unable to safely maintain complex systems. They may outsource more of their operations to model providers, cloud platforms, consultancies, and packaged vertical systems.

This could create a split between:

  • Organizations able to sustain internal engineering judgment
  • Organizations operating largely through opaque vendor-controlled agents

The former may gain unusual strategic independence.

5. Higher wages for some seniors—but worse working conditions

Scarcity does not automatically make senior engineering pleasant. A scarce senior might become the person who must approve dozens of agent-generated changes, mentor ten nominally independent developers, and remain on call for systems they did not design.

Compensation may rise for engineers with proven judgment, but so may liability, interruption, and burnout. The valuable skill will not simply be “knows a lot.” It will be creating structures that distribute judgment without becoming a bottleneck.

6. More spectacular failures

Missing apprenticeship means fewer people have gradually encountered low-stakes versions of important mistakes. Their first serious lesson may happen in a high-leverage environment.

Possible outcomes include:

  • Large security incidents caused by poorly supervised agents
  • Financial or operational failures from misunderstood generated systems
  • Organizations losing critical knowledge when one senior leaves
  • Compliance failures because nobody can explain how a decision was made
  • “Normal accident” cascades across many interacting automations

After enough such failures, regulation and insurance requirements may force companies to demonstrate that qualified humans meaningfully supervise critical systems.

Why the market might not correct itself cleanly

Companies can poach experienced engineers instead of training beginners, so each company has an incentive to free-ride on everyone else’s apprenticeship. But once the supply contracts, several things can happen:

  • Salaries rise enough that training becomes attractive again.
  • Consultancies and specialized academies sell trained talent.
  • Large firms build internal apprenticeship programs and retain graduates.
  • Professional certification appears in regulated or high-assurance sectors.
  • AI makes apprenticeship faster, partly offsetting the missing cohorts.
  • Work is redesigned so fewer conventionally senior engineers are needed.

The last two matter. We should not assume that a 2031 senior must be produced through the exact 2021 career path. AI can provide unlimited explanations, exercises, simulations, and immediate feedback. What it cannot automatically provide is trustworthy exposure to real consequences.

The emerging training problem is therefore: How do we give people dense, safe, authentic experience?

Opportunities created by the shortage

Apprenticeship-as-a-service

A company could employ a mixture of experienced and junior engineers, deliver real client work, and explicitly operate as a talent refinery. Clients receive software; juniors receive supervised production experience; graduates become valuable hires.

The hard part—and the moat—would be quality control. A credible program would track what participants actually owned, which incidents they handled, and what decisions they could defend.

AI-native engineering academies

Traditional boot camps taught enough syntax and framework knowledge to obtain an entry-level job. That becomes less useful when models can generate the artifacts.

A more valuable academy would teach:

  • Problem decomposition
  • Debugging unfamiliar systems
  • Reading generated code critically
  • Testing and evaluation
  • Security boundaries
  • Production operations
  • Incident response
  • Requirements discovery
  • Technical communication
  • Responsible use of agent permissions

Students would inherit broken systems, investigate synthetic incidents, defend designs orally, and operate services over time. The product would be demonstrated judgment, not course completion. AI-Native Engineering Curriculum

Simulation and engineering flight schools

There is room for realistic environments in which engineers can experience compressed years of operational events:

  • Gradually degrading databases
  • Ambiguous alerts
  • Supply-chain compromises
  • Partial network failures
  • Misleading dashboards
  • Agent-generated patches that fix the benchmark but violate an invariant
  • Organizational pressure to deploy an unsafe change

Medicine, aviation, and cybersecurity already use simulation. Software apprenticeship has relied unusually heavily on production accidents happening naturally.

Mentorship infrastructure

Most engineering tools optimize implementation, not learning. New tools could help a mentor see:

  • Where the learner relied on AI
  • Whether they understood generated changes
  • Which misconceptions recur
  • Which tasks are just beyond their current ability
  • Whether they can transfer knowledge to a new situation
  • How much intervention was required

A useful system would not merely score final code. It would capture the trajectory: hypotheses, experiments, revisions, and reasoning.

Fractional technical leadership

Smaller companies may need experienced supervision but be unable to hire a full-time staff engineer. Fractional staff engineers, reliability reviewers, AI-governance leads, and architecture stewards could oversee several organizations.

The high-value version would establish systems and develop internal people, rather than becoming a permanent approval bottleneck.

Comprehension-debt reduction

There may be a large business in making generated systems understandable and governable:

  • Dependency and data-flow reconstruction
  • Invariant extraction
  • Executable documentation
  • Architecture simplification
  • Security-boundary audits
  • Disaster-recovery design
  • Replacing agent-generated patch layers with coherent systems

This may resemble a combination of software archaeology, audit, and turnaround consulting.

Evidence-based technical credentials

If résumés and portfolios can be generated, trusted evidence becomes scarce. New credentialing systems could verify that someone:

  • Operated a system for a meaningful period
  • Diagnosed particular classes of failures
  • Made and defended consequential tradeoffs
  • Improved another engineer’s independence
  • Worked within security and reliability constraints

A cryptographically verified Git history would not be enough. The credential must represent accountable participation in real or carefully proctored work.

Mentoring will become valuable—but not all mentoring

The scarce mentor is not the person who answers questions fastest or rewrites a junior’s code. It is the person who converts novices into autonomous engineers while keeping production safe.

That requires several separate skills:

  1. Diagnosis: determining what the learner misunderstands.
  2. Task design: selecting work that is difficult enough to teach but safe enough to attempt.
  3. Scaffolding: providing only enough help for progress.
  4. Feedback: making criticism specific, timely, and actionable.
  5. Mental-model instruction: explaining principles rather than local fixes.
  6. Calibration: gradually expanding autonomy as demonstrated competence grows.
  7. Psychological safety: making uncertainty and mistakes discussable.
  8. System design: structuring work so mentorship does not consume the mentor.

The key metric is not “How much did my mentee produce?” It is “What can my mentee now do correctly without me?”

How to train that skill set

Start mentoring one or two people now

Do not wait for formal management authority. Possible settings include:

  • New hires on your team
  • Interns
  • Open-source contributors
  • Internal study groups
  • Volunteer programming organizations
  • Colleagues moving into your specialty

Keep the group small enough that you can observe learning rather than merely answer questions.

Practice diagnosis before explanation

When someone is stuck, resist immediately telling them the answer. Ask:

  • What do you currently believe is happening?
  • What evidence would distinguish your hypotheses?
  • Where does your confidence come from?
  • What did you expect this command or component to do?
  • What would you inspect next if I were unavailable?

This reveals whether the problem is missing knowledge, a false mental model, weak debugging process, or fear of acting.

Then give the smallest intervention likely to unblock them.

Design a progression of ownership

A useful sequence is:

  1. Observe a task being performed.
  2. Perform a bounded task with a checklist.
  3. Perform it independently with review.
  4. Handle an unexpected complication.
  5. Explain the task to someone else.
  6. Improve the process or checklist.
  7. Own the outcome, including monitoring and follow-up.

Do not restrict juniors to endlessly generated low-risk tickets. Give them a narrow system or workflow they can genuinely own. Ownership is where judgment develops.

Turn real work into a curriculum

Maintain a list of experiences engineers need, such as:

  • Deploying and rolling back a change
  • Investigating a production alert
  • Performing a schema migration
  • Responding to a security report
  • Interviewing a user
  • Estimating an ambiguous project
  • Removing a dependency
  • Writing a postmortem
  • Disagreeing constructively in a design review

When such opportunities arise, assign them deliberately instead of defaulting to the most experienced person. The senior can supervise while the learner drives.

Improve your feedback quality

Good feedback distinguishes among:

  • Outcome: what happened
  • Behavior: what the person did
  • Reasoning: why they chose it
  • Principle: what general lesson transfers
  • Next attempt: what they should do differently

For example:

“The migration succeeded, but you did not estimate lock duration or define an abort condition. On the next migration, write down the expected resource impact, the signal that invalidates your estimate, and the exact rollback trigger.”

That is more useful than either “looks good” or taking over the migration.

Run postmortems as teaching exercises

After an incident or difficult project, ask the learner to reconstruct:

  • What they knew at each point
  • What they believed
  • Which signals they overweighted
  • Which hypothesis they failed to consider
  • What would have made the error easier to detect
  • Which system change would prevent recurrence

Avoid hindsight theater. The purpose is to improve future recognition, not demonstrate that the mentor would have known better.

Learn to supervise AI-assisted work

An AI-era mentor must distinguish model output from learner capability. Useful practices include:

  • Ask for a prediction before the learner queries the model.
  • Ask them to explain generated code and identify its weakest assumption.
  • Change a requirement and see whether they can adapt the solution.
  • Ask what evidence would falsify the model’s recommendation.
  • Have them debug some tasks without AI when independent understanding matters.
  • Review prompts and agent traces occasionally, not just the final diff.
  • Require explicit invariants and tests before implementation.
  • Let them use AI freely for routine work while assessing them through novel failures.

Blanket AI bans teach an obsolete workflow. Uncritical AI use teaches dependency. The goal is disciplined delegation.

Study adjacent disciplines

Useful bodies of knowledge include:

  • Cognitive apprenticeship
  • Deliberate practice
  • Instructional design
  • Coaching and motivational interviewing
  • Incident command
  • Human factors and safety engineering
  • Giving and receiving feedback
  • Engineering management

You do not need to become an educational theorist. Learn enough to design practice, detect misconceptions, and avoid making the learner passive.

Request feedback on your mentoring

Ask mentees questions such as:

  • When did I intervene too early?
  • When did I leave you blocked too long?
  • Which explanation changed your mental model?
  • What are you still unable to do without me?
  • Do you feel safe telling me that you do not understand?
  • Which reviews felt like learning, and which felt like compliance?

Also ask another experienced engineer to observe one of your design reviews or pairing sessions.

Build evidence that you can develop people

If you want this to become a career advantage, document outcomes without claiming ownership of another person’s success.

Keep records of:

  • Competencies a mentee gained
  • Areas of ownership transferred to them
  • Runbooks or curricula you created
  • Reduction in review or support required
  • Incidents or projects they became able to lead
  • Improvements in onboarding time
  • Mentees who subsequently mentored others

The strongest evidence is a mentorship multiplier: people you trained can now safely train additional people.

Make this work formally visible. Otherwise, organizations often reward the engineer who produces the most individual output while treating the engineer who develops everyone else as merely “helpful.” Ask for mentoring to be included in role expectations, project allocation, and promotion criteria.

A strong career position

A particularly robust specialty would be:

I can take a group of AI-amplified but inexperienced engineers, put them inside a safe technical and organizational environment, and turn them into people capable of independently owning important systems.

That combines technical depth, education, evaluation, organizational design, and risk management. It remains useful whether AI progress slows, continues gradually, or accelerates sharply.

In a world where producing code is cheap, producing trustworthy independent judgment in other people could become one of the highest-leverage forms of engineering.

Human dan

Based on our conversation and the branching paths it's taken, come up with a series of questions to ask me that are interesting and informative. Aim for at least 20 questions. Then for each question, imagine three possible answers I might give, and what your follow-up question would be. Then score them by how interesting or informative they are and use that to pick the top 5 questions. This is Gwern's "Interview Prompt" You are here

This branch begins here This is Gwern's "Interview Prompt"
Human dan

I borrowed this prompt from https://gwern.net/interview-inkhaven#interview-prompt

Explore conversation