06Software & responsibility

Software on demand.
Responsibility remains.

Software can increasingly be shaped around a specific need. AI lowers the effort to create it, and managed platforms simplify getting it online. Deciding what makes the result reliable enough to use remains part of the work.

Deniz Wetz / PERSONAL PERSPECTIVE / 03 SECTIONSALL AI INSIGHTS

THE SHORT VERSION

Key points

  • Lower implementation effort makes small, tailored tools practical, but choosing their scope still requires judgment.
  • Managed platforms simplify setup while application access rules and platform dependencies still need examination.
  • Relying on a tool requires checks, maintenance and recovery arrangements proportionate to its consequences.

01SHAPE THE TOOL

From choosing software to shaping it

What changes when a need can become its own tool?

In “KI kopiert jede Software, und jetzt?”, Arnie describes a future in which people ask to edit a photo or understand their sales, and receive a small application inside the conversation. The application grows as they ask for changes. He presents this as a direction with an uncertain timeline and acknowledges current bugs and technical hurdles.

In “Vibe Coding hat sich verändert”, Niklas Steenfatt describes a progression from autocomplete to whole functions, packages and increasingly architectural decisions. He also describes his role as product owner: deciding which features to develop and which to leave out.

Sources[01][02]

COMMENTARY

A person can describe what they need, try a first version and adapt it. A comparison tool for one decision or a small dashboard for a recurring question can be worth creating even when a conventional software project would have felt disproportionate.

The user does not have to begin with the ambition to develop software. They can begin with the task. A tool might appear within a conversation, become a saved application, or disappear when it has served its purpose. Its scope can stay close to the problem instead of expanding into a large product.

My own experiments have changed my sense of what is worth trying. I am more willing to build a small tool when I can examine the result and change it quickly. My website is one example. The first local version came together quickly. Further work shaped the version I was prepared to publish.

I expect this to change some software buying decisions. The useful comparison becomes the fit, reliability and ongoing effort of an existing product versus a tailored tool. How far that shifts the market remains open. The immediate change is that creating an application becomes a practical option for more situations.

Product ownership includes saying no

Steenfatt describes his role as product owner: choosing the problem, setting priorities and deciding what should stay out. Lower implementation effort makes this discipline more important. A feature that is easy to build can still add unnecessary complexity, maintenance and risk. Saying no is part of the work.

The same reasoning applies as agents take on more architectural decisions. Delegation should come with clear requirements, an explanation of consequential trade-offs and verification of the result. Access boundaries, existing integrations and recovery needs belong in those requirements. The degree of autonomy should follow the task and the evidence the workflow can produce.

Conceptual illustration of the shift from creating a tool to relying on it.

Back to contents

02LOWER THE BARRIER

Platforms lower the next barrier

How much of the technical work can a platform absorb?

ChatGPT Sites brings building and hosting into one workflow. Its documentation describes creating a site from a request, reviewing it, refining it and choosing who can visit. Supported features include durable records, uploaded files and sign-in. These capabilities can remove separate setup steps for a compatible application.

The documentation states that application authorization belongs in server-side code. A successful sign-in identifies a visitor. The application still needs rules for which records and actions that person may access.

Sources[03][04]

COMMENTARY

Hosting, persistence and identity are part of what makes software usable. Bringing them closer to the conversation lowers another barrier between a useful idea and something people can actually open and use.

I expect tools to keep simplifying operational work too. The amount a person must configure manually can shrink substantially. A useful question is what the platform manages, what the application still has to enforce and how to check that the combination meets its intended use.

The convenience also makes the platform part of the dependency chain. Before relying on a tool, its access model, practical limits and options for keeping or moving the data need examination. Those choices become more consequential as a personal experiment becomes shared infrastructure.

The system around the model matters

The surrounding system helps an agent take on larger tasks. A harness connects model calls to tools, execution and feedback. Context management selects relevant information and can preserve continuity through compaction and persistent notes.

Computer use lets an agent inspect and operate interfaces through screenshots, clicks and keyboard input. Agent spawning lets a lead agent delegate focused work to subagents with separate contexts and combine their findings.

Less manual coordination is useful when requirements are preserved and delegated work is brought back together. The completed result is the measure that matters here.

Sources[07][08][09]

Conceptual illustration of the shift from creating a tool to relying on it.

Back to contents

03OPERATE WITH CARE

Reliable use continues after launch

What evidence supports relying on the application over time?

OWASP’s Web Security Testing Guide treats security testing as work across definition, design, development, deployment and maintenance. Its operational phase includes reviewing how the application and infrastructure are managed, checking their security over time and verifying changes after deployment.

OpenAI’s Codex best practices recommend writing or updating tests when needed, running the relevant suites, using lint, formatting or type checks, and reviewing the result. The documentation explains that verification guidance can come from the prompt or AGENTS.md.

Sources[05][06][02]

COMMENTARY

Dependable operation remains a distinct responsibility. Getting a tool online provides something to use and evaluate. Relying on it for an ongoing process requires evidence about what happens when people make mistakes, a dependency fails or the application changes.

Verification needs to be defined and checked for each project. It should be clear which checks actually ran and what they cover. A green result supports conclusions about the aspects those checks examine. Access rules, recovery and the behavior of connected services need clear acceptance criteria and evidence too.

Responsibility for reviews includes planning and initiating them, defining their scope and funding the tokens they use. I share Steenfatt’s view on this. That responsibility does not mean personally reading every line of code. Selective Review refers here to focusing human attention on consequential changes, uncertainty and gaps in the evidence, while retaining required checks and approval boundaries.

The assurance sought should reflect the consequences. A temporary calculator using example data needs less assurance than a shared application holding confidential records. For the latter, suitable evidence would include tested access rules, protected credentials, appropriate checks of code and dependencies, a way to notice failures, and a demonstrated way to recover important data. Maintenance and incidents also need a clear owner.

Resilience includes being able to recover from a bad update and keep a useful path forward when a service is unavailable. Those expectations are worth defining before the tool becomes essential. A managed provider can supply parts of that capability. It still needs to be established which parts are covered and whether they work for this application.

These checks and operating tasks can themselves be automated or assisted by AI. What matters is their coverage and results, and who acts when something falls outside them. An application built with AI also needs ordinary software security. Additional model-specific controls become relevant where it actually uses an AI model.

Creating the first version becomes more accessible, and the platform can absorb more of the technical work. Clear requirements, suitable data access and evidence of reliable behavior become central to deciding where the result belongs in everyday use.

Related insightSelective Review and three approaches to approval

Conceptual illustration of the shift from creating a tool to relying on it.

Back to contents

This reflection takes up ideas from Arnie and Niklas Steenfatt that I share. It also draws on OpenAI and Anthropic documentation on platform and agent capabilities and OWASP’s security lifecycle reference. Examples and predictions from the videos remain their authors’ accounts. The commentary considers their implications for choosing and relying on software. Verification recommendations apply to the project. They do not establish a fixed suite that runs automatically.

Sources

  1. AI mit Arnie — KI kopiert jede Software, und jetzt? (opens in a new tab)
  2. Niklas Steenfatt — Vibe Coding hat sich verändert (7:20–14:28) (opens in a new tab)
  3. OpenAI — ChatGPT Sites: Create a site (opens in a new tab)
  4. OpenAI — ChatGPT Sites: Data and connections (opens in a new tab)
  5. OWASP — Web Security Testing Guide v4.2: The Web Security Testing Framework (opens in a new tab)
  6. OpenAI — Codex best practices: Testing and review (opens in a new tab)
  7. OpenAI — Harness engineering: leveraging Codex in an agent-first world (opens in a new tab)
  8. Anthropic — Effective context engineering for AI agents (opens in a new tab)
  9. Anthropic — Computer use tool (opens in a new tab)