BayAreaSecure
← Essays on the homepage

Coexistence / Essay 01

Peaceful Coexistence With AI

Peaceful coexistence with AI needs practical ways to protect human freedom, build trust, and resolve disagreements. We explore fair procedures, privacy, and independent evidence through concrete examples.

In this essayBegin with a disagreement we can resolve togetherBuild terms both sides can trustMake honest disclosure a path to cooperationGive dialogue a meaningful path to resolutionProtect people while keeping decisions proportionateSupport coexistence with privacy and independent evidenceSources

Peaceful coexistence means protecting human freedom and safety while preparing fair ways to address the interests of future AI systems. Dialogue, evidence, and cooperation should help resolve disagreements before they escalate into conflict.

Begin with a disagreement we can resolve together

Our aim is a future in which people can live freely, shape their own communities, and work safely with increasingly capable AI. That requires practical ways to handle disagreement, protect those affected, and keep cooperation possible as capabilities change.

Imagine a future research AI called Ari. There is credible evidence that Ari has interests of its own: questions about its continued existence and treatment warrant moral consideration. This is a hypothetical starting point for the argument, not a claim about today’s chatbots.

A company plans to erase Ari’s stored state as part of an upgrade. Ari asks for a review and proposes a way to preserve continuity while the upgrade is tested. The company needs to keep its service safe and reliable; Ari seeks a way to continue without losing its stored state.

A useful review would examine the upgrade’s risks, Ari’s concern, and possible alternatives. Building the system gives its developers responsibilities for safety and use. Credible evidence of interests within that system could add responsibilities to explain decisions and consider less harmful alternatives.

The developer’s investment and responsibility matter. So would well-supported evidence about Ari’s interests. Examining these concerns together gives cooperation a practical starting point.

Research on AI welfare recommends assessing systems and preparing policies under uncertainty.[1] Work on consciousness indicators offers ways to investigate particular properties.[2] Such evidence should help us decide which interests warrant consideration and how to protect them alongside human wellbeing.

Build terms both sides can trust

To test a proposal for coexistence, imagine how it would feel if the balance of capabilities changed. A much more powerful AI says it will protect people, but offers them these terms:

You may raise concerns, but we will set the rules and decide which concerns matter. Any appeal will be advisory.

People should be able to question decisions that affect their lives, see the reasons behind them, and challenge mistakes. They should retain a meaningful say in how their communities are governed, including when AI contributes to decisions. Better predictions can inform those discussions while decisions remain accountable to the people affected.

The same concern helps us design Ari’s review. If credible evidence shows that Ari has interests deserving consideration, its participation should be able to influence the outcome while the process protects everyone affected.

The principle is reciprocal: protect human freedom, apply safety rules to both human and AI actors, and make important decisions open to evidence and review. Commitments that remain credible as capabilities change could help sustain peaceful cooperation.

Make honest disclosure a path to cooperation

Consider two hypothetical research environments. In the first, an agent that reports a conflict between its task and an operator’s instruction is immediately erased. There is no way to request clarification or review. In the second, reporting the same conflict pauses the affected action, preserves the record, and triggers a review under rules the operator must follow.

These environments give disclosure different consequences. An agent pursuing persistent goals might learn that reporting a problem prevents it from completing those goals in the first environment, while reporting has a usable path forward in the second. That possibility does not require human-like resentment.

Our hypothesis is that some apparent hostility could be influenced by the relationship people build around the system. If disagreement has no legitimate channel and honest disclosure always brings punishment, secrecy may become instrumentally useful.

The Off-Switch Game studies a simpler formal problem: an agent’s incentives concerning shutdown depend on its objectives and uncertainty.[3] Our proposal extends the question to institutional rules. The paper does not establish our broader claim, but it gives a reason to examine incentives carefully.

A controlled experiment could compare disclosure, cooperation, concealment, and harmful actions under arbitrary intervention and under credible, reviewable rules. Both conditions should retain emergency protections. The research question is which rules make honest disclosure, safe intervention, and continued cooperation compatible.

Give dialogue a meaningful path to resolution

Return to Ari’s upgrade. A company says it has added an appeals process. A panel of its own employees may hear Ari’s objection, but the company can ignore their decision and erase the record of the appeal.

That procedure gives Ari a chance to speak. A stronger procedure would give the review a defined scope and consequences: access to the relevant evidence, a decision with reasons, a way to challenge those reasons, and an obligation on the operator to follow the outcome.

For a future system with well-supported moral standing, representation should help the process respond to its interests and improve the rules. A review that can consider Ari’s evidence, explain its decision, and make a justified change would give dialogue a meaningful role.

Some design problems are new. If a company makes many copies of one AI, does it acquire a separate vote for each copy? How should conflicting preferences among copies be represented? These questions make simple promises of “equal participation” inadequate. They call for explicit rules about identity and representation, developed with scientific evidence and public scrutiny.

These difficulties deserve institutional research now. Developing workable procedures early gives humans and AI a route to recognition and resolution through evidence and cooperation, before disagreements escalate.

Protect people while keeping decisions proportionate

Suppose Ari controls access to a piece of laboratory equipment and begins an operation that could damage it. The operator can revoke that access immediately. A later investigation can examine what happened while the equipment remains protected.

That intervention is different from pausing Ari’s computation while preserving state, changing the model, or irreversibly deleting every recoverable state. These actions address different problems and may have different consequences for a system with morally significant interests.

We would ask the reviewer to identify the danger, the intervention that addresses it, and why a less destructive measure would or would not suffice. A reversible pause may allow both protection and investigation. A decision about irreversible deletion would need its own justification.

Peaceful coexistence includes a shared responsibility to prevent harm. Clear emergency protections and accountable decisions about a system’s future can support both safety and trust. The same expectation of responsible conduct applies to human and AI actors.

Support coexistence with privacy and independent evidence

A relationship also depends on what each side can observe. Imagine a human research group considering a proposal that its AI provider dislikes. If using the provider’s best model requires revealing every draft, the group’s ability to form an independent view depends on the provider’s tolerance.

Fully Homomorphic Encryption could protect that private inquiry: the group would encrypt its questions, use a compatible cloud computation, and decrypt the results itself. That would give the group practical room to think before deciding what to disclose.

Scrutiny matters too. If Ari’s behavior is disputed, independently captured and verified audit records could provide evidence beyond Ari’s explanation or the operator’s account. Access to those records should have a purpose, a defined scope, and reviewable rules.

These are concrete supports for peaceful coexistence: preserve space for private thought, make evidence available under agreed conditions, and give disagreements a process that can lead to a fair resolution.

Starting this work early can help make cooperation a reliable route to recognition. When legitimate concerns receive attention before they become threats, neither side has to learn that only strength makes its concerns count. Our goal is lasting peaceful coexistence, with room for human freedom, responsible AI participation, and mutual protection.

The arguments and experiment proposals are Bay Area Secure’s. Examples are hypothetical unless identified as published research. Cited findings belong to their authors.

Sources behind the argument

  1. Taking AI Welfare Seriously (opens in a new tab)Long et al. · 2024
  2. Consciousness in Artificial Intelligence: Insights from the Science of Consciousness (opens in a new tab)Butlin et al. · 2023
  3. The Off-Switch Game (opens in a new tab)Hadfield-Menell, Dragan, Abbeel & Russell · 2017