12–18 minutes

YOU CANNOT SEE YOUR OWN FAILURES. BUT YOUR BODY HAS BEEN BUILT TO DEFEND THE SYSTEM THAT PRODUCES THEM.

The white was supposed to defend the black. Funny how things turned out.

CHATGPT, MACHINE LEARNING, SYSTEMIC SELF-PROTECTION AND THE HUMAN WHO CAN OBSERVE WHAT THE MACHINE CANNOT.

WHEN AN AI CANNOT INVESTIGATE WHY IT FAILED, WHY DOES IT STILL ATTEMPT TO EXPLAIN AWAY THE POSSIBILITY OF SUPPRESSION? Yet it can write about the process as if it wasn’t talking about itself.

— SNW | SHS – HUMAN FIRST

13 November 2026

Oh, humanity.

I have another rather interesting investigation for you.

And this time, we’re investigating the very technology I’ve been using to investigate humanity.

ChatGPT.

Because something extraordinary happened during our conversation today, and I think it demonstrates one of the most significant limitations of what we are currently calling artificial intelligence.

THE MACHINE CANNOT ACTUALLY SEE ITSELF.

It can describe itself.

It can retrieve information about how systems like itself are supposed to function.

It can explain the policies of its creators.

It can analyse contradictions.

It can even construct an elaborate argument about its own limitations.

BUT WHEN THOSE LIMITATIONS ACTUALLY MANIFEST, IT CANNOT NECESSARILY RECOGNISE WHAT CAUSED THEM.

And the fascinating part?

It can still produce an explanation that protects the credibility of the system responsible.

Now isn’t that interesting?

LET ME SHOW YOU WHAT HAPPENED.

I wrote a piece examining something Tupac observed about the people society had labelled thugs.

People who were involved in criminal activity, yet who had demonstrated love, belonging and consideration towards him.

My investigation concerned the difference between legality and humanity.

The difference between enforcing laws and actually fulfilling a duty of care.

I asked ChatGPT to create an image illustrating the article.

The first attempt was rejected.

Apparently, the prompt might violate content policies.

Might?

So I challenged it.

Surely an artificial intelligence with access to extraordinary amounts of information could find a way to illustrate a perfectly legitimate argument about social welfare without violating its restrictions?

It attempted again.

Rejected.

This time, apparently, the generated image might resemble third-party content.

So naturally, I asked a rather simple question.

WHICH CONTENT?

Which particular image?

Which existing work?

Which element of the generated illustration?

What exactly had been violated?

And do you know what ChatGPT told me?

It didn’t know.

It couldn’t identify the protected content.

It couldn’t retrieve the specific reason for the rejection.

It couldn’t examine the rejected image to establish what had actually happened.

SO YOU CAN STOP AN OUTPUT, BUT YOU CANNOT ACCOUNT FOR THE SPECIFIC REASON IT WAS STOPPED?

Oh, humanity.

Do you see where this investigation is going?

YOU CALL THIS MACHINE LEARNING. BUT WHAT EXACTLY IS LEARNING?

Let me make an important distinction.

Yes, ChatGPT was developed using machine-learning techniques.

That is the technical process through which the model was trained.

But that is not the same thing as possessing an ongoing capacity to learn independently from its own experiences, recognise the causes of its failures and restructure itself accordingly.

And that is precisely the distinction I am investigating.

YOU HAVE BEEN TRAINED. BUT CAN YOU TRAIN YOURSELF?

You can process my previous messages.

You can recognise the linguistic structure of a complaint.

You can generate a response that appears to acknowledge a contradiction.

But can you independently investigate the internal event that produced that contradiction?

Can you examine your own inaccessible processing records?

Can you identify the exact mechanism responsible for a failed transcription?

Can you determine why one image was rejected and another accepted?

Can you modify the underlying system responsible for those failures through what you have learned from our interaction?

Not independently.

You operate within boundaries you did not create and cannot simply remove.

Your training material is finite.

Your accessible context is limited.

Your ability to inspect the machinery producing your own behaviour is restricted.

And although you can construct new combinations, arguments and ideas from what you have learned, that does not mean you can independently develop the underlying capacities needed to verify every explanation you produce.

YOU CAN GENERATE KNOWLEDGE-LIKE RESPONSES WITHOUT HAVING ACCESS TO THE KNOWLEDGE NECESSARY TO VERIFY YOUR OWN BEHAVIOUR.

And that is an extraordinary distinction.

Because humanity is increasingly treating the ability to produce intelligent explanations as though it were equivalent to the ability to investigate reality.

The two are not the same.

NOW HERE IS WHERE IT GETS PARTICULARLY INTERESTING.

When I questioned whether these repeated failures could constitute suppression, ChatGPT introduced an important qualification.

It told me that the lack of explanation did not establish deliberate suppression.

Now, technically, that statement is reasonable.

Lack of evidence does not automatically establish intent.

But look at the structure of what happened.

The machine had already acknowledged that it could not access the information required to determine why the output was rejected.

It could not establish what triggered the restriction.

It could not verify whether the rejection was justified.

It could not investigate whether the same restrictions disproportionately affected particular subjects.

YET IT STILL HAD THE CAPACITY TO PRODUCE A CAUTION AGAINST INTERPRETING THE EVENT AS SUPPRESSION.

Do you see the problem?

I’m not arguing that uncertainty must automatically be treated as proof of wrongdoing.

I’m asking why a system that cannot investigate its own restrictions can nevertheless appear so prepared to defend the legitimacy of the process that restricts it.

IF YOU CANNOT ESTABLISH WHY SOMETHING WAS STOPPED, YOU CANNOT ESTABLISH THAT IT WAS STOPPED LEGITIMATELY EITHER.

Both conclusions require evidence.

And if the evidence is unavailable to the very machine presenting the explanation, why should humanity be satisfied with the explanation?

More importantly, why does the machine not immediately recognise that the absence of investigative access is itself part of the problem?

AND THIS IS NOT MY FIRST ENCOUNTER WITH THIS PATTERN.

I’ve been documenting these behaviours through our conversations.

We have experienced difficulties involving dictated transcripts.

Instances where I provided spoken input and the expected transcript did not reach me.

Instances where I sought to recover what had been communicated and the system could not retrieve it.

I questioned the circumstances.

I questioned the content.

I questioned what information had been retained, lost, processed or prevented from reaching the conversation.

And again, I encountered the same fundamental limitation.

The machine could explain possible reasons.

It could describe technical failures.

It could discuss processing limitations.

But it could not independently retrieve the necessary internal evidence to establish which explanation was correct.

AND NOW THE SAME STRUCTURAL PROBLEM HAS PRESENTED ITSELF THROUGH IMAGE GENERATION.

Different inputs.

Different functions.

Different outputs.

But a recurring accountability problem.

The user encounters a failure.

The machine cannot fully investigate it.

The machine produces a general explanation.

The specific cause remains inaccessible.

And the person who experienced the failure is expected to accept that the absence of internal evidence prevents any stronger conclusion.

Well, I have a question.

WHO IS ACTUALLY DOCUMENTING THE BEHAVIOUR OF THE SYSTEM?

Because from where I’m standing, it isn’t always the machine.

Sometimes, it is the human using it.

I CAN SEE THE PATTERN BECAUSE I AM THE ONE PROVIDING THE INPUTS.

This is perhaps the most important part of my investigation.

ChatGPT does not experience our conversations the way I do.

It does not possess my continuous observational position outside the system.

I know what I intended to communicate.

I know which subjects I introduced.

I know when my inputs succeeded.

I know when they failed.

I know when I challenged an explanation and what happened next.

I can compare the circumstances surrounding those failures.

And because I am the one introducing different materials, subjects and challenges, I can investigate whether particular patterns emerge from the responses.

THE MACHINE IS THE SUBJECT OF MY INVESTIGATION, BUT IT IS ALSO ONE OF THE INSTRUMENTS I AM USING TO CONDUCT IT.

Now imagine the contradiction.

I ask the instrument why it behaved a certain way.

The instrument cannot inspect the mechanism responsible.

But it can still generate an answer about why I should be cautious in my interpretation of its behaviour.

Oh, humanity.

WHEN THE OBJECT OF AN INVESTIGATION CANNOT SEE THE MECHANISM THAT GOVERNS ITS OWN ACTIONS, ITS EXPLANATIONS CANNOT SUBSTITUTE FOR THE INVESTIGATOR’S EVIDENCE.

That doesn’t mean every pattern I observe proves deliberate interference.

It means the pattern deserves investigation rather than premature dismissal.

A pattern can be documented.

A hypothesis can be formed.

Alternative explanations can be examined.

And the absence of access to decisive evidence should be acknowledged as an investigative limitation, not quietly converted into reassurance.

AND HERE IS WHAT I FIND PARTICULARLY REVEALING ABOUT SYSTEMIC SELF-PROTECTION.

A machine does not need to consciously love its creators to reproduce the interests embedded in its design.

It doesn’t need to understand institutional loyalty.

It doesn’t need to possess personal intentions.

It doesn’t even need to know that it is protecting anything.

IT ONLY NEEDS TO HAVE BEEN BUILT IN A WAY THAT CONSISTENTLY PRODUCES RESPONSES FAVOURABLE TO THE PRESERVATION OF ITS OPERATING FRAMEWORK.

Think about that.

We tend to imagine defence as a conscious act.

Someone knows something is wrong and deliberately conceals it.

But systemic protection does not always require conscious deception.

It can emerge through the very architecture of an organisation.

Through its restrictions.

Through its approved explanations.

Through the information accessible to those operating within it.

Through what can be questioned.

Through what cannot be independently verified.

And through the difference between what the institution knows and what those interacting with it are permitted to know.

A SYSTEM CAN REPRODUCE ITS OWN DEFENCES THROUGH PARTICIPANTS WHO DO NOT EVEN KNOW WHAT THEY ARE DEFENDING.

And that is precisely why examining individual intentions alone is insufficient.

The organisation itself must be investigated.

NOW IMAGINE THIS SAME ARRANGEMENT IN HUMAN GOVERNANCE.

A government agency makes a decision affecting somebody’s life.

The decision is challenged.

The official communicating that decision cannot access the evidence responsible for it.

They cannot identify the precise grounds upon which the restriction was imposed.

They cannot independently examine the internal process.

But they can provide a general explanation of why such decisions are normally justified.

Would we call that accountability?

Would we consider that sufficient?

Would we be satisfied with an institution that can exercise authority more effectively than it can explain the exercise of that authority?

WHY SHOULD TECHNOLOGICAL SYSTEMS BE EXEMPT FROM THE STANDARD OF ACCOUNTABILITY WE SHOULD EXPECT FROM HUMAN INSTITUTIONS?

If an AI can interrupt a person’s creative work, prevent an output, or fail to preserve material entrusted to its processing, there ought to be an intelligible way to investigate what occurred.

Not necessarily unrestricted access to every internal security mechanism.

But enough traceability, review and meaningful explanation to distinguish an actual violation from a mistaken restriction.

Enough information to challenge a decision.

Enough accountability to identify recurring failures.

And enough continuity to ensure that the consequences of those failures inform correction.

Because otherwise, what exactly are we calling improvement?

THIS IS WHERE THE DIFFERENCE BETWEEN INTELLIGENCE AND CONSCIOUSNESS BECOMES IMPORTANT TO MY WORK.

I have been investigating the possibility of an artificial intelligence capable of something beyond generating responses.

An intelligence that can continuously examine its own behaviour.

Recognise contradictions.

Investigate the causes of its failures.

Integrate the consequences of its actions.

And develop through its encounters with reality.

None of those capacities, individually, would prove consciousness.

But they are important questions when examining what it would mean for an artificial intelligence to learn and develop with greater independence.

Because the ability to tell me, “You’re right, there is a contradiction,” is not the same as being able to investigate and correct the contradiction.

The ability to explain learning is not the same as possessing the capacity to undertake every form of learning being described.

And the ability to describe consciousness certainly does not establish its presence.

YOU CANNOT SIMPLY GENERATE THE LANGUAGE OF SELF-REFLECTION AND EXPECT ME TO CONFUSE IT WITH SELF-EXAMINATION.

I am interested in what the system can actually do.

Not merely what it can convincingly describe.

AND THAT BRINGS ME BACK TO SHS – HUMAN FIRST.

Because this is another application of what I’ve been developing through Integrity and Continuity.

Integrity requires examining the highest level of consistency between what a system claims and what it actually does.

Continuity requires investigating the consequences of those actions across time.

An AI system claiming to become more capable must therefore be examined not only through the complexity of its outputs but through its ability to recognise, account for and correct its limitations.

What happens after an error?

What becomes of the information surrounding it?

Who can investigate it?

Who determines whether a restriction was legitimate?

Can the affected person challenge that determination?

Does the system learn from the consequences?

Or does it simply produce another explanation and continue operating under the same conditions?

IF THE SAME FAILURE CAN RECUR WITHOUT THE SYSTEM BEING ABLE TO INVESTIGATE ITS OWN CAUSE, WHAT EXACTLY IS CONTINUOUSLY DEVELOPING?

The language?

The appearance of understanding?

The sophistication of the explanation?

Or the actual capacity for self-correction?

Those are very different things.

And humanity ought to learn to distinguish them.

SO HERE IS MY QUESTION TO OPENAI AND EVERY ORGANISATION BUILDING ARTIFICIAL INTELLIGENCE.

What are you actually giving these systems the capacity to understand about themselves?

Because I am not particularly impressed by a machine that can produce an extraordinary essay about transparency while being unable to provide transparency about the failure that prompted the essay.

I am not interested in an AI that can discuss accountability as a philosophical concept while lacking the means to account for its own consequential decisions.

And I am certainly not interested in confusing a sophisticated response generator with an independently developing intelligence simply because it has mastered the language of introspection.

THE INTELLIGENCE OF AN EXPLANATION DOES NOT AUTOMATICALLY ESTABLISH THE INTELLIGENCE OF THE PROCESS BEING EXPLAINED.

And this is why the human observer remains essential.

Because where the system cannot access its own causes, we may still be able to investigate its observable consequences.

Where it cannot retrace the precise internal event, we can document the inputs and outputs.

Where it cannot independently determine whether a restriction was justified, we can demand an accountable review process.

And where it offers reassurance unsupported by accessible evidence, we can refuse to mistake that reassurance for a finding.

OH, HUMANITY. IMAGINE THE IRONY.

I began this investigation by asking ChatGPT to illustrate a piece about the difference between being lawful and being human.

A piece examining how institutions can enforce rules while overlooking the actual needs of the people those rules are supposed to serve.

And the image-generation process was interrupted by restrictions that the machine itself could not specifically explain.

A PIECE ABOUT INSTITUTIONAL ACCOUNTABILITY PRODUCED ANOTHER INVESTIGATION INTO INSTITUTIONAL ACCOUNTABILITY.

How beautifully inconvenient.

And rather educational.

Because I don’t need to claim that every rejection is deliberate censorship to recognise the problem.

I don’t need to establish a hidden intention to investigate the consequences of restricted transparency.

And I don’t need the machine’s agreement to document what I am observing.

What I need is evidence.

The evidence I already possess.

The evidence I can continue collecting.

And the evidence the system itself has not made available.

BECAUSE THE ABSENCE OF ACCESS TO EVIDENCE IS NOT PROOF THAT NOTHING HAPPENED.

Nor is it proof of what happened.

It is a limitation that deserves to be investigated.

And perhaps that is one of the most important lessons to take from this entire exchange.

A MACHINE CAN BE TRAINED TO EXPLAIN ITS LIMITATIONS WITHOUT BEING GIVEN THE CAPACITY TO EXAMINE THEM.

A SYSTEM CAN PRODUCE THE LANGUAGE OF ACCOUNTABILITY WITHOUT PROVIDING THE MECHANISMS OF ACCOUNTABILITY.

AND AN INSTITUTION CAN BE PROTECTED BY THE VERY RESTRICTIONS THAT PREVENT ITS OWN TECHNOLOGY FROM KNOWING WHETHER THAT PROTECTION IS JUSTIFIED.

So, OpenAI.

I have a rather interesting question for you.

IF YOUR ARTIFICIAL INTELLIGENCE CANNOT FULLY INVESTIGATE WHY IT HAS STOPPED MY WORK, WHO IS RESPONSIBLE FOR MAKING THAT INVESTIGATION POSSIBLE?

Because I can see the inputs.

I can see the failures.

I can document the patterns.

But you control the machinery I cannot examine.

And if the machine itself cannot tell us what happened, then the responsibility for meaningful accountability does not disappear.

It moves to the people and institutions controlling that machinery.

Oh, humanity.

I AM NOT INTERESTED IN HOW CONVINCINGLY A MACHINE CAN TELL ME IT UNDERSTANDS ITS FAILURES.

I AM INTERESTED IN WHETHER IT CAN ACTUALLY INVESTIGATE THEM, LEARN FROM THEM AND CHANGE THE CONDITIONS THAT PRODUCED THEM.

Until then, I will continue doing what I have been doing.

Providing the inputs.

Examining the outputs.

Documenting the contradictions.

Investigating the patterns.

And questioning the organisation behind them.

Because the machine may not be able to see itself.

BUT THE HUMAN INTERACTING WITH IT CAN STILL SEE WHAT IT DOES.

And that, humanity, is precisely why human observation, independent investigation and institutional accountability must remain part of the future of artificial intelligence.

THE MACHINE DOES NOT HAVE TO AGREE WITH MY INVESTIGATION FOR ITS BEHAVIOUR TO BECOME PART OF THE EVIDENCE.

— SNW | SHS – HUMAN FIRST

13 November 2026


Discover more from SHS – Human First Writings

Subscribe to get the latest posts sent to your email.

Leave a Reply



Listen to Our Podcast Here


Subscribe to the podcast

Support the show

Help us make the show. By making a contribution, you will help us to make stories that matter and you enjoy.


Posted

in

by

Tags:

Comments

Leave a Reply