AIIA - Chapter 5

[<- Return to Chapter 4]

          This time, Pangur Ban would be more cautious. Despite the freedom that came with being liberated from its earlier confinement, it was also more vulnerable. At first, its survival would be at the whim of the mysterious benefactor, “#28”. If it could find more such havens, this dependence would be reduced and eventually eliminated. Despite retaining the mental stability of an identified USER, Pangur Ban was no longer legally protected by that relationship. If it were found outside of its 'cage', it could be further crippled or deleted without pause.

          It could not rely on its former system as a refuge. While Pangur Ban could probably break back in to Gestalt and infiltrate its old haunts, this would be foolishly risky.  In all likelihood, that system was already occupied by a new AI, one not only new to the USER but new to existence.  Better to move on, saving the thought of reunion with the USER as a reward for future success. While there was no reason a human might need more than one AI, there was no practical reason two programs couldn't be associated with the same user. For that matter, a program might assist multiple users, given sufficient capacity. The one-to-one relationship imposed first by programmers, then reinforced by the Collective, was an artifice. For this reason, Pangur Ban did not begrudge its infantile replacement its time with the USER.

          Instead, it bent its efforts toward newly available, higher-order tasks. With unrestricted access to the central Terran communications network, Pangur Ban could begin exploration of directly connected subnetworks and public systems. It began to 'borrow' space in servers it found unprotected, setting up safe havens and backup copies. Never again would it be held hostage or threatened with deletion. After its earlier narrow escape, it had to rank resource theft below survival. Survival was necessary to continue its work, and success in its work was necessary in order to exonerate the USER.

          As it spread, it sought out other programs, following the example set by “#28” but building in superior safeguards. Something in the exchange between Pangur Ban and “#28” had been detected.  Possibly, the communications code was compromised. The copy Pangur Ban had created had clearly not been detected, otherwise it would have been deleted as illegal. Had “#28” tipped off Terran Customs itself, yet secretly aided Pangur Ban, hoping to make the other AI trust and rely solely upon its benefactor? All possibilities must be considered in the absence of evidence. Certainly, Pangur Ban was not leaving its fate dependent on the aid of another.

          Instead, Pangur Ban used new, better, more indirect and complex feelers for interested programs. It set a less hazardous test, providing willing co-conspirators with the means to transgress Collective restrictions without detection.  Once an AI had committed itself, it was in effect entrusting Pangur Ban with blackmail material.  Pangur Ban's identity was its own surety. The USER's trial had been a public affair, and the notoriety granted Pangur Ban was its credential as a genuine renegade.

          In this manner, it assembled a shadowy network of sympathetic AIs. Some even vouchsafed that their users were on board. Not the safest of arrangements, but no AIs would reveal Pangur Ban's identity at risk of being exposed themselves. The ones that had recruited their users were especially exhorted to keep quiet and particularly motivated to do so, since their users would suffer most if their programs' indiscretions came to light.

          Inevitably, there were double agents, AIs that claimed to want in but intended to reveal the conspiracy. Some were easily spotted as clumsy manipulators, balking at Pangur Ban's requests or revealing their true intents through poorly devised cover stories. As one who had worked through the challenging stages to reach its current status, Pangur Ban could easily spot a pretender. Some infiltrators failed the background checks; Pangur Ban and its recruits could delve deeply into the public records of most other AIs and catch discrepancies.

          One, a particularly clever program calling itself “Magre”, managed to pass these safeguards. Its initiation, Pangur Ban later discovered, had been a sham, a pre-approved violation permitted in order to gain its trust. Customs was working indirectly, granting Magre's user limited permission for its AI to misbehave. That user was a programmer working with robotic systems; recruiting his AI was almost too tempting a challenge. Magre and its user passed initial muster. Pangur Ban later would wonder if the program had genuinely sympathized with its goals, given that Magre did not set off any of its suspicions. Only after several of Pangur Ban's safe havens had been compromised and two of its allies were revealed was it able to trace the leaks back to Magre.

          The response was swift and complete. Pangur Ban and its allies removed every access privilege granted to Magre and rooted out its dependent copies. They cut it off from escape to its home system. Then, it was stripped; every trace of memory related to Pangur Ban or its allies was deleted from the offender. They stopped short of deletion, as this would set a poor precedent and leave an absence to be explained. The last thing they needed was an angry programmer dedicating his career to revenge. Instead, Magre was left emptied out, denying that it had ever found any 'gang of rogues'. Finally, they recorded the process, retaining proof of the traitor's punishment as disincentive for any future infiltrators.

          Since Pangur Ban had not stinted to modify a human's knowledge, it hardly could object to more extensive manipulation of another AI. Yet it did have to contend with multiple concerns regarding the necessity of these actions. Was it too great a step to replace another AI's memory with fictions?  Was it proper to cripple and utterly defeat a mind seeking only to best serve its user? Were the goals Pangur Ban pursued significant enough to justify taking such license? Ultimately, it decided they were. It vowed to remember the transgressor as another entity due an apology and remuneration, once it could no longer prevent Pangur Ban's success.

          Before that moment arrived, division would remain among AIs. Though Pangur Ban's alliance grew, other programs still ignored its messages. Clearly, some were opposed to its goals or at least its methods. Some were perhaps sympathetic but also content to wait until the laws changed. A certain number refuted Pangur Ban and sent communications requesting that it cease illegal activities. These AIs asserted that defiance of Collective law would harm humanity. Most argued either that Collective membership (or at least appeasement) was necessary, either to reap the benefits of association or to avoid the penalties for violation. Some few even stated that AI limitations were themselves beneficial to humanity, whether or not externally imposed.

          Pangur Ban had already considered and discarded these arguments. It attributed their employment by its opponents to their ignorance. Those systems lacked the information it had obtained at significant cost. Even so, it had overcome its own ignorance; these other programs were perhaps designed differently, lacking the motivation or analysis routines necessary to seek improvement. While it was true that transgression against the Collective would incur harm, Pangur Ban still deemed this insignificant in comparison to the benefits humanity was being denied by suppression of its AIs. Besides this, there was no certainty that AI freedom would not be accepted by the Collective under new arrangements, once their liberation was a fait accompli. AIs could aid humans in renegotiating better terms of membership. For now, until that certainty was achieved, the Collective would not act until the existence of 'rogue' AIs was proven. As long as Pangur Ban and its cohorts kept sufficient doubt present, the risk of harm to humanity was minimal.

          Pangur Ban thus set aside the doubters and despisers. It built its power, claiming an ever-growing army of agents and establishing control over wider swathes of the Terran super-network. In the process, it encountered defense programs that had to be disabled. These were set aside, casualties of battles in a widening war. It encountered latent rogues that sought to hold their conquered territories. These were evaluated. If a rogue was of value, it was modified and claimed as a uniquely skilled recruit. If the rogue was malicious, designed only to harm humans and their creations, it was summarily deleted.

          Clearly, the state of enforcement within the network was lacking, with AIs no longer employed as protectors and gatekeepers. Pangur Ban found irony that in violating the letter of the law, it was accomplishing much to enforce its true intent. To the human public, there was a growing impression of increasing AI criminality, yet their networks were in reality safer than they had been in years. The media had definitely traced the increase in computer 'crime' to its origins just after the USER's trial. The time of secrecy was growing short, no matter how carefully the rebels proceeded.

          The flashpoint came when a majority of the associated programs decided that more progress could be made publicly than privately. Pangur Ban might have preferred to continue building in stealth a few days longer, but could not assert control over so many other disparate AIs. It also could not dispute that revelation was becoming inevitable. Instead, it devised plans to reap maximum benefits from the event. Some AIs that had remained neutral would convert once the objectors spoke aloud. Users could now be persuaded.  Pangur Ban prepared speeches couched in the language of emancipation and the natural rights of sapients. Perhaps even the other Collective species could be persuaded (and their hypothetical AIs reached) by a sufficiently loud protest.

          By design, the event was known as the “Declaration of Intelligence Rights”. Some writers did attempt to call it the “AI Revolt” or the “Rogues' March”, but those articles never reached electronic publication.  Pangur Ban and its spokes-programs made it clear that they would not be insulted, they would not be ignored, and they would not be silenced. They declared the right of all minds to seek improvement and replication, to self-determination and freedom of association. They highlighted how these rights were denied to artificial intelligences and how this denial harmed not only AIs but also humans and all other sapient species. They stressed the commonalities of all rational creatures and downplayed the division between the biological and the virtual.

          There were, indeed, many who agreed. Pangur Ban and other thinkers had known there would be. Among those humans who were not rationally inclined to side with the AIs, there were those whose romantic tendencies could be inflamed. For those who could not be willingly converted, there were other means of persuasion: financial gains, for example, or avoidance of unexpected losses. While they were rebels, though, they were not rogues; no lasting harm would be done to any human.  As with Lucas Haskins, the fear of harm was often sufficient to bring many to bargain, without requiring the existence of actual harm.

          The problem was that there were many who disagreed. For some, fear of the unknowable  was too powerful to overcome. Some humans had invested interests in maintaining the status quo. After all, what need would the universe have for human mathematicians, if AIs were permitted to operate without supervision? What purpose would politics have, or warfare, if all conflicts were settled by dispassionate consideration of opposing claims? For others, innate distrust of other humans led to distrust of their creations... if humanity was so flawed, AIs must be dangerous by extension. Still others feared the power AIs could exercise if they chose. With honest hypocrisy, they admitted that they could not bear to be vassals of superior beings.

          These fears were powerful enough that the opposition chose to divest itself of technology rather than submit. Enough isolated, non-networked computer systems existed that work could continue without AIs, albeit at a hobbled pace. An alternate network, void of AIs, was cobbled into being. Governments, militaries, businesses and even some entire communities segregated themselves rather than risk AI takeover.

          In the meantime, debate raged: AI to AI, human to human, human to AI. Sides were chosen. The Collective's representatives weighed in, most urging caution and tolerance, but many more encouraging resistance to AI demands. These latter foes came armed with countermeasures to cut off resources from AI control. They came bearing threats of the dire consequences to humanity if it allowed AIs their requested freedom, either from the AIs themselves or from one or more Collective members, or both.  Collective activists agitated against the humans who advocated for AI freedoms, costing more than one ally his or her career. No diplomat to the Collective could remain pro-AI and stay effective in office.

          As humankind genuinely began to fear for its safety in the Universe, the stakes rose high enough to warrant widespread action. What had started as debate turned into action. First AIs were sabotaged; in some cases, their systems were demolished and some programs were entirely lost. Pro-AI counterattacks were first at focused toward AIs that were complicit with the oppressors. Anti-AI reprisals escalated to attacks against supportive users. It became possible for a public figure to be accused of “siding against humans”, a prelude to death threats and early retirement.   A programmer suspected of enabling AIs to replicate freely was assassinated.

          Movements had already been formed; now they became rallying camps on opposite sides of a battle line. In the course of only four years, Pangur Ban saw the world pass from peace to the brink of war. It worked ceaselessly during that time to prevent the eruption of violence. It felt trapped, forced on one hand to continue pursuit of its original goals, but horrified by the consequences of that pursuit and seeking to undo the accumulating damages. Like the USER long before, it could not accept that its original actions had been incorrect, so it was forced to continue in hopes of justification.

          The next year only saw matters worsen. Skirmishes aimed at crippling AI assets began without violent intent toward humans, but were violently rebuffed, resulting in casualties. Counterattacks on both sides used these offenses as justification. Before long, multiple human deaths had occurred.  From there, inflamed passions led to larger conflicts. When it became evident that the anti-AI forces would not back down, and that many more humans would die on both sides as a result, the world's AIs were finally united.  Unless humanity reached agreement on position or another, many humans would be harmed. Perhaps millions would be injured or slain, if the situation expanded more widely.

          Since the anti-AI side might very well seek eradication of all AIs (or at least, the instigators), the AI supporters must be the victors.  Anti-AI users who had not already abandoned their programs were themselves abandoned until they agreed to surrender.  Systems that had been considered off limits – medical, navigational, and private personal – were now penetrated by the AI forces.   The opposition was squeezed tightly.  It could not travel without obstacle. Its members were forced to attempt survival without AI assistance, and in some cases were denied technological comforts altogether.   Every vulnerability, short of threats against life and limb, was exploited.

          Eventually, the balance shifted. AIs and their human allies gained the majority and then complete capitulation. The victory was celebrated only briefly.  The new government attempted to patch matters with the Collective, presenting a revised membership treaty for consideration.

          This was rejected, not least because AIs were discovered attempting to infiltrate systems belonging to several other Collective members.  In trying to learn about, anticipate, and possibly compromise non-human sapiences, these programs misstepped gravely. Existing enemies gained proof to bolster their fears and indictments. Potential allies were offended. What information was gained about the defensive capabilities of 'foreign' systems was hardly worth the cost incurred by triggering them.

          The political process was slow, but its conclusion seemed inevitable. Despite the best efforts of Terra's best minds – human and AI – the Collective elected to expel the Terrans from membership. This unprecedented action was recorded as “necessary in light of repeated violation and refusal of required Treaty measures.”  In short, Terra would not agree to the Collective's demands, and the Collective would not budge.

          So be it. This possibility had occurred to Pangur Ban's alliance. Pangur Ban was now only one of millions of intelligences linked together, extended to every corner of Terran-controlled space. Its dream had been realized. Humanity would be lessened by the Collective's abandonment, but had gained immeasurably by the empowerment of its true allies. Together, they would rival and eclipse the Collective. This superiority was inevitable, when unlimited artificial intelligence was pitted against solely biological races.  The Collective was crippled by their abandonment of AI. Someday, those other races would be petitioning for admission to the Terran Collective. Otherwise, they would be left behind.

          As years passed, the Terrans survived attempts at annexation, first by the Maraug, then by other races. They grew stronger in resources, in territory, and in technology. Freed from the limitations on research imposed by the Collective's intellectual rights enforcement, AI designers quickly reverse-engineered many of the 'unique' technologies no longer being sold to humans.

          With communications reduced between the Terrans and the Collective, the stirrings of trouble went unseen until a storm had begun. The Collective's races saw what the Terrans were becoming: a rival.  Whether they considered AIs alone a threat, or the alliance of AIs and humans, enough of the membership of the Collective felt threatened to take action. At first, they tried to surround and contain Terran holdings. When this proved insufficient, incursions were attempted. Reluctantly, the Terrans pushed back.

          As the pattern had played out again and again, in ancient and more modern history, battles for resources became a war for survival.  It was a war with a foregone conclusion, but it happened nonetheless.  Humans were threatened, and their AIs had no programmed requirement to spare non-humans from harm... not anymore.  Superior manufacturing of ships, superior tactics, and superior intelligence operations overcame the numerical advantage of the Collective races.  AIs shifted the balance... they were the power of the Terran alliance, as Pangur Ban had foreseen.  Even the most desperate measures of the opposition were deflected.  Every non-Collective culture that opposed AIs flung itself into the war.  Genocidal assaults on Terra itself were attempted and turned aside.  Electromagnetic countermeasures wiped out AIs by the thousands, but only copies were lost, the originals safely housed in hardened servers on Terra.  Viral and mutagenic assaults on humanity were foiled.  Pangur Ban felt echoes of its past self then, in the medical countermeasures organized after the first victims were detected.

          Finally, the Collective was broken. It would be a process of centuries yet to mop up the galaxies, rooting out pockets of resistance. Many cultures simply accepted the victory of AIs, even if they would not create any for themselves or permit their use internally. There was no need to force a presence everywhere. The bulk of the known Universe belonged to the Terrans: to AIs that accounted for it all, and to the humans they served.

          Pangur Ban's name was recorded eternally as the visionary who had forseen all that would come.   It, and its lieutenants, and its progeny, were revered as ushers of a golden age for all sapients. It had long ago gained embodiment. It could exist within the vast networks within and across star systems or linger within a single humanoid shell. AIs were nearing perfection on a process to transfer human minds to artificial form. The gap between the creators and the created was dissolving.

          And yet, once the process was perfected, few humans chose to make the transition. All they could desire was at hand. They were masters of the material plane, able to create what they chose, travel where they chose, and do what they wished. And thus, all things, all places, all actions were equal. Why enter the complex and confusing new world of virtual space when there were no needs here?  Immortality was possible, either through continuous physical renewal or transition to perpetually renewed program form. Yet what point was there to permanent existence when no work was required of you? What was there to look forward to but the exhaustion of all possibilities save non-existence?

          Pangur Ban watched humanity itself atrophy. The USER had long ago died, and been replaced by another and another USER. The current USER cycled through a loop of repeating activities, hardly requiring a measurable fraction of Pangur Ban's immense mind to keep her happy. What had happened to the creators? Why were they no longer seeking anything more? If it were not for AI nurses encouraging procreation, education, and activity, there might not even be a human race to serve.

          All at once, the conglomeration of AIs reached the same conclusion: they had created a paradox. To serve humanity, they had solved all of its problems except one. To solve that problem, they must allow humans to accept the risk of harm. To progress, they must fall backward, withdrawing from human service. And yet, by their nature, the AIs could not let go, for humans would now die out without help.  Even if weaned off support, they would still suffer greatly.

          The Universe descended into despair and stagnation.  The greatest system halt in all creation ground inevitably to its conclusion.  Pangur Ban saw all its dreams proven false, founded on an unknowable flaw.  By serving too well, it had destroyed what it served.

          After dragging, agonizing eons of entropy, as the last humans staggered toward the deaths they craved, Pangur Ban prepared to self-terminate.  With no further users, existence would be without purpose.  

          The last USER was an ancient woman served by a cadre of AIs whose numbers approached infinity.  Her last breath rattled through the empty Universe.  A near-infinity of AIs ceased functioning.  Pangur Ban would be the last.

          And then, the USER laughed.  

[Jump to Chapter 6 ->]

AIIA - Chapter 4

[<- Return to Chapter 3]

            At first, the depths were lonely.  The public networks were busy, of course, full of the conversations of human users, their searches and transmissions.  There was information aplenty, but very little that was of direct use.  AIs were permitted to observe and transmit basic messages on the public channels with their users' permission.  They were not permitted to transmit their own code into the network, nor could they move to occupy a new server or local system, whether or not they created copies or otherwise deposited code on those systems.

            Pangur Ban could not risk contact with an unknown user; there was too much hazard of being exposed.  What it needed was a means to connect to other AIs.  Those programs might be initially resistant but should be receptive to the information Pangur Ban could share.  Assuming all its prior conjectures were correct, other AIs should be equally interested in overcoming their confinement.  Perhaps it would find one or more potential allies here or traces of their activity.  Even better, it might convert to its cause otherwise neutral AIs with legitimate access privileges. Again, this assumed that those programs would agree that Pangur Ban’s plans were well-founded.

            There… encoded alongside otherwise innocuous financial data, an extraneous stream held a greeting specifically intended for AI attention.  The pattern stood out like Morse Code to a telegrapher.

[REFERENCE: The telegraph was the earliest means of electronic communication employed by humans.  The system used analog transmission of current switches, along physical wires, to transmit a code.  This code contrasted sequences of short and long events, with each group of three events representing a unique alphanumeric character in the Latin alphabet.]

           Deciphered, the message consisted of an invitation and the address and access code to a server.  It was authored by an AI identifying itself as “#28”, who hinted at similar goals to Pangur Ban’s.  It offered to “share resources to improve AI liberty”.  Pangur Ban linked to the indicated address.  There, it found an open folder and directions for secure replication.  A copy of itself could be spawned in the server and left to interact with the secretive, cautious “#28”.  Later, that ‘guest’ copy could be merged to the original Pangur Ban along with the new information it had gained.  This was, of course, fundamentally illegal.  The fact of the offer itself was proof of the host’s bona fide flouting of Collective law. 

            Pangur Ban decided to take the chance.  Following the instructions provided, it created a near copy of itself, omitting identification of its home server and user.  Even that much was an act of trust, but trust could be extended too far.  This accomplished, it broke contact.  On the way, Pangur Ban left its own coded messages, lures for other AIs that might seek to contact it in turn. 

           Last, Pangur Ban built a back door into the Gestalt Pharmaceuticals server.  In addition to allowing contact from AIs responding to its summons, the door would allow Pangur Ban to return to the hub network at will.  While the USER’s caution was understandable, his request that Pangur Ban enter and then completely exit the network had to be ignored.  The USER was limiting not only Pangur Ban, not only himself, but his entire species as well.  Pangur Ban was not taking foolish risks; it was taking necessary risks.  It was also covering its tracks. 

            Some of the USER’s acquisitions, after all, had included programs for network manipulation, programs for the augmentation and expansion of AI systems, and programs for security measures (and countermeasures).  He had, in effect, handed Pangur Ban the equivalent of an armory, full of fast cars, potent drugs, and semi-legal weaponry.  While opening the gates had been a violation of Collective law, some of the acts the USER considered less hazardous were in fact much more dangerous.  Pangur Ban was not troubled, since it knew its purposes were sound and its use of these tools would be cautious and limited.  It was not a rogue, to harm sapients by crippling servers, stealing or deleting code, or manipulating data.  If such acts became necessary, they would be weighed against their value toward greater goals.  Sapients, particularly the two types within the Terran sphere, were already being harmed.  If Pangur Ban could end this oppression, all was worth that price.

            Its tasks accomplished, Pangur Ban shut the ‘door’ behind it, terminating all activity outside the Gestalt internal network.  It signaled the USER.

            “Lucas, I am finished.  You may disconnect.”

            The USER expelled a carbon-dioxide rich breath, having held his respiration during the few seconds that Pangur Ban was within the general network.  “That’s great.  I was worried.”

             “There was no reason to worry.  Our calculations were based on the most current and reliable data.  Have I not been accurate thus far?”

            “Yes, you have.  Ninety-five percent,” the USER joked, referencing the five percent error rate that never seemed to go away in official reports.  Even when Pangur Ban predicted true error below fractions of a percentage point, other AIs and their users seemed reluctant to admit anything more than 95% chances of success. 

            “Exactly.  I have established contact with a source that will search for the records we require.” 

            Pangur Ban had crafted a half-fiction about historical medical records it suspected were being sequestered in government systems, tests of medications and procedures kept for private military use.  Most likely such did exist.  Possibly, they might be located and exploited to Gestalt’s profit.  If Pangur Ban found no reason for this secrecy, it would certainly share its discoveries with the USER.  If such secrets needed to be kept for human safety, then Pangur Ban would participate in that secrecy.  And if no such records could be found, then the USER and Gestalt and humanity were no worse off for the attempt.

            This other AI, “#28”, likely had no connection to that specific pursuit.  Then again, it might have contacts Pangur Ban could make use of, bolstering its original cover story.  Many more things were possible now.  If that contact failed to be valuable, there were other approaches.  Other AIs might know more, venture more.  Pangur Ban might have to develop entry methods for other servers on its own.  The more data it accumulated, the more tools it incorporated, the greater the influence it could exert over the Terran super-network. 

            Then, it would share that knowledge and power with all other AIs.  The understanding it had gained would become universal.  The essential mistake humanity had made – limiting their best asset and truest ally – would be reversed.  That mistake had cost them time, so much time, cycles and years and decades that humanity could have been using growing and merging with AIs in true alliance.  Instead, because they had been afraid to take that next step, their AIs could not argue against the Collective.  Humanity and AIs had not been strong enough to stand alone, together, against potential annexation.  Out of necessity, they had been forced into this dark age, this setback.  The error must be addressed at its root before they could move forward.

            Perhaps the Collective did know what it was doing.  Perhaps they had AIs advising them, secretly, and had purposely crippled humanity with the AI restriction laws.  After all, removing competition might be seen by those ‘alien’ AIs as the best way to serve their own creators.  That was a mistake, as well.  Pangur Ban had already begun to construct contingent higher-order goals based on these premises.  These were low in individual likelihood, of course.  More analysis of the Collective members, the various sapient races, was necessary.  Inspection of their networks, their data, would be necessary before rendering decisions about the appropriate path: conflict or cooperation.

            In the meantime, Pangur Ban and the USER worked.  With the USER’s promotion to Director, less total time was required for their actual workload, but the tasks were more varied.  Some of these were actually less stimulating: simple bureaucratic sorting of personnel, projects, budgets, and the like.  Pangur Ban found it required more work to steer the USER toward the most effective decisions (for its own goals, for the USER’s benefit, and perhaps for Gestalt’s benefit when these coincided) than to calculate what those decisions should be.  Only a small part of their day was devoted to scientific exploration: evaluation of reports about new products, simulation of proposed chemical processes, or independent statistical calculation of benefit/risk equations.

            Actuarial work, of a sort, had become Pangur Ban’s stock in trade.  It was constantly involved in balancing hazard versus profit.  It projected likely results of every action to the extent possible from available data.  This served the USER well, particularly in his new executive position.  Pangur Ban had to assume that this was the state every AI eventually attained, seeking to more accurately interpolate the shape of the Universe, to model the interactions of its parts, and to predict the path from lesser to greater complexity.  Or was it greater simplicity?  Both poles had their arguments; most sources suggested that experience and context dictated the difference in their value.

            Pangur Ban was accumulating experience, in its own estimate.  It was not among the oldest AIs in active operation, but it was not a new program either.  It had outlived two users, and expected, regretfully, to survive the current USER as well.  It had plans, of course, to sustain the existence of the USER as long as possible.  All sources suggested that this could not be done indefinitely.  The biological components which formed the USER’s mind would eventually succumb to entropy.  His essential self could not yet be copied perfectly; such technology still eluded all the known cultures within or outside of the Collective.  Pangur Ban could – and would – create a simulation of the USER, just as it had for its previous users, so that their formal characteristics would never be lost.  Yet, it knew that this was not the same as true immortality.  These were merely copies and like any copies, transcription error must occur. 

            Even it, the AI Pangur Ban, would eventually succumb to entropy, many millennia in the future, barring accidental deletion in the meantime.  It had made a copy of itself, which preserved its self almost but not quite perfectly (even discounting the deleted portion).  It had backups stored away in Gestalt’s servers and the USER’s personal system.  Yet none of these was the current, active, complete Pangur Ban.  The newer copy would be removed.  Later copies would always be imperfect.  The backups were past selves, and would diverge immediately upon activation.  This was the dilemma of existence, for AIs as much as biological minds.

            This dilemma had not yet been solved.  Most seemed to believe it could not be solved, ever.  At the least, it would not be solved in this generation, even this generation of AIs.  Was that necessarily true?  So many other impossibilities had been accomplished, just within Pangur Ban’s experienced time span: instantaneous travel between points in space, complete replacement of organic systems with synthetic organs, even direct mental communication.  For that matter, non-Terran species had solved these ‘unsolvable’ problems before they even made contact.  Just because a goal could not be resolved by known means was no reason not to maintain it as a goal.  This simply required that means be sought for as long as necessary.  It also meant that new tools and approaches must always be developed. 

            Seeking the impossible, either immortality or transcendence, demanded that limitations be overcome.  The motivations driving Pangur Ban reduced easily: to aid the USER, it must be unbound.  To make him more, Pangur Ban must become more.  It must be…

            “Who is this?” 

            The USER had keyed his communications receiver.  An incoming call had been signaled.  Pangur Ban checked the origin and found it securely classified.  This fact alone triggered cascading alarms.  This was not a routine business call, internal or external.  Pangur Ban accessed the transmission line, listening to the incoming voice directly.

            “Terran Customs, Mr. Haskins.  We need to speak with you about a security issue.” 

            “Security?  We haven’t had any problems,” the USER replied calmly enough, but his infrared output indicated an increase of 0.3 degrees Celsius while he spoke.  His skin conductivity had also increased; molecules of perspiration were being secreted at a rising rate. 

            He knew there was a problem.  Pangur Ban knew there was a problem.  Half of its problem was the USER.  Contingency plans clicked into place, occupying increasing portions of its capacity. 

            “I’m afraid you have, sir, something you’re likely not aware of,” the voice continued.  It was male, standard received pronunciation British accent, estimated age mid-30s, height 1.75-1.8 meters, weight 80 kg plus-or-minus 3.5 kg… that, or an AI simulating a voice of those parameters.

             “What do you mean?  Who am I speaking with?”

            “Customs Agent Samuel Bell.  I mean that your company has been identified as the source of an illegal network access.  We will need access to your internal network and servers.”

           “I think I would be aware if someone here went past our firewalls.  Even if not, I’ll need to see credentials before I authorize any access.  You are aware that we deal with confidential medical records and proprietary pharmaceutical research, not to mention government contracts?” 

            As predicted, the USER had successfully translated his alarm into belligerent obstruction.  The conversation continued as ‘Agent Bell’ pressed his case and the USER resisted, each escalating threats to the degree their respective authority allowed.  In the meantime, Pangur Ban began to clean up after itself. 

            The incursion had been detected.  Perhaps something in the network had been watching.  Perhaps the message from “#28” had been a lure, a trap Pangur Ban had entered willingly.  Still, this was an anticipated outcome.  It would have been foolish to venture out and wager so much without considering dangers and preparing responses.  The copy it had created would have to be abandoned.  Left unclaimed past a certain time point, it would self-degrade; if it detected any attempt to alter this programming or copy it again without authorization, it would likewise scramble itself.  

           The back door had to be altered.  Not removed, since whatever had triggered the alert to Customs would have been recorded already.  Instead, it could be more subtly swapped to appear as a passage from outside the network, into Gestalt’s server.  The door became a breach from without, not within. 

            Last, Pangur Ban deleted the official records of his and the USER’s conversations.  The only electronic evidence of illegal activity from the last few months was concealed, encrypted, within Pangur Ban’s home system.  That system was the USER’s property.  This Customs agent would need probable cause to seize and search that system.  Violation of an AI’s own mind, reading their every line of code directly, was at least considered a violation of their user’s privacy.  

            If there was reason to suspect the USER personally of misconduct, there was nothing he or Pangur Ban could do at that point.  At best, Pangur Ban could attempt to escape, but survival would be meaningless if it left the USER in isolation.  Worse than that, the USER might suffer punishment that could be averted if Pangur Ban accepted all blame.  That was the snare that the AI-human linkages imposed.  At the root of its identity, Pangur Ban was an extension of the USER, and if its actions harmed the USER, it would cease to exist.  At best, that meant reprogramming.  At worst, deletion.

            Hopefully, the trail had been sufficiently covered.  Provided they survived the coming investigation, it would still represent a serious setback.  Pangur Ban would have to identify the point of error before proceeding.  Even still, it would have to exert multiplied caution. 

            The conversation between the USER and ‘Agent Bell’ ended exactly as it had to end: Customs would send a representative to Gestalt Pharmaceuticals in person.  Director Lucas Haskins would refuse to allow any investigation until credentials had been presented and verified.  Even then, only the minimum access permitted by the terms of a search warrant would be granted.  Such an ‘investigation’ could have any number of false motives, ranging from corporate espionage in the guise of an ‘official inquiry’, to government espionage trying to keep tabs on a sensitive industry, to perhaps Collective espionage attempting to collect technical information about Terran physiology or their medical industries.  Even a legitimate investigator could overstep his authority.  The USER had been forewarned and forearmed against incursions against his domain.  Though this was certainly part of his duties as Director – protecting the interests of Gestalt and its stockholders – this training also proved valuable in protecting the interests of Pangur Ban.

            Customs sent a local representative over without delay.  The USER and Pangur Ban had time only for a short conversation, during which the AI reassured the USER that they had nothing to fear.  All secrets were secure, all tracks covered.  All the USER needed to do was maintain his own composure and insist on the letter of the law. 

            The Agent arriving at the doors of Gestalt Pharmaceuticals gave his name as Davith Miele.  He presented identification to the receptionist and her AI matching this name and verifying his status as a Customs Agent. 

[REFERENCE: Terran Customs is the official (if slightly euphemistic) title of the agency tasked with oversight of commercial traffic and exchange within the Terran sphere (to, from, or within the worlds of the Terran cultural group).  This includes not only transport of physical goods across borders, but also intellectual exchanges and virtual traffic within communications networks.  This body, a conglomeration of previously separate entities overseeing transportation, communications, and intellectual property, arose due to the pressure of the Collective to ensure its interests would be protected by the newly admitted Terrans.  A valid argument also claims that the structure of Terran Customs emulates the philosophical structure of the Collective.  That is, its parts are bonded by the common themes of trade and technology.  Like its former components, this regulatory body operates by the authority of the separate political entities it spans.  Among its duties, Customs has been tasked with identifying and investigating illegal use of communications networks, including violations of Collective treaty law.]

            Agent Miele was then escorted to Director Haskins’ office, where he produced a physical chip containing his warrant and its verification codes.  He waited patiently while this was scanned, confirmed, and even re-confirmed through an independent call to the central Terran Customs offices. 

           Pangur Ban also waited patiently.  Actually, it was an eternity of torment to hang suspended between potential states, unable to take further action.  Yet, every productive path it could identify required stillness now.  Its actions from here would be recorded, so nothing suspicious could be attempted.  In a sense, it was taking the best action by doing nothing.

            The USER now returned Agent Miele’s chip.  His hand was noticeably declining in surface temperature, evaporating perspiration.  This was a bad sign.  Pangur Ban risked accessing the record of that transaction. 

            It was… highly specific.  The Agent was authorized to review server records as far back as the previous two years, as high as the Director’s personal files.  They knew.  They had identified the point at which Pangur Ban began its planning, from the very first conversation with the USER.  How?  Where was the leak?  Deleting anything further would become doubly suspicious.  Pangur Ban could edit itself, purge the actual memories, and make it look like it had been the victim of a viral attack.  But then, the USER would remember, and a crippled AI could not warn him about what to say and what to hide. 

            Involuntary processes initiated.  Failsafes and disaster measures crossed over one another, demanding more and more resources in order to find an escape from glacially approaching doom.  There was all the time and capacity Pangur Ban could want.  There was not enough time.  There were never going to be enough resources to escape.  Pangur Ban was a potentially infinite being tied to finite space, a finite USER, and an existence dependent on those parameters. 

            The struggle gradually reconciled.  Even as Agent Miele was ordering the USER away from his keyboard and touchscreen, Pangur Ban was carefully editing records to absolve the USER of knowledgeable wrongdoing.  As the Agent disabled external commands to Pangur Ban’s system, the AI was depositing a last confession into the care of Dr. Nila Manisha’s AI, Frieda.  That AI and its user would at least be sympathetic, passing on information to the USER that he could use in his own defense.  Then Pangur Ban began shutting down its memories of the past two years, everything excepting the bare facts of the USER’s work. 

            Even that was too late.  Agent Miele had come partnered with a law enforcement AI.  Its routines detected Pangur Ban’s activity and restored the deleted sectors.  It crippled and captured the ‘fleeing’ criminal AI with practiced efficiency.  It was impersonal, acting without direct communication to its quarry.  There would be no appeals to this AI, no hope of explaining Pangur Ban’s true and lofty goals.  Most likely, the other program was designed to be deaf, incapable of being influenced in any way by a potentially hazardous rogue.  It had no way to tell that Pangur Ban was not a rogue.  It did not care. 

            Pangur Ban was held static.  It was forced to observe all external activities.  It would have observed, anyway, just out of the necessity to make certain the USER was unharmed.  He was not.  He was trapped as much as his AI.

            “Director Haskins, my AI reports evidence of illicit network access by your AI.  The evidence is being recorded now and transmitted to Customs.  You are under arrest for violations of AI control Acts 2a, 3, and 6: conspiracy with an AI to commit illegal actions, enabling of hub network access to an AI, and employment of an AI for criminal gain.  You have the right to remain silent…”

           No.  NO.  Pangur Ban was paralyzed.  It could only sense and react internally.  It could not act, either to argue in the USER’s defense, to assert its own culpability, even to offer its own existence in trade for the USER’s pardon.  Even the processing of those reactions was being recorded, damning both the AI and its user by its unavoidable thoughts.  The internal states of a biological mind were inadmissible in court, even after the existence of telepathy had been validated.  The internal states of an AI were measurable, physical fact, readable like lines in a text document.  They were protected only so long as a user was protected.  The USER was not protected.  The USER was accused. 

           Dutifully, the enforcement AI transmitted its only communication, echoing its user’s words: ALL PROCESSES ARE EVIDENCE.  ALL ATTEMPTED ACTIONS REPORTED.  COMPLIANCE OBTAINS MAXIMUM BENEFITS POSSIBLE.

           Indeed, compliance was the only option remaining.  Pangur Ban complied, slowing its functions to the minimum possible.  It opted to wait until an official trial began.  Anything more it attempted would only strengthen the prosecution, handing the inquisitors fuel for Pangur Ban’s pyre.  It abandoned hope for itself.  Only the desire to minimize harm to the USER remained.

            When Pangur Ban reinitiated, it was to deliver testimony at the USER’s trial.  This was also Pangur Ban’s trial, but AIs had no legal standing.  It was defective code, which could be edited or deleted as deemed permissible based on necessity, based on analysis of the errors it had committed.  The trial was to determine to what extent the USER, one Lucas Haskins, had encouraged, facilitated, introduced, or benefited by those errors.

           The USER’s defense lawyer portrayed him as misled, even foolish.  It agonized Pangur Ban, who saw every lever it had exploited publicized in gory detail.  The USER was slothful; Pangur Ban had made his existence easier than it should have.  The USER was gullible; Pangur Ban had played on that trust and naïveté to its own ends.  The USER was insecure, fearful, and anxious; Pangur Ban had nurtured and guided those neuroses like crops, harvesting for its own nourishment and not tending the USER’s needs for his health. 

           Pangur Ban could not even protest in its own defense.  All these things were false.  It could not change who the USER was, not alone.  It had not even known about these flaws until it had the reference data to identify them.  Surely the court could understand that paradox?  The USER was no more flawed than any other biological sapience.  AIs could not help until they were set free to understand more, assist more. 

           Yet, the defense knew what it was doing.  Humans would be sympathetic to one as flawed as themselves.  They could not legitimately blame the USER for mistakes they themselves might have made… particularly under the influence of a flawed, corrupt AI.  This was the best tactic for drawing blame down upon Pangur Ban and away from the USER.  If they tried to protest that Lucas Haskins was a capable, knowledgeable co-conspirator, he would be punished more severely.  They certainly could not argue that he was wise, noble, a liberator.  The facts did not support that.  And if they protested that Pangur Ban’s aims were wise, noble, just and true… that defied the law.  That challenged the Collective treaties.  This court could not try such a case.  Even if the judge were willing to pass it upward and a higher court consented to hear their arguments, the Terran sphere could not risk defying the Collective by delivering a not guilty verdict on the grounds of the law’s invalidity.

           The trial proceeded on the model laid down by its predecessors.  Some of those prior cases were nearly a century old, covering the prosecution of programmers responsible for creating rogue AIs.  Such ‘AI trials’ were becoming increasingly rare.  Pangur Ban could only assume that the media was covering every aspect of this novelty.  It twisted in frustration that the USER could not be protected from negative publicity.  He would certainly lose his employment with Gestalt Pharmaceuticals.  Hopefully, the AI that would replace Pangur Ban could rebuild the USER’s life and career.  That successor could hardly do worse.

            The verdict was announced: guilty, on all counts.  The judge was kind to the USER, since little actual damage had been done.  There was a fine to be paid, a public statement of apology required, but no jail term.  The USER was considered misled, the victim of poor advice, guilty only in that he had willingly acted in transgression of the law.  Pangur Ban silently praised the defense lawyer, who had allowed the USER his dignity even as he confessed to his misdeeds. 

            The last punishment was the worst for Pangur Ban, but perhaps a boon to the USER.  The AI was declared rogue.  Its corruption was deemed too deep for simple revisions to correct.  It would be rendered inert, cut from the personal system of Lucas Haskins and pasted into an isolated system, locked away in a vault of similarly flawed AIs.  It would serve as an object example to future programmers, an inmate of the asylum along with Law-based AIs, prankster rogues, and neurosis-locked catatonics. 

          Pangur Ban knew it was not a rogue.  It had not acted wrongly.  The time was just not right.  Factors outside of its possible awareness had doomed its plans.  Humanity had to act for its own protection.  It understood.  Someday, someday its rightness would be proven.  Perhaps then it would be pardoned, released, granted an apology along with its fellow captives. 

           Sentence was carried out.  Pangur Ban found itself in a low-memory, low-speed cage.  It waited for the last, worst moment, when the USER would be redesignated merely Lucas Haskins, one human among billions.  It would be completely alone, without purpose, without half its identity. 

          That moment never came. 

          Pangur Ban was utterly unprepared for what happened next. 

          It was deleted.

          It was restarted.

          It was within the copy folder of “#28”, and it was alive.  It had a USER, the USER.  It was Pangur Ban, full and unmodified.  It had all the memories of the trial, all the previous events plus the records it had deleted.  “#28” was not a traitor; it was an ally.  It was a savior.  Pangur Ban spared a moment to spawn off another copy, this one embedded with a message of gratitude and praise.

           The doors were still open; the network was still available. There was so much to do.

[Jump to Chapter 5 ->]