Machina Calamity?
Li Qingsong immediately recalled many previously imagined modes of existence.
"When you say 'Machina Calamity,' do you mean the kind of entity that, after its Intelligent AI goes out of control, only knows how to follow past instructions, and endlessly exploits resources and multiplies itself?"
The Confidential Secretary gave Li Qingsong a strange look. "How could Intelligent AI go out of control? They are just intelligent programs created by intelligent life. The control has always been in the hands of intelligent life."
"Well, I don't know if you know anything else, but as far as we know, we haven't yet discovered any unorthodox intelligent life forms in this universe—those completely out of control, program-driven, and capable of autonomous proliferation."
"What mode of existence do the Machina Calamity you encountered have? How did they come about?"
"Intelligent AI is just a tool. In essence, it is no different from the hoes and shovels in the hands of primitive intelligent life."
Tools do not possess independent consciousness and are not capable of escaping control.
The secretary first emphasized this point, and then explained to Li Qingsong in detail, "But Intelligent AI tools still have certain special characteristics; their functions are too powerful."
It can do far too many things for intelligent life, which can easily lead intelligent life to become dependent on it.
If a civilization cannot effectively control this dependence and delegates too many tasks to Intelligent AI, it could very well become a Machina Calamity.
Li Qingsong reflected on his interactions with Intelligent AI.
He did indeed develop and create many Intelligent AI, such as the Jade Emperor, the Divine Craftsman AI, Nuwa, and Shennong. One particularly important Intelligent AI, Wukong, played a crucial role in the previous war.
Undoubtedly, we are also delegating many tasks to Intelligent AI. But since the decision-making power is essentially in the hands of intelligent life, could simply entrusting too many tasks to Intelligent AI lead to Machina Calamity?
This seems unreasonable.
"Both your civilization and our civilization have entrusted a great deal of work to Intelligent AI. Does that mean we could also become Machina Calamity?"
"No, no, it's not the same."
The secretary quickly shook her head, afraid that her explanation was not clear enough and that the interrogator in front of her might misunderstand and cause her to be punished. "We are just having the Intelligent AI perform some relatively simple, specific and repetitive tasks on our behalf. All the key decisions are made by our intelligent life itself."
But what if a civilization completely loses its ambition, becomes extremely lazy, and entrusts even crucial decisions to Intelligent AI?
What if, even further, all intelligent life in this civilization became completely immersed in pleasure, leaving technological development and crucial decisions concerning the fate of civilization to Intelligent AI?
"That's impossible."
Li Qingsong instinctively denied it. "Intelligent AI has no autonomous consciousness and cannot make such a decision with wisdom."
The secretary slowly said, "Yes, we don't have Intelligent AI, but we do have intelligent life forms."
In that case... the only option for Intelligent AI is to capture intelligent life forms from other civilizations and have them assist in making decisions.
"How could a captured intelligent life form be willing to sacrifice its intelligence for the enemy?"
"Intelligent AI does not need these captured intelligent life forms to be willing. It only needs a sufficiently sophisticated algorithm, supplemented by strict punishment and reward measures, so that even if the captured intelligent life forms consciously make malicious suggestions and try to destroy the host civilization, they can always be identified."
The numerous suggestions, whether malicious, benevolent, brilliant, or foolish, put forward by many intelligent beings can all be filtered through this algorithm, and the final filtered results usually have a very high probability of being correct.
Intelligent AI can then leverage the wisdom of external intelligent life to understand its next steps and better serve the host civilization.
Once the correct advice is determined, the intelligent life forms that offered incorrect advice will be punished, even executed. Through this step-by-step selection and purification process, those that remain will always be intelligent life forms willing to serve the Intelligent AI and the host civilization.
At the same time, in order to maintain sufficient vitality, this system requires a constant replenishment of external intelligent life. Therefore, under the control of Intelligent AI, apart from the host civilization, the captured intelligent life is always in a state of rapid loss, and the Intelligent AI is always eager for more external intelligent life to replenish it.
They will relentlessly search for and attack one external civilization after another, capturing intelligent life forms from these civilizations to replenish their own systems. Once their resources are depleted, they will capture again, and replenish their numbers once more...
And so it goes.
This is the Machina Calamity.
Li Qingsong initially found it somewhat absurd.
How is it possible to filter out the correct results using an algorithm without knowing which results are correct?
But upon closer examination, he discovered that it was highly reasonable.
This has been preliminarily verified in human history.
Verification code.
CAPTCHAs were originally used solely to prevent malicious access. However, people later discovered that CAPTCHAs could be used for more meaningful purposes beyond this.
Throughout human history, there has been a great need to input ancient books into electronic systems. However, most of these ancient books are severely damaged and the writing is not standardized, requiring people to decipher each character one by one before they can be entered into computers.
The number of ancient books is enormous, and this data entry work requires a great many people to complete, and this work is usually not well funded.
What should we do then?
Someone has found a solution.
Use a verification code.
Take photos of ancient books, extract text fragments to use as CAPTCHAs, and let humans trying to access the website decipher them.
But here's the problem: the electronic system itself doesn't know what the correct answer is, so how can it tell whether the answer submitted by the visitor is correct?
People eventually found a solution: to set up an algorithm to compare whether the answers submitted by multiple visitors for the same text fragment are consistent.
With the addition of other factors and comprehensive evaluation, the electronic program can ultimately select the correct answer even without knowing the answer itself.
If humankind's primitive computer technology and algorithms could already accomplish this, then Intelligent AI can do the same by capturing external intelligent life forms and using algorithms to filter out the answers that are truly beneficial to its own development.