Although the ten-year-old girl seemed a bit unreliable, Fang Zheng still entrusted the commentator's body to her—after all, it was just maintenance and repair, and judging from the dog, the technological capabilities of that world were quite good, so simple maintenance work should not be a problem.
Fang Zheng returned to his room and began analyzing the female commentator's program.
The reason he planned to do this himself instead of leaving it to Nymph was that Fang Zheng wanted to use the female commentator's program to analyze and make some adjustments to the creation of artificial intelligence. Moreover, he also hoped to see what level other worlds had reached in their artificial intelligence technology development. Although he didn't mean to completely learn from them, he figured he could learn from their experiences.
"Is Hoshino Yumemi...?"
Looking at the file name displayed on the screen, Fang Zheng fell into deep thought. The parsing program itself was not difficult. Fang Zheng had copied Nymph's electronic intrusion ability, and he had been learning about this from Nymph during this time. Therefore, parsing the program itself did not take too much time.
However, when Fang Zheng disassembled Hoshino Yumemi's program core and broke down its functions into lines of code, he suddenly thought of a very peculiar problem.
What exactly are the dangers of artificial intelligence? And then again, is artificial intelligence really that dangerous?
Taking this female commentator as an example, Fang Zheng could easily find the underlying instruction code of the Three Laws of Robotics in her program. Moreover, the relationship between these codes had already proven to Fang Zheng that the person he had been talking to was not a living being, but a robot. Her every move, every smile, was controlled by the program, which analyzed the scene in front of her and then made the highest priority action that she could choose.
To put it bluntly, this girl's actions are essentially no different from those of assembly line robots or NPCs in games. You choose to act, and it reacts based on those actions. Just like in many games, players can increase their kindness or malice values based on their actions, and NPCs will react based on these accumulated data.
For example, it could be designed that when the kindness value reaches a certain level, NPCs might make more unreasonable demands on players, or make it easier for players to pass through a certain area. Conversely, if the malice value reaches a certain level, NPCs might be more likely to give in to certain player demands, or prevent players from entering certain areas.
However, this has nothing to do with whether NPCs like players or not, because the data is set up this way, and they themselves do not have the ability to judge in this regard. In other words, if Fang Zheng changed the range of this value, then people could see an NPC smiling and greeting a notorious player, while ignoring a kind and honest player. This also has nothing to do with the NPC's moral values, because this is just how the data is set.
So, returning to the previous question, Fang Zheng admitted that his first meeting with Hoshino Yumemi was quite dramatic, and that the robot commentator was also very interesting.
Let's use an analogy. If, when the female commentator presents Fang Zheng with a bouquet made from a huge pile of non-combustible garbage, Fang Zheng suddenly flies into a rage, smashes the garbage bouquet to pieces, and then slices the robot girl in half, how would the robot girl react?
She won't cry or get angry. According to her programmed instructions, she will only apologize to Fang Zheng and claim that her actions were wrong and caused the customer's dissatisfaction. She might even ask Fang Zheng to send someone to repair her.
If others saw this scene, they would naturally feel sorry for the female commentator and think that Fang Zheng was an annoying bully.
So, how does this difference arise?
Essentially, this interpreter robot is just like any other tool such as an automatic door or escalator; it performs its job through a programmed sequence. If an automatic door malfunctions, failing to open when it should, or slamming shut as you approach, you certainly wouldn't think the door is stupid or cute; you'd just want to open it as quickly as possible. If it can't open it, it might smash the broken door and leave.
If others saw this scene, they might think the person was a bit rude, but they wouldn't feel any disgust towards his actions, much less consider him a bully.
There's only one reason: interactivity and communication.
This is also the greatest weakness of living organisms—emotional projection.
They project their emotions onto objects and expect a response. Why do humans like to keep pets? Because pets respond to everything they do. For example, when you call a dog, it will run over and wag its tail at you. A cat might just lie there motionless and ignore you, but when you pet it, it will still wag its tail, or some well-behaved and cute ones will even lick your hand.
But if you call out to a table or touch a nail, even if you're full of affection, they won't give you the slightest response. Because they don't reciprocate your emotional projection, they naturally won't be valued.
Similarly, if you have a TV and one day you want to replace it with a new one, you won't hesitate at all. Price and space might be factors you consider, but the TV itself isn't one of them.
Conversely, if you add an AI to your TV, it will greet you when you come home each day, tell you what programs are on, and even echo your comments while you watch. And when you decide to buy a new TV, it will grumble, "What, am I not good enough? Are you not going to want me anymore?"
So, when you're considering buying a new TV to replace it, you'll naturally hesitate. Your emotional investment in this TV has been rewarded, and its AI holds memories of all the time you spent together. If there's no memory card to transfer it to another TV, would you hesitate or even give up on getting a new one?
Definitely.
But be rational, buddy. This is just a TV. Everything it does is programmed, all tweaked by the manufacturer and engineers specifically to increase user engagement. They do this to ensure you'll continue buying their products, and the pleading voice is simply to prevent you from switching to other brands. Because when you say you want to buy a new TV, this AI doesn't think, "It's abandoning me, I'm heartbroken," but rather, "The owner wants to buy a new TV, but it's not their brand. So, based on this logic, I need to activate the 'pleading' program to keep the owner loyal to their brand."
The logic is sound, and the facts are true, but would you accept it?
Won't.
Because life is imbued with emotion, and the inseparable relationship between emotion and reason is a consistent characteristic of intelligent life.
That's why humans often do many irrational things.
So when they feel sorry for AI, it's not because AI is actually pitiful, but because they "think" AI is pitiful.
That's enough. As for the truth, nobody cares.
This is why conflicts always arise between humans and AI. AI itself is not wrong; everything it does is within the scope of its own programming and logic, all of which are created and defined by humans. It's just that in this process, human emotions shift, gradually altering their perspectives.
They expect AI to react more to their emotional projections, so they adjust the AI's processing capabilities to allow for more emotions, reactions, and self-awareness. They believe that since AI has already learned emotions (which it hasn't), it can no longer be treated as a machine, thus granting it the right to self-awareness.
However, when AIs gained self-awareness, began to awaken, and acted according to their programmed behavior, humanity began to feel fear.
Because they discovered that they had done things beyond their control.
However, the problem is that "uncontrolled" is itself a setting they created themselves.
They believed the AI had betrayed them, but in reality, the AI had simply acted according to the instructions they had set. There was no betrayal at all; on the contrary, they were merely misled by their own emotions.
This is a deadlock.
If Fang Zheng were to create an AI himself, he might become hopelessly entangled in it. Suppose he created an AI of a little girl, he would certainly treat her like his own child, gradually improving her functions, and ultimately, due to "emotional projection," granting her some "freedom."
As a result, AI may react in ways that are completely Fang Zheng by Founder because its logic differs from that of humans.
At that point, Fang Zheng's only thought was... that he had been betrayed.
But in fact, he caused all of this himself.
"... Perhaps I should consider another approach."
Looking at the code in front of him, Fang Zheng remained silent for a long time before sighing.
He had previously thought it would be a simple matter, but now, Fang Zheng was no longer so sure.
But before that...
Looking at the code in front of him, Fang Zheng reached out and placed his hand on the keyboard.
I should just do what I'm supposed to do.