Around 9 a. m., Han Luyi came out of the headquarters building of the Origin Group and walked to the Icecore factory area.
Ding Yaoxian, the process manager I met once before, was waiting at the factory gate with two other people.
Seeing Han Luyi walking over alone, without a car or his secretary or assistant, Ding Yaoxian's face showed a hint of surprise, followed by a hint of helplessness.
The production line was in a state of utter chaos, and even working overtime couldn't solve the problem. And then, the big boss of this partner company decided to come and inspect the production line at this crucial moment.
What is this? A high-profile business tour?
Ding Yaoxian only found it troublesome.
No wonder President Liao was away on a business trip and asked me to receive him.
As soon as Han Luyi approached, Ding Yaoxian composed himself and greeted him, "Good morning, Boss Han."
"Good morning, Mr. Ding. Long Time No See. Is President Liao not here?" Han Luyi asked.
"President Liao went out to discuss technical support matters, so he asked me to receive you."
Han Luyi understood that the problem on this production line was indeed of paramount importance to Icecore, and since it couldn't be resolved internally, Liao Botao was thinking of seeking external assistance.
As for Han Luyi, he didn't expect to solve the problem with Han Luyi. Ding Yaoxian took Han Luyi to the office area to sign a thick stack of supplementary confidentiality agreements. Then, he had him put his mobile phone, watch, and other electronic devices into the shielded cabinet. After that, the group passed through two layers of access control and entered the changing room in front of the Production Line area.
Everyone has to change into a one-piece cleanroom suit and cap here, which looks like a simplified version of a spacesuit.
Ding Yaoxian was standing next to Han Luyi, couldn't help but take another look at the small scab on Han Luyi's lip.
Han Luyi smiled awkwardly and said, "The weather has been dry lately, and I'm feeling a bit feverish." After saying that, he put on his mask to cover his face.
Ding Yaoxian said, "Boss Han, you should drink more water." Then he thought to himself: Is the weather dry lately? Isn't it quite humid? We need to take extra precautions against moisture in the factory.
After a brief interlude, the group walked together into the most central area of the entire wafer fab.
Photolithography yellow light area.
To prevent natural light from prematurely exposing the photoresist, the entire factory is shrouded in specially designed yellow artificial light 24 hours a day. Yellow light has a long wavelength and carries low energy, thus preventing the photoresist from being exposed.
The group walked up to a huge industrial piece of equipment and stopped.
Ding Yaoxian began, "Boss Han, look, this is the core equipment of our production line, the ASML Tinscan NXT series immersion V-lithography machine."
Han Luyi nodded seriously.
In fact, Han Luyi knew nothing about this. He was a complete novice when it came to photolithography technology. But he came today to solve the production line problem for Icecore.
"Engineer Ding, what exactly is the problem?" Han Luyi asked.
Ding Yaoxian pointed to the several pieces of equipment in front of him and said, "The symptom is large overlay error, but there is no pattern to it. These machines have all had problems before, and it doesn't happen every time. Sometimes a dozen or so batches are fine, but suddenly a problem occurs, and an entire batch of wafers is ruined. It's a real headache."
He would rather the problem be with a specific machine, even if the probability was higher.
These kinds of problems, which randomly appear on various production lines, are the ones that have the greatest impact on production management.
"What is the overprinting error?" Han Luyi asked next.
Ding Yaoxian glanced at Han Lu.
No, you don't even know about overlay error? What are you here for?
But knowing that Boss Han's background was in software, he patiently explained, "As we discussed last time, our Icecore's seven-nanometer process is achieved through multiple exposure technology. After one exposure, it needs to be re-aligned and exposed again with a new pattern. This is called overlay. The error between overlays must be controlled at the nanometer level, otherwise the resulting pattern will be ruined."
Upon hearing this, Han Luyi realized the thorny nature of the problem.
The splicing itself is a problem, but the more serious problem is that it occurs randomly.
If there's a problem with every exposure, it means the stitching algorithm is wrong and needs to be redone; but if it happens randomly, it means the stitching algorithm is fine. So where does the problem come from? Han Luyi scanned the Sight with his camera.
Labels for all items in the factory popped up.
First, there was the colossal beast before them:
[Equipment: ASML Tinscan NXT series immersion V-lithography machine]
[Status: Healthy]
[Driver software: asml native driver]
The Production Line next door:
[Equipment: Fully automatic front-end coating and developing machine]
[Status: Healthy]
[Driver software: Original manufacturer driver]
Everything seems fine.
Ding Yaoxian, standing nearby, added, "Boss Han, you wouldn't believe it, we've checked everything we could. We've examined the temperature distortion of the lenses, the batch activity of the photoresist, even the micro-vibrations in the factory when vehicles pass by—and nothing showed a correlation." He sighed, "If this had happened before, we would have called in the original manufacturer's engineers long ago. But now all after-sales service is cut off. Not only can their engineers not come, but they can't even do remote diagnostics."
It sounds like a locked-room murder.
If the Hardware is fine, then it must be the software.
After-sales service has stopped; what software are they using now?
Han Luyi asked the question that had been on his mind.
"It's our self-developed management system, but we've been using it for almost two years, so it's definitely not that." Ding Yaoxian understood Han Luyi's meaning immediately, and he was also somewhat unconvinced.
Industrial production is not like internet products; things that are usable don't change easily.
They initially developed this operating system for multi-exposure technology, and then, for stability reasons, they didn't touch it. How could something that hadn't been modified for two years suddenly malfunction?
Han Luyi watched for a while longer, then suddenly spoke up, "Engineer Ding, where is your monitoring room? Can we go take a look?"
Ding Yaoxian could tell that Han Luyi was clueless, and he had little hope of finding a solution.
Dozens of semiconductor engineers in the factory have been studying it for half a month and still can't figure it out. How could a layman solve the problem?
All he wanted now was for Han Luyi to finish reviewing the documents and leave as soon as possible so they could continue their investigation. Fortunately, the security level of the monitoring room wasn't any higher than that of the production area.
The group then entered the central monitoring room, where several engineers were on duty, each appearing to be under immense pressure. Upon entering, Han Luyi pointed to the large screen beside him and asked, "Can we see the management system's operation logs?"
He didn't ask about the lithography machine's logs; those were encrypted, and even the Icecore couldn't see them.
Ding Yaoxian asked an engineer on duty to retrieve the work logs for the past two weeks, then said to Han Luyi, "Boss Han, this system is also part of our core process; you can't leak it."
"Don't worry, Engineer Ding."
Han Lu—as he spoke, he opened his Sight.
The logbook in front of me was immediately tinged with different colors by the Sight.
Han Luyi quietly flipped through the journal entries.
This log is extremely large, encompassing all the logs generated by the lithography machines on various production lines managed by the production management system during the production process. The vast majority of these logs are at the [inf] level, recording some operational information, with only a very small number showing [arn] and [errr].
Ding Yaoxian explained, "We checked this area immediately, and there's no corresponding error message in the system, so it's definitely not the problem."
Then, seeing that Han Luyi was not speaking and seemed to be in a very focused state, he simply shut up so as not to disturb Han Luyi, and did not introduce Han Luyi's identity to the others.
The on-duty engineers, seeing that Ding Yaoxian had personally brought them in, and that they immediately started checking the logs, were unsure what had happened. They only glanced at them out of the corner of their eyes, secretly observing. After a few minutes, Han Luyi suddenly asked, "The last problem occurred in the early hours of this morning?"
He had already scrolled back to the first log entry that the Sight had marked as problematic, and there was a log entry with a timestamp of [02:07:33.129] that the Sight had highlighted in red.
Ding Yaoxian was startled upon hearing this and asked, "How did you know?"
He was so anxious that he forgot to use honorifics.
Han Luyi pointed to the line of log on the screen and said, "Look, there's an error here."
Several engineers nearby had already gathered around.
The dense logs displayed on the screen at this moment are all at the [inf] level, with no errors marked.
How can this person be so certain that something went wrong?
They've checked the work logs countless times over the past two weeks, but haven't found anything wrong.
An engineer nearby, responsible for maintaining the self-developed system, didn't know Han Luyi's identity, but upon hearing his words, couldn't help but speak up, "Hey, what are you saying? Isn't this log line normal? Status code 200, the lithography machine received it normally, and there are no error messages."
Judging from the engineer's tone, which wasn't very friendly, Ding Yaoxian was about to stop him, but Han Luyi didn't seem to care and said directly, "The communication was successful, but the values are off."
After finishing speaking, Han Luyi added, "Excuse me, let me do something." Then he used the mouse and keyboard to copy the log line, put it into a new document next to it, scrolled up, found several other log lines, copied their contents, and pasted them into the document one by one. "This log line records the alignment compensation parameter, right? 1.341289, and the unit after that is nanometers?" Han Luyi he looked at it.
The engineer who had just argued with him seemed a bit lost, seeing how quickly he manually retrieved several log entries. He was focused on reading the logs and remained silent. Ding Yaoxian, however, answered, "Yes, these are the values calculated by our system. The line below is the lithography machine's feedback: 1.3413 nanometers. Because the lithography machine's precision isn't at the 0.1 picometer level, the subsequent values were rounded off. Boss Han, are you right—"
Just as I finished explaining, the young engineer who had spoken earlier suddenly exclaimed, "Wait a minute, how can it be 1.2?"
Ding Yaoxian was interrupted halfway through his sentence. He turned his head and saw that the engineer was staring intently at the log on the screen. Ding Yaoxian followed his gaze and looked at the screen.
He and Han Luyi were just discussing the input and return values during a normal period of time.
The first time Han Luyi copied the data, at 2 AM, happened to be the input and return values for the incorrect batch, which were 1.299998 and 1.2000 respectively. Ding Yaoxian immediately realized the problem.
The difference is almost 0.1 nanometers!
For a 7-nanometer process using multiple exposure technology, a 0.1-nanometer error, after being amplified several times, is enough to directly render the circuitry on the wafer unusable.
What's going on?
Realizing what had happened, Ding Yaoxian quickly shouted to the others in the room, "Quick! Find the timestamps of previous accidents, find the corresponding logs, and see if they are all like this!"
Looking at this incident alone, the log is enough to prove that this problem can cause wafers to be scrapped, but they still need to verify whether the previous incidents were due to the same reason.
The people in the monitoring room sprang into action, pulling up the incident records, finding the corresponding time, and searching through the relevant log entries. Several people worked separately on different computers, and a few minutes later, the first person had a result.
"Engineer Ding, we've located it. Last night's failure had the same accuracy problem; 0.999997 was rounded down to 0.9000!"
Then the others also made their own discoveries.
"I found one here too; the return value for 2.199999 is 2.1000!"
"Me too!"
They quickly found seven or eight records that appeared during the failed batch, all of which had the same problem of precision loss.
Now we can basically pinpoint where the problem lies.
If one time could be a coincidence, it's impossible for seven or eight times to be coincidences.
The next question is how to fix it.
Now that the pattern of the problem has been identified, there's always a solution. Currently, the compensation value is directly sent to the lithography machine after being read by the management system through optical measurement instruments. Since the lithography machine's approximation is flawed, let's stop letting the lithography machine do this work. Instead, we should process the compensation value in the management system before sending it to the lithography machine. We can't afford to have similar problems occur again.
Since the software team leader wasn't present, Ding Yaoxian asked first, "If we bring the approximation function into our system earlier, how quickly do you think it could be completed?"
The software engineers exchanged bewildered glances, none daring to offer an answer. This management system hadn't been touched for two years; it had only been maintained previously. What if rushing to fix it now created even bigger problems?
Besides, they couldn't make that decision.
An awkward silence fell over the room.
Ding Yaoxian was filled with a mixture of joy, anxiety, and anger. He said, "Never mind, I'll report this to President Liao first."
Han Luyi suddenly interjected, "If we can't fix this problem immediately, why not add some blocking logic first? If this data format is detected, we shouldn't expose it."
This is the procedure for handling online incidents on the Internet.
First stop the bleeding, then repair the damage, and finally find the root cause.
In fact, the production process is the same, but Ding Yaoxian was too emotional to think of it at the time.
He glanced at Han Lu and said, "Boss Han, thank you!"
After saying that, he went to the side and picked up a landline phone.