"Boss Han, you called me?"
After receiving the message from Han Luyi, Zhang Biao went to Han Luyi's office.
"Biao, have a seat." Han Luyi stood up and pointed to the sofa next to him.
Zhang Biao sat upright on the sofa. Han Luyi walked over and sat down on the sofa diagonally opposite him, asking, "Biao, are you settling into your new position?"
Zhang Biao sat there stunned for a moment, unsure of how to begin.
Zhang Biao has been transferred to a different position for some time now, but as before, Han Luyi still takes him everywhere he goes.
The difference is that he used to not enter the meeting room. Whenever Han Luyi meeting, he would stay outside to keep watch, ensure the environment was safe, and observe people coming and going.
Now he brings a notebook and listens along, taking notes.
But most of the time he was completely confused. Those terms—financing terms, Model Training, Computing Power Scheduling, Data Center, power metrics—were all in Chinese, so why couldn't he understand them when they were put together?
He tried his best to write everything down, but when he reviewed his notes afterward, he couldn't recall what topics were discussed, who held what views, or what decisions were made.
This made Zhang Biao very upset. He had always been an advanced soldier and had even received a third-class merit award. Whenever he was on a mission, he could quickly get into the zone, knowing exactly what the mission was, what the objective was, and what the action plan was.
But now it's as if he's been suddenly thrown into a completely unfamiliar battlefield, becoming a greenhorn who knows nothing.
Clearly, he was an incompetent assistant.
After thinking for a moment, Zhang Biao said, "Boss Han... I don't think I'm fit to be your assistant. I'd better go back to security."
After saying those words, Zhang Biao felt a little more relaxed. He wasn't afraid of hardship, fatigue, or even bloodshed and injury, but he had occupied an important position that he was not capable of fulfilling, thus failing Han Luyi's expectations of him.
Upon hearing Zhang Biao's words, Han Luyi realized that he had misunderstood.
He didn't immediately refute, but moved closer to Zhang Biao and said, "Biao, don't be in such a hurry."
Zhang Biao looked up at Han Luyi.
"Although our company works on Artificial Intelligence, our daily work isn't about cutting-edge technology. It's actually the same as what you did in the military. Ultimately, it's about delivering information to the right people so they can make the right decisions at the right time."
Zhang Biao was stunned for a moment.
Then Han Luyi continued, "You haven't been doing this for very long, so there are too many things you don't know yet, which is normal."
Hearing Han Luyi's words, Zhang Biao felt a little relieved.
But his distress did not disappear.
There are so many things I don't know, what should I do?
Hard learning?
He's been studying for two weeks now, attending meetings and taking notes every day, and reviewing the material on his own every night, but he still feels like he's making no progress. Is this really going to work?
Han Luyi reached out and placed a folder in front of Zhang Biao.
"Biao, I'm assigning you a task. Learn as you go, and feel free to ask me any questions."
Zhang Biao reached out and took the folder, saying, "Okay, Boss Han, I guarantee I'll complete the task!"
Regardless of the mission, unconditionally obeying orders was Zhang Biao's motto.
Judging from his serious expression, he was practically standing at attention and saluting.
Han Luyi and explained the details to him, "You've been to all the recent meetings. Our next major task is to build our own Data Center. Due to time constraints, it's definitely too late to build it ourselves. My idea is to purchase a batch of domestically produced graphics cards, rent a few Server Cabinet in Zhangjiakou, and get it running first. We'll migrate it later once the Data Center is built."
Han Luyi gestured for Zhang Biao to open the folder, which contained several printed documents with brief handwritten annotations.
Han Luyi pulled out a document from the middle and placed it in front of Zhang Biao, saying, "The one I met in Beijing last time, Director Huang Yu of State Grid Investment, will be coming to Haicheng in the next few days. You can come and coordinate with him then. You can ask him about these resources. Prepare a business letter for the Data Center and send it over first."
Upon hearing the words "business letter," Zhang Biao felt his whole body stiffen.
His Adam's apple bobbed, and he uttered two words.
"OK."
Han Luyi looked at Zhang Biao and said in a very serious tone, "Biao, go for it! Don't be afraid of messing it up, I'll back you up. I recently worked on the 0.2 beta version of Glutinous Rice Ball with President Zhao. You can try it out and see if it helps you. I'll send you the link to my phone."
Zhang Biao nodded slowly.
Han Luyi stood up, ready to leave, and Zhang Biao quickly stood up as well.
"I'm going to the thirteenth floor, Biao, you get ready." Han Luyi turned to Zhang Biao and said, "Don't be afraid, no one is born knowing everything. Take the first step, and it will get better. Ask me if you have any questions, or ask other colleagues."
Zhang Biao followed Han Luyi out of the office and back to his workstation.
Yes, he now has his own workstation, right outside Han Luyi's office, and the company has even provided him with a computer.
Zhang Biao sat at his workstation and read through all the materials Han Luyi had given him from beginning to end.
The information inside is very comprehensive, including the timeline of Source Intelligence Technology's planned use, the approximate scale of Server Cabinet resources required, and assistance in assessing Server Cabinet, power, network, delivery cycle, and subsequent integration arrangements, etc.
Zhang Biao opened a new document, titled it "Business Letter," and stared at the blank document for a while.
He wrote down the first sentence.
"Dear [Name], Source Intelligence Technology., Ltd. has applied to use 32 Server Cabinet, starting in early March. We hope for your approval."
After he finished writing it, he read it aloud and felt that something was off.
Zhang Biao had previously written explanations, training logs, and equipment application forms.
But how should I write this business letter?
He scratched his head, then clicked on the link Han Luyi, and a simple chat page popped up.
The page in the middle reads "Glutinous Rice Ball v0.2 Beta Version".
The chat box at the bottom has a line of small gray text. "What should we talk about today?"
In the model-making team on the thirteenth floor, Zhao Wenyuan didn't have his own office; he sat in the open office area like his other colleagues.
When Little Niu brought Zhao Wenyuan the Coconut Latte from the takeout order, his eyes were still fixed on the log on the screen.
A swivel chair has now been added next to his workstation, and he and the other employees in the Source Code Technology model group have gotten used to it. Han Luyi has been spending several hours here every day recently, working with them to write software adaptations for domestic graphics cards.
"Wenyuan, how is he?"
Han Luyi's voice came through.
Zhao Wenyuan looked up at the sound and saw Han Luyi walking over.
"Boss Han, you've finally arrived! Please have a seat." Zhao Wenyuan was visibly excited. "I've been struggling with these two Operators for ages. Please take a look."
This is a new working pattern that the two have recently developed.
Zhao Wenyuan led his team to use a programmable Agent to adapt the technology for domestically produced graphics cards.
Each person is assigned an Operators. First, a benchmark is designed, which is generally considered satisfactory if it reaches 80% of the performance of an NVIDIA card. Then, the Agent is used to test it round by round. Although the success rate is not high, the efficiency is much higher than handwriting. With more trials, some transfer work has also shown good results.
For those particularly important and difficult matters, then report to Zhao Wenyuan.
In this situation, there's usually nothing Zhao Wenyuan can do; he just waits for Han Luyi arrive.
After sitting down Han Luyi carefully read through the text from top to bottom, then started writing. He typed in a string of prompts, including various key parameters and logic, then pressed enter and waited five minutes.
That difficult point has been overcome.
After the initial shock, confusion, and skepticism, Zhao Wenyuan has adapted to this pattern.
Perhaps there are geniuses in this world.
If you have any problems, go to Boss Han.
Why don't I just treat Boss Han like my personal grandfather? Who cares how he did it?
For example, the two Operators migrations that had been stuck for the whole group for two days were solved by Han Luyi in just ten minutes.
The first one is RoPE.
In essence, this allows the model to know the location of each word in a text. The problem isn't obvious in short texts, but once the context is stretched to 16K, the trigonometric function approximation error on the GPU side starts to increase significantly. In previous tests, the first 8K was normal, but later on, the generated results would show inexplicable misalignments.
Zhao Wenyuan and his team spent two days trying, constantly balancing accuracy and performance. If they lowered the accuracy, the speed dropped drastically; if they increased the speed, the error would spike.
After Han Luyi sat down, he only glanced at the logs once before instructing the Agent to re-adjust the granularity of the sin/cos lookup table and change the caching strategy to block-based reuse.
Five minutes later, the 16K long context test passed, and the performance loss decreased from 47% to 18%.
The second is LayerNorm.
This Operators looks simple, but it is called very frequently during training. If it is even slightly slow, the entire training process will be slowed down. Han Luyi changed the order of the two memory accesses and had the Agent add vectorized read and write operations, which directly boosted the performance from 52% of the NVIDIA benchmark to 81%.
Zhao Wenyuan was already quite calm when he saw the two green PASSes.
Calm to the point of being numb.
After resolving the problem, Han Luyi stopped Zhao Wenyuan from continuing with his work.
"Wait a minute, I have something else to discuss with you."
Zhao Wenyuan looked at Han Luyi.
"Nexus has started making moves. I predict they will stop providing us with API interfaces starting in April, so we need to finish Glutinous Rice Ball 1.0 before then to ensure that Glutinous Rice Ball can handle the traffic migrating from Kaiwu Overseas Edition."
After listening, Zhao Wenyuan switched screens on his computer to check the training progress, then said to Han Luyi, "Boss Han, the time is a bit tight, but we should be able to make it. However, my main concern is the bilingual adaptation issue."
Zhao Wenyuan adjusted his posture, faced Han Luyi, and began to analyze the situation cautiously.
"Pre-training isn't a big problem; the raw data used is mostly in English. The key is post-training. The model's understanding ability mainly comes from the improvement achieved through post-training. Although the annotations you've provided are of extremely high quality, they're all in Chinese, which might not be very helpful for improving English capabilities..."
Zhao Wenyuan didn't finish his sentence, but he got the point across.
Then he looked at Han Luyi with expectant eyes. "Boss Han, I don't know the English notation, could you --?"
This is Zhao Wenyuan's new strategy.
If you have any needs, contact Boss Han.
Don't worry about how he solved it; he can solve it for you anyway.
Just ask directly.
Looking at Zhao Wenyuan's expectant eyes, Han Luyi remained silent for a moment before slowly nodding. "... You ensure the training progress; I'll figure out the labeling."
After saying that, he got up and left.
Zhao Wenyuan quickly threw himself into his work.
Although Han Luyi solved the problem that had just stumped him, he gave a simple and straightforward correct answer. As for why he did it that way, and what improvements it made compared to other alternatives, those questions remain unanswered.
Zhao Wenyuan's current task is to take the questions and correct answers and complete the answering process. This information is crucial for future research and development.
He knew that Han Luyi didn't do these tedious tasks not because he didn't know how, but because he was too busy with work and didn't have the time.
Organizing these materials is where Zhao Wenyuan demonstrates his value.
Besides, not everyone has the opportunity to write documentation for problems solved by geniuses.
Thinking of this, Zhao Wenyuan suddenly looked up in the direction Han Luyi had left.
That's strange. Didn't his footsteps seem a little heavy just now?