As soon as he finished speaking, Director Xu visibly relaxed.
Deputy District Chief Chen's enthusiasm also grew even higher.
Although the two are extremely shrewd and show no outward change, their Sight interfaces don't lie.
Professor Jia's tone revealed a hint of joy when he said this.
He certainly neither believed nor wanted his students to commit fraud.
However, training Large Model is something that not everyone can do well, let alone be the best in the world.
Due to the Computing Power controls initiated by Washington a few years ago, domestic Model Training is often stuck on the bottleneck of insufficient Computing Power. This problem exists in reality for both manufacturers and universities.
Take Professor Jia himself as an example. Jiaotong University is already one of the top universities in the country, but the laboratory only has a few hundred Nvidia training cards. It's possible to make Large Model with small parameters, but making Large Model is out of the question.
The fact that Han Luyi can now create this model means, without a doubt, that it improves the efficiency of graphics card usage.
However, this was their trade secret, so Professor Jia didn't ask.
Professor Jia returned to his seat, Han Luyi pulled up the slides to continue his presentation.
"Glutinous Rice Ball is a general-purpose model we developed ourselves, and the underlying training framework is maintained by the internal team at Source Intelligence Technology. Pre-training uses a mixed Chinese and English corpus processed by our first data pipeline, while post-training mainly uses data compiled and labeled by the Source Intelligence team itself."
Director Xu nodded slightly, while Deputy Director Liu kept observing Han Luyi's expression.
His role today is rather ambiguous; his most important task is to assist Director Xu in determining whether this company should be reported to higher authorities for further discussion.
Han Luyi continued, "Regarding Computing Power, we partnered with Dingsheng Cloud Services during the training period and used the Computing Power they provided. After the training was completed, the current inference Computing Power is deployed at the Zhangjiakou Cloud Horizon Data Center."
Upon hearing this, Deputy District Chief Chen couldn't help but interject.
How come you're in Zhangjiakou?
This was his instinctive reaction as a district leader.
If such an important enterprise's core resources aren't located in Haicheng, how can we provide follow-up services, conduct statistics, and form an industrial chain?
Han Luyi moment, unsure how to answer. Electricity was cheap in Zhangjiakou, and there were supporting facilities, but he still said, "That's just Data Center; our research and development and productization are still done in Haicheng."
Deputy District Chief Chen realized what he meant and smiled, "Boss Han, that's not what I meant. It's normal for companies to allocate resources nationwide according to their business needs, but there are also Data Center projects in Lingang. We'll discuss that later."
Good companies aren't afraid of you asking for resources; they're afraid of you not wanting them.
No, they're just going to run away.
After seeing that Deputy District Chief Chen had finished asking his questions, Director Xu posed one last question, "Boss Han, we'll take the technical documents back and review them in more detail. We're short on time today, could we perhaps do a live demonstration first?"
This brings us back to Han Luyi's initial suggestion, with a live demonstration.
"Of course, let me first show you the demo environment," Han Luyi said. "This interface is currently connected to our internal inference service, which is deployed in the Data Center in Zhangjiakou that I just mentioned. All the data is encrypted and will not leak out."
When the browser opens, it still displays the same simple chat box, showing the model number, Glutinous Rice Ball -0.9, and Glutinous Rice Ball's L0G0.
"Everyone is welcome to submit questions on the spot, as long as they are legal and compliant," Han Luyi said.
This is the second time he has emphasized this.
Like other internet content, the legality and compliance of AI tools are factors that the government highly values.
In fact, Han Luyi did put a lot of effort into ensuring safety alignment, and not just because of government compliance requirements.
Han Luyi himself also realized how much influence this lifelike chat assistant could have on people.
If you get used to listening to AI's advice, you may unconsciously be influenced by it.
Therefore, Glutinous Rice Ball's moral standards may be higher and more restrained than those of ordinary AI.
Professor Jia first posed a question.
He took out a piece of paper from his bag, which contained questions he had prepared in advance, and handed it to Han Luyi.
Han Luyi took it and looked at it, raising an eyebrow.
That's exactly the feeling I had during my final exams back then.
This is a computer system design problem, requiring the model to design a Task Scheduling system that supports multi-tenant priority.
Resource quotas, failure retry, idempotent execution, and key data structures and concurrency control schemes are provided.
Compared to ordinary algorithm or coding questions, these system design problems test a person's abstract thinking ability and overall perspective. Even in real programmer interviews, they only appear in the interview process of senior programmers.
This issue is also relevant in real-world AI training scenarios and cloud computing scheduling.
As expected of Teacher Jia, the questions he sets are still incredibly challenging.
In a typical Large Model, this kind of question would either lead to a bunch of correct but empty platitudes, or it would easily cause the design to go astray.
However, Glutinous Rice Ball did receive specialized training in this area, because the first scenario Glutinous Rice Ball needed to support was the use of Riding the Wind manipulation, which is also a common system design issue.
Han Luyi took out his phone, took a picture, and uploaded it to Glutinous Rice Ball. Glutinous Rice Ball began to think.
Director Xu suddenly asked a question, "Boss Han, is the multimodal model that OpenAI released a couple of days ago, which can process video and audio, the same thing as this?"
Han Luyi explained, "Director Xu, your observation is very insightful. Glutinous Rice Ball is not a multimodal model, although we hope to explore this direction in the next step. Multimodal models can natively process other forms of input, such as sound, images, and video. However, Glutinous Rice Ball's current image reading principle is to first convert the image into a text description, and then process it to generate a response."
Director Xu nodded and did not ask any further questions.
Soon, the Glutinous Rice Ball began to be served.
Everyone in the conference room had their eyes on the big screen.
The core of this system is "fair scheduling under resource constraints." It needs to address four issues simultaneously: tenant isolation,...
Priority preemption, failure semantics, idempotency boundary.
Next, they began to output the details of the various technical implementations.
Professor Jia stared intently at the answer, while the other leaders watched him.
After observing for a while, Professor Jia turned around and added a question, "If the task execution time is unpredictable, and some tasks occupy GPU resources for a long time, how can we prevent short tasks from never being scheduled?"
Han Luyi certainly knew the answer to this question, but he knew the question was about Glutinous Rice Ball.
He typed the question into the dialog box.
Press Enter.
The main reason why short tasks cannot be scheduled is due to issues such as resource fragmentation and uninterrupted leases. The fastest solution is to reserve a small Resource Pool for short tasks.
Director Xu, himself with a technical background, agreed with the answer, but he still turned to Professor Jia and asked, "Professor Jia, what do you think of this level?"
Professor Jia squinted his eyes, which were a little tired from staring at the screen, and said, "Not bad. Most AIs can't do this. It's even better than my graduate students."
At this moment, Deputy District Chief Chen spoke up, "Could I make a move?"
In this situation, no one would say no.
Han Luyi quickly asked Deputy District Chief Chen a question.
Deputy District Chief Chen spoke up, "We have a symposium next week, so I'll give it the topic and have him write a speech."
Word processing was indeed the initial application of the Large Model, but to say that it can produce government speeches would be to underestimate the Secretariat.
Deputy District Chief Chen verbally outlined the theme of the symposium, Han Luyi relayed to Glutinous Rice Ball. (The message was typed in a dialog box and entered.)
A few dozen seconds later, a well-structured speech appeared on the screen. It began with background information, included data in the body, and concluded with a forward-looking perspective; the format was standard, and the tone was typical of government policy.
That's pretty good.
After reading it, Deputy District Chief Chen remained silent for a moment.
"This is indeed well-written."
He paused, then added, "Of course, whether or not it will be used will require further refinement by the secretariat."
These words made Deputy Director Liu, who was standing next to him, twitch his lips, but he didn't say anything.
The atmosphere in the meeting room had become quite relaxed.
Director Xu checked the time, exchanged glances with Deputy District Chief Chen, and only after receiving confirmation did he close his notebook and stand up.
"Boss Han, President Su, today has been very fruitful. Thank you for your time and cooperation," he said. "We'll take the materials back for an internal evaluation and contact you again later."
"Director Xu can come anytime," Su Niannian replied.
Director Xu nodded and exchanged a glance with Deputy District Chief Chen.
Clearly, the two already knew how to proceed, but it wasn't appropriate to say it in this setting.
Of course, none of this could escape the observation of the Sight.
Deputy District Chief Chen also stood up and took the initiative to shake hands with Han Luyi.
"Boss Han, if there's anything we can help with in Pudong, please feel free to contact me anytime. Don't hesitate to ask," he said. "For an excellent company like yours, if you have any resource needs, just tell me directly, and we'll try our best to cooperate. It's our job."
"Thank you, District Chief Chen."
Deputy Director Liu also exchanged a few polite words, essentially saying the same thing as Director Xu: no new information was added.
The group escorted the leaders to their cars. Professor Jia slowed down a couple of steps and said something before getting in.
"Han Luyi, Su Niannian, well done," Professor Jia said. "Come back to the school when you have time and share your experience with the younger students."
Han Luyi agreed and saw the teacher off.
Back in the office, Han Luyi and Su Niannian found a sofa and sat down.
"What do you think of today's trip?" Su Niannian asked first.
"They have a good impression of me," Han Luyi said. "Overall, they're supportive, but it has to be reported up the chain of command, and I don't know what kind of support they'll provide."
Su Niannian glanced at Han Luyi's profile. "I told you, they won't be disappointed."
Then she suddenly changed the subject. "I didn't expect Professor Jia to come. I'm a little scared to see him give me the questions."
"Haha, it's okay, even if Glutinous Rice Ball can't answer it, I can." Han Luyi joked, then steered the conversation back to work. "Deputy District Chief Chen seems more enthusiastic; we could try to get resources from him first, since the district's decision-making chain is shorter."
Su Niannian scribbled a few lines in her phone's notes app, then looked up. "I've asked Shen Congyun to prepare a handover memo. You on your end—"
Han Luyi's phone vibrated.
He took it out and glanced at the screen.
Lu Zhengping.
Lu Zhengping of the Strategic Emerging Industries Guidance Fund.
Han Luyi for a moment.
"You go ahead with your work." He stood up. "I need to take this call."
Su Niannian glanced at him but didn't ask.
Han Luyi walked into the corridor and answered the phone.
"Mr. Lu."