Zhao Wenyuan's eyes widened upon hearing this. "You mean, Dingsheng Group stole our data?"
Han Luyi nodded.
Zhao Wenyuan thought for a moment and said, "Given Dingsheng's track record, it's not surprising they would do something like this. So what do we do? Stop cooperating with them?"
"Cooperation is fine, but since we know they'll try to steal it, let's devise a strategy first. Give me a piece of paper."
Zhao Wenyuan went to the study, found some paper and pen, and handed them to Han Luyi.
Han Luyi first drew a large circle on the paper, and then drew a small circle inside it.
"The recent data annotations, including those from our first training, have been categorized into two groups: 85% are necessary but not decisive conditions, and the remaining 15% are those that have the greatest impact on the model's capabilities. We only send the less important annotations to Dingsheng for the first training run, and save the most important ones for the final round, running them on our own machines."
"After all, only physical isolation is truly safe," Han Luyi said. "Moreover, we need to show them some 'good enough' data to lure them into stealing it."
"Fishing." Zhao Wenyuan understood instantly.
Looking at the image, Zhao Wenyuan raised a question, "Once the Model Training, we can use cross-comparison to detect which annotations have a greater impact; but at this stage, how do we distinguish them? Or do we just randomly select 15%?"
Han Luyi and said, "I have a way, it's better than just choosing randomly."
Zhao Wenyuan didn't press further, nodding, "That's a good idea. Anyway, once the large Model Training and released, they'll definitely Distillation it. The Distillation model can replicate 80% of the capabilities. Your method can at least reduce their capabilities to 80%." "Hmm, but that's not the point," Han Luyi said. "I'm not just trying to prevent them from stealing our data."
"What else?" Zhao Wenyuan asked.
Han Luyi didn't answer that question, but instead asked Zhao Wenyuan another one, "Did you read the Term Sheet you signed a couple of days ago carefully?" Zhao Wenyuan knew that the next topic would be related to the signed document, so he took out a copy from his phone.
Which clause are you referring to?
"It's the clause about data protection, the additional protection mechanism in the equity clause."
Zhao Wenyuan flipped over and looked at the original clauses:
[Equity Terms - Additional Protection Mechanisms]
If the investor and its affiliates fail to demonstrate that they have fulfilled their reasonable duty of care regarding the data provided by the company, and there is any use, transfer, backup, sampling, or derivative use beyond the scope authorized by this agreement, this clause shall be deemed to have been triggered.
Once triggered, the company has the right to:
(i) All shares already exchanged by the investors will be repurchased free of charge, with a repurchase price of zero;
(ii) Any unused Computing Power quota under this Agreement shall automatically terminate, and the Investor shall not claim compensation for the Computing Power costs already incurred; (iii) The Investor reserves the right to claim actual losses from the Investor and its affiliates.
This clause does not require the investor's subjective fault as a constitutive element.
After reading Zhao Wenyuan's words, he looked up at Han Luyi and asked, "You predicted they would steal it?"
"This isn't a protective clause, it's a trigger." Han Luyi shook his head. "It's not just about protecting Dingsheng; I don't trust anyone except my own Data Center and my own machines. But besides self-protection, I have other purposes."
Zhao Wenyuan said, "If you want them to steal, we can exercise this additional protection mechanism, use their Computing Power for free, and even get our shares back?"
Han Luyi nodded slowly.
Zhao Wenyuan pondered for a moment and said, "I'm afraid that won't be easy to do."
After thinking for a while, Zhao Wenyuan said, "The main problem is that it's difficult to provide evidence. The data doesn't have a tracking code. If you say he stole it from you, he might say he found it. Unless..."
"Unless it uses a watermark," Han Luyi said.
"Well, the usual watermarks are special characters and statistical watermarks." After Zhao Wenyuan finished speaking, he suddenly noticed that Zhang Biao was taking notes on his conversation with Han Luyi in a notebook.
Why is Zhang Biao suddenly interested in technical topics?
Zhao Wenyuan's urge to explain problems immediately kicked in—he couldn't let such a studious person slip by.
He then explained, "Digital watermarks are like tracking codes for digital assets, proving ownership of certain digital assets."
"For example, invisible character watermarking involves adding characters that are invisible to humans but can be read by computers. This way, if someone steals our data, we can use a computer to read it and find those specific characters in specific locations, proving that the data was indeed stolen from us."
Zhao Wenyuan pulled over the piece of paper that Han Luyi had just used and drew a simple diagram on it.
"Statistical watermarking is a bit more complicated. For example, if there are many words that can express the same meaning, we pre-determine the ratio in the data: 'good-looking' and 'beautiful' will appear in a 1:2 ratio. As long as the entire dataset conforms to this statistical pattern, then the data was stolen from us." "Now is not the time for lecturing. You can talk to Biao about it separately when you get back." Han Luyi said, "Wenyuan, the watermarking methods you mentioned are all quite conventional, and the methods for cracking them are not secrets. I guess since Dingsheng dared to steal, they should be able to handle these things well."
"What should we do then?"
"I do have an idea: logical watermarking. I don't think anyone's tried this before," Han Luyi said. "They can change the words, manipulate the data, but as soon as the model speaks, it's irrefutable evidence."
"You mean..." Zhao Wenyuan thought for a moment, feeling that he was starting to understand, "To abstract the logical rules reflected in the annotations. If the logical pattern of the model trained by the other party is highly similar to ours, it means that their annotations are highly similar to ours. This is like establishing a mapping between two spaces—a logical space and a semantic space."
Han Luyi turned around and saw Zhang Biao looking confused again. He gave him an analogy. "It's like we have a recipe, and they stole it and copied it again, even changing some unimportant ingredients. But when we eat it, it tastes exactly the same, so we still know they copied us."
Zhang Biao's face showed a knowing look, and he wrote it down in his notebook.
"But," Zhao Wenyuan thought for a moment, "How do you know they won't change their logic too?"
Han Luyi smiled and said, "I bet they won't. Since they're trying to steal our data, they must not be doing as well as us. If you were to copy the top student's answers, would you dare to change them?"
Zhao Wenyuan frowned. "I didn't copy the answers."
Han Luyi was taken aback, then quickly said, "I haven't copied it either."
Zhang Biao remained silent, and no one asked him anything.
"In short, I'll categorize this batch of Annotated Data for you, and I'll handle the logical watermarking."
"Wait for them to come."
Having finished discussing the important matters, Han Luyi stood up from the sofa.
"Wenyuan, you've worked hard these past few days. Let's take a break from work and go out for a meal together. Consider it our first get-together since Source Intelligence Technology was founded, and let's look forward to 2027," Han Luyi suggested.
After hearing Han Luyi's words, Zhao Wenyuan looked embarrassed. "Boss Han, I'm sorry, I have a date tonight." This time it was Han Luyi's turn to widen his eyes. "Huh?"
Zhao Wenyuan explained, "I met a girl at a bar a couple of days ago. We arranged to have dinner together and then go to Xintiandi to countdown to the New Year." Zhao Wenyuan, with your thick eyebrows and big eyes, I thought you were training your models at night instead of sleeping.
Zhao Wenyuan seemed to sense Han Luyi's inner complaints and added, "After all, the model takes quite a long time to run one cycle, so you don't need to stay by the computer the whole time."
No wonder it's inconvenient to live with my parents... Han Luyi seemed to understand something.
Since Zhao Wenyuan already had an appointment, the first dinner gathering of Source Intelligence Technology had to be postponed.
Han Luyi went straight home, Zhang Biao offered to cook two dishes for the two of them to eat together.
After finishing his meal, Zhang Biao went back to the apartment next door.
Han Luyi sat in the empty living room, suddenly feeling lost. He turned on the TV, randomly switched to a few New Year's Eve galas, and found that Zhou Shen was singing in them all. So he randomly stopped on one and started watching.
At 11:55, the TV presenter began the countdown.
Han Luyi turned off the TV instead.
He got up and walked to the French windows.
Looking north, the skyline of Lujiazui is lit up, the entire curtain wall of Haicheng Center has become a huge "2027", the laser at the top of Jin Mao Tower draws circles in the sky, and the colored lights of the Oriental Pearl Tower change color section by section.
Cruise ships slowly glided along the Huangpu River, their colorful lights shimmering like scattered gold in the water.
The entire city is preparing for the same thing.
My phone vibrated once, then vibrated again.
Han Luyi took out his phone; there were two messages.
A message from Su Niannian:
"Happy New Year, Luyi! [fireworks] I hope we can all achieve our wishes in the new year! Source Intelligence and Source Code! [rocket]!"
There was another message from Gu Siyue:
Happy New Year, Han Luyi.
A smile appeared on Han Luyi's face.
He replied to Su Niannian's message first:
Nian Nian New Year, Nian Nian! Let's build our business together next year!
When it came to Gu Siyue, he hesitated for a moment, then typed:
"Happy New Year, Gu Siyue."
Putting down his phone and gazing at the bustling lights outside, Han Luyi's mind flashed through a series of images like a movie.
In February, on the day he was laid off, the blue panel appeared before his eyes for the first time.
BugKiller was launched in April.
In May, BugKiller's first order arrived.
In July, Source Code Technology was officially established.
In October, in Beijing, He Yunshen said, "One hundred million isn't enough, I'll give you two hundred million."
In December, Glutinous Rice Ball's intention understanding, relying on the 7B base, already ranked first in the world, and the training of Large Model was poised to begin.
There are some scenes that cannot be fully described in a single sentence.
A unique passion surged within Han Luyi's chest.
In 2026, he gained Sight and accomplished so much.
He's coming in 2027!