Alibaba Announces Generative Language Model Related Patents

Alibaba (China) Co., Ltd. recently applied to publish a patent for “Generative Language Models and Training Methods, Devices, Electronic Equipment, and Storage Media,” according to Qichacha APP. The patent abstract states that this application provides a generative language model, including: a preset of N semantic nodes and a text generation module. Each semantic node has an assigned role, where: an initial semantic node at the starting position receives a target prompt provided by the user and generates semantic content related to its assigned role; an intermediate semantic node in the middle position, based on its assigned role, receives semantic outputs from preceding semantic nodes and generates semantic content related to its role; an end semantic node at the final position receives semantic outputs from preceding nodes and generates semantic guidance information in a semantic form; the text generation module outputs a target semantic response based on the target prompt and guided by the target guidance information. This application significantly addresses the interpretability issue of generative language models, which is important for applying such models in scenarios requiring high information accuracy. (People’s Financial News)