US Patent:
20230020886, Jan 19, 2023
Inventors:
- San Jose CA, US
Niyati Chhaya - Hyderabad, IN
Snehal Raj - Odisha, IN
Sharmila Reddy Nangi - Hyderabad, IN
Sapthotharan Nair - Cupertino CA, US
Sagnik Mukherjee - Kolkata, IN
Jay Mundra - Chittorgarh Rajasthan, IN
Fan Du - Milpitas CA, US
Atharv Tyagi - Uttar Pradesh, IN
Aparna Garimella - Karnataka, IN
International Classification:
G06F 16/34
G06F 16/332
G06N 3/04
G06N 3/08
Abstract:
A text summarization system auto-generates text summarization models using a combination of neural architecture search and knowledge distillation. Given an input dataset for generating/training a text summarization model, neural architecture search is used to sample a search space to select a network architecture for the text summarization model. Knowledge distillation includes fine-tuning a language model for a given text summarization task using the input dataset, and using the fine-tuned language model as a teacher model to inform the selection of the network architecture and the training of the text summarization model. Once a text summarization model has been generated, the text summarization model can be used to generate summaries for given text.