US Patent:
20160092766, Mar 31, 2016
Inventors:
- Mountain View CA, US
Maria Carolina Parada San Martin - Palo Alto CA, US
International Classification:
G06N 3/08
G10L 25/30
G10L 15/06
G06N 3/04
G06N 7/00
Abstract:
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a deep neural network. One of the methods for training a deep neural network that includes a low rank hidden input layer and an adjoining hidden layer, the low rank hidden input layer including a first matrix A and a second matrix B with dimensions i×m and m×o, respectively, to identify a keyword includes receiving a feature vector including i values that represent features of an audio signal encoding an utterance, determining, using the low rank hidden input layer, an output vector including o values using the feature vector, determining, using the adjoining hidden layer, another vector using the output vector, determining a confidence score that indicates whether the utterance includes the keyword using the other vector, and adjusting weights for the low rank hidden input layer using the confidence score.