  We study the effectiveness of several techniques to personalize end-to-end
speech models and improve the recognition of proper names relevant to the user.
These techniques differ in the amounts of user effort required to provide
supervision, and are evaluated on how they impact speech recognition
performance. We propose using keyword-dependent precision and recall metrics to
measure vocabulary acquisition performance. We evaluate the algorithms on a
dataset that we designed to contain names of persons that are difficult to
recognize. Therefore, the baseline recall rate for proper names in this dataset
is very low: 2.4%. A data synthesis approach we developed brings it to 48.6%,
with no need for speech input from the user. With speech input, if the user
corrects only the names, the name recall rate improves to 64.4%. If the user
corrects all the recognition errors, we achieve the best recall of 73.5%. To
eliminate the need to upload user data and store personalized models on a
server, we focus on performing the entire personalization workflow on a mobile
device.
