Today we’re joined by Arul Menezes, a Distinguished Engineer at Microsoft. Arul, a 30 year veteran of Microsoft, manages the machine translation research and products in the Azure Cognitive Services group. In our conversation, we explore the historical evolution of machine translation like breakthroughs in seq2seq and the emergence of transformer models. We also discuss how they’re using multilingual transfer learning and combining what they’ve learned in translation with pre-trained language models like BERT. Finally, we explore what they’re doing to experience domain-specific improvements in their models, and what excites Arul about the translation architecture going forward. The complete show notes for this episode can be found at https://twimlai.com/go/458. Subscribe: Apple Podcasts: https://tinyurl.com/twimlapplepodcast Spotify: https://tinyurl.com/twimlspotify Google Podcasts: https://podcasts.google.com/?feed=aHR0cHM6Ly90d2ltbGFpLmxpYnN5bi5jb20vcnNz RSS: https://twimlai.libsyn.com/rss Full episodes playlist: https://www.youtube.com/playlist?list=PLILZm3MRkvH83C46bZ4rPmB-jKWBltWkP Subscribe to our Youtube Channel: https://www.youtube.com/channel/UC7kjWIK1H8tfmFlzZO-wHMw?sub_confirmation=1 Podcast website: https://twimlai.com Sign up for our newsletter: https://twimlai.com/newsletter Check out our blog: https://twimlai.com/blog Follow us on Twitter: https://twitter.com/twimlai Follow us on Facebook: https://facebook.com/twimlai Follow us on Instagram: https://instagram.com/twimlai