Rasa Reading Group: Pay Attention to MLPs

Now i will be studying the unpublished preprint “‘Pay Focus on MLPs” (that’s “multilayer perceptrons”, the classic minimal deep learning architecture) by Hanxiao Liu, Zihang Dai, David R. So, Quoc V. Le from Google Brain. It proposes replacing attention in transformers with multilayer perceptrons, reducing inside a drastic decrease in the entire quantity of trainable parameters.

Connect to paper: https://paperswithcode.com/paper/pay-attention-to-mlps

Find out more about Rasa: https://rasa.com

Rasa documentation: http://rasa.com/docs

Join the Rasa Community: https://forum.rasa.com

Twitter: https://twitter.com/Rasa_HQ

Facebook: https://world wide web.facebook.com/RasaHQ

Linkedin: https://world wide web.linkedin.com/company/rasa

#AIchatbot #research #NLP

You May Also Like