About me

I am a natural language processing researcher at Naver Labs Europe in Grenoble, France, focusing on making recent NLP advances applicable across domains and languages.

Before joining NLE, I did my PhD on deep learning for source code processing at the Centre of Deep Learning and Bayesian Methods of the HSE University, where I was advised by Prof. Dmitry Vetrov, the head of our Bayesian Methods Research Group. I received my Bachelor's and Master's degrees at Moscow State University. My research contributed to the adaptation of NLP approaches to source code, the investigation of neural network ensembles properties, and the sparsification of recurrent neural networks. At HSE, I also taught machine learning to Bachelor and Master students for 6 years and was selected by students for the Best Teacher award 3 times. During 2017-2019, I've been one of the main organizers of the Summer School on Deep Learning and Bayesian Methods.

News

• 21 March 2024 » Our study on cross-lingual transfer in generative tasks has been accepted to NAACL 2024 in Mexico City!
• 14 July 2023 » I presented our work on ambiguity in tokenization at ACL 2023 in Toronto, Canada
• 5 May 2023 » I presented our CodeBPE paper at ICLR 2023 in Kigali, Rwanda
• 7 Oct 2022 » I defended my PhD in Computer Science! (link to the thesis)
• 24 Jun 2022 » I joined Naver Labs Europe in Grenoble as an NLP researcher!
• 29 Apr 2022 » We presented our spotlight paper on CodeBPE at the DL4Code workshop of ICLR 2022 (online)!
• 01 Oct 2021 » Our paper on analyzing the interplay between weight decay and batch normalization has been accepted to NeurIPS 2021 (online)!
• 22 Aug 2021 » We with Sergey Troshin presented our paper Empirical Study of Transformers for Source Code at ESEC/FSE 2021 (online). Here is our code
• 7 Jun 2021 » Two papers on deep learning for source code presented at NAACL 2021 (a single-author long one and a short one with Sergey Troshin)
• 10 Oct 2020 » We presented our spotlight paper On Power Laws in Deep Ensembles at NeurIPS 2020 (online)
• 11 Feb 2020 » We with Ekaterina Lobacheva presented our paper at AAAI Conference on Artificial Intelligence in New York, USA (presentation, poster)
• 12 Dec 2019 » I presented our paper at NeurIPS Workshop on Context and Compositionality in Biological and Artificial Neural Systems in Vancouver, Canada
• 4 Dec 2019 » I gave a lecture on Bayesian neural networks at Machine Learning and Applications to Physics workshop in Madrid, Spain
• 25 Aug 2019 » We organized the third Deep|Bayes summer school.
• 4 Jul 2019 » I gave lecture and seminar on Bayesian neural networks at the Fifth Machine Learning in High Energy Physics Summer School in Hamburg, Germany
• 26 Jun 2019 » I took part in Google NLP summit in Zurich, Switzerland
• 7 Jun 2019 » I gave a tutorial on Bayesian sparsification of neural networks at Probabilistic AI summer school in Trondheim, Norway ( video )
• 7 Dec 2018 » I gave a contributed talk presenting our paper at NeurIPS Workshop on Compact Deep Neural Networks with industrial applications, Montreal, Canada
• 3 Nov 2018 » We presented our paper at EMNLP 2018, Brussels, Belgium
• 1 Sep 2018 » We organized the second Summer school on deep learning and Bayesian methods in Moscow, Russia. I was one of the main organizers
• 30 Aug 2017 » Our research group organized the first Summer school on deep learning and Bayesian methods in Moscow, Russia. We with Kate Lobacheva ran all the organization
• 10 Aug 2017 » We presented our paper at the ICML Workshop on Learning to Generate Natural Language, Sydney, Australia
• 14 Oct 2016 » Our paper was published in the Journal on machine learning and data analysis. I gave a talk presenting it at the 11th International Conference on Intelligent Data Processing in Barcelona, Spain