About me
I am a natural language processing researcher at Naver Labs Europe in Grenoble, France,
focusing on making recent NLP advances applicable across domains and languages. Together with colleagues, I am co-teaching an NLP course at CentraleSupelec
and co-organizing an ALPS winter school.
Before joining NLE, I did my PhD on deep learning for source code processing at the
Centre of Deep Learning and Bayesian Methods of the
HSE University,
where I was advised by Prof. Dmitry Vetrov,
the head of our Bayesian Methods Research Group.
I received my Bachelor's and Master's degrees at Moscow State University.
My research contributed to the adaptation of NLP approaches to source code, the investigation of neural network ensembles properties,
and the sparsification of recurrent neural networks.
At HSE, I also taught machine learning to Bachelor and Master students for 6 years
and was selected by students for the Best Teacher award 3 times.
During 2017-2019, I've been one of the main organizers of the
Summer School on Deep Learning and Bayesian Methods.
News
- Oct 2024 » Our
work on Bergen, a benchmarking library for RAG,
has been accepted to EMNLP 2024 Findings!
I also presented its multilingual extension and our study on multilingual RAG at the
Knowledgeable LLMs workshop in Bangkok, Thailand!
- Sep 2024 » I presented our
study on cross-lingual transfer in generative tasks at NAACL 2024 in Mexico City,
and its follow-up on cross-lingual transfer in instruction tuning of LLMs at
INLG 2024 in Tokyo, Japan!
- Jun 2024 » I joined an organization committee of the
ALPS winter school (Advanced Language Processing School),
which will take place in April 2025 in French Alps!
- Jul 2023 » I presented our
work on ambiguity in tokenization at ACL 2023 in Toronto, Canada
- May 2023 » I presented our
CodeBPE paper at ICLR 2023 in Kigali, Rwanda
- Oct 2022 » I gave a talk about our results in DL4Code at
JetBrains research semianr (online)!
- Oct 2022 » I defended my PhD in Computer Science!
(link to the thesis)
- Jun 2022 » I joined
Naver Labs Europe in Grenoble, France
as an NLP researcher!
- Apr 2022 » We presented our
spotlight paper on CodeBPE
at the
DL4Code workshop of ICLR 2022
(online)!
- Oct 2021 » Our
paper on analyzing the interplay between weight decay and batch normalization
has been accepted to
NeurIPS 2021
(online)!
- Aug 2021 » We with Sergey Troshin presented our paper
Empirical Study of Transformers for Source Code
at ESEC/FSE 2021 (online).
Here is our code
- Jun 2021 » Two papers on deep learning for source code presented
at
NAACL 2021
(a single-author long one and a short one with Sergey Troshin)
- Oct 2020 » We presented our spotlight paper
On Power Laws in Deep Ensembles
at
NeurIPS 2020 (online)
- Feb 2020 » We with Ekaterina Lobacheva presented
our paper at
AAAI Conference on Artificial Intelligence
in New York, USA (presentation,
poster)
- Dec 2019 » I presented
our paper at
NeurIPS Workshop on Context and Compositionality in Biological and Artificial Neural Systems
in Vancouver, Canada
- Dec 2019 » I gave a lecture on Bayesian neural networks at
Machine Learning and Applications to Physics
workshop in Madrid, Spain
- Aug 2019 » We organized the third
Deep|Bayes summer school.
- Jul 2019 » I gave
lecture
and seminar
on Bayesian neural networks at the
Fifth Machine Learning in High Energy Physics Summer School in Hamburg, Germany
- Jun 2019 » I took part in
Google NLP summit in Zurich, Switzerland
- Jun 2019 » I gave a
tutorial on Bayesian sparsification of neural networks at
Probabilistic AI summer school in Trondheim, Norway (
video )
- Dec 2018 » I gave a contributed
talk presenting
our paper at NeurIPS
Workshop on Compact Deep Neural Networks with industrial applications, Montreal, Canada
- Nov 2018 » We presented
our paper at
EMNLP 2018, Brussels, Belgium
- Sep 2018 » We organized the second
Summer school on deep learning and Bayesian methods in Moscow, Russia. I was one of the main organizers
- Aug 2017 » Our research group organized the first
Summer school on deep learning and Bayesian methods in Moscow, Russia. We with
Kate Lobacheva ran all the organization
- Aug 2017 » We presented our
paper at the
ICML Workshop on Learning to Generate Natural Language,
Sydney, Australia
- Oct 2016 » Our
paper was published in the
Journal on machine learning and data analysis. I gave a
talk presenting it at the
11th International Conference on Intelligent Data Processing
in Barcelona, Spain