MIPT Deep Learning Club #15
Batch normalization
Batch normalization
Quantum Kitchen Sinks
Eric Gaussier (CUEF de Grenoble - Université Grenoble Alpes) about “Semantic annotation in the biomedical domain: large scale classification and BioASQ” Eri...
Evolution Strategies
Daria Romanovskaia about Nature paper “Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning” Authors of this paper propos...
Michael Chertkov about “Science Application Informed Machine Learning” [ML in Physics, application of GANs to the problem of turbulence, controlling of energ...
Anton Karazeev about optical setups that can mimic the functionality of artificial neural networks (Optical Neural Networks) - paper [1], Nature, 2017. The ...
Taras Khakhulin about “Breaking the Softmax Bottleneck: A High-Rank RNN Language Model” The problem of constructing the Language model was considered as a f...
Anton Karazeev on classical methods of keyphrases extraction from (biomedical) texts: statistical (TF-IDF) and graphical (TextRank). Besides them, newly pro...
Anton Karazeev on application of neural networks (Restricted Boltzmann Machines, RBM) for quantum state tomography qst Tomography of quantum states is labou...
Danil Lykov on applications of attention-mechanisms Besides well-known paper “Show, Attend and Tell” by Bengio et al., a new paper about “AttnGAN” by Micros...
Danil Lykov about Hinton’s paper on “Dynamic Routing Between Capsules” New method of information transmitting from different areas of image is proposed (in ...
Emil Zakirov about “Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer” Authors studied conditional computation layer called Mi...
“Improving the Realism of Synthetic Images” - Anton Karazeev about paper by Apple (Machine Learning Journal) The key novelty here is using the generator’s h...
System for face recognition - Danil Lykov about “DeepFace” by Facebook
Synthesis of human speech from text - Emil Zakirov about generative model “WaveNet” by google [September, 2016] WaveNet [April, 2017] Tacotron
PyTorch Intro
Understanding Black-box Predictions