Fourier Neural Networks: A Comparative Study

no code implementations • 8 Feb 2019 • Abylay Zhumekenov, Malika Uteuliyeva, Olzhas Kabdolov, Rustem Takhanov, Zhenisbek Assylbekov, Alejandro J. Castro

We review neural network architectures which were motivated by Fourier series and integrals and which are referred to as Fourier neural networks.

Reproducing and Regularizing the SCRN Model

1 code implementation • COLING 2018 • Olzhas Kabdolov, Zhenisbek Assylbekov, Rustem Takhanov

We reproduce the Structurally Constrained Recurrent Network (SCRN) model, and then regularize it using the existing widespread techniques, such as naive dropout, variational dropout, and weight tying.

Language Modelling