Grokfast: Accelerated Grokking by Amplifying Slow Gradients

1 code implementation • 30 May 2024 • Jaerin Lee, Bong Gyun Kang, Kihoon Kim, Kyoung Mu Lee

One puzzling artifact in machine learning dubbed grokking is where delayed generalization is achieved tenfolds of iterations after near perfect overfitting to the training data.

RHOBIN Challenge: Reconstruction of Human Object Interaction

no code implementations • 7 Jan 2024 • Xianghui Xie, Xi Wang, Nikos Athanasiou, Bharat Lal Bhatnagar, Chun-Hao P. Huang, Kaichun Mo, Hao Chen, Xia Jia, Zerui Zhang, Liangxian Cui, Xiao Lin, Bingqiao Qian, Jie Xiao, Wenfei Yang, Hyeongjin Nam, Daniel Sungho Jung, Kihoon Kim, Kyoung Mu Lee, Otmar Hilliges, Gerard Pons-Moll

Modeling the interaction between humans and objects has been an emerging research direction in recent years.

3D Reconstruction Human-Object Interaction Detection +3

KNU-HYUNDAI's NMT system for Scientific Paper and Patent Tasks onWAT 2019

no code implementations • WS 2019 • Cheoneum Park, Young-Jun Jung, Kihoon Kim, Geonyeong Kim, Jae-Won Jeon, Seongmin Lee, Jun-Seok Kim, Chang-Ki Lee

In this paper, we describe the neural machine translation (NMT) system submitted by the Kangwon National University and HYUNDAI (KNU-HYUNDAI) team to the translation tasks of the 6th workshop on Asian Translation (WAT 2019).

Data Augmentation Machine Translation +2