no code implementations • 2 Aug 2021 • Jordan Inturrisi, Sui Yang Khoo, Abbas Kouzani, Riccardo Pagliarella
We demonstrate how PiLU is a generalised rectifier unit and note its similarities with the Adaptive Piecewise Linear Units, namely adaptive and piecewise linear.
