Search Results for author:
Found 2 papers, 2 papers with code
Language Modelling for Source Code with Transformer-XL
It has been found that software, like natural language texts, exhibits "naturalness", which can be captured by statistical language models.
Is Attention All What You Need? -- An Empirical Investigation on Convolution-Based Active Memory and Self-Attention
The key to a Transformer model is the self-attention mechanism, which allows the model to analyze an entire sequence in a computationally efficient manner.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
