Graph Attention Networks (https://arxiv.org/abs/1710.10903)
-
Updated
Apr 12, 2020 - Python
#
self-attention
Here are 85 public repositories matching this topic...
Datasets, tools, and benchmarks for representation learning of code.
python
nlp
data-science
data
machine-learning
natural-language-processing
deep-learning
tensorflow
ml
cnn
open-data
neural-networks
rnn
datasets
representation-learning
nlp-machine-learning
bert
programming-language-theory
self-attention
machine-learning-on-source-code
-
Updated
Jun 22, 2020 - Jupyter Notebook
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
nlp
text-classification
question-answering
document-classification
transfer-learning
fasttext
language-model
textcnn
attention-is-all-you-need
self-attention
transformer-encoder
bert-model
pre-training
language-understanding
-
Updated
Jan 1, 2019 - Python
CCNet: Criss-Cross Attention for Semantic Segmentation (ICCV 2019).
-
Updated
Jan 30, 2020 - Python
Text classification using deep learning models in Pytorch
text-classification
pytorch
lstm-model
glove
rnn-model
sentiment-classification
attention-model
self-attention
-
Updated
Nov 17, 2018 - Python
A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.
-
Updated
May 7, 2020 - Python
A Structured Self-attentive Sentence Embedding
visualization
deep-learning
python3
pytorch
classification
attention
attention-mechanism
attention-model
sentence-embeddings
self-attentive-rnn
self-attention
attention-weights
-
Updated
Sep 22, 2019 - Python
Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP
nlp
deep-learning
numpy
word2vec
word-embeddings
keras
python3
pytorch
recurrent-neural-networks
attention
nmt
skipgram
doc2vec
cnn-keras
saliency-map
seq2seq-pytorch
self-attention
document-embeddings
hierarchical-attention-network
-
Updated
Mar 11, 2020 - Jupyter Notebook
An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.
deep-learning
language-modeling
pytorch
recurrent-neural-networks
transformer
deepmind
language-model
word-language-model
self-attention
-
Updated
Dec 27, 2018 - Python
Implementing Stand-Alone Self-Attention in Vision Models using Pytorch
-
Updated
Feb 13, 2020 - Python
Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"
-
Updated
Jan 28, 2020 - Python
Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)
visualization
nlp
natural-language-processing
vuejs
deep-learning
attention
deep-learning-library
attention-mechanism
text-visualization
attention-mechanisms
deep-learning-visualization
self-attentive-rnn
self-attention
attention-visualization
attention-scores
-
Updated
May 4, 2018 - Vue
A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
-
Updated
Dec 10, 2018 - Python
A variant of the Self Attention GAN named: FAGAN (Full Attention GAN)
-
Updated
Nov 21, 2018 - Python
Transformer for Graph Classification (in Pytorch and Tensorflow)
transformer
unsupervised-learning
graph-embeddings
graph-classification
self-attention
graph-neural-networks
graph-representation-learning
pytorch-implementation
unsupervised-graph-embedding
node-embeddings
unsupervised-graph-neural-network
graph-transformer
-
Updated
Jun 24, 2020 - Python
Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)
text-classification
tensorflow
attention
attention-mechanism
iclr2017
sentence-embeddings
self-attention
-
Updated
Jun 25, 2018 - Python
Multi-turn dialogue baselines written in PyTorch
chatbot
transformer
seq2seq
attention
gcn
hred
baselines
self-attention
gat
multi-head
kgcvae
wseq
recosa
vhred
hran
hred-attn
dshred
word-level-attention
utterance-level-attention
dailydialog
-
Updated
Mar 10, 2020 - Python
The implementation of DeBERTa
deeplearning
representation-learning
language-model
bert
natural-language-understanding
self-attention
roberta
transformer-encoder
-
Updated
Jun 26, 2020 - Python
Representation learning on dynamic graphs using self-attention networks
-
Updated
Feb 11, 2020 - Python
reinforcement-learning
tensorflow
relational-networks
proximal-policy-optimization
ppo
explainable-ai
self-attention
-
Updated
Apr 15, 2019 - Python
Implementation from the paper Attention Augmented Convolutional Networks in Tensorflow (https://arxiv.org/pdf/1904.09925v1.pdf)
-
Updated
May 5, 2019 - Python
Code for Describing a Knowledge Base
deep-learning
wiki
text-generation
pytorch
generation
datasets
natural-language-generation
attention-mechanism
end-to-end-learning
self-attention
data-to-text
-
Updated
Feb 12, 2020 - Python
Sequence to Sequence Models in PyTorch
pytorch
transformer
pointer-networks
attention
sequence-to-sequence
rnn-encoder-decoder
self-attention
-
Updated
Jun 26, 2020 - Python
Transformer-based Relational Memory for Knowledge Graph Embeddings (ACL 2020) (in Pytorch and Tensorflow)
transformer
knowledge-graph
knowledge-graph-embeddings
self-attention
triple-classification
search-personalization
relational-memory
knowledge-graph-transformer
-
Updated
Jun 22, 2020 - Python
PyTorch implementation of the model presented in "Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention"
machine-learning
computer-vision
deep-learning
agriculture
pytorch
remote-sensing
cvpr
spatio-temporal
earth-observation
time-series-classification
self-attention
transformer-architecture
satellite-image
cvpr2020
-
Updated
Mar 30, 2020 - Python
Chatbot using Tensorflow (Model is transformer) ko
-
Updated
Dec 10, 2018 - Python
Collection of important Question-Answering papers implemented in PyTorch
deep-learning
spacy
neural-networks
question-answering
convolutional-neural-networks
attention-mechanism
nlp-machine-learning
pytorch-tutorial
self-attention
pytorch-implementation
squad-dataset
-
Updated
Jun 25, 2020 - Jupyter Notebook
Improve this page
Add a description, image, and links to the self-attention topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the self-attention topic, visit your repo's landing page and select "manage topics."
In official documents, there is a notice 'Each function object is meant to be used only once (in the forward pass).' in subclass of torch.autograd.Function.
In model SpGraphAttentionLayer, you have use the object of SpecialSpmmFunction(self.special_spmm) twice, one for e_rowsum and one for h_prime.
Is it the right usage for subclass of torch.autograd.Function?