#

transformer

Here are 789 public repositories matching this topic...

graykode / nlp-tutorial

Star

Natural Language Processing Tutorial for Deep Learning Researchers

nlp natural-language-processing tutorial tensorflow paper pytorch transformer attention bert

Updated Oct 3, 2020
Jupyter Notebook

google / trax

Star

Trax — Deep Learning with Clear Code and Speed

machine-learning reinforcement-learning deep-learning numpy deep-reinforcement-learning transformer jax

Updated Oct 3, 2020
Python

codertimo / BERT-pytorch

Star

Open

chooses 15% of token

1

makcedward commented Feb 22, 2019

From paper, it mentioned

Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.

It means that 15% of token will be choose for sure.

From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.

Read more

good first issue

Open

PositionalEmbedding

3

Open

Question about the loss of Masked LM

4

openai / jukebox

Star

Code for the paper "Jukebox: A Generative Model for Music"

audio music paper pytorch transformer generative-model vq-vae

Updated Jul 4, 2020
Python

Kyubyong / transformer

Star

A TensorFlow Implementation of the Transformer: Attention Is All You Need

translation transformer implementation attention-mechanism attention-is-all-you-need

Updated Sep 25, 2020
Python

Morizeyao / GPT2-Chinese

Star

Chinese version of GPT2 training code, using BERT tokenizer.

nlp text-generation transformer chinese gpt-2

Updated Aug 17, 2020
Python

xmuSistone / ViewpagerTransition

Star

viewpager with parallax pages, together with vertical sliding (or click) and activity transition

parallax transition viewpager transformer

Updated May 3, 2017
Java

posthtml / posthtml

Star

PostHTML is a tool to transform HTML/XML with JS plugins

html parser xml transformer html-parser xml-parser posthtml

Updated Sep 23, 2020
JavaScript

bentrevett / pytorch-seq2seq

Star

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

tutorial pytorch transformer lstm gru rnn seq2seq attention neural-machine-translation sequence-to-sequence encoder-decoder pytorch-tutorial pytorch-tutorials encoder-decoder-model pytorch-implmention pytorch-nlp torchtext pytorch-implementation pytorch-seq2seq cnn-seq2seq

Updated Jun 1, 2020
Jupyter Notebook

huggingface / pytorch-openai-transformer-lm

Star

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

pytorch transformer openai neural-networks language-model

Updated Feb 7, 2019
Python

awslabs / sockeye

Star

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

machine-learning deep-neural-networks translation deep-learning mxnet machine-translation transformer seq2seq neural-machine-translation sequence-to-sequence gluon attention-mechanism encoder-decoder attention-model sequence-to-sequence-models attention-alignment-visualization attention-is-all-you-need sockeye transformer-architecture transformer-network

Updated Oct 2, 2020
Python

microsoft / DialoGPT

Star

Large-scale pretraining for dialogue

machine-learning dialogue text-generation pytorch transformer data-processing text-data gpt-2 dialogpt

Updated Sep 20, 2020
Python

yangjianxin1 / GPT2-chitchat

Star

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

nlp text-generation transformer gpt-2 gpt2 dialogpt chichat dialogue-model

Updated May 16, 2020
Python

MikaelZero / mojito

Star

微信、bilibili大图、长图、gif、视频、自定义view的转场效果，The transition effect of wechat, bilibili large image, long image, GIF, video and custom view

android video drag gif transformer longimage photoview bigimageviewer bigimage dragimageview dragvideo

Updated Sep 24, 2020
Java

Separius / BERT-keras

Star

Keras implementation of BERT with pre-trained weights

nlp theano tensorflow keras language-modeling transformer transfer-learning pretrained-models

Updated Jul 26, 2019
Python

wajahatkarim3 / EasyFlipViewPager

Star

📖 The library for creating book and card flip animations in ViewPager in Android

android animation transformations android-library viewpager transformer flip pagetransformer page-transformer pageflip flip-animation viewpager-transformer viewpagertransformer

Updated May 12, 2020
Java

GaoQ1 / rasa_chatbot_cn

Star

building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)

python demo tensorflow policy rasa-nlu transformer chinese rasa bert slot-filling intent-classification rasa-core rasa-nlu-gao rasa-chatbot train-dialogue rasa-x

Updated Jun 21, 2020
Python

flugger / laravel-responder

Star

A Laravel Fractal package for building API responses, giving you the power of Fractal with Laravel's elegancy.

api laravel lumen fractal transformer responder

Updated Sep 9, 2020
PHP

kpe / bert-for-tf2

Star

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

tensorflow keras transformer bert

Updated Sep 3, 2020
Python

Tencent / TurboTransformers

Star

Open

How can I participate in this project?

3

lsy641 commented May 15, 2020

Hi, I am so interesting in your project, and wonder if you need contributor and how could I make my own contribution?

Read more

good first issue

Open

只支持huggingface训练的tensorflow模型载入么？

4

yuanxiaosc / BERT_Paper_Chinese_Translation

Star

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

paper transformer chinese-translation paper-translate bert

Updated Jun 1, 2020

qiaoguan / deep-ctr-prediction

Star

CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)

afm transformer resnet recommendation recommendation-algorithms ctr-prediction ctr recommendation-algorithm factorization-machine deepfm xdeepfm deep-ctr ad-algorithm esmm deep-cross deep-interest-network fibinet

Updated Nov 15, 2019
Python

geftimov / android-viewpager-transformers

Star

A collection of view pager transformers

android animation viewpager transformer android-viewpager-transformers pager-transformers

Updated May 30, 2017
Java

woutervh- / typescript-is

Star

typescript runtime transformer type-check

Updated Jul 16, 2020
TypeScript

kaituoxu / Speech-Transformer

Star

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

end-to-end pytorch transformer attention asr attention-is-all-you-need self-attention

Updated May 7, 2020
Python

lvapeab / nmt-keras

Star

Neural Machine Translation with Keras

machine-learning theano deep-learning tensorflow machine-translation keras decoding transformer gru neural-machine-translation sequence-to-sequence score nmt newer attention-mechanism web-demo attention-model lstm-networks attention-is-all-you-need attention-seq2seq nmt-keras

Updated Jul 3, 2020
Python

curiousily / Getting-Things-Done-with-Pytorch

Star

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BERT.

nlp machine-learning tutorial computer-vision deep-learning time-series sentiment-analysis pytorch transformer lstm yolo face-recognition face-detection object-detection transfer-learning bert anomaly-detection time-series-forecasting coronavirus time-series-anomaly-detection

Updated Jun 27, 2020
Jupyter Notebook

awesome-fast-attention

Separius / awesome-fast-attention

Star

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Oct 2, 2020
Python

cedrickchee / awesome-bert-nlp

Star

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

nlp natural-language-processing transformer neural-networks awesome-list transfer-learning language-model attention-mechanism bert gpt-2 xlnet pre-trained-language-models gpt-3

Updated Jul 29, 2020

kristerkari / react-native-svg-transformer

Star

Import SVG files in your React Native project the same way that you would in a Web application.

svg react-native loader transformer react-native-svg

Updated Jul 23, 2020
JavaScript

Improve this page

Add a description, image, and links to the transformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.