#

language-model

Here are 1,104 public repositories matching this topic...

transformers

huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Updated Feb 4, 2023
Python

brightmart / nlp_chinese_corpus

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

nlp news wiki text-classification word2vec corpus dataset question-answering chinese chinese-nlp language-model bert chinese-corpus pretrain chinese-dataset

Updated Nov 21, 2022

EleutherAI / gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

transformers gpt language-model gpt-2 gpt-3

Updated Feb 25, 2022
Python

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

python machine-learning ai nextjs discord-bot assistant language-model chatgpt rlhf

Updated Feb 4, 2023
Python

haystack

deepset-ai / haystack

🔍 Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-3 and alike). Haystack offers production-ready tools to quickly build ChatGPT-like question answering, semantic search, text generation, and more.

Updated Feb 3, 2023
Python

tokenizers

huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

nlp natural-language-processing transformers gpt language-model bert natural-language-understanding

Updated Jan 31, 2023
Rust

NVIDIA / NeMo

NeMo: a toolkit for conversational AI

nlp text-to-speech deep-learning neural-network machine-translation tts speech-synthesis speech-recognition speech-to-text nmt language-model speaker-recognition nlp-machine-learning asr speaker-diarization text-normalization

Updated Feb 4, 2023
Python

codertimo / BERT-pytorch

Google AI 2018 BERT pytorch implementation

nlp pytorch transformer language-model bert

Updated Feb 2, 2023
Python

speechbrain / speechbrain

A PyTorch-based Speech Toolkit

Updated Feb 2, 2023
Python

EleutherAI / gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

transformers language-model gpt-3 deepspeed-library

Updated Feb 3, 2023
Python

mlfoundations / open_clip

An open source implementation of CLIP.

computer-vision deep-learning pytorch pretrained-models language-model contrastive-loss multi-modal-learning zero-shot-classification

Updated Feb 4, 2023
Python

CLUEbenchmark / CLUE

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

benchmark tensorflow nlu glue corpus transformers pytorch dataset chinese pretrained-models language-model albert bert roberta chineseglue

Updated Nov 21, 2022
Python

tensorflow / lingvo

Lingvo

nlp research translation tensorflow machine-translation speech distributed tts speech-synthesis mnist speech-recognition lm seq2seq speech-to-text gpu-computing language-model asr

Updated Feb 3, 2023
Python

zzw922cn / awesome-speech-recognition-speech-synthesis-papers

Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)

Updated Dec 8, 2022

CyberZHG / keras-bert

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

keras language-model bert

Updated Jan 22, 2022
Python

Separius / awesome-sentence-embedding

A curated list of pretrained sentence and word embedding models

nlp awesome natural-language word-embeddings awesome-list pretrained-models unsupervised-learning embedding-models language-model bert cross-lingual wordembedding sentence-embeddings pretrained-embedding sentence-representations contextualized-representation pretrained-language-model subword-models

Updated Apr 23, 2021
Python

chiphuyen / lazynlp

Library to scrape and clean web pages to create massive datasets.

python nlp data-science natural-language-processing text-mining open artificial-intelligence language-model

Updated Nov 11, 2020
Python

salesforce / awd-lstm-lm

LSTM and QRNN Language Model Toolkit for PyTorch

pytorch lstm sgd language-model qrnn

Updated Feb 12, 2022
Python

pytorch-cpp

prabhuomkar / pytorch-cpp

Sponsor

C++ Implementation of PyTorch Tutorials for Everyone

machine-learning tutorial cplusplus neural-network torch pytorch autograd artificial-intelligence generative-adversarial-network colab datasets tensors language-model convolutional-neural-network recurrent-neural-network libtorch interactive-tutorials scriptmodule-files

Updated Jan 4, 2023
C++

NVIDIA / OpenSeq2Seq

Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP

text-to-speech deep-learning tensorflow multi-node speech-synthesis speech-recognition seq2seq speech-to-text neural-machine-translation sequence-to-sequence language-model multi-gpu float16 mixed-precision

Updated May 11, 2021
Python

Improve this page

Add a description, image, and links to the language-model topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the language-model topic, visit your repo's landing page and select "manage topics."