language-models

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Open-source offline translation library written in Python

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).

ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

An easy to use Natural Language Processing library and framework for predicting, training, fine-tuning, and serving up state-of-the-art NLP models.

A package built on top of Hugging Face's transformers library that makes it easy to utilize state-of-the-art NLP models

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

🤗 ParsBERT: Transformer-based Model for Persian Language Understanding

Pre-trained models and language resources for Natural Language Processing in Polish

This repository contains landmark research papers in Natural Language Processing that came out in this century.

This repository contains a collection of papers and resources on Reasoning in Large Language Models.

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

ChatGPT Universe is fleeting notes on ChatGPT, GPT, and large language models (LLMs)

The "tl;dr" on a few notable transformer papers (pre-2022).

Crosslingual Generalization through Multitask Finetuning

Repository for the paper "Reasoning with Language Model Prompting: A Survey".