nlp-library

💫 Industrial-strength Natural Language Processing (NLP) in Python

A comprehensive list of pytorch related content on github,such as different models,implementations,helper libraries,tutorials etc.

中文自然语言处理工具包 Toolkit for Chinese natural language processing

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

Awesome-pytorch-list 翻译工作进行中......

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.

Underthesea - Vietnamese NLP Toolkit

Kuromoji is a self-contained and very easy to use Japanese morphological analyzer designed for search

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021.

Japanese morphological analysis engine written in pure Python

Thai Natural Language Processing in Python.

Self-contained Japanese Morphological Analyzer written in pure Go

An Open-Source Toolkit for Prompt-Learning.

A Japanese Tokenizer for Business

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

👄 The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

skweak: A software toolkit for weak supervision applied to NLP tasks

Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?

📦 快速转化「中文数字」和「阿拉伯数字」～ (最新特性：分数，日期、温度等转化）

chatbot_ner: Named Entity Recognition for chatbots.

Pytorch NLP library based on FastAI

A Japanese tokenizer based on recurrent neural networks

multi_task_NLP is a utility toolkit enabling NLP developers to easily train and infer a single model for multiple tasks.

Python version of Sudachi, a Japanese tokenizer.

An NLP library for the Urdu language. It comes with a lot of battery included features to help you process Urdu data in the easiest way possible.

pyarabic

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.