#

text-processing

Here are 1,102 public repositories matching this topic...

learnbyexample / Command-line-text-processing

⚡ From finding text to search and replace, from sorting to beautifying text and more 🎨

ruby linux command-line regex perl ebook awk sed text-processing grep

Updated Oct 16, 2021
Shell

google / diff-match-patch

Diff Match Patch is a high-performance library in multiple languages that manipulates plain text.

diff match patch text-processing difference

Updated Jul 21, 2021
Python

chmln / sd

Intuitive find & replace CLI (sed alternative)

rust cli terminal command-line regex text-processing

Updated Jun 6, 2022
Rust

fastnlp / fastNLP

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

natural-language-processing deep-learning text-classification chinese-nlp text-processing nlp-parsing nlp-library

Updated Jun 11, 2022
Python

pyparsing / pyparsing

Python library for creating PEG parsers

python parsing parser-combinators python3 parsing-expression-grammar python-3 text-processing python-2 python2 parsing-library peg-parsers

Updated Jun 10, 2022
Python

kk7nc / Text_Classification

Text Classification Algorithms: A Survey

deep-learning random-forest text-classification recurrent-neural-networks naive-bayes-classifier dimensionality-reduction logistic-regression document-classification convolutional-neural-networks text-processing decision-trees boosting-algorithms support-vector-machines hierarchical-attention-networks nlp-machine-learning conditional-random-fields k-nearest-neighbours deep-belief-network rocchio-algorithm deep-neural-network

Updated Mar 9, 2022
Python

birchb1024 / frangipanni

Program to convert lines of text into a tree structure.

go golang tree-structure text-processing

Updated Dec 5, 2021
Go

pemistahl / lingua-go

👄 The most accurate natural language detection library for Go, suitable for long and short text alike

nlp go natural-language-processing language-detection language-modeling golang-library text-processing nlp-machine-learning language-recognition language-processing language-identification language-classification

Updated Apr 20, 2022
Go

BurntSushi / aho-corasick

A fast implementation of Aho-Corasick in Rust.

search finite-state-machine text-processing aho-corasick substring-matching

Updated Jun 2, 2022
Rust

cbaziotis / ekphrasis

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

nlp tokenizer text-processing semeval nlp-library word-segmentation spelling-correction tokenization text-segmentation spell-corrector word-normalization

Updated May 26, 2022
Python

sstadick / hck

A sharp cut(1) clone.

rust command-line text-processing

Updated Jun 7, 2022
Rust

abadojack / whatlanggo

Natural language detection library for Go

nlp go language text-processing

Updated Jan 15, 2021
Go

derek73 / python-nameparser

A simple Python module for parsing human names into their individual components

python text-processing text-parser python-module

Updated Feb 8, 2022
Python

open-korean-text / open-korean-text

Open Korean Text Processor - An Open-source Korean Text Processor

natural-language-processing tokenizer korean text-processing korean-text-processing korean-tokenizer

Updated Mar 1, 2021
Scala

proycon / pynlpl

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

python nlp machine-learning natural-language-processing library linguistics computational-linguistics text-processing nlp-library search-algorithms evaluation-metrics folia language-modelling

Updated Mar 13, 2019
Python

andrewbihl / bsed

Open

Allow catch-all line commands

andrewbihl commented Jan 27, 2020

I'd like to be able to run commands on all lines of a file. For example, bsed wrap lines with " should execute on all lines of the file. Current workaround is to include some trivial filter like wrap lines containing '.' with "

Read more

good first issue Easy

airbnb / artificial-adversary

🗣️ Tool to generate adversarial text examples and test machine learning models against them

python spam data-science machine-learning text-mining data-mining text-classification metrics text text-analysis python3 classification text-processing python2 spam-filtering spam-detection spam-classification adversarial-examples black-box-attacks black-box-benchmarking

Updated Jan 7, 2022
Python

textpipe / textpipe

Textpipe: clean and extract metadata from text

nlp text-analysis named-entities named-entity-recognition text-processing language-identification

Updated Jun 9, 2021
Python

PyKoSpacing

haven-jeon / PyKoSpacing

Automatic Korean word spacing with Python

nlp text-processing spacing korean-nlp

Updated May 27, 2022
Python

BurntSushi / regex-automata

A low level regular expression library that uses deterministic finite automata.

rust automata regex regexp text-processing nfa automaton dfa regex-engine

Updated Jun 12, 2022
Rust

gagolews / stringi

Open

stringi cheat sheet

2

waynelapierre commented Jan 1, 2021

Are there any cheat sheets of stringi available? Like this one of stringr: http://edrub.in/CheatSheets/cheatSheetStringr.pdf

It would be more efficient to have a cheat sheet since R base, stringr, and stringi have different but similar types of syntax, which could be confusing some times.

Read more

documentation good first issue

pyarabic

linuxscout / pyarabic

pyarabic

text-processing nlp-library arabic-language

Updated Apr 1, 2022
Python

ikegami-yukino / jaconv

Sponsor

Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku

transliteration japanese-language text-processing pure-python preprocessing character-converter japanese-kana julius

Updated Oct 11, 2021
Python

rust-unic

open-i18n / rust-unic

Open

Support for stdin

2

ad-si commented Jan 8, 2019

This should work:

cat test.txt | unic-inspector

Read more

enhancement help wanted good first issue A: apps

textvec / textvec

Text vectorization tool to outperform TFIDF for classification tasks

python nlp machine-learning natural-language-processing text-classification text-analysis tf-idf text-processing

Updated Dec 3, 2020
Python

s3nh / text-detector

Sponsor

Tool which allow you to detect and translate text.

nlp recognition deep-learning text craft pytorch text-recognition text-processing ocr-recognition crnn scene-text-detection scene-text-detectors

Updated Sep 10, 2019
Python

NIHOPA / NLPre

Python library for Natural Language Preprocessing (NLPre)

python nlp natural-language-processing text-processing nlp-parsing

Updated Jun 29, 2021
Python

himkt / konoha

Sponsor

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

nlp natural-language-processing japanese text-processing mecab kytea sudachi sentencepiece janome

Updated Jan 26, 2022
Python

RandyPen / TextCluster

短文本聚类预处理模块 Short text cluster

nlp text-mining cluster text-processing text-clustering text-cluster

Updated Dec 28, 2019
Python

larrykollar / Unix-Text-Processing

Recreated sources for the book "UNIX Text Processing," published in 1987.

unix formatting publishing text-processing groff utp gnu-troff utp-revival

Updated Oct 20, 2020
Roff

Improve this page

Add a description, image, and links to the text-processing topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the text-processing topic, visit your repo's landing page and select "manage topics."