natural-language-processing
Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.
Here are 5,655 public repositories matching this topic...
When you look at the variables in the pretrained base uncased BERT the varibles look like list 1. When you do the training from scratch, 2 additional variables per layer are introduced, with suffixes adam_m and adam_v. It would be nice for someone to explain what these variables are? and what is their significance to the process of training?
If one were to manually initialize variables from a pri
-
Updated
May 27, 2020 - Python
-
Updated
Jun 8, 2020 - Python
I was going though the existing enhancement issues again and though it'd be nice to collect ideas for spaCy plugins and related projects. There are always people in the community who are looking for new things to build, so here's some inspiration
If you have questions about the projects I suggested,
-
Updated
Jun 14, 2020 - Python
-
Updated
Jun 12, 2017
Example (from TfidfTransformer)
if isinstance(docs[0], tuple):
docs = [docs]
return [self.gensim_model[doc] for doc in docs]
This method expects a list of tuples, instead of an iterable. This means that the entire corpus has to be stored as a lis
-
Updated
Jun 1, 2020
-
Updated
May 24, 2020
Looping the process of writing images into the .tfrecords-file works fine, but how do I read multiple images from a .tfrecords-file?
Is there any simple solution? would be great if added to the code.
-
Updated
May 31, 2020 - Jupyter Notebook
This output is unexpected. The In
returns the capitalize In
from PorterStemmer's output.
>>> from nltk.stem import PorterStemmer
>>> porter = PorterStemmer()
>>> porter.stem('In')
'In'
More details on https://stackoverflow.com/q/60387288/610569
I tried selecting hyper parameters of my model following "Tutorial 8: Model Tuning" below:
https://github.com/flairNLP/flair/blob/master/resources/docs/TUTORIAL_8_MODEL_OPTIMIZATION.md
Although I got the "param_selection.txt" file in the result directory, I am not sure how to interpret the file, i.e. which parameter combination to use. At the bottom of the "param_selection.txt" file, I found "
Feature request: separate logging for model computed loss and regularization loss in tensorboard
It would be nice to separately log model computed loss from regularization loss in tensorboard. Involves minor changes to the Trainer.
I propose this topic as feature request, but it's also a documentation issue, as lack of details in user guide paragraph: https://rasa.com/docs/rasa/core/actions/#custom-actions.
What specified in paragraph Execute Actions in Other Code is obscure to me, and details at the API documentation link [Action Server](]https://rasa.com/docs/rasa/api/acti
-
Updated
Jun 14, 2020
Prerequisites
Please fill in by replacing
[ ]
with[x]
.
- Are you running the latest
bert-as-service
? - Did you follow the installation and the usage instructions in
README.md
? - Did you check the [FAQ list in
README.md
](https://github.com/hanxiao/bert-as-se
The dutch sentiment file (see nl-sentiment.xml) has words with negative subjectivity, which does not respect the boundary values for subjectivity: [0.0, 1.0]. I did not check for how many cases, but the word "verloren" is an example.
Sentiment files for other languages may have negative subjectivity as well. Since
As per the StanfordCoreNLP documentation for CoreLabel, The functions after() and before() should return white space strings between the token and the next/previous tokens respectively.
However, they return an empty string always even if there are some white spaces when the tokenizer option **normalizeOth
The words and sentences properties are helpers that use the textblob.tokenizers.WordTokenizer and textblob.tokenizers.SentenceTokenizer classes, respectively.
You can use other tokenizers, such as those provided by NLTK, by passing them into the TextBlob constructor then accessing the t
Is your feature request related to a problem? Please describe.
Other related issues: #408 #251
I trained a Chinese model for spaCy, linked it to [spacy's package folder]/data/zh
(using spacy link
) and want to use that for ludwig. However, when I tried to set the config for ludwig, I received an error, which tell me that there is no way to load the Chinese model.
ValueError: Key ch
Excuse me, https://github.com/graykode/nlp-tutorial/blob/master/1-1.NNLM/NNLM-Torch.py#L50 The comment here may be wrong. It should be X = X.view(-1, n_step * m) # [batch_size, n_step * m]
Sorry for disturbing you.
-
Updated
Jun 15, 2020 - Python
-
Updated
Jun 4, 2020 - Python
Description
Add a ReadMe file in the GitHub folder.
Explain usage of the Templates
Other Comments
Principles of NLP Documentation
Each landing page at the folder level should have a ReadMe which explains -
○ Summary of what this folder offers.
○ Why and how it benefits users
○ As applicable - Documentation of using it, brief description etc
Scenarios folder:
○
When using a pocketsphinx wakeword mycroft tries to load a language specific model. If the model doesn't exist the load fails. (report on the forums)
This should be handled by using a fallback mechanism, so if no language specific model exists it should log a warning and fallback to using the english model that is included in mycr
It would be worth to provide a tutorial how to train a simple cross-language classification model using sentencepiece. Supposed to have a given training set and have chosen a model (let'say a simple Word2Vec plus softmax or a LSTM model, etc), how to use the created sentencepiece model (vocabulary/codes) to feed this model for train and inference?
Created by Alan Turing
- Wikipedia
- Wikipedia
Many models have identical implementations of
prune_heads
it would be nice to store that implementation as a method onPretrainedModel
and reduce the redundancy.