Tagging this as a Good First issue if anyone's interested.

The position embedding in the BERT is not the same as in the transformer. Why not use the form in bert?

Spacy has customizable word level tokenizers with rules for multiple languages. I think porting that to rust would add nicely to this package. Having a customizable uniform word level tokenization across platforms (client web, server) and languages would be beneficial. Currently, idk any clean way or whether it's even possible to write bindings for spacy cython.

Spacy Tokenizer Code

https:

Hi,

First thanks for releasing this, it has been quite helpful.
Would be great if the README page mentioned in software requirements the dependency on pytorch-qrnn (for QRNN-based models). Currently, following the instructions and running one of the standard QRNN models will just throw a ModuleNotFoundError with no instructions. Would be great if there was a prior mention and/or a try/catch w

On home page of website: https://nlp.johnsnowlabs.com/ I read "Full Python, Scala, and Java support"

Unfortunately it's 3 days now I'm trying to use Spark NLP in Java without any success.

• I cannot find Java API (JavaDoc) of the framework.
• not event a single example in Java is available
• I do not know Scala, I do not know how to convert things like:
  val testData = spark.createDataFrame(

It would be great to have instructions on how to train a language model from scratch - not just loading the paper's model.

Hi,

I noticed that I cannot use nlp.update with Doc as inputs instead of raw strings. Please refer to the mini example below:

from spacy_transformers.language import TransformersLanguage
from spacy_transformers.pipeline.wordpiecer import TransformersWordPiecer
from spacy_transformers.pipeline.tok2vec import TransformersTok2Vec

nlp = TransformersLanguage(trf_name='test_bert', meta

I think the filenames in models.sh referred to on lines 4-9 should refer to kaldi-generic-en-tdnn_f-r20190609* which is downloaded on line 3.

File "main.py", line 40, in
tf.app.run()
File "/home/luban/anaconda2/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 48, in run
_sys.exit(main(_sys.argv[:1] + flags_passthrough))
File "main.py", line 30, in main
train(args)
File "/nfs/private/proj/chatbot/lib/train.py", line 32, in train
model = seq2seq_model_utils.create_model(sess, arg