Deep learning

Current implementation of Go binding can not specify options.

GPUOptions struct is in internal package. And go generate doesn't work for protobuf directory. So we can't specify GPUOptions for NewSession.

As reported by some people (see NielsRogge/Transformers-Tutorials#53 and on the forum), the generate() method currently does not take into account config.decoder.eos_token_id, only config.eos_token_id to properly stop generation.

Hence, models that are made using EncoderDecoderModel/`VisionEnco

🐛 Describe the bug

Usage of RRefContext::handleException in torch/csrc/distributed/rpc/rref_context.cpp is wrong when the future has an error.

RRefContext::handleException uses TORCH_CHECK which throws.

Callers of RRefContext::handleException don't expect that and run code after it without any guarding.

Versions

master

cc @pietern @mrshenli @pritamdamania87

According to FastAPI's docs, response_model can accept type annotations that are not pydantic models. However, the code referenced below is checking for the __fields__ attribute, which won't be on type annotations such as list[float], for example.

https://github.com/ray-project/ray/blob/e60a5f52eb93c851b186cb78fa1f70d