Search results

[LLM] time to first token

Status: Open.

#3392 In alibaba/MNN;

· pfk-beta opened on Apr 18, 2025

CPUAttention.cpp 和 KVCacheManager.cpp 问题

UserThe user ask question about how to use. Or don't use MNN correctly and cause bug.The user ask question about how to use. Or don't use MNN correctly and cause bug.

Status: Open.

#3391 In alibaba/MNN;

· DakeQQ opened on Apr 18, 2025

archlinux pymnn error!

questionFurther information is requestedFurther information is requested

Status: Open.

#3390 In alibaba/MNN;

· wxqwinner opened on Apr 18, 2025

请问ARM64 Linux上是否支持运行MNN-LLM，目前运行直接发生crash以及ARM Linux开发版是否支持OpenCL运行MNN-LLM

Status: Open.

#3389 In alibaba/MNN;

· mlbo opened on Apr 18, 2025

android和LINUXy运行速率不同

questionFurther information is requestedFurther information is requested

Status: Open.

#3388 In alibaba/MNN;

· shalong07 opened on Apr 17, 2025

ios MNN.framework编译失败

UserThe user ask question about how to use. Or don't use MNN correctly and cause bug.The user ask question about how to use. Or don't use MNN correctly and cause bug.

Status: Open.

#3387 In alibaba/MNN;

· achuge2008 opened on Apr 16, 2025

YOLO-10，CPU opencl精度没问题，cuda精度不达预期

questionFurther information is requestedFurther information is requested

Status: Open.

#3386 In alibaba/MNN;

· ppl21847 opened on Apr 16, 2025

sd1.5以训练模式导出模型问题

Train

Status: Open.

#3385 In alibaba/MNN;

· simon886212 opened on Apr 15, 2025

How to repeat the test?

UserThe user ask question about how to use. Or don't use MNN correctly and cause bug.The user ask question about how to use. Or don't use MNN correctly and cause bug.

Status: Open.

#3384 In alibaba/MNN;

· LY000001 opened on Apr 15, 2025

使用Vulkan作为推理后端时，如何获取每个 kernel/算子 的信息？

UserThe user ask question about how to use. Or don't use MNN correctly and cause bug.The user ask question about how to use. Or don't use MNN correctly and cause bug.

Status: Open.

#3383 In alibaba/MNN;

· Sodiride123 opened on Apr 14, 2025

ModuleBasic.out崩溃

questionFurther information is requestedFurther information is requested

Status: Open.

#3382 In alibaba/MNN;

· lucaslv404 opened on Apr 14, 2025

OpenCL后端崩溃

bugSomething isn't workingSomething isn't working

Status: Open.

#3381 In alibaba/MNN;

· lucaslv404 opened on Apr 14, 2025