Topic: kernel

IST-DASLab/

marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

aliyun/

alibabacloud-ecs-troubleshoot-skills

Troubleshooting skills for Alibaba Cloud ECS