IST-DASLab/

marlin

GitHub

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

1.1kstars

90forks

36issues

Apache-2.0license

2024since

Star historydaily snapshots by VibeCrowd

Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).

Alternatives & relatedmatched by topic overlap

hiyouga/

LlamaFactory

▲ 162/wk

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

74k9.0kPython

NousResearch/

hermes-agent

▲ 3.5k/wk

The agent that grows with you

225k44kPython

Significant-Gravitas/

AutoGPT

▲ 72/wk

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

186k46kPython

huggingface/

transformers

▲ 266/wk

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

163k34kPython

open-webui/

open-webui

▲ 729/wk

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

148k21kPython

langchain-ai/

langchain

▲ 595/wk

The agent engineering platform.

143k24kPython

Comparemarlin vs LlamaFactory marlin vs hermes-agent marlin vs AutoGPT

SharePost on X LinkedIn