mlc-ai

All

33 repositories

xgrammar
Public
Fast, Flexible and Portable Structured Generation
large-language-models structured-generation
C++
•
Apache License 2.0
•118•1.5k•17•11•Updated Jan 3, 2026Jan 3, 2026
wheels
Public
HTML
•0•0•0•0•Updated Jan 2, 2026Jan 2, 2026
mlc-llm
Public
Universal LLM Deployment Engine with ML Compilation
language-model tvm llm machine-learning-compilation
Python
•
Apache License 2.0
•1.9k•22k•314•32•Updated Dec 31, 2025Dec 31, 2025
relax
Public
Python
•
Apache License 2.0
•89•171•20•4•Updated Dec 31, 2025Dec 31, 2025
mlc-ai.github.io
Public
HTML
•0•0•0•0•Updated Dec 18, 2025Dec 18, 2025
package
Public
Shell
•
Apache License 2.0
•16•14•2•0•Updated Dec 18, 2025Dec 18, 2025
book-zh
Public
HTML
•0•0•0•0•Updated Dec 18, 2025Dec 18, 2025
book-en
Public
HTML
•3•9•0•0•Updated Dec 18, 2025Dec 18, 2025
mlc-zh
Public
Python
•
Apache License 2.0
•69•623•3•1•Updated Dec 18, 2025Dec 18, 2025
mlc-en
Public
Python
•
Apache License 2.0
•59•451•1•1•Updated Dec 18, 2025Dec 18, 2025
blog
Public
HTML
•2•4•0•0•Updated Dec 2, 2025Dec 2, 2025
web-llm
Public
High-performance In-browser LLM Inference Engine
deep-learning language-model webgpu tvm webml llm chatgpt
TypeScript
•
Apache License 2.0
•1.2k•17k•138•16•Updated Nov 24, 2025Nov 24, 2025
binary-mlc-llm-libs
Public
Python
•58•281•24•1•Updated Nov 20, 2025Nov 20, 2025
tvm-ffi
Public
Open ABI and FFI for Machine Learning Systems
C++
•
Apache License 2.0
•48•0•0•0•Updated Nov 9, 2025Nov 9, 2025
XGrammar-web-assets
Public
Apache License 2.0
•0•1•0•0•Updated Oct 21, 2025Oct 21, 2025
web-llm-chat
Public
Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
chat privacy ai nextjs chatbot llama hermes chat-application gemma webgpu
TypeScript
•
Apache License 2.0
•174•921•12•9•Updated Sep 3, 2025Sep 3, 2025
tokenizers-cpp
Public
Universal cross-platform tokenizers binding to HF and sentencepiece
C++
•
Apache License 2.0
•105•438•23•4•Updated Aug 8, 2025Aug 8, 2025
mlc-python
Public
C++
•
Apache License 2.0
•7•38•2•0•Updated Jul 19, 2025Jul 19, 2025
mlc-backtrace
Public
C++
•3•3•0•0•Updated Apr 13, 2025Apr 13, 2025
webllm-playground
Public
Run LLMs in the Browser with MLC / WebLLM ✨
TypeScript
•23•12•0•0•Updated Jan 22, 2025Jan 22, 2025
web-llm-assistant
Public
AI Assistant running within your browser.
chrome-extension agent machine-learning foundation-models large-language-models
TypeScript
•
Apache License 2.0
•17•77•3•0•Updated Dec 3, 2024Dec 3, 2024
web-agent-interface
Public
An interface for AI Agents to interact with various web platforms.
TypeScript
•7•19•1•0•Updated Dec 3, 2024Dec 3, 2024
notebooks
Public
Jupyter Notebook
•
Apache License 2.0
•80•217•10•1•Updated Nov 22, 2024Nov 22, 2024
docs
Public archive
The documents for TVM Unity
Shell
•
Apache License 2.0
•2•8•0•2•Updated Aug 9, 2024Aug 9, 2024
jekyll-theme-mlc
Public
SCSS
•
Apache License 2.0
•1•0•0•0•Updated May 27, 2024May 27, 2024
llm-perf-bench
Public
Python
•
Apache License 2.0
•13•120•4•2•Updated Apr 22, 2024Apr 22, 2024
web-data
Public
supporting data for web
Apache License 2.0
•5•2•0•0•Updated Apr 16, 2024Apr 16, 2024
web-stable-diffusion
Public
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
deep-learning web-assembly webgpu tvm webml stable-diffusion
Jupyter Notebook
•
Apache License 2.0
•235•3.7k•34•2•Updated Mar 12, 2024Mar 12, 2024
env
Public
repo for docker related builds
Shell
•
Apache License 2.0
•0•3•0•0•Updated Jan 21, 2024Jan 21, 2024
text-generation-webui
Public
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Python
•
GNU Affero General Public License v3.0
•5.9k•4•0•0•Updated Nov 16, 2023Nov 16, 2023