Skip to content

Pull requests: mlc-ai/mlc-llm

New pull requestNew
16 Open 1,657 Closed
16 Open 1,657 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

Perf: load weights, create KV cache, initialize tokenizer in parallel
#3215 opened Apr 27, 2025 by BekabooLoading…
[Refactor] PagedKVCache spec for MLC-LLM
#3203 opened Apr 14, 2025 by annanyaprLoading…
Update mlc_llm.rst correcting for mlc from mlc_llm
#3196 opened Apr 7, 2025 by agrajagcoLoading…
1
[Android] Support LLaVA and Phi-V
#3195 opened Apr 6, 2025 by davidlightmysterionLoading…
2
[Serving] Support tool function calls under strict format constraints
#3190 opened Mar 26, 2025 by IrfnfnkemedLoading…
3
[Serving] Add Structural-Tag api to RequestResponseFormat
#3187 opened Mar 24, 2025 by IrfnfnkemedLoading…
Refactored random.h to have PhiloxRandomGenerator
#3181 opened Mar 18, 2025 by annanyaprLoading…
[Model] Qwen-2-VL Support
#3125 opened Feb 10, 2025 by nihalgeorge01 • Draft
3
[CPP_CLI] MLC Cli App over JSONEngine interface
#3114 opened Jan 30, 2025 by srkreddy1238Loading…
@MasterJH5574@mengshyu
5
[Bench] Add support for multiple backend
#3037 opened Nov 20, 2024 by cyx-6 • Draft
[SERVE][CPP][Android] add native executable program to benchmark models
#2987 opened Oct 18, 2024 by pfk-betaLoading…
[Model] Add use_qk_norm option for Cohere model
#2877 opened Sep 2, 2024 by tlopexLoading…
4
[Serving] PagedKVCache Quantization
#2663 opened Jul 16, 2024 by davidpissarraLoading…
11
[Bench] Add bench for GSM8K eval
#2585 opened Jun 16, 2024 by HzfengsyLoading…
[Bench] Add bench for MMLU eval
#2584 opened Jun 16, 2024 by HzfengsyLoading…
Add docker container support
#1271 opened Nov 15, 2023 by Sing-LiLoading…
@junrushao
5
ProTip!no:milestone will show everything without a milestone.
close