Skip to content

Pull requests: mlc-ai/mlc-llm

New pull requestNew
Clear current search query, filters, and sorts
16 Open 1,657 Closed
16 Open 1,657 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

Perf: load weights, create KV cache, initialize tokenizer in parallel
#3215 opened Apr 27, 2025 by BekabooLoading… updated Apr 27, 2025
[Serving] Support tool function calls under strict format constraints
#3190 opened Mar 26, 2025 by IrfnfnkemedLoading… updated Apr 24, 2025
3
[Android] Support LLaVA and Phi-V
#3195 opened Apr 6, 2025 by davidlightmysterionLoading… updated Apr 18, 2025
2
[Refactor] PagedKVCache spec for MLC-LLM
#3203 opened Apr 14, 2025 by annanyaprLoading… updated Apr 14, 2025
Update mlc_llm.rst correcting for mlc from mlc_llm
#3196 opened Apr 7, 2025 by agrajagcoLoading… updated Apr 7, 2025
1
Refactored random.h to have PhiloxRandomGenerator
#3181 opened Mar 18, 2025 by annanyaprLoading… updated Apr 6, 2025
[Serving] Add Structural-Tag api to RequestResponseFormat
#3187 opened Mar 24, 2025 by IrfnfnkemedLoading… updated Mar 26, 2025
[Model] Qwen-2-VL Support
#3125 opened Feb 10, 2025 by nihalgeorge01 • Draft updated Mar 10, 2025
3
[CPP_CLI] MLC Cli App over JSONEngine interface
#3114 opened Jan 30, 2025 by srkreddy1238Loading… updated Jan 31, 2025
@MasterJH5574@mengshyu
5
[Serving] PagedKVCache Quantization
#2663 opened Jul 16, 2024 by davidpissarraLoading… updated Dec 21, 2024
11
[Bench] Add support for multiple backend
#3037 opened Nov 20, 2024 by cyx-6 • Draft updated Nov 21, 2024
[SERVE][CPP][Android] add native executable program to benchmark models
#2987 opened Oct 18, 2024 by pfk-betaLoading… updated Oct 18, 2024
[Model] Add use_qk_norm option for Cohere model
#2877 opened Sep 2, 2024 by tlopexLoading… updated Oct 9, 2024
4
[Bench] Add bench for MMLU eval
#2584 opened Jun 16, 2024 by HzfengsyLoading… updated Jun 22, 2024
[Bench] Add bench for GSM8K eval
#2585 opened Jun 16, 2024 by HzfengsyLoading… updated Jun 22, 2024
Add docker container support
#1271 opened Nov 15, 2023 by Sing-LiLoading… updated May 27, 2024
@junrushao
5
ProTip! Mix and match filters to narrow down what you’re looking for.
close