- 78d5382 feat(cli): group subcommands into Inference, Model Management, and LiteRT-LM File sections in help text by Wai Hon Law · 6 hours ago upstream/main
- 609bb73 Enable per-op profiling in LiteRT LM. by Google AI Edge · 6 hours ago
- f2f7810 [litertlm] Add SuppressTokensConfig to LiteRT-LM Swift API. by Bangcheng Wang · 6 hours ago
- 29b6369 Internal Change Only by Google AI Edge · 9 hours ago
- 3568271 Internal change by Google AI Edge · 9 hours ago
- 126cc31 Update dependencies of litert_lm by Google AI Edge · 9 hours ago
- b48da15 [litertlm] Add NoRepeatNgramConfig to LiteRT-LM Swift API. by Bangcheng Wang · 9 hours ago
- e5893b5 Add back proper config for mixed precision of GPU options. by Yi-Chun Kuo · 10 hours ago
- 62cfa40 Fix ASAN heap-use-after-free in EmbeddingLookupMultiModal by extending buffer lifetime. by Salil Tambe · 10 hours ago
- 12fb7cd [litertlm] Add RepetitionPenaltyConfig and maxOutputTokens to LiteRT-LM Swift API. by Bangcheng Wang · 10 hours ago
- 2e38d70 NPU: Report the max sequence length to the Engine to fail more gracefully by Matt Kreileder · 11 hours ago
- c72a126 fix(cli): include jsonschema in the PyPI dependency by Wai Hon Law · 11 hours ago
- 0e3ee2b Fix zero token and NaN metrics in LiteRT-LM benchmark logging. by Salil Tambe · 15 hours ago
- e8afa3b fix(benchmark): pass enable_speculative_decoding in Benchmark.run() by Wai Hon Law · 17 hours ago
- ce0fbc3 fix: remove thinking content handling from Qwen3 chat template by Wai Hon Law · 30 hours ago
- 372ff7e feat: set filterChannelContentFromKvCache to true by default by Wai Hon Law · 31 hours ago
- 7355f6d Add large Gemma 4 models (12B, 26B, 31B) and VRAM warning to LiteRT-LM chat app. by Google AI Edge · 32 hours ago
- f35fcbc feat: default filter_channel_content_from_kv_cache to None across CLI and language bindings by Wai Hon Law · 35 hours ago
- df23d63 Internal change to enable support for Google Tensor backend by Google AI Edge · 35 hours ago
- c74608b Centralize CPU and GPU option configurations across LiteRT-LM executors by Salil Tambe · 35 hours ago
- 587d1d6 Add response_format API for constrained decoding (JSON Schema and Regex) in Kotlin. by Wai Hon Law · 2 days ago
- e94d740 Internal change by Wai Hon Law · 2 days ago
- 0e380a5 On Windows, `ERROR` is defined as a macro. When passed as an argument, the preprocessor expands `ERROR` prematurely, resulting in build breaks. by Google AI Edge · 2 days ago
- f947287 Add a flag to set gpu_enable_metal_residency_set by Byungchul Kim · 2 days ago
- 5dc3536 [litertlm] Add SuppressTokensConfig to LiteRT-LM Kotlin API. by Bangcheng Wang · 2 days ago
- 92f3caa Add support for GPU LoRA weight verification for audio inputs and AST testing. by Salil Tambe · 2 days ago
- 2d816fb refactor: extract LiteRT-LM C API internal structs into shared engine_internal.h by Wai Hon Law · 2 days ago
- 21a1eba [litertlm] Add NoRepeatNgramConfig to LiteRtLm Kotlin API. by Bangcheng Wang · 2 days ago
- 70f8523 Set `self.handle = nil` in `Conversation.deinit` and `Engine.deinit` before native deallocation to prevent re-entry or double-free errors during teardown. by Yishuang Pang · 2 days ago
- 36c721f fix: support thinking budget for Qwen models and dynamically select first channel as thinking channel by Wai Hon Law · 2 days ago
- 4f2cae6 Reorder constructor initializer list in LlmLiteRtNpuCompiledModelExecutor to match class field declaration order and prevent compiler reordering warnings (-Wreorder-ctor). by Google AI Edge · 2 days ago
- 33e0b35 fix: support padded vocabulary sizes in ConstrainedDecoder by Wai Hon Law · 2 days ago
- 071264d Support response_format API in LiteRT-LM OpenAI handler. by Wai Hon Law · 2 days ago
- e5ab46e NPU execution: Update HW mask for sliding window attention by Matt Kreileder · 2 days ago
- 2bedb7b Set NPU backend in CompiledModel options by David Massoud · 2 days ago
- d75150e Downgrade most ABSL_LOG(INFO) to ABSL_VLOG. by Google AI Edge · 2 days ago
- 9643e94 Internal code update by Tenghui Zhu · 2 days ago
- 719ddb4 [litertlm] Add RepetitionPenaltyConfig to LiteRtLm Kotlin API. by Bangcheng Wang · 2 days ago
- 3f67cd3 Internal code update by Tenghui Zhu · 2 days ago
- c7adc1b Add metadata for LiteRT-LM embedding models. by Matthew Chan · 2 days ago
- 4698342 Expose op profiling symbols to litert windows DLL. by Google AI Edge · 2 days ago
- 325d683 Add GetTFLiteModelSectionOffsetAndSize to ModelResources. by David Massoud · 2 days ago
- 28441e2 Enable residency set configuration. by Fengwu Yao · 3 days ago
- d116ee4 Internal changes only. by Fengwu Yao · 3 days ago
- 1bdd7da fix: update LiteRtLmConversationConfig test struct layout to match C engine header by Wai Hon Law · 3 days ago
- e398f12 NPU: Initial implementation for sliding window attention support in HW cache update by Matt Kreileder · 3 days ago
- fddcd26 Add residency API setting. by Fengwu Yao · 3 days ago
- 4771083 Fix Windows model download path resolution in api_test.py using shutil.which. by Google AI Edge · 3 days ago
- 2a51e94 fix(cli): allow additional properties in config.json schema by Wai Hon Law · 3 days ago
- 5b92c80 Rename verify_api.py to api_test.py, configure GCS model downloads, fix Kokoro apt lock timeouts. by Google AI Edge · 3 days ago
- ef16b76 This is an internal change by Google AI Edge · 3 days ago
- 5ae2b32 Internal change by Google AI Edge · 3 days ago
- ef12fc2 feat(python): add response format API by Wai Hon Law · 3 days ago
- 13df7ab This is an internal change by Google AI Edge · 3 days ago
- 98eba9b Skip macOS gated model download and pytest on unauthenticated pull requests. by Salil Tambe · 3 days ago
- 2a568b8 feat(cli): add --chat-template option to litert-lm run by Wai Hon Law · 3 days ago
- 3852882 Implement single-turn prompt template rendering for GenericDataProcessor by delegating to RenderSingleTurnTemplateCommon. Also add unit tests verifying RenderSingleTurnTemplate for single-turn rendering and appending message flows. by Google AI Edge · 3 days ago
- 4991db6 feat(cli): add 9 new config options to config.json and validate via JSON Schema by Wai Hon Law · 3 days ago
- bea5562 [litertlm] Add SuppressTokensConfig to LiteRT LM C API and Python bindings. by Bangcheng Wang · 3 days ago
- 6340ece Fix Hugging Face S3 redirect 403 authorization failures on macOS and Linux CI workflows by Salil Tambe · 3 days ago
- 8cafae3 Update GetOptimizedPrefillWorkGroups to use cautious greedy algorithm by Marissa Ikonomidis · 4 days ago
- f871d8d [litertlm] Add NoRepeatNgramConfig to LiteRT LM C and Python APIs. by Bangcheng Wang · 4 days ago
- 4790839 Prepare only 1 step ahead of command buffer for single KV cache case by Byungchul Kim · 4 days ago
- 5c17868 Optimize MTP rejection sampling verifier batch locking by Salil Tambe · 4 days ago
- e5f9ba7 feat(cli): add pack and unpack commands and litertlm_builder.pack API by Wai Hon Law · 4 days ago
- 69cb398 feat(cli): add --speculative-decoding option and deprecate --enable-speculative-decoding; update --thinking options by Wai Hon Law · 4 days ago
- 44d2a22 Update CI build to download model from GCS instead of Hugging Face. by Google AI Edge · 4 days ago
- da33e30 feat(cli): support configuration via config.json and validation via JSON Schema by Wai Hon Law · 5 days ago
- db900bd Reset current context and executor if only session is released by Byungchul Kim · 5 days ago
- 020a3c0 Guard HuggingFaceTokenizer include with a build flag by Google AI Edge · 5 days ago
- 83a91b5 Update dependencies of litert_lm by Byungchul Kim · 6 days ago
- 156e8d8 feat(cli): use blue for all channel contents and print [/channel-name] at channel end by Wai Hon Law · 7 days ago
- 840fe9e Correct wrong condition to enable sampler handling input by Byungchul Kim · 7 days ago
- 056d1ba Internal changes only by Bangcheng Wang · 7 days ago
- 1d3024f Update checksums for LiteRT-LM v0.14.0 binary targets. by Google AI Edge · 8 days ago
- ad53ed1 Allow configurable NPU KV cache initialization value via model metadata. by Andrew Zhang · 8 days ago upstream/v0.15.0-alpha0
- 36af951 ci: add -c opt and unify bazel disk and repository cache paths in macOS CI workflow by Wai Hon Law · 8 days ago
- 5c1cd36 [litertlm] Add RepetitionPenaltyConfig to LiteRT LM C and Python APIs. by Bangcheng Wang · 8 days ago
- 60c408e style(cli): format non-streaming OpenAI handler JSON responses with 2-space indentation and trailing newline by Wai Hon Law · 8 days ago
- 105dcba Support varying audio chunk size for streaming audio encoder models by Yi-Chun Kuo · 8 days ago
- b0ac2f9 Reverts df914b949e728bced8059506d45736024720a51c by Fengwu Yao · 9 days ago
- 4c48743 Create test_lm_multi_prefill.litertlm for testing multi-prefill. by Matthew Chan · 9 days ago
- 8a4a12b Support varying audio chunk size for streaming audio encoder models by Google AI Edge · 9 days ago
- 862d3c0 feat(cli): add reasoning_tokens to usage in OpenAI chat completions endpoint by Wai Hon Law · 9 days ago
- eeb4802 Enable LFM on-device testing for Exynos NPU by Salil Tambe · 9 days ago
- ba9a470 feat(swift): expose ThinkingConfig and thinking token budget in Swift API by Wai Hon Law · 9 days ago
- df914b9 Update dependencies of litert_lm by Fengwu Yao · 9 days ago
- ca4dadc Automated Code Change by Google AI Edge · 9 days ago
- c8bc396 Support varying audio chunk size for streaming audio encoder models by Yi-Chun Kuo · 9 days ago
- 5dd1326 Fix premature callback invocation and empty prefill hang in Conversation. by Google AI Edge · 9 days ago
- 910fb26 [litertlm] Support completion_usage object in OpenAI server handler by Wai Hon Law · 9 days ago
- e62cbd2 feat(cli): support reasoning_effort parameter in OpenAI server handler by Wai Hon Law · 9 days ago
- 4174318 Bump version to 0.15.0 by Google AI Edge · 9 days ago
- fa7268c Fix msan failure by initializing memory of audio buffer in cached_session_test. by Matthew Chan · 9 days ago
- c27a4a8 Add LaTeX rendering to LiteRT-LM web chat app by Google AI Edge · 9 days ago
- 5893966 feat(kotlin): expose ThinkingConfig and thinking token budget in Kotlin API by Wai Hon Law · 9 days ago
- 2e4796b feat(cli): group thinking related options under the --thinking prefix by Wai Hon Law · 10 days ago
- d2b8a38 feat(kotlin): add maxOutputToken API to ConversationConfig and sendMessage by Wai Hon Law · 10 days ago
- dd411af fix(python): provide distinct error messages for different NPU initialization failures by Wai Hon Law · 10 days ago
- 440c37a ci: add --repository_cache flag and paths across Linux, Android, and macOS workflows by Wai Hon Law · 10 days ago