Skip to content

[LLM Runner] Store grammar/schema in PTE via NamedData #19477

Open
Open
[LLM Runner] Store grammar/schema in PTE via NamedData#19477
Assignees
kirklandsign
Labels
module: llmIssues related to LLM examples and apps, and to the extensions/llm/ codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
@kirklandsign

Description

@kirklandsign
kirklandsign
opened on May 11, 2026

Embed grammar in .pte via NamedData. add_metadata(grammar=..., grammar_type=...) on export side, runner reads at load time. GenerationConfig overrides. Depends on: metadata NamedData integration (D104322796).

cc @larryliu0820 @mergennachin @cccclai @helunwencser @jackzhxng

Metadata

Metadata

Assignees

Labels

module: llmIssues related to LLM examples and apps, and to the extensions/llm/ codetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Fields

No fields configured for issues without a type.

Projects

ExecuTorch Core

Status

To triage
ExecuTorch LLM Runner

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions