Skip to content

Token by token streaming shouldn't use TextContent #146

@rakyll

Description

@rakyll

AGY harness streams token by token outputs by using TextContent. In Interactions proto, TextContent isn't for token streaming. Either we can introduce ContentBlock or can buffer tokens in AGY harness implementation and emit a TextContent when all tokens arrive.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions