Skip to content

ilyesarf/straw

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Compress big infra into one md file

Compression Rates

  • Logs: 3,774 lines -> 37 patterns (99.0% reduction)
  • Topology: 746 edges -> 11 flows (98.5% reduction)
  • Metrics: 507 samples -> 15 elevated (97.0% reduction)
  • Total LLM Token Reduction: 276k Tokens (Raw) -> 1100 Tokens (with straw) (99.5% reduction)

Test

$ go run main.go stream.txt

About

Compress big infra into one md file -- 99.5% llm token reduction

Resources

Stars

Watchers

Forks

Contributors

Languages