Skip to content
 
 

Latest commit

 

History

8 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

spark-tar

Extract spark event logs which are compressed with codecs like LZ4, Zstd, snappy etc

To build

sbt package

To use

$SPARK_HOME/bin/spark-submit --master local --class SparkEvents ~/spark-tar_2.12-0.1.jar <input-path (file:///spark-events.lz4)> <output-path (hdfs:///spark-events.log)>

About

Extract spark event logs which are compressed with codecs like LZ4, Zstd, snappy etc

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages