bigdata-notebook/spark_23 at master · soniclavier/bigdata-notebook · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
project		project
src		src
MEETUP_NOTES.md		MEETUP_NOTES.md
README.md		README.md
build.sbt		build.sbt

README.md

Spark 2.3/2.4.0-SNAPSHOT repository

Spark Structured Streaming
- Socket Stream
- File Stream
  - schema
- Kafka Source
- Kafka Sink
- EventTime
- ProcessingTime
- Watermarks
- Checkpointing
- Sliding Window
- Tumbling Window
- Aggregations/Operations
  - avg
  - count
  - max
  - flatMap
  - alias
  - filter
  - groupby
  - where
  - withColumnRenamed
  - repartition
  - partitionBy
- SQL
  - selectExpr
  - CAST
  - where
- Output Modes
  - complete
  - append
  - update
- Multiple Stream Queries
- Kafka Producer