#spark
Read more stories on Hashnode
Articles with this tag
Designing Data-Intensive Applications [Book Highlights] [ Part II ] Distributed Data why we distribute a database across multiple...
Designing Data-Intensive Applications [Book Highlights] [Part I : Chapter IV] Encoding and Evolution Avro To maintain forward and backward...
Spark Structured Streaming Dynamic Dataset Join I have came across a unique problem, I had a list of valid names in some remote configuration which...
Spark Streaming from Amazon SQS So this is a journal log, to describe how was I able to integrate Spark Streaming and Amazon SQS and what all problems...
Long Running Spark Streaming Jobs Fault Tolerance Spark and YARN both were not really designed for real time processing, but they have adapted to the...
Spark Streaming Misc Spark Streaming's issue with s3/hdfs as stream source With reference to...