ChipokiaTech news, without the noise
← All stories
InfoQ·

LinkedIn Cuts Daily Spark Shuffle Fetch Failures from 750 to 20 with Apache Celeborn

LinkedIn deployed Apache Celeborn as a shared remote shuffle platform across most Spark and Flink workloads, reducing daily shuffle fetch failures from approximately 750 to 20. The deployment also lowered compute costs by 10%, improved application runtimes by…

Preview courtesy of InfoQ. The full article opens on their site.

More from InfoQ