You might have been a victim of skewed data when performing some operations in Spark especially that requires a shuffle like a Join and you might have noticed that your job takes longer and you don’t know what is going on and why it’s happening.
Solving Data Skewness in Spark
Solving Data Skewness in Spark
Solving Data Skewness in Spark
You might have been a victim of skewed data when performing some operations in Spark especially that requires a shuffle like a Join and you might have noticed that your job takes longer and you don’t know what is going on and why it’s happening.