Welcome to the first optimization blog of the Spark Optimization series, in this article we will learn what cluster to choose based on memory, cores and storage. The goal of this is to give you enough so you can start off with an optimal cluster and save some money. Since I have worked mainly in AWS, I will refer its services like
Optimizing Spark Cluster
Optimizing Spark Cluster
Optimizing Spark Cluster
Welcome to the first optimization blog of the Spark Optimization series, in this article we will learn what cluster to choose based on memory, cores and storage. The goal of this is to give you enough so you can start off with an optimal cluster and save some money. Since I have worked mainly in AWS, I will refer its services like