Spark RDD#
Resilient Distributed Datasets#
Resilient Distributed Datasets (RDD) is a fundamental data structure of Spark.
There are two ways to create RDDs − parallelizing an existing collection in your driver program, or referencing a dataset in an external storage system, such as a shared file system, HDFS, HBase, or any data source offering a Hadoop Input Format.
Iterative Operations on MapReduce#
Interactive Operations on MapReduce#
Iterative Operations on Spark RDD#
Interactive Operations on Spark RDD#
