Spark深入分析(目录)

Spark-Core

  • Spark-Init

  1. SparkContext
  2. SparkEnv
  3. SparkConf
  4. RpcEnv
  5. SparkStatusTracker
  6. SecurityManager
  7. SparkUI
  8. MetricsSystem
  • Spark-Memory

  1. ........
  • Spark-Storage

  1. SerializerManager
  2. BroadcastManager
  3. ShuffleManager
  4. MemoryManager
  5. NettyBlockTransferService
  6. BlockManagerMaster
  7. BlockManager
  • Spark-Compute

  1. LiveListenerBus
  2. MapOutputTracker
  3. DAGScheduler
  4. TaskScheduler
  5. ExecutorAllocationManager
  6. OutputCommitCoordinator
  7. ContextClearner
  • Spark-RunOn

  1. on Yarn
  2. on Standlone
  3. on Mesos
  4. on Local

Spark-Subassembly(Spark组件)

  • Spark-SQL

  1. Spark-Session
  2. Sql-Context
  3. BaseRelation
  4. SparkPlan
  5. SparkOptimizer
  6. SparkSqlParser
  7. QueryExecution
  • Spark-Streaming

  • Spark-MLib

  • Spark-Graphx

Spark-Public

  • Spark-Tags

 

 

 

 

 

 

 

 

 

 

(不定时更新,未完待续)

 

 

 

 

 

 

 

 

 

 

 

你可能感兴趣的:(Spark,SparkSql,SparkCore,Spark,Spark深入,Spark源码分析,SparkCore,SparkSql)