spark.Accumulator

scala> val accum = sc.accumulator(0)
accum: org.apache.spark.Accumulator[Int] = 0

scala> sc.parallelize(Array(1, 2, 3, 4)).foreach(x => accum += x)
...
10/09/29 18:41:08 INFO SparkContext: Tasks finished in 0.317106 s

scala> accum.value
res2: Int = 10

http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.Accumulator

原文地址:https://www.cnblogs.com/rocky-AGE-24/p/7436460.html