Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

6.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

7.  def equals(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

8.  def finalize(): Unit

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( classOf[java.lang.Throwable] )

9.  final def getClass(): Class[_]

   Definition Classes

   AnyRef → Any

   Annotations

   @native()

10.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

11.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

12.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

13.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

14.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

15.  def onApplicationEnd(applicationEnd: SparkListenerApplicationEnd): Unit

    Called when the application ends

    Called when the application ends

    Definition Classes

    SparkListener → SparkListenerInterface

16.  def onApplicationStart(applicationStart: SparkListenerApplicationStart): Unit

    Called when the application starts

    Called when the application starts

    Definition Classes

    SparkListener → SparkListenerInterface

17.  def onBlockManagerAdded(blockManagerAdded: SparkListenerBlockManagerAdded): Unit

    Called when a new block manager has joined

    Called when a new block manager has joined

    Definition Classes

    SparkListener → SparkListenerInterface

18.  def onBlockManagerRemoved(blockManagerRemoved: SparkListenerBlockManagerRemoved): Unit

    Called when an existing block manager has been removed

    Called when an existing block manager has been removed

    Definition Classes

    SparkListener → SparkListenerInterface

19.  def onBlockUpdated(blockUpdated: SparkListenerBlockUpdated): Unit

    Called when the driver receives a block update info.

    Called when the driver receives a block update info.

    Definition Classes

    SparkListener → SparkListenerInterface

20.  def onEnvironmentUpdate(environmentUpdate: SparkListenerEnvironmentUpdate): Unit

    Called when environment properties have been updated

    Called when environment properties have been updated

    Definition Classes

    SparkListener → SparkListenerInterface

21.  def onExecutorAdded(executorAdded: SparkListenerExecutorAdded): Unit

    Called when the driver registers a new executor.

    Called when the driver registers a new executor.

    Definition Classes

    SparkListener → SparkListenerInterface

22.  def onExecutorBlacklisted(executorBlacklisted: SparkListenerExecutorBlacklisted): Unit

    Called when the driver excludes an executor for a Spark application.

    Called when the driver excludes an executor for a Spark application.

    Definition Classes

    SparkListener → SparkListenerInterface

23.  def onExecutorBlacklistedForStage(executorBlacklistedForStage: SparkListenerExecutorBlacklistedForStage): Unit

    Called when the driver excludes an executor for a stage.

    Called when the driver excludes an executor for a stage.

    Definition Classes

    SparkListener → SparkListenerInterface

24.  def onExecutorExcluded(executorExcluded: SparkListenerExecutorExcluded): Unit

    Called when the driver excludes an executor for a Spark application.

    Called when the driver excludes an executor for a Spark application.

    Definition Classes

    SparkListener → SparkListenerInterface

25.  def onExecutorExcludedForStage(executorExcludedForStage: SparkListenerExecutorExcludedForStage): Unit

    Called when the driver excludes an executor for a stage.

    Called when the driver excludes an executor for a stage.

    Definition Classes

    SparkListener → SparkListenerInterface

26.  def onExecutorMetricsUpdate(executorMetricsUpdate: SparkListenerExecutorMetricsUpdate): Unit

    Called when the driver receives task metrics from an executor in a heartbeat.

    Called when the driver receives task metrics from an executor in a heartbeat.

    Definition Classes

    SparkListener → SparkListenerInterface

27.  def onExecutorRemoved(executorRemoved: SparkListenerExecutorRemoved): Unit

    Called when the driver removes an executor.

    Called when the driver removes an executor.

    Definition Classes

    SparkListener → SparkListenerInterface

28.  def onExecutorUnblacklisted(executorUnblacklisted: SparkListenerExecutorUnblacklisted): Unit

    Called when the driver re-enables a previously excluded executor.

    Called when the driver re-enables a previously excluded executor.

    Definition Classes

    SparkListener → SparkListenerInterface

29.  def onExecutorUnexcluded(executorUnexcluded: SparkListenerExecutorUnexcluded): Unit

    Called when the driver re-enables a previously excluded executor.

    Called when the driver re-enables a previously excluded executor.

    Definition Classes

    SparkListener → SparkListenerInterface

30.  def onJobEnd(jobEnd: SparkListenerJobEnd): Unit

    Called when a job ends

    Called when a job ends

    Definition Classes

    SparkListener → SparkListenerInterface

31.  def onJobStart(jobStart: SparkListenerJobStart): Unit

    Called when a job starts

    Called when a job starts

    Definition Classes

    SparkListener → SparkListenerInterface

32.  def onNodeBlacklisted(nodeBlacklisted: SparkListenerNodeBlacklisted): Unit

    Called when the driver excludes a node for a Spark application.

    Called when the driver excludes a node for a Spark application.

    Definition Classes

    SparkListener → SparkListenerInterface

33.  def onNodeBlacklistedForStage(nodeBlacklistedForStage: SparkListenerNodeBlacklistedForStage): Unit

    Called when the driver excludes a node for a stage.

    Called when the driver excludes a node for a stage.

    Definition Classes

    SparkListener → SparkListenerInterface

34.  def onNodeExcluded(nodeExcluded: SparkListenerNodeExcluded): Unit

    Called when the driver excludes a node for a Spark application.

    Called when the driver excludes a node for a Spark application.

    Definition Classes

    SparkListener → SparkListenerInterface

35.  def onNodeExcludedForStage(nodeExcludedForStage: SparkListenerNodeExcludedForStage): Unit

    Called when the driver excludes a node for a stage.

    Called when the driver excludes a node for a stage.

    Definition Classes

    SparkListener → SparkListenerInterface

36.  def onNodeUnblacklisted(nodeUnblacklisted: SparkListenerNodeUnblacklisted): Unit

    Called when the driver re-enables a previously excluded node.

    Called when the driver re-enables a previously excluded node.

    Definition Classes

    SparkListener → SparkListenerInterface

37.  def onNodeUnexcluded(nodeUnexcluded: SparkListenerNodeUnexcluded): Unit

    Called when the driver re-enables a previously excluded node.

    Called when the driver re-enables a previously excluded node.

    Definition Classes

    SparkListener → SparkListenerInterface

38.  def onOtherEvent(event: SparkListenerEvent): Unit

    Called when other events like SQL-specific events are posted.

    Called when other events like SQL-specific events are posted.

    Definition Classes

    SparkListener → SparkListenerInterface

39.  def onResourceProfileAdded(event: SparkListenerResourceProfileAdded): Unit

    Called when a Resource Profile is added to the manager.

    Called when a Resource Profile is added to the manager.

    Definition Classes

    SparkListener → SparkListenerInterface

40.  def onSpeculativeTaskSubmitted(speculativeTask: SparkListenerSpeculativeTaskSubmitted): Unit

    Called when a speculative task is submitted

    Called when a speculative task is submitted

    Definition Classes

    SparkListener → SparkListenerInterface

41.  def onStageCompleted(stageCompleted: SparkListenerStageCompleted): Unit

    Called when a stage completes successfully or fails, with information on the completed stage.

    Called when a stage completes successfully or fails, with information on the completed stage.

    Definition Classes

    SparkListener → SparkListenerInterface

42.  def onStageExecutorMetrics(executorMetrics: SparkListenerStageExecutorMetrics): Unit

    Called with the peak memory metrics for a given (executor, stage) combination.

    Called with the peak memory metrics for a given (executor, stage) combination. Note that this is only present when reading from the event log (as in the history server), and is never called in a live application.

    Definition Classes

    SparkListener → SparkListenerInterface

43.  def onStageSubmitted(stageSubmitted: SparkListenerStageSubmitted): Unit

    Called when a stage is submitted

    Called when a stage is submitted

    Definition Classes

    SparkListener → SparkListenerInterface

44.  def onTaskEnd(taskEnd: SparkListenerTaskEnd): Unit

    Called when a task ends

    Called when a task ends

    Definition Classes

    SparkListener → SparkListenerInterface

45.  def onTaskGettingResult(taskGettingResult: SparkListenerTaskGettingResult): Unit

    Called when a task begins remotely fetching its result (will not be called for tasks that do not need to fetch the result remotely).

    Called when a task begins remotely fetching its result (will not be called for tasks that do not need to fetch the result remotely).

    Definition Classes

    SparkListener → SparkListenerInterface

46.  def onTaskStart(taskStart: SparkListenerTaskStart): Unit

    Called when a task starts

    Called when a task starts

    Definition Classes

    SparkListener → SparkListenerInterface

47.  def onUnpersistRDD(unpersistRDD: SparkListenerUnpersistRDD): Unit

    Called when an RDD is manually unpersisted by the application

    Called when an RDD is manually unpersisted by the application

    Definition Classes

    SparkListener → SparkListenerInterface

48.  def onUnschedulableTaskSetAdded(unschedulableTaskSetAdded: SparkListenerUnschedulableTaskSetAdded): Unit

    Called when a taskset becomes unschedulable due to exludeOnFailure and dynamic allocation is enabled.

    Called when a taskset becomes unschedulable due to exludeOnFailure and dynamic allocation is enabled.

    Definition Classes

    SparkListener → SparkListenerInterface

49.  def onUnschedulableTaskSetRemoved(unschedulableTaskSetRemoved: SparkListenerUnschedulableTaskSetRemoved): Unit

    Called when an unschedulable taskset becomes schedulable and dynamic allocation is enabled.

    Called when an unschedulable taskset becomes schedulable and dynamic allocation is enabled.

    Definition Classes

    SparkListener → SparkListenerInterface

50.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

51.  def toString(): String

    Definition Classes

    AnyRef → Any

52.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

53.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

54.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()