3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
rzvde-g8-kirsanov-dmitry
application UI
Details for Stage 178 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
6.8 min
Locality Level Summary:
Node local: 4
Output Size / Records:
2.2 GiB / 47295356
Shuffle Read Size / Records:
5.4 GiB / 47295356
Spill (Memory):
13.5 GiB
Spill (Disk):
4.6 GiB
Associated Job Ids:
102
DAG Visualization
digraph G { subgraph clusterstage_178 { label="Stage 178"; subgraph cluster1086 { label="Exchange"; 428 [labelType="html" label="ShuffledRowRDD [428] [Unordered]<br>parquet at NativeMethodAccessorImpl.java:0"]; } subgraph cluster1082 { label="WholeStageCodegen (2)"; 429 [labelType="html" label="MapPartitionsRDD [429] [Unordered]<br>parquet at NativeMethodAccessorImpl.java:0"]; } subgraph cluster1081 { label="WriteFiles"; 430 [labelType="html" label="MapPartitionsRDD [430] [Unordered]<br>parquet at NativeMethodAccessorImpl.java:0"]; } } 428->429; 429->430; }
427,428
Event Timeline
Enable zooming
Tasks: 4. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time