3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
g10-chepusov-vladislav-stage2
application UI
Details for Stage 15 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 s
Locality Level Summary:
Process local: 8
Input Size / Records:
335.8 MiB / 515
Shuffle Write Size / Records:
343.7 MiB / 5121533
Associated Job Ids:
9
DAG Visualization
digraph G { subgraph clusterstage_15 { label="Stage 15"; subgraph cluster0 { label="Scan csv "; 0 [labelType="html" label="FileScanRDD [0]<br>count at NativeMethodAccessorImpl.java:0"]; 1 [labelType="html" label="MapPartitionsRDD [1]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster1 { label="mapPartitionsInternal"; 2 [labelType="html" label="MapPartitionsRDD [2]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster2 { label="mapPartitionsInternal"; 3 [labelType="html" label="FileScan csv [ride_id#0,rideable_type#1,started_at#2,ended_at#3,start_station_name#4,start_station_id#5,end_station_name#6,end_station_id#7,start_lat#8,start_lng#9,end_lat#10,end_lng#11,member_casual#12] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(6 paths)[s3a://rzvde-g10-chepusov-vladislav/raw/citibike_data/202508/202508-cit..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<ride_id:string,rideable_type:string,started_at:timestamp,ended_at:timestamp,start_station_...\n [3] [Cached]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster108 { label="InMemoryTableScan"; 39 [labelType="html" label="MapPartitionsRDD [39]<br>count at NativeMethodAccessorImpl.java:0"]; 40 [labelType="html" label="MapPartitionsRDD [40]<br>count at NativeMethodAccessorImpl.java:0"]; 41 [labelType="html" label="MapPartitionsRDD [41]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster103 { label="WholeStageCodegen (1)"; 42 [labelType="html" label="MapPartitionsRDD [42]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster102 { label="Exchange"; 43 [labelType="html" label="MapPartitionsRDD [43]<br>count at NativeMethodAccessorImpl.java:0"]; } } 0->1; 1->2; 2->3; 3->39; 39->40; 40->41; 41->42; 42->43; }
3
Event Timeline
Enable zooming
Tasks: 8. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time