3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
g11.durnev.pavel-CitiBike-WAP
application UI
Details for Stage 107 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
126.2 MiB / 123
Shuffle Write Size / Records:
118.0 B / 2
Associated Job Ids:
71
DAG Visualization
digraph G { subgraph clusterstage_107 { label="Stage 107"; subgraph cluster44 { label="Scan csv "; 21 [labelType="html" label="FileScanRDD [21]<br>showString at NativeMethodAccessorImpl.java:0"]; 22 [labelType="html" label="MapPartitionsRDD [22]<br>showString at NativeMethodAccessorImpl.java:0"]; } subgraph cluster41 { label="WholeStageCodegen (1)"; 23 [labelType="html" label="MapPartitionsRDD [23]<br>showString at NativeMethodAccessorImpl.java:0"]; } subgraph cluster45 { label="mapPartitionsInternal"; 24 [labelType="html" label="MapPartitionsRDD [24]<br>showString at NativeMethodAccessorImpl.java:0"]; } subgraph cluster46 { label="mapPartitionsInternal"; 25 [labelType="html" label="*(1) Project [ride_id#128, rideable_type#129, started_at#130, ended_at#131, start_station_name#132, start_station_id#133, end_station_name#134, end_station_id#135, start_lat#136, start_lng#137, end_lat#138, end_lng#139, member_casual#140, _corrupt_record#141, regexp_extract(input_file_name(), [^/]+$, 0) AS _source_file#156]\n+- FileScan csv [ride_id#128,rideable_type#129,started_at#130,ended_at#131,start_station_name#132,start_station_id#133,end_station_name#134,end_station_id#135,start_lat#136,start_lng#137,end_lat#138,end_lng#139,member_casual#140,_corrupt_record#141] Batched: false, DataFilters: [], Format: CSV, Location: InMemoryFileIndex(2 paths)[s3a://rzvde-g11-durnev-pavel/raw/citibike_data/202602/202602-citibike-..., PartitionFilters: [], PushedFilters: [], ReadSchema: struct<ride_id:string,rideable_type:string,started_at:string,ended_at:string,start_station_name:s...\n [25] [Cached]<br>showString at NativeMethodAccessorImpl.java:0"]; } subgraph cluster808 { label="InMemoryTableScan"; 318 [labelType="html" label="MapPartitionsRDD [318]<br>count at NativeMethodAccessorImpl.java:0"]; 319 [labelType="html" label="MapPartitionsRDD [319]<br>count at NativeMethodAccessorImpl.java:0"]; 320 [labelType="html" label="MapPartitionsRDD [320]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster804 { label="WholeStageCodegen (1)"; 321 [labelType="html" label="MapPartitionsRDD [321]<br>count at NativeMethodAccessorImpl.java:0"]; } subgraph cluster803 { label="Exchange"; 322 [labelType="html" label="MapPartitionsRDD [322]<br>count at NativeMethodAccessorImpl.java:0"]; } } 21->22; 22->23; 23->24; 24->25; 25->318; 318->319; 319->320; 320->321; 321->322; }
25
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time