3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
rzvde-g8-kirsanov-dmitry
application UI
Details for Stage 152 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
19 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
39.8 MiB / 1
Associated Job Ids:
91
DAG Visualization
digraph G { subgraph clusterstage_152 { label="Stage 152"; subgraph cluster916 { label="AQEShuffleRead"; 364 [labelType="html" label="ShuffledRowRDD [364] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster913 { label="WholeStageCodegen (2)"; 365 [labelType="html" label="MapPartitionsRDD [365] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster912 { label="Window"; 366 [labelType="html" label="MapPartitionsRDD [366] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster909 { label="WholeStageCodegen (3)"; 367 [labelType="html" label="MapPartitionsRDD [367] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster917 { label="mapPartitionsInternal"; 368 [labelType="html" label="MapPartitionsRDD [368] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster918 { label="mapPartitionsInternal"; 369 [labelType="html" label="AdaptiveSparkPlan isFinalPlan=false\n+- Project [ride_id#10530, rideable_type#10531, started_at#10532, ended_at#10533, start_station_name#10534, start_station_id#10655, end_station_name#10536, end_station_id#10657, start_lat#10538, start_lng#10539, end_lat#10540, end_lng#10541, member_casual#10542, valid_ride_id#10641, valid_time#10642, valid_station#10643, _source_file#10644, 2026-04-08 09:56:30.312891 AS _processed_dttm#10645, _start_station_ride_num#10647, year#10648, month#10649]\n +- Window [row_number() windowspecdefinition(start_station_id#10535, started_at#10532 ASC NULLS FIRST, specifiedwindowframe(RowFrame, unboundedpreceding$(), currentrow$())) AS _start_station_ride_num#10647], [start_station_id#10535], [started_at#10532 ASC NULLS FIRST]\n +- Sort [start_station_id#10535 ASC NULLS FIRST, started_at#10532 ASC NULLS FIRST], false, 0\n +- Exchange hashpartitioning(start_station_id#10535, 200), ENSURE_REQUIREMENTS, [plan_id=2095]\n +- Project [ride_id#10530, rideable_type#10531... [369] [Cached] [Unordered]<br>count at <unknown>:0"]; } subgraph cluster954 { label="InMemoryTableScan"; 378 [labelType="html" label="MapPartitionsRDD [378] [Unordered]<br>showString at <unknown>:0"]; 379 [labelType="html" label="MapPartitionsRDD [379] [Unordered]<br>showString at <unknown>:0"]; 380 [labelType="html" label="MapPartitionsRDD [380] [Unordered]<br>showString at <unknown>:0"]; } subgraph cluster950 { label="WholeStageCodegen (1)"; 381 [labelType="html" label="MapPartitionsRDD [381] [Unordered]<br>showString at <unknown>:0"]; } subgraph cluster955 { label="mapPartitionsInternal"; 382 [labelType="html" label="MapPartitionsRDD [382] [Unordered]<br>showString at <unknown>:0"]; } } 364->365; 365->366; 366->367; 367->368; 368->369; 369->378; 378->379; 379->380; 380->381; 381->382; }
363,364
369
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time