Stages for All Jobs

Completed Stages (103)

Page:
Stage Id ▾ Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
182
parquet at NativeMethodAccessorImpl.java:0 +details
2026/04/08 12:14:36 4.0 min
72/72
3.2 GiB2.2 GiB
180
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 12:13:21 1.2 min
72/72
3.2 GiB357.4 MiB
178
parquet at NativeMethodAccessorImpl.java:0 +details
2026/04/08 10:30:21 3.4 min
4/4
2.2 GiB5.4 GiB
175
parquet at NativeMethodAccessorImpl.java:0 +details
2026/04/08 10:28:39 1.6 min
72/72
3.2 GiB5.4 GiB
173
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 10:27:09 1.5 min
72/72
3.2 GiB357.4 MiB
171
parquet at NativeMethodAccessorImpl.java:0 +details
2026/04/08 10:14:44 4.4 min
72/72
3.2 GiB2.2 GiB
169
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 10:13:08 1.6 min
72/72
3.2 GiB357.4 MiB
167
count at <unknown>:0 +details
2026/04/08 10:12:44 14 ms
1/1
4.1 KiB
164
count at <unknown>:0 +details
2026/04/08 10:12:37 7 s
72/72
3.2 GiB4.1 KiB
162
count at <unknown>:0 +details
2026/04/08 10:12:37 16 ms
1/1
4.1 KiB
159
count at <unknown>:0 +details
2026/04/08 10:12:29 8 s
72/72
3.2 GiB4.1 KiB
157
count at <unknown>:0 +details
2026/04/08 10:12:29 21 ms
1/1
4.1 KiB
154
count at <unknown>:0 +details
2026/04/08 10:12:26 4 s
72/72
3.2 GiB4.1 KiB
152
showString at <unknown>:0 +details
2026/04/08 10:04:24 34 ms
1/1
39.8 MiB
150
count at <unknown>:0 +details
2026/04/08 10:04:24 23 ms
1/1
4.1 KiB
147
count at <unknown>:0 +details
2026/04/08 10:04:17 7 s
72/72
3.2 GiB4.1 KiB
145
count at <unknown>:0 +details
2026/04/08 09:59:22 4.9 min
72/72
3.5 GiB
143
count at <unknown>:0 +details
2026/04/08 09:56:30 2.9 min
74/74
8.8 GiB3.5 GiB
142
count at <unknown>:0 +details
2026/04/08 09:54:03 23 ms
1/1
4.3 KiB
140
count at <unknown>:0 +details
2026/04/08 09:53:17 45 s
74/74
8.8 GiB4.3 KiB
139
showString at <unknown>:0 +details
2026/04/08 09:53:17 71 ms
1/1
7.5 KiB
138
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:51:23 1.9 min
74/74
8.8 GiB
137
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:51:23 0.2 s
1/1
7.5 KiB
136
Listing leaf files and directories for 55 paths:
s3a://rzvde-g8-kirsanov-dmitry/raw/citibike_data/202502/202502-citibike-tripdata-part00.csv, ... load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:51:22 1 s
55/55
135
Listing leaf files and directories for 55 paths:
s3a://rzvde-g8-kirsanov-dmitry/raw/citibike_data/202502/202502-citibike-tripdata-part00.csv, ... load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:51:20 1 s
55/55
134
parquet at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:23:32 2 s
2/2
1364.5 KiB2.3 MiB
132
parquet at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:23:31 0.4 s
2/2
5.8 MiB2.3 MiB
131
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:23:28 2 s
2/2
159.9 KiB2.3 MiB
129
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:23:27 0.4 s
2/2
5.8 MiB2.3 MiB
126
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:20:33 0.4 s
2/2
5.8 MiB2.3 MiB
123
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:19:06 0.4 s
2/2
5.8 MiB2.3 MiB
122
count at <unknown>:0 +details
2026/04/08 09:07:11 15 ms
1/1
118.0 B
120
count at <unknown>:0 +details
2026/04/08 09:07:10 0.2 s
2/2
5.8 MiB118.0 B
119
count at <unknown>:0 +details
2026/04/08 09:07:10 15 ms
1/1
118.0 B
117
count at <unknown>:0 +details
2026/04/08 09:07:10 0.2 s
2/2
5.8 MiB118.0 B
116
count at <unknown>:0 +details
2026/04/08 09:07:10 15 ms
1/1
118.0 B
114
count at <unknown>:0 +details
2026/04/08 09:07:10 0.2 s
2/2
5.8 MiB118.0 B
113
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:31 54 ms
1/1
1165.2 KiB
111
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:30 0.4 s
2/2
5.8 MiB2.3 MiB
110
count at <unknown>:0 +details
2026/04/08 09:00:30 20 ms
1/1
118.0 B
108
count at <unknown>:0 +details
2026/04/08 09:00:30 0.2 s
2/2
5.8 MiB118.0 B
107
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:30 19 ms
1/1
118.0 B
105
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:29 0.3 s
2/2
5.8 MiB118.0 B
104
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:29 20 ms
1/1
118.0 B
102
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:29 0.1 s
2/2
5.8 MiB118.0 B
101
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:13 0.1 s
1/1
1165.2 KiB
99
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:13 0.4 s
2/2
5.8 MiB2.3 MiB
98
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:13 26 ms
1/1
118.0 B
96
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:12 0.3 s
2/2
5.8 MiB118.0 B
95
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:12 38 ms
1/1
118.0 B
93
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:12 0.5 s
2/2
5.8 MiB118.0 B
92
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:11 36 ms
1/1
118.0 B
90
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:11 0.2 s
2/2
5.8 MiB118.0 B
89
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:06 0.2 s
2/2
2.3 MiB
87
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:06 0.4 s
2/2
5.8 MiB2.3 MiB
86
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:05 0.4 s
2/2
5.8 MiB
85
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:05 0.1 s
1/1
7.6 KiB
84
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:04 0.7 s
2/2
5.8 MiB
83
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:00:04 0.3 s
1/1
7.6 KiB
82
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:20 46 ms
1/1
1416.2 KiB
80
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:20 22 ms
1/1
118.0 B
77
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:19 40 ms
2/2
2.8 MiB118.0 B
75
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:19 18 ms
1/1
118.0 B
72
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:19 25 ms
2/2
2.8 MiB118.0 B
70
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:19 18 ms
1/1
118.0 B
67
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:49:19 22 ms
2/2
2.8 MiB118.0 B
65
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:25 23 ms
1/1
118.0 B
62
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:25 36 ms
2/2
2.8 MiB118.0 B
60
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:25 20 ms
1/1
118.0 B
57
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:25 41 ms
2/2
2.8 MiB118.0 B
55
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:25 18 ms
1/1
118.0 B
52
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:25 21 ms
2/2
2.8 MiB118.0 B
50
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:22 47 ms
2/2
2.8 MiB
48
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:22 0.3 s
2/2
5.8 MiB
47
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:21 0.3 s
1/1
7.6 KiB
46
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:21 0.3 s
2/2
5.8 MiB
45
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:41:20 0.2 s
1/1
7.6 KiB
44
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:39:19 26 ms
1/1
118.0 B
41
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:39:19 42 ms
2/2
2.8 MiB118.0 B
39
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:39:19 19 ms
1/1
118.0 B
36
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:39:19 61 ms
2/2
2.8 MiB118.0 B
34
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:39:19 19 ms
1/1
118.0 B
31
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:39:19 27 ms
2/2
2.8 MiB118.0 B
29
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:30:51 0.1 s
2/2
2.8 MiB
27
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:30:51 0.4 s
2/2
5.8 MiB
26
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:43 29 ms
1/1
1416.2 KiB
24
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:43 60 ms
1/1
118.0 B
21
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:43 31 ms
2/2
2.8 MiB118.0 B
19
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:26 75 ms
1/1
1416.2 KiB
17
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:26 40 ms
1/1
118.0 B
14
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:26 82 ms
2/2
2.8 MiB118.0 B
12
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:25 1.0 s
2/2
2.3 MiB
10
count at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:24 0.7 s
2/2
5.8 MiB2.3 MiB
9
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:22 0.1 s
1/1
7.6 KiB
8
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:21 0.4 s
2/2
5.8 MiB
7
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:20:21 0.1 s
1/1
7.6 KiB
6
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:19:47 0.1 s
1/1
7.6 KiB
5
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:19:47 0.5 s
2/2
5.8 MiB
4
load at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:19:47 0.1 s
1/1
7.6 KiB
3
showString at NativeMethodAccessorImpl.java:0 +details
2026/04/08 08:18:33 0.2 s
1/1
7.6 KiB
Page:

Skipped Stages (78)

Page:
Stage Id ▾ Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write
181
count at <unknown>:0 +details
Unknown Unknown
0/74
179
count at <unknown>:0 +details
Unknown Unknown
0/74
177
parquet at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/72
176
count at <unknown>:0 +details
Unknown Unknown
0/74
174
count at <unknown>:0 +details
Unknown Unknown
0/74
172
count at <unknown>:0 +details
Unknown Unknown
0/74
170
count at <unknown>:0 +details
Unknown Unknown
0/74
168
count at <unknown>:0 +details
Unknown Unknown
0/74
166
count at <unknown>:0 +details
Unknown Unknown
0/72
165
count at <unknown>:0 +details
Unknown Unknown
0/74
163
count at <unknown>:0 +details
Unknown Unknown
0/74
161
count at <unknown>:0 +details
Unknown Unknown
0/72
160
count at <unknown>:0 +details
Unknown Unknown
0/74
158
count at <unknown>:0 +details
Unknown Unknown
0/74
156
count at <unknown>:0 +details
Unknown Unknown
0/72
155
count at <unknown>:0 +details
Unknown Unknown
0/74
153
count at <unknown>:0 +details
Unknown Unknown
0/74
151
count at <unknown>:0 +details
Unknown Unknown
0/74
149
count at <unknown>:0 +details
Unknown Unknown
0/72
148
count at <unknown>:0 +details
Unknown Unknown
0/74
146
count at <unknown>:0 +details
Unknown Unknown
0/74
144
count at <unknown>:0 +details
Unknown Unknown
0/74
141
count at <unknown>:0 +details
Unknown Unknown
0/74
133
parquet at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
130
csv at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
127
csv at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
124
csv at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
121
count at <unknown>:0 +details
Unknown Unknown
0/2
118
count at <unknown>:0 +details
Unknown Unknown
0/2
115
count at <unknown>:0 +details
Unknown Unknown
0/2
112
showString at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
109
count at <unknown>:0 +details
Unknown Unknown
0/2
106
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
103
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
100
showString at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
97
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
94
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
91
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
88
showString at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
81
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
79
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
78
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
76
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
74
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
73
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
71
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
69
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
68
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
66
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
64
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
63
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
61
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
59
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
58
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
56
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
54
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
53
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
51
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
49
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
43
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
42
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
40
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
38
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
37
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
35
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
33
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
32
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
30
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
28
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
25
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
23
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
22
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
20
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
18
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
16
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
15
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
13
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
11
count at NativeMethodAccessorImpl.java:0 +details
Unknown Unknown
0/2
Page:

Failed Stages (2)

Page:
Stage Id ▾ Description Submitted Duration Tasks: Succeeded/Total Input Output Shuffle Read Shuffle Write Failure Reason
128
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:20:34 0.3 s
0/2 (8 failed)
9.1 MiBTASK_WRITE_FAILED +details
125
csv at NativeMethodAccessorImpl.java:0 +details
2026/04/08 09:19:07 0.5 s
0/2 (7 failed) (1 killed: Stage cancelled: Job aborted due to stage failure: Task 1 in stage 125.0 failed 4 times, most recent failure: Lost task 1.3 in stage 125.0 (TID 116) (172.20.0.28 executor 0): org.apache.spark.SparkException: [TASK_WRITE_FAILED] Task failed while writing rows to file:/notebooks/g8.kirsanov.dmitry/rzvde-g8-kirsanov-dmitry/raw_invalid/citibike_data. at org.apache.spark.sql.errors.QueryExecutionErrors$.taskFailedWhileWritingRowsError(QueryExecutionErrors.scala:774) at org.apache.spark.sql.execution.datasources.FileFormatWriter$.executeTask(FileFormatWriter.scala:420) at org.apache.spark.sql.execution.datasources.WriteFilesExec.$anonfun$doExecuteWrite$1(WriteFiles.scala:100) at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2(RDD.scala:890) at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsInternal$2$adapted(RDD.scala:890) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:364) at org.apache.spark.rdd.RDD.iterator(RDD.scala:328) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:93) at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:161) at org.apache.spark.scheduler.Task.run(Task.scala:141) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Executor.scala:620) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64) at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:94) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:623) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: java.io.IOException: Mkdirs failed to create file:/notebooks/g8.kirsanov.dmitry/rzvde-g8-kirsanov-dmitry/raw_invalid/citibike_data/_temporary/0/_temporary/attempt_20260408091907245283280079423519_0125_m_000001_116/yyyymm=202502 (exists=false, cwd=file:/opt/bitnami/spark/work/app-20260408081812-0003/0) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:515) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:500) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1195) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1175) at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1064) at org.apache.spark.sql.execution.datasources.CodecStreams$.createOutputStream(CodecStreams.scala:81) at org.apache.spark.sql.execution.datasources.CodecStreams$.createOutputStreamWriter(CodecStreams.scala:92) at org.apache.spark.sql.execution.datasources.csv.CsvOutputWriter.<init>(CsvOutputWriter.scala:38) at org.apache.spark.sql.execution.datasources.csv.CSVFileFormat$$anon$1.newInstance(CSVFileFormat.scala:84) at org.apache.spark.sql.execution.datasources.BaseDynamicPartitionDataWriter.renewCurrentWriter(FileFormatDataWriter.scala:298) at org.apache.spark.sql.execution.datasources.DynamicPartitionDataSingleWriter.write(FileFormatDataWriter.scala:365) at org.apache.spark.sql.execution.datasources.FileFormatDataWriter.writeWithMetrics(FileFormatDataWriter.scala:85) at org.apache.spark.sql.execution.datasources.FileFormatDataWriter.writeWithIterator(FileFormatDataWriter.scala:92) at org.apache.spark.sql.execution.datasources.FileFormatWriter$.$anonfun$executeTask$1(FileFormatWriter.scala:403) at org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1397) at org.apache.spark.sql.execution.datasources.FileFormatWriter$.executeTask(FileFormatWriter.scala:410) ... 17 more Driver stacktrace:)
9.1 MiBTASK_WRITE_FAILED +details
Page: