Commit 7c83641
authored
Set file_size attribute directly from file metadata (#576)
Datafusion PartitionedFile struct relies on correct file url and
file size. This file size is used for calculating offset for reading
the parquet footer. Wrong file size can lead to query issues.
This PR aims to fix that issue. Fixes #5751 parent f289529 commit 7c83641
1 file changed
+2
-3
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
97 | 97 | | |
98 | 98 | | |
99 | 99 | | |
| 100 | + | |
| 101 | + | |
100 | 102 | | |
101 | 103 | | |
102 | 104 | | |
| |||
105 | 107 | | |
106 | 108 | | |
107 | 109 | | |
108 | | - | |
109 | | - | |
110 | | - | |
111 | 110 | | |
112 | 111 | | |
113 | 112 | | |
| |||
0 commit comments