Skip to content

Commit ede9295

Browse files
committed
More efficient parallelization for buffer compression.
1 parent 35c21bd commit ede9295

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

src/tech/v3/libs/arrow.clj

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1090,10 +1090,10 @@ Dependent block frames are not supported!!")
10901090
{:compression-type (compression-kwd->file-type (comp-map :compression-type))
10911091
;;parallelize buffer compression
10921092
:buffers
1093-
(->> (hamf/pgroups
1094-
n-buffers
1095-
(fn [^long sidx ^long eidx]
1096-
(let [buffers (subvec buffers sidx eidx)
1093+
(->> buffers
1094+
(hamf/pmap
1095+
(fn [buffer]
1096+
(let [buffers [buffer]
10971097
comp-fn (create-compressor comp-map)
10981098
os (ByteArrayOutputStream.)
10991099
data-len (byte-array 8)

0 commit comments

Comments
 (0)