refactor: Simplify data compression logic

refactor: Simplify data compression logic Remove duplicate file reading and streamline compression process Co-authored-by: Daijiro Fukuda <fukuda@clear-code.com>
fluent · Nov 2, 2024 · 0759c78 · 0759c78
1 parent 5a4b255
commit 0759c78
Showing 1 changed file with 1 addition and 5 deletions.
diff --git a/lib/fluent/plugin/out_s3.rb b/lib/fluent/plugin/out_s3.rb
@@ -641,11 +641,7 @@ def content_type
       end
 
       def compress(chunk, tmp)
-        uncompressed_data = ''
-        chunk.open do |io|
-          uncompressed_data = io.read
-        end
-        compressed_data = Zstd.compress(uncompressed_data, level: @level)
+        compressed_data = Zstd.compress(chunk.read, level: @level)
         tmp.write(compressed_data)
       rescue => e
         log.warn "zstd compression failed: #{e.message}"