Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support DataNode connection reuse #80

Merged
merged 8 commits into from
Feb 22, 2024
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Fix erasure coded read
  • Loading branch information
Kimahriman committed Feb 22, 2024
commit 6fb5562b5bea4054280de4c6a855fe6e48c548b0
6 changes: 4 additions & 2 deletions crates/hdfs-native/src/hdfs/block_reader.rs
Original file line number Diff line number Diff line change
@@ -394,8 +394,8 @@ impl StripedBlockStream {
&datanode_url,
block,
token.clone(),
self.offset as u64,
self.len as u64,
offset as u64,
len as u64,
)
.await?;

@@ -427,6 +427,8 @@ impl StripedBlockStream {

// There should be one last empty packet after we are done
connection.read_packet().await?;
connection.send_read_success().await?;
DATANODE_CACHE.release(connection);

Ok(())
}
Loading