Options that control how server side of YT stores data. More...

#include <client_method_options.h>

Public Member Functions
TSelf &	EnableEarlyFinish (bool)
	Whether to wait all replicas to be written.
TSelf &	UploadReplicationFactor (ui64)
	Number of replicas to be created.
TSelf &	MinUploadReplicationFactor (ui64)
TSelf &	DesiredChunkSize (ui64)
	Desired size of a chunk.
TSelf &	RetryBlockSize (size_t)
	Size of data block accumulated in memory to provide retries.

Detailed Description

Options that control how server side of YT stores data.

Member Function Documentation

◆ DesiredChunkSize()

TSelf & NYT::TWriterOptions::DesiredChunkSize ( ui64 )

Desired size of a chunk.

See also: NYT::TWriterOptions::RetryBlockSize

◆ EnableEarlyFinish()

TSelf & NYT::TWriterOptions::EnableEarlyFinish ( bool )

Whether to wait all replicas to be written.

When set to true upload will be considered successful as soon as NYT::TWriterOptions::MinUploadReplicationFactor number of replicas are created.

◆ MinUploadReplicationFactor()

TSelf & NYT::TWriterOptions::MinUploadReplicationFactor ( ui64 )

Min number of created replicas needed to consider upload successful.

See also: NYT::TWriterOptions::EnableEarlyFinish

◆ RetryBlockSize()

TSelf & NYT::TWriterOptions::RetryBlockSize ( size_t )

Size of data block accumulated in memory to provide retries.

Data is accumulated in memory buffer so in case error occurs data could be resended.

If RetryBlockSize is not set buffer size is set to DesiredChunkSize. If neither RetryBlockSize nor DesiredChunkSize is set size of buffer is 64MB.

Note: Written chunks cannot be larger than size of this memory buffer.

Since DesiredChunkSize is compared against data already compressed with compression codec it makes sense to set RetryBlockSize = DesiredChunkSize / ExpectedCompressionRatio

See also: NYT::TWriterOptions::DesiredChunkSize; NYT::TTableWriterOptions::SingleHttpRequest

The documentation for this struct was generated from the following file:

yt/cpp/mapreduce/interface/client_method_options.h