C++ YT Wrapper
C++ library for working with YT clusters
Loading...
Searching...
No Matches
NYT::TReduceOperationSpecBase< TDerived > Struct Template Reference

Spec of Reduce operation. More...

#include <operation.h>

Inheritance diagram for NYT::TReduceOperationSpecBase< TDerived >:
NYT::TUserOperationSpecBase< TDerived > NYT::TWithAutoMergeSpec< TDerived > NYT::TOperationSpecBase< TDerived >

Public Member Functions

TSelf & ReducerSpec (TUserJobSpec)
 Spec of reduce job.
TSelf & SortBy (TSortColumns)
 Columns to sort rows by (must include ReduceBy as prefix).
TSelf & ReduceBy (TSortColumns)
 Columns to group rows by.
TSelf & JoinBy (TSortColumns)
 Columns to join foreign tables by (must be prefix of ReduceBy).
TSelf & EnableKeyGuarantee (bool)
 Guarantee to feed all rows with same ReduceBy columns to a single job (true by default).
TSelf & DataSizePerJob (ui64)
 Recommended number of jobs to run.
Public Member Functions inherited from NYT::TUserOperationSpecBase< TDerived >
TSelf & FailOnJobRestart (bool)
 On any unsuccessful job completion (i.e. abortion or failure) force the whole operation to fail.
TSelf & StderrTablePath (TYPath)
 Table to save whole stderr of operation.
TSelf & CoreTablePath (TYPath)
 Table to save coredumps of operation.
TSelf & WaitingJobTimeout (TDuration)
 How long should the scheduler wait for the job to be started on a node.
Public Member Functions inherited from NYT::TOperationSpecBase< TDerived >
TSelf & TimeLimit (TDuration)
 Limit on operation execution time.
TSelf & Alias (TString)
 Alias for searching for an operation in the future.
TSelf & Title (TString)
 Title to be shown in web interface.
TSelf & Pool (TString)
 Pool to be used for this operation.
TSelf & Weight (double)
 Weight of operation.
 FLUENT_OPTIONAL_VECTOR_FIELD_ENCAPSULATED (TString, PoolTree)
 Pool tree list that operation will use.
 FLUENT_FIELD_OPTION_ENCAPSULATED (TSchedulerResources, ResourceLimits)
 How much resources can be consumed by operation.
TSelf & MaxFailedJobCount (ui64)
 How many jobs can fail before operation is failed.
TSelf & Annotations (TNode)
TSelf & Description (TNode)
Public Member Functions inherited from NYT::TWithAutoMergeSpec< TDerived >
TSelf & AutoMerge (TAutoMergeSpec)
 Options for auto merge operation stage.

Detailed Description

template<typename TDerived>
struct NYT::TReduceOperationSpecBase< TDerived >

Spec of Reduce operation.

See also
https://ytsaurus.tech/docs/en/user-guide/data-processing/operations/reduce

Member Function Documentation

◆ DataSizePerJob()

template<typename TDerived>
TSelf & NYT::TReduceOperationSpecBase< TDerived >::DataSizePerJob ( ui64 )

Recommended number of jobs to run.

`JobCount' has higher priority than NYT::TReduceOperationSpecBase::DataSizePerJob. This option only provide a recommendation and may be ignored if conflicting with YT internal limits. */ TSelf& JobCount ( ui32 ); ;

/**

Recommended of data size for each job.

DataSizePerJob has lower priority that NYT::TReduceOperationSpecBase::JobCount. This option only provide a recommendation and may be ignored if conflicting with YT internal limits.

◆ JoinBy()

template<typename TDerived>
TSelf & NYT::TReduceOperationSpecBase< TDerived >::JoinBy ( TSortColumns )

Columns to join foreign tables by (must be prefix of ReduceBy).

See also
https://ytsaurus.tech/docs/en/user-guide/data-processing/operations/reduce#foreign_tables

The documentation for this struct was generated from the following file: