Spec of Map operation. More...
#include <operation.h>
Public Member Functions | |
| TSelf & | MapperSpec (TUserJobSpec) |
| Spec of mapper job. | |
| TSelf & | Ordered (bool) |
| Whether to guarantee the order of rows passed to mapper matches the order in the table. | |
| TSelf & | DataSizePerJob (ui64) |
| Recommended number of jobs to run. | |
| Public Member Functions inherited from NYT::TUserOperationSpecBase< TDerived > | |
| TSelf & | FailOnJobRestart (bool) |
| On any unsuccessful job completion (i.e. abortion or failure) force the whole operation to fail. | |
| TSelf & | StderrTablePath (TYPath) |
| Table to save whole stderr of operation. | |
| TSelf & | CoreTablePath (TYPath) |
| Table to save coredumps of operation. | |
| TSelf & | WaitingJobTimeout (TDuration) |
| How long should the scheduler wait for the job to be started on a node. | |
| Public Member Functions inherited from NYT::TOperationSpecBase< TDerived > | |
| TSelf & | TimeLimit (TDuration) |
| Limit on operation execution time. | |
| TSelf & | Alias (TString) |
| Alias for searching for an operation in the future. | |
| TSelf & | Title (TString) |
| Title to be shown in web interface. | |
| TSelf & | Pool (TString) |
| Pool to be used for this operation. | |
| TSelf & | Weight (double) |
| Weight of operation. | |
| FLUENT_OPTIONAL_VECTOR_FIELD_ENCAPSULATED (TString, PoolTree) | |
| Pool tree list that operation will use. | |
| FLUENT_FIELD_OPTION_ENCAPSULATED (TSchedulerResources, ResourceLimits) | |
| How much resources can be consumed by operation. | |
| TSelf & | MaxFailedJobCount (ui64) |
| How many jobs can fail before operation is failed. | |
| TSelf & | Annotations (TNode) |
| TSelf & | Description (TNode) |
| Public Member Functions inherited from NYT::TWithAutoMergeSpec< TDerived > | |
| TSelf & | AutoMerge (TAutoMergeSpec) |
| Options for auto merge operation stage. | |
Detailed Description
struct NYT::TMapOperationSpecBase< TDerived >
Spec of Map operation.
Member Function Documentation
◆ DataSizePerJob()
| TSelf & NYT::TMapOperationSpecBase< TDerived >::DataSizePerJob | ( | ui64 | ) |
Recommended number of jobs to run.
`JobCount' has higher priority than NYT::TMapOperationSpecBase::DataSizePerJob. This option only provide a recommendation and may be ignored if conflicting with YT internal limits. */ TSelf& JobCount ( ui32 ); ;
/**
Recommended of data size for each job.
DataSizePerJob has lower priority that NYT::TMapOperationSpecBase::JobCount. This option only provide a recommendation and may be ignored if conflicting with YT internal limits.
◆ Ordered()
| TSelf & NYT::TMapOperationSpecBase< TDerived >::Ordered | ( | bool | ) |
Whether to guarantee the order of rows passed to mapper matches the order in the table.
When Ordered' is false (by default), there is no guaranties about order of reading rows. In this case mapper might work slightly faster because row delivered from fast node can be processed YT waits response from slow nodes. When Ordered' is true, rows will come in order in which they are stored in input tables.
The documentation for this struct was generated from the following file:
- yt/cpp/mapreduce/interface/operation.h
