Loading...
Searching...
No Matches
NYT::IMapper< TR, TW > Class Template Referenceabstract
Base interface for structured (typed) map jobs with given reader and writer. More...
#include <operation.h>
Inheritance diagram for NYT::IMapper< TR, TW >:
Public Types | |
| using | TReader = TR |
| using | TWriter = TW |
| Public Types inherited from NYT::IJob | |
| enum | EType { Mapper , Reducer , ReducerAggregator , RawJob , VanillaJob } |
| Type of job. | |
Public Member Functions | |
| virtual void | Start (TWriter *writer) |
| This method is called before feeding input rows to mapper (before Do method). | |
| virtual void | Do (TReader *reader, TWriter *writer)=0 |
| This method is called exactly once for the whole job input. | |
| virtual void | Finish (TWriter *writer) |
| This method is called after feeding input rows to mapper (after Do method). | |
| virtual TStructuredRowStreamDescription | GetInputRowStreamDescription () const override |
| virtual TStructuredRowStreamDescription | GetOutputRowStreamDescription () const override |
| Public Member Functions inherited from NYT::IStructuredJob | |
| virtual TRawTableReaderPtr | CreateCustomRawJobReader (int fd) const |
| This methods are called when creating table reader and writer for the job. | |
| virtual THolder< IProxyOutput > | CreateCustomRawJobWriter (size_t outputTableCount) const |
| Public Member Functions inherited from NYT::IJob | |
| virtual void | Save (IOutputStream &stream) const |
| Save job state to stream to be restored on cluster nodes. | |
| virtual void | Load (IInputStream &stream) |
| Restore job state from a stream. | |
| const TNode & | SecureVault () const |
| Get operation secure vault (specified in NYT::TOperationOptions::SecureVault) inside a job. | |
| i64 | GetOutputTableCount () const |
| Get number of output tables. | |
| virtual void | PrepareOperation (const IOperationPreparationContext &context, TJobOperationPreparer &preparer) const |
| Method allowing user to control some properties of input and output tables and formats. | |
Static Public Attributes | |
| static constexpr EType | JobType = EType::Mapper |
| Type of job implemented by this class. | |
Detailed Description
template<class TR, class TW>
class NYT::IMapper< TR, TW >
class NYT::IMapper< TR, TW >
Base interface for structured (typed) map jobs with given reader and writer.
Member Function Documentation
◆ Do()
template<class TR, class TW>
|
pure virtual |
This method is called exactly once for the whole job input.
Read input rows from reader and write output ones to writer.
◆ GetInputRowStreamDescription()
template<class TR, class TW>
|
overridevirtual |
Implements NYT::IStructuredJob.
◆ GetOutputRowStreamDescription()
template<class TR, class TW>
|
overridevirtual |
Implements NYT::IStructuredJob.
The documentation for this class was generated from the following file:
- yt/cpp/mapreduce/interface/operation.h
