Package org.apache.trevni.avro
Class AvroTrevniInputFormat<T>
java.lang.Object
org.apache.hadoop.mapred.FileInputFormat<AvroWrapper<T>,NullWritable>
org.apache.trevni.avro.AvroTrevniInputFormat<T>
- All Implemented Interfaces:
InputFormat<AvroWrapper<T>,NullWritable>
An
InputFormat for Trevni files.
A subset schema to be read may be specified with
AvroJob.setInputSchema(JobConf,Schema).
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat
FileInputFormat.Counter -
Field Summary
Fields inherited from class org.apache.hadoop.mapred.FileInputFormat
INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptiongetRecordReader(InputSplit split, JobConf job, Reporter reporter) protected booleanisSplitable(FileSystem fs, Path filename) protected FileStatus[]listStatus(JobConf job) Methods inherited from class org.apache.hadoop.mapred.FileInputFormat
addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize
-
Constructor Details
-
AvroTrevniInputFormat
public AvroTrevniInputFormat()
-
-
Method Details
-
isSplitable
- Overrides:
isSplitablein classFileInputFormat<AvroWrapper<T>,NullWritable>
-
listStatus
- Overrides:
listStatusin classFileInputFormat<AvroWrapper<T>,NullWritable> - Throws:
IOException
-
getRecordReader
public RecordReader<AvroWrapper<T>,NullWritable> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException - Specified by:
getRecordReaderin interfaceInputFormat<AvroWrapper<T>,NullWritable> - Specified by:
getRecordReaderin classFileInputFormat<AvroWrapper<T>,NullWritable> - Throws:
IOException
-