Package com.cupoftea.csv.lazy

Class CsvOpenCsvPartitionReader

java.lang.Object

com.cupoftea.csv.lazy.CsvOpenCsvPartitionReader

All Implemented Interfaces:

PartitionReader, Closeable, AutoCloseable

public class CsvOpenCsvPartitionReader
extends Object
implements PartitionReader

Fallback streaming partition reader using OpenCSV for complex quoting or non-standard encodings.

Constructor Summary

Constructors

Constructor	Description
CsvOpenCsvPartitionReader(File file, CSVImporterConfiguration config, int batchSize)

Method Summary

Modifier and Type	Method	Description
void	close()
CupOfTea	nextBatch()	Reads the next batch of rows from this partition as a CupOfTea DataFrame.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.cupoftea.lazy.PartitionReader

aggregateDirect, hasAppliedFilters, supportsDirectAggregation

Constructor Details

CsvOpenCsvPartitionReader

public CsvOpenCsvPartitionReader(File file,
 CSVImporterConfiguration config,
 int batchSize)
                          throws IOException

Throws:

IOException

Method Details

nextBatch

public CupOfTea nextBatch()
                   throws IOException

Description copied from interface: PartitionReader

Reads the next batch of rows from this partition as a CupOfTea DataFrame. Returns null when this partition has been completely exhausted.

Specified by:

nextBatch in interface PartitionReader

Returns:

next batch DataFrame, or null if end of partition reached

Throws:

IOException - if an I/O error occurs while reading

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Specified by:

close in interface PartitionReader

Throws:

IOException