org.neuroph.core.data

Class BufferedDataSet

java.lang.Object

org.neuroph.core.data.DataSet

org.neuroph.core.data.BufferedDataSet

All Implemented Interfaces:

Serializable, Iterable<DataSetRow>, Iterator<DataSetRow>, javax.visrec.ml.data.DataSet<DataSetRow>

public class BufferedDataSet
extends DataSet
implements Iterator<DataSetRow>

This class can be used for large training sets, which are partially read from file during the training. It loads bufferSize rows from file into DataSet, and when it iterates all of them, it takes next bufferSize rows. It can be used everywhere where DataSet class is used since it extends it. The rows should be iterated with iterator() interface.

Author:

Zoran Sevarac

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface javax.visrec.ml.data.DataSet

javax.visrec.ml.data.DataSet.Column, javax.visrec.ml.data.DataSet.ColumnType

Constructor Summary

Constructors

Constructor and Description
BufferedDataSet(File file, int inputSize, int outputSize, String delimiter) Creates new buffered data set with specified file, input and output size.
BufferedDataSet(File file, int inputSize, String delimiter)

Method Summary

Modifier and Type	Method and Description
boolean	hasNext() Returns true if there are more rows, false otherwise
Iterator<DataSetRow>	iterator() Returns iterator for buffered data set
DataSetRow	next() Returns next data set row.
void	remove()

Methods inherited from class org.neuroph.core.data.DataSet

add, add, add, addRow, clear, createFromFile, createFromFile, createTrainingAndTestSubsets, get, getColumnName, getColumnNames, getColumnType, getColumnTypes, getFilePath, getInputSize, getItems, getLabel, getOutputSize, getRowAt, getRows, indexOf, isEmpty, isSupervised, load, remove, remove, removeRowAt, sample, save, save, saveAsTxt, setColumnName, setColumnNames, setColumnType, setFilePath, setLabel, shuffle, size, split, split, split, split, toCSV, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Methods inherited from interface javax.visrec.ml.data.DataSet

addAll, shuffle, split

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

BufferedDataSet

public BufferedDataSet(File file,
                       int inputSize,
                       String delimiter)

BufferedDataSet

public BufferedDataSet(File file,
                       int inputSize,
                       int outputSize,
                       String delimiter)
                throws FileNotFoundException

Creates new buffered data set with specified file, input and output size. Data set file is assumed to be txt value with data set rows in a single line, with input and output vector values delimited by delimiter.

Parameters:

file - datas et file

inputSize - size of input vector

outputSize - size of outut vector

delimiter - delimiter for vector values

Throws:

FileNotFoundException

Method Detail

iterator

public Iterator<DataSetRow> iterator()

Returns iterator for buffered data set

Specified by:

iterator in interface Iterable<DataSetRow>

Overrides:

iterator in class DataSet

Returns:

hasNext

public boolean hasNext()

Returns true if there are more rows, false otherwise

Specified by:

hasNext in interface Iterator<DataSetRow>

Returns:

true if there are more rows, false otherwise

next

public DataSetRow next()

Returns next data set row. Note that if there are no more buffered rows, this mthod will load next bufferSize rows into buffer.

Specified by:

next in interface Iterator<DataSetRow>

Returns:

next data set row

remove

public void remove()

Specified by:

remove in interface Iterator<DataSetRow>