Struct UnpartitionedWriter

pub struct UnpartitionedWriter<B, I = RecordBatch, O = Vec<DataFile>>
where
    B: IcebergWriterBuilder<I, O>,
    O: IntoIterator + FromIterator<<O as IntoIterator>::Item>,
    <O as IntoIterator>::Item: Clone,
{ /* private fields */ }

A simple wrapper around IcebergWriterBuilder for unpartitioned tables.

This writer lazily creates the underlying writer on the first write operation and writes all data to a single file (or set of files if rolling).

Type Parameters

• B - The inner writer builder type
• I - Input type (defaults to RecordBatch)
• O - Output collection type (defaults to Vec<DataFile>)

Implementations

impl<B, I, O> UnpartitionedWriter<B, I, O>

where B: IcebergWriterBuilder<I, O>, I: Send + 'static, O: IntoIterator + FromIterator<<O as IntoIterator>::Item>, <O as IntoIterator>::Item: Send + Clone,

pub fn new(inner_builder: B) -> Self

Create a new UnpartitionedWriter.

pub async fn write(&mut self, input: I) -> Result<()>

Write data to the writer.

The underlying writer is lazily created on the first write operation.

Parameters

• input - The input data to write

Returns

Ok(()) on success, or an error if the write operation fails.

pub async fn close(self) -> Result<O>

Close the writer and return all written data files.

This method consumes the writer to prevent further use.

Returns

The accumulated output from all write operations, or an empty collection if no data was written.