Module arrow

Conversion between Iceberg and Arrow schema

Re-exports

pub use partition_value_calculator::*;

pub use record_batch_partition_splitter::*;

Modules

delete_file_loader

Delete File loader

partition_value_calculator

Partition value calculator for computing partition values Partition value calculation for Iceberg tables.

record_batch_partition_splitter

Record batch partition splitter for partitioned tables

record_batch_projector

RecordBatch projection utilities

Structs

ArrowArrayAccessor

Partner type representing accessing and walking arrow arrays alongside iceberg schema

ArrowFileReader

ArrowFileReader is a wrapper around a FileRead that impls parquets AsyncFileReader.

ArrowReader

Reads data from Parquet files

ArrowReaderBuilder

Builder to create ArrowReader

Enums

FieldMatchMode

Defines how Arrow fields are matched with Iceberg fields when converting data.

Constants

DEFAULT_MAP_FIELD_NAME

When iceberg map type convert to Arrow map type, the default map field name is “key_value”.

UTC_TIME_ZONE

UTC time zone for Arrow timestamp type.

Traits

ArrowSchemaVisitor

A post order arrow schema visitor.

Functions

arrow_primitive_to_literal

Convert arrow primitive array to iceberg primitive value array. This function will assume the schema of arrow struct array is the same as iceberg struct type.

arrow_schema_to_schema

Convert Arrow schema to Iceberg schema.

arrow_struct_to_literal

Convert arrow struct array to iceberg struct value array. This function will assume the schema of arrow struct array is the same as iceberg struct type.

arrow_type_to_type

Convert Arrow type to iceberg type.

schema_to_arrow_schema

Convert iceberg schema to an arrow schema.

type_to_arrow_type

Convert iceberg type to an arrow type.