This document explains how the release manager releases Apache Iceberg Rust in accordance with Apache requirements.
Introduction
Source Release is the key point which Apache values, and is also necessary for an ASF release.
Please remember that publishing software has legal consequences.
This guide complements the foundation-wide policies and guides:
Terminology
In this guide:
iceberg_version: the final Iceberg Rust version, like0.9.1.rc: the numeric release candidate voting round, like2.rc_tag: the git tag for a release candidate, likev0.9.1-rc.2.rc_dist_dir: the ASF dev distribution directory, likeapache-iceberg-rust-0.9.1-rc2.source_archive: the source tarball, likeapache-iceberg-rust-0.9.1.tar.gz.
The RC tag includes rc.<number>. The ASF dev distribution directory uses rc<number>. The source archive name uses only the final version.
Preparation
This section is the requirements for individuals who are new to the role of release manager.
Refer to Setup GPG Key to make sure the GPG key has been set up. The RC creation script requires a local GPG secret key when artifact signing or tag creation is enabled.
Install the release tooling used by the local scripts:
cargo-denydockergpgsvn
The local release helpers are under dev/release/. They log every step before it runs and after it succeeds. If a step fails, the script prints the failed step and stops.
Start a tracking issue about the next release
Start a tracking issue on GitHub for the upcoming release to track all tasks that need to be completed.
Title:
Tracking issues of Iceberg Rust ${iceberg_version} Release
Content:
This issue is used to track tasks of the iceberg rust ${iceberg_version} release.
## Tasks
### Blockers
> Blockers are the tasks that must be completed before the release.
### Build Release
#### GitHub Side
- [ ] Bump version in project
- [ ] Update docs
- [ ] Generate dependencies list
- [ ] Create and push release candidate tag
#### ASF Side
- [ ] Create ASF source release artifacts
- [ ] Upload artifacts to the SVN dist repo
### Voting
- [ ] Start VOTE at iceberg community
### Official Release
- [ ] Push the release git tag
- [ ] Publish artifacts to SVN RELEASE branch
- [ ] Change Iceberg Rust Website download link
- [ ] Send the announcement
For details of each step, please refer to: https://rust.iceberg.apache.org/release
GitHub Side
Bump version in project
Bump all components' version in the project to the new Iceberg Rust version. This version is the final version, not the release candidate version.
- Rust core and Python binding: bump version in root
Cargo.tomlunder[workspace.package].
Update docs
Update CHANGELOG.md by drafting a new release note on GitHub Releases.
Generate dependencies list
Download and set up cargo-deny. You can refer to cargo-deny.
For example:
cargo install cargo-deny
Run the following command to update the dependencies list of every package:
dev/release/dependencies.sh generate
Run the following command to verify the updated dependencies' license:
dev/release/dependencies.sh check
Create release candidate tag and artifacts
After the version bump PR gets merged, check out the exact commit to release and run:
dev/release/create_rc.sh ${iceberg_version} ${rc}
For example:
dev/release/create_rc.sh 0.9.1 2
Useful options include:
--release_ref HEAD: git commit-ish to archive and tag.--dist_dir dist: artifact output root.--create_rc_tag 1: create the signed annotated RC tag as the final release step.--check_headers 1: check Apache license headers against the source archive.--check_deps 1: run dependency license checks before artifact creation.--sign 1: create and verify the detached GPG signature.--upload_svn 0: upload RC artifacts to the ASF dev dist SVN repository.--svn_dist_url https://dist.apache.org/repos/dist/dev/iceberg: SVN directory URL where the RC artifact directory will be uploaded.
This script creates:
- Local artifact directory:
dist/apache-iceberg-rust-${iceberg_version}-rc${rc}/ - Source archive:
apache-iceberg-rust-${iceberg_version}.tar.gz - Signature:
apache-iceberg-rust-${iceberg_version}.tar.gz.asc - SHA-512 checksum:
apache-iceberg-rust-${iceberg_version}.tar.gz.sha512 - Signed annotated RC tag:
v${iceberg_version}-rc.${rc}
The script checks license headers against the generated source archive, not the live Git worktree. If enabled, SVN upload runs after local artifact verification and before RC tag creation. The script creates the signed RC tag as the final release step, then prints a draft VOTE email for dev@iceberg.apache.org.
To upload artifacts to ASF dev dist as part of RC creation, pass:
dev/release/create_rc.sh ${iceberg_version} ${rc} --upload_svn 1
The script does not push the RC tag. Review the output, then push the tag manually:
git push origin "v${iceberg_version}-rc.${rc}"
If an RC has a problem, abandon that RC and increment the RC number.
ASF Side
If any step in the ASF release process fails and requires code changes, abandon that RC and prepare a new RC number. Our release page displays ASF releases instead of GitHub Releases.
Verify the release candidate locally
Before uploading artifacts to ASF dev dist, verify the local artifacts:
dev/release/verify_rc.sh ${iceberg_version} ${rc} --download 0
To skip expensive build steps during a quick local check:
dev/release/verify_rc.sh ${iceberg_version} ${rc} --download 0 --build 0 --python 0
Upload artifacts to the SVN dist repo
SVN is required for this step.
The SVN repository of the dev branch is: https://dist.apache.org/repos/dist/dev/iceberg/
First, check out Iceberg to a local directory:
svn co https://dist.apache.org/repos/dist/dev/iceberg/ /tmp/iceberg-dist-dev
If the artifacts were not uploaded by dev/release/create_rc.sh --upload_svn 1, upload them manually:
rc_dist_dir="apache-iceberg-rust-${iceberg_version}-rc${rc}"
mkdir "/tmp/iceberg-dist-dev/${rc_dist_dir}/"
cp "./dist/${rc_dist_dir}/"* "/tmp/iceberg-dist-dev/${rc_dist_dir}/"
cd /tmp/iceberg-dist-dev/
svn status
svn add "${rc_dist_dir}"
svn commit -m "Prepare Apache Iceberg Rust ${iceberg_version} RC${rc}"
Visit https://dist.apache.org/repos/dist/dev/iceberg/ to make sure the artifacts are uploaded correctly.
Verify the uploaded release candidate
After uploading the artifacts, verify them from ASF dev dist:
dev/release/verify_rc.sh ${iceberg_version} ${rc}
Rescue
If you accidentally publish wrong or unexpected artifacts, like wrong signature files or checksum files, cancel the current RC, increment the RC number, and initiate a new release candidate. Remember to delete the wrong artifacts from the SVN dist repo.
Voting
Send the Iceberg community VOTE email to dev@iceberg.apache.org.
Title:
[VOTE] Release Apache Iceberg Rust ${iceberg_version} RC${rc}
Content:
Hello Apache Iceberg Rust Community,
This is a call for a vote to release Apache Iceberg Rust version ${iceberg_version}.
The tag to be voted on is: v${iceberg_version}-rc.${rc}.
The release candidate:
https://dist.apache.org/repos/dist/dev/iceberg/apache-iceberg-rust-${iceberg_version}-rc${rc}/
Keys to verify the release candidate:
https://downloads.apache.org/iceberg/KEYS
Git tag for the release:
https://github.com/apache/iceberg-rust/releases/tag/v${iceberg_version}-rc.${rc}
Please download, verify, and test the release candidate.
This vote will be open for at least 72 hours and will remain open until the required number of votes is reached.
Please vote accordingly:
[ ] +1 Approve
[ ] +0 No opinion
[ ] -1 Disapprove (please provide a reason)
To learn more about Apache Iceberg, please visit:
https://rust.iceberg.apache.org/
Checklist for reference:
[ ] Download links are valid
[ ] Checksums and signatures are correct
[ ] LICENSE and NOTICE files are present
[ ] No unexpected binary files are included
[ ] All source files have ASF headers
[ ] The project builds successfully from source
[ ] pyiceberg-core builds and tests successfully
For more details, please refer to:
https://rust.iceberg.apache.org/release.html#how-to-verify-a-release
Thanks,
${name}
Example: https://lists.apache.org/thread/c211gqq2yl15jbxqk4rcnq1bdqltjm5l
After at least 3 +1 binding votes from Iceberg PMC members, claim the vote result.
Title:
[RESULT][VOTE] Release Apache Iceberg Rust ${iceberg_version} RC${rc}
Content:
Hello Apache Iceberg Rust Community,
The vote to release Apache Iceberg Rust ${iceberg_version} RC${rc} has passed.
The vote PASSED with 3 +1 binding and 1 +1 non-binding votes, no +0 or -1 votes:
Binding votes:
- xxx
- yyy
- zzz
Non-Binding votes:
- aaa
Vote thread: ${vote_thread_url}
Thanks,
${name}
Example: https://lists.apache.org/thread/xk5myl10mztcfotn59oo59s4ckvojds6
How to verify a release
Validate with the helper script
Run:
dev/release/verify_rc.sh ${iceberg_version} ${rc}
The helper downloads the source archive, signature, and checksum from ASF dev dist, verifies the signature with the local GPG keyring, verifies the checksum, extracts the archive, checks source headers, and runs Rust and Python build/tests.
To import Apache Iceberg release keys before signature verification, run:
dev/release/verify_rc.sh ${iceberg_version} ${rc} --import_gpg_keys 1
Validate manually
A release candidate contains links to following things:
- A source tarball
- A signature (
.asc) - A checksum (
.sha512)
After downloading them, here are the instructions on how to verify them.
-
Import keys:
curl https://downloads.apache.org/iceberg/KEYS -o KEYS gpg --import KEYS -
Verify the
.ascfile:gpg --verify apache-iceberg-rust-*.tar.gz.ascExpects:
gpg: Good signature from ... -
Verify the checksum:
shasum -a 512 -c apache-iceberg-rust-*.tar.gz.sha512Expects:
"apache-iceberg-rust-...tar.gz: OK" -
Verify build and test:
tar -xzf apache-iceberg-rust-*.tar.gz cd apache-iceberg-rust-*/ make build && make test -
Verify pyiceberg-core build and tests:
( cd bindings/python make install make test ) -
Verify license headers:
docker run --rm -v $(pwd):/github/workspace apache/skywalking-eyes header checkExpects:
INFO Totally checked _ files, valid: _, invalid: 0, ignored: _, fixed: 0
Official Release
Promote the RC
After the VOTE passes, create the final release tag and move the ASF artifacts from dev dist to release dist:
dev/release/release.sh ${iceberg_version} ${rc}
Useful options include:
--create_release_tag 1: create the signed annotated final release git tag.--move_svn 1: move the RC artifacts from ASF dev dist to ASF release dist.--tag_ref <rc tag commit>: git commit-ish to tag as the final release.--dev_dist_url https://dist.apache.org/repos/dist/dev/iceberg: SVN directory URL containing RC artifact directories.--release_dist_url https://dist.apache.org/repos/dist/release/iceberg: SVN directory URL where final release artifact directories are published.
The release script does not push the final release tag. Review the output, then push the tag manually:
git push origin "v${iceberg_version}"
Pushing the final release tag triggers the publish workflow for crates and pyiceberg-core.
Create a GitHub Release
- Click here to create a new release.
- Pick the git tag of this release version from the dropdown menu.
- Make sure the branch target is
main. - Generate the release note by clicking the
Generate release notesbutton. - Add the release note from every component's
upgrade.mdif there are breaking changes before the content generated by GitHub. Check them carefully. - Publish the release.
Send the announcement
Send the release announcement to dev@iceberg.apache.org and CC announce@apache.org.
Instead of adding breaking changes, include the new features as "notable changes" in the announcement.
Title:
[ANNOUNCE] Release Apache Iceberg Rust ${iceberg_version}
Content:
Hi all,
The Apache Iceberg Rust community is pleased to announce
that Apache Iceberg Rust ${iceberg_version} has been released!
Iceberg is a data access layer that allows users to easily and efficiently
retrieve data from various storage services in a unified way.
The notable changes since the previous release include:
1. xxxxx
2. yyyyyy
3. zzzzzz
Please refer to the change log for the complete list of changes:
https://github.com/apache/iceberg-rust/releases/tag/v${iceberg_version}
Apache Iceberg Rust website: https://rust.iceberg.apache.org/
Download Links: https://rust.iceberg.apache.org/download
From official ASF distribution: https://dist.apache.org/repos/dist/release/iceberg/apache-iceberg-rust-${iceberg_version}/
Iceberg Resources:
- Issue: https://github.com/apache/iceberg-rust/issues
- Mailing list: dev@iceberg.apache.org
Thanks
On behalf of Apache Iceberg Community
Example: https://lists.apache.org/thread/oy77n55brvk72tnlb2bjzfs9nz3cfd0s