8000 fix(python): Fix `scan_iceberg()` storage options not taking effect by nameexhaustion · Pull Request #24574 · pola-rs/polars · GitHub
[go: up one dir, main page]

Skip to content

Conversation

@nameexhaustion
Copy link
Collaborator

The storage_options parameter to scan_iceberg() currently takes configuration keys defined at https://py.iceberg.apache.org/configuration/#fileio rather than the ones used by object store. This PR adds a conversion step before passing them to the native reader.

@github-actions github-actions bot added A-io-iceberg Related to Apache Iceberg tables. fix Bug fix python Related to Python Polars rust Related to Rust Polars labels Sep 23, 2025
@nameexhaustion nameexhaustion changed the title fix: Fix scan_iceberg() storage options not taking effect fix(python): Fix scan_iceberg() storage options not taking effect Sep 23, 2025
@nameexhaustion nameexhaustion removed the rust Related to Rust Polars label Sep 23, 2025
@codecov
Copy link
codecov bot commented Sep 23, 2025

Codecov Report

❌ Patch coverage is 36.36364% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 81.75%. Comparing base (df06eaf) to head (e1bd8ed).
⚠️ Report is 10 commits behind head on main.

Files with missing lines Patch % Lines
py-polars/polars/io/iceberg/dataset.py 36.36% 7 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #24574      +/-   ##
==========================================
- Coverage   81.76%   81.75%   -0.01%     
==========================================
  Files        1686     1686              
  Lines      229972   229993      +21     
  Branches     2971     2974       +3     
==========================================
- Hits       188045   188041       -4     
- Misses      41174    41199      +25     
  Partials      753      753              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@nameexhaustion nameexhaustion marked this pull request as draft September 23, 2025 07:24
@nameexhaustion nameexhaustion marked this pull request as ready for review September 23, 2025 10:57
@ritchie46 ritchie46 merged commit 055bb45 into pola-rs:main Sep 24, 2025
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-io-iceberg Related to Apache Iceberg tables. fix Bug fix python Related to Python Polars

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Storage options not passed to scan_iceberg

2 participants

0