Thanks to visit codestin.com
Credit goes to github.com

Skip to content

feat: unified DuckDBDataFrameQuery #91

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
egorchakov merged 1 commit into from
Dec 1, 2025
Merged

feat: unified DuckDBDataFrameQuery #91

egorchakov merged 1 commit into from
Dec 1, 2025

Conversation

@egorchakov
Copy link
Contributor

@egorchakov egorchakov commented Nov 28, 2025

introduce DuckDBDataFrameQuery:

  • replaces previous duckdb x polars io funcs
  • validates the query to contain a single SELECT statement (result convertible to pl.DataFrame with .pl())
  • pl.DataFrame kwargs are registered as views, all others passed as query params
  • pickleable (for multiprocessing use with pipefunc)
  • thread-local connections (for multithreading use with pipefunc)
  • extensions are auto-installed and loaded

@koritsky
Copy link
Contributor

koritsky commented Nov 28, 2025 •
edited
Loading

> introduce unified io func
> longer yamls

@egorchakov
Copy link
Contributor Author

egorchakov commented Nov 28, 2025

@koritsky unification is never pain-free

@egorchakov egorchakov merged commit d86ca1e into main Dec 1, 2025
1 check passed
@egorchakov egorchakov deleted the feat/duckdb-unify branch December 1, 2025 13:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@koritsky koritsky koritsky approved these changes

@sandhawalia sandhawalia Awaiting requested review from sandhawalia

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@egorchakov @koritsky