Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add ExtractPlan to Connection/ClientContext and add example of alternative execution engine #1897

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
Mytherin merged 2 commits into from
Jun 23, 2021
Merged

Add ExtractPlan to Connection/ClientContext and add example of alternative execution engine #1897

Mytherin merged 2 commits into from
Jun 23, 2021

Conversation

@Mytherin
Copy link
Collaborator

@Mytherin Mytherin commented Jun 23, 2021 •
edited
Loading

This PR adds an example of using an alternative execution engine with DuckDB. The essence of it is that we create some tables inside DuckDB, and then use the new ExtractPlan function to receive a fully bound and (potentially) optimized logical plan from any query we want to fire. We then have a transformer phase that transforms DuckDB's logical plan to our own (custom) physical plan and execute that plan.

Simplified/shortened code snippet:

 class MyNode {
 public:
 	virtual ~MyNode() {
 	}
 	virtual vector<int> GetNextRow() = 0;

 	unique_ptr<MyNode> child;
 };

 class MyPlanGenerator {
 public:
 	unique_ptr<MyNode> TransformPlan(LogicalOperator &op);
 };

int main() {
	DuckDB db(nullptr);
	Connection con(db);

	con.Query("CREATE TABLE mytable(i INTEGER, j INTEGER)");
	con.Query("CREATE TABLE myothertable(k INTEGER)");

	// extract DuckDB's logical plan
	auto plan = con.ExtractPlan(query);

	// transform the logical plan into our own plan
	MyPlanGenerator generator;
	auto my_plan = generator.TransformPlan(*plan);

	// execute!
	...
}

@Mytherin
Add code to extract only the logical plan to the client and add an ex…
a9a0132 
…ample of an alternate executor based on the logical query plan
@Mytherin
Copy link
Collaborator Author

Mytherin commented Jun 23, 2021

CC @mbasmanova

@hannes
Copy link
Member

hannes commented Jun 23, 2021

Also CCing @wesm ^^

@Alex-Monahan
Copy link
Contributor

Alex-Monahan commented Jun 23, 2021

This looks like some interesting stuff... Can't wait to see what folks have in mind!

@Mytherin Mytherin merged commit 94a0cf9 into duckdb:master Jun 23, 2021
@wesm
Copy link

wesm commented Jun 28, 2021

Cool, this will be very helpful to enable interchangeable execution engines.

@Mytherin Mytherin mentioned this pull request Jun 30, 2021
Merged
hawkfish pushed a commit to hawkfish/duckdb that referenced this pull request Oct 20, 2025
WASM duckdb#1897: UTC Offset Support
9af71f7 
* Add a translation layer for UTC offset syntax to equivalent Olson IDs

fixes: duckdb/duckdb-wasm#1897
hawkfish added a commit to hawkfish/duckdb that referenced this pull request Oct 21, 2025
@hawkfish
WASM duckdb#1897: UTC Offset Support
270be05 
* Ignore colons.

fixes: duckdb/duckdb-wasm#1897
hannes added a commit that referenced this pull request Oct 24, 2025
@hannes
WASM #1897: UTC Offset Support (#19464)
0cc9bb7 
* Add a translation layer for UTC offset syntax to equivalent Olson IDs

fixes: duckdb/duckdb-wasm#1897
github-actions bot pushed a commit to duckdb/duckdb-r that referenced this pull request Oct 28, 2025
@krlmlr
vendor: Update vendored sources to duckdb/duckdb@b62b03c
0f39843 
CI Fix: clear benchmark cache between runs (duckdb/duckdb#19508)
vfs integration tests p2 - update (env) vars and tests (duckdb/duckdb#19428)
[Compression] Fix issue in ZSTD decompression related to mis-interpreted segment offsets (duckdb/duckdb#19475)
Add tests for nested lambda bindings (duckdb/duckdb#19453)
WASM duckdb/duckdb#1897: UTC Offset Support (duckdb/duckdb#19464)
@github-actions github-actions bot mentioned this pull request Oct 28, 2025
Merged
github-actions bot added a commit to duckdb/duckdb-r that referenced this pull request Oct 28, 2025
@github-actions @krlmlr
vendor: Update vendored sources to duckdb/duckdb@b62b03c (#1641)
f6afe8c 
CI Fix: clear benchmark cache between runs (duckdb/duckdb#19508)
vfs integration tests p2 - update (env) vars and tests (duckdb/duckdb#19428)
[Compression] Fix issue in ZSTD decompression related to mis-interpreted segment offsets (duckdb/duckdb#19475)
Add tests for nested lambda bindings (duckdb/duckdb#19453)
WASM duckdb/duckdb#1897: UTC Offset Support (duckdb/duckdb#19464)

Co-authored-by: krlmlr <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@Mytherin @hannes @Alex-Monahan @wesm