Load data from Oracle into CrateDB¶

The usage guide will walk you through starting the Oracle Database and CrateDB, inserting a record into Oracle, loading data into a CrateDB table, and validating that the data has been stored successfully. The data transfer is supported by the CrateDB Toolkit Ingestr I/O data pipeline elements.

Prerequisites¶

Use Docker or Podman to run all components. This approach works consistently across Linux, macOS, and Windows.

Files¶

First, download and save all required files to your machine.

Services¶

Start services using Docker Compose or Podman Compose. If you use Podman, replace docker with podman (or enable the podman‑docker compatibility shim) and run podman compose up.

docker compose up

Submit data¶

Write a few sample records to Oracle.

docker compose run --rm --no-TTY sqlplus sys/secret@oracledb/freepdb1 as sysdba @/demo/init.sql

Invoke the data transfer pipeline.

docker compose run --rm --no-TTY ctk-ingest ctk load "oracle://sys:secret@oracledb:1521/?service_name=freepdb1&table=sys.demo&mode=sysdba" "crate://crate:crate@cratedb:4200/doc/oracle_demo"

Explore data¶

Inspect data stored in CrateDB.

docker compose exec cratedb crash -c "SELECT * FROM doc.oracle_demo"

+----+-------------+----------+
| id | temperature | humidity |
+----+-------------+----------+
|  1 |       42.84 |    83.1  |
|  2 |       84.84 |    56.99 |
+----+-------------+----------+
SELECT 2 rows in set (0.061 sec)