-
Notifications
You must be signed in to change notification settings - Fork 5
SK-2302 release/25.9.11 #246
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
52 commits
Select commit
Hold shift + click to select a range
013f144
SK-2274 test internal release
skyflow-bharti 8bbf2d6
[AUTOMATED] Private Release 3.0.0-beta.3-dev-013f144
skyflow-bharti b03c677
SK-2286 V3 release/25.9.3 (#224)
skyflow-shravan ad33628
SK-2286 override vault url and accept skyflow creds from env (#225)
skyflow-shravan 61d26c7
SK-2289 Fix upsert operation not working issue
skyflow-vivek d3257dc
Merge pull request #226 from skyflowapi/skyflow-vivek/SK-2289-fix-ups…
skyflow-vivek 6f23911
[AUTOMATED] Private Release 2.0.0-beta.4-dev-d3257dc
skyflow-vivek b50c410
SK-2292 Update default concurrency limit from 10 to 1
skyflow-vivek 33f6d97
SK-2292 fix unit tests
skyflow-bharti 082387d
SK-2292 fix log in detokenize
skyflow-bharti d7908d1
SK-2292 fix log in detokenize
skyflow-bharti a25231a
Merge branch 'v3-release/25.9.5' into skyflow-vivek/SK-2292-update-de…
skyflow-bharti 8e725b7
Merge pull request #232 from skyflowapi/skyflow-vivek/SK-2292-update-…
skyflow-bharti 0186972
[AUTOMATED] Private Release 2.0.0-dev-8e725b7
skyflow-bharti 903835b
Merge pull request #230 from skyflowapi/skyflow-vivek/SK-2292-update-…
skyflow-bharti 7b1b3bc
[AUTOMATED] Private Release 2.0.0-dev-903835b
skyflow-bharti e96d8dc
Merge branch 'v3-release/25.9.2' into v3-release/25.9.5
skyflow-bharti ff60830
[AUTOMATED] Private Release 2.0.0-dev-e96d8dc
skyflow-bharti 10d960f
SK-2302 add multi table insert support
skyflow-bharti 3fa14f8
SK-2291: Add unit test cases for V3 SDK. (#234)
saileshwar-skyflow b7d34bb
[AUTOMATED] Private Release 2.0.0-dev-3fa14f8
saileshwar-skyflow ae75c8d
SK-2302 add changes for bulk async changes
skyflow-bharti e561622
SK-2302 updated the messages
skyflow-bharti a5514d3
SK-2302 updated the messages
skyflow-bharti c5595d0
SK-2302 updated variable names
skyflow-bharti 01ce5e0
SK-2302 updated limit
skyflow-bharti ae9f2f4
[AUTOMATED] Private Release 2.0.0-dev-01ce5e0
skyflow-bharti e0db412
Merge branch 'v3-release/25.9.5' into v3-release/25.9.11
skyflow-bharti 72916bd
[AUTOMATED] Private Release 2.0.0-dev-e0db412
skyflow-bharti 7d67954
Merge branch 'origin/v3-release/25.9.11' into SK-2302-multi-table-ins…
skyflow-vivek 4ecc162
SK-2302 Fix unit test
skyflow-vivek e9d055a
Merge pull request #242 from skyflowapi/SK-2302-multi-table-insert-su…
skyflow-bharti ff35817
[AUTOMATED] Private Release 2.0.0-dev-e9d055a
skyflow-bharti 6506b91
SK-2302 fixed error index
skyflow-bharti 937cc18
Merge pull request #244 from skyflowapi/SK-2302-multi-table-insert-su…
skyflow-bharti 2cc408f
[AUTOMATED] Private Release 2.0.0-dev-937cc18
skyflow-bharti 1cc246e
SK-2302 fixed detokenize token redaction
skyflow-bharti b40c279
SK-2302 Update Concurrency values for insert and detokenize
skyflow-vivek e6833d8
[AUTOMATED] Private Release 2.0.0-dev-b40c279
skyflow-vivek 3a80c07
SK-2302 add unit tests
skyflow-bharti 4401e48
[AUTOMATED] Private Release 2.0.0-dev-3a80c07
skyflow-bharti 1aa170f
Merge branch 'v3-release/25.9.11' into SK-2302-multi-table-insert-sup…
skyflow-bharti a742b35
SK-2302 remove pom chnages and added samples for multi table insert s…
skyflow-bharti 7b83641
[AUTOMATED] Private Release 2.0.0-dev-a742b35
skyflow-bharti 24cb613
SK-2302 changed Update enum to Upsert
skyflow-bharti 339d8f7
Merge branch 'v3-release/25.9.11' into SK-2302-multi-table-insert-sup…
skyflow-bharti c3f911e
Merge pull request #245 from skyflowapi/SK-2302-multi-table-insert-su…
skyflow-bharti 0537764
[AUTOMATED] Private Release 2.0.0-dev-c3f911e
skyflow-bharti 6993fc0
SK-2302 updated the samples
skyflow-bharti fa3042a
[AUTOMATED] Private Release 2.0.0-dev-6993fc0
skyflow-bharti baba121
SK-2305 Fix few small behaviour inconsistencies
skyflow-vivek 224b191
[AUTOMATED] Private Release 2.0.0-dev-baba121
skyflow-vivek File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Some comments aren't visible on the classic Files Changed page.
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
100 changes: 100 additions & 0 deletions
100
samples/src/main/java/com/example/vault/BulkMultiTableInsertAsync.java
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,100 @@ | ||
| package com.example.vault; | ||
|
|
||
| import com.skyflow.Skyflow; | ||
| import com.skyflow.config.Credentials; | ||
| import com.skyflow.config.VaultConfig; | ||
| import com.skyflow.enums.Env; | ||
| import com.skyflow.enums.LogLevel; | ||
| import com.skyflow.enums.UpdateType; | ||
| import com.skyflow.vault.data.InsertRecord; | ||
| import com.skyflow.vault.data.InsertRequest; | ||
| import com.skyflow.vault.data.InsertResponse; | ||
|
|
||
| import java.util.ArrayList; | ||
| import java.util.HashMap; | ||
| import java.util.List; | ||
| import java.util.concurrent.CompletableFuture; | ||
| import java.util.concurrent.CompletionException; | ||
|
|
||
| /** | ||
| * This sample demonstrates how to perform an asynchronous bulk insert operation using the Skyflow Java SDK. | ||
| * The process involves: | ||
| * 1. Setting up credentials and vault configuration | ||
| * 2. Creating multiple records to be inserted | ||
| * 3. Building and executing an async bulk insert request | ||
| * 4. Handling the insert response or errors using CompletableFuture | ||
| */ | ||
| public class BulkMultiTableInsertAsync { | ||
|
|
||
| public static void main(String[] args) { | ||
| try { | ||
| // Step 1: Initialize credentials with the path to your service account key file | ||
| String filePath = "<YOUR_CREDENTIALS_FILE_PATH>"; | ||
| Credentials credentials = new Credentials(); | ||
| credentials.setPath(filePath); | ||
|
|
||
| // Step 2: Configure the vault with required parameters | ||
| VaultConfig vaultConfig = new VaultConfig(); | ||
| vaultConfig.setVaultId("<YOUR_VAULT_ID>"); | ||
| vaultConfig.setClusterId("<YOUR_CLUSTER_ID>"); | ||
| vaultConfig.setEnv(Env.PROD); | ||
| vaultConfig.setCredentials(credentials); | ||
|
|
||
| // Step 3: Create Skyflow client instance with error logging | ||
| Skyflow skyflowClient = Skyflow.builder() | ||
| .setLogLevel(LogLevel.ERROR) | ||
| .addVaultConfig(vaultConfig) | ||
| .build(); | ||
|
|
||
| // Step 4: Prepare first record for insertion | ||
| HashMap<String, Object> recordData1 = new HashMap<>(); | ||
| rerecordData1cord1.put("<YOUR_COLUMN_NAME_1>", "<YOUR_VALUE_1>"); | ||
| recordData1.put("<YOUR_COLUMN_NAME_2>", "<YOUR_VALUE_1>"); | ||
|
|
||
| List<String> upsertColumns = new ArrayList<>(); | ||
| upsertColumns.add("<YOUR_COLUMN_NAME_1>"); | ||
|
|
||
| InsertRecord insertRecord1 = InsertRecord | ||
| .builder() | ||
| .data(recordData1) | ||
| .table("<YOUR_TABLE_NAME>") | ||
| .upsert(upsertColumns) | ||
| .upsertType(UpsertType.UPDATE) | ||
| .build(); | ||
|
|
||
| // Step 5: Prepare second record for insertion | ||
| HashMap<String, Object> recordData2 = new HashMap<>(); | ||
| recordData2.put("<YOUR_COLUMN_NAME_1>", "<YOUR_VALUE_1>"); | ||
| recordData2.put("<YOUR_COLUMN_NAME_2>", "<YOUR_VALUE_1>"); | ||
|
|
||
| InsertRecord insertRecord2 = InsertRecord | ||
| .builder() | ||
| .data(recordData2) | ||
| .table("<YOUR_TABLE_NAME>") | ||
| .build(); | ||
|
|
||
| // Step 6: Combine records into a Insert record list | ||
| ArrayList<InsertRecord> insertRecords = new ArrayList<>(); | ||
| insertRecords.add(insertRecord1); | ||
| insertRecords.add(insertRecord2); | ||
|
|
||
| // Step 7: Build the insert request with table name and values | ||
| InsertRequest request = InsertRequest.builder() | ||
| .records(insertRecords) | ||
| .build(); | ||
|
|
||
| // Step 8: Execute the async bulk insert operation and handle response using callbacks | ||
| CompletableFuture<InsertResponse> future = skyflowClient.vault().bulkInsertAsync(request); | ||
| // Add success and error callbacks | ||
| future.thenAccept(response -> { | ||
| System.out.println("Async bulk insert resolved with response:\t" + response); | ||
| }).exceptionally(throwable -> { | ||
| System.err.println("Async bulk insert rejected with error:\t" + throwable.getMessage()); | ||
| throw new CompletionException(throwable); | ||
| }); | ||
| } catch (Exception e) { | ||
| // Step 9: Handle any synchronous errors that occur during setup | ||
| System.err.println("Error in Skyflow operations:\t" + e.getMessage()); | ||
| } | ||
| } | ||
| } |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.