Add Filter Parameter and TagName field mapping for OPC Publisher Transformer #296
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: GBBBAS <[email protected]>
Signed-off-by: GBBBAS <[email protected]>
Signed-off-by: GBBBAS <[email protected]>
Signed-off-by: GBBBAS <[email protected]>
|
Kudos, SonarCloud Quality Gate passed! |
cching95
approved these changes
May 26, 2023
GBBBAS
added a commit
that referenced
this pull request
May 30, 2023
* EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
May 31, 2023
* EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
May 31, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Jun 10, 2023
* EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Jun 16, 2023
* EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]>
cching95
added a commit
that referenced
this pull request
Jun 19, 2023
* v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Revert init files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Jun 19, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Jun 19, 2023
* v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Revert init files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]>
cching95
added a commit
that referenced
this pull request
Jul 6, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * interpolation at time with filter Signed-off-by: cching95 <[email protected]> * added good/bad filter on interpolation at time Signed-off-by: cching95 <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]>
rodalynbarce
added a commit
that referenced
this pull request
Jul 7, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * interpolation at time with filter Signed-off-by: cching95 <[email protected]> * added good/bad filter on interpolation at time Signed-off-by: cching95 <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]>
cching95
added a commit
that referenced
this pull request
Jul 7, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added mkdocs, weather src connector, test case Signed-off-by: Pawel <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Signed-off-by: Pawel <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
rodalynbarce
added a commit
that referenced
this pull request
Jul 7, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * interpolation at time with filter Signed-off-by: cching95 <[email protected]> * added good/bad filter on interpolation at time Signed-off-by: cching95 <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Jul 7, 2023
… MISO (#321) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Adding timezone support in ISO Sources with improved testing Signed-off-by: Shivam Saxena <[email protected]> * Adding MISO Raw to SMDM Transformer with unitesting and documentation. Signed-off-by: Shivam Saxena <[email protected]> * Restructuring SMDM Transformers, Adding Usage & Meta data support in geneeric way. Signed-off-by: Shivam Saxena <[email protected]> * Fixing naming conventions and adding testcases for Meta data Signed-off-by: Shivam Saxena <[email protected]> * Changing MDM Types to Classes instead of String for supportive columns Signed-off-by: Shivam Saxena <[email protected]> * Removing unnecessary spaces Signed-off-by: Shivam Saxena <[email protected]> * Fixing bug with Python3.10 Signed-off-by: Shivam Saxena <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Adding DF show for MisoToMDM Testcases Signed-off-by: Shivam Saxena <[email protected]> * MisoToMDM Test cases: Adding show for all DFs Signed-off-by: Shivam Saxena <[email protected]> * Removing timezone from dates for MISOToMDM Transformer class Signed-off-by: Shivam Saxena <[email protected]> * Removing show statements from MisoToMDM Transformer test cases Signed-off-by: Shivam Saxena <[email protected]> * Converting Column names into CamelCasing for ISOs Signed-off-by: Shivam Saxena <[email protected]> * Fixing spark.py and meters utils testcases Signed-off-by: Shivam Saxena <[email protected]> * Fixing Small code smell Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: PaveeG <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Jul 10, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added mkdocs, weather src connector, test case Signed-off-by: Pawel <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Signed-off-by: Pawel <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Jul 10, 2023
… MISO (#321) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Adding timezone support in ISO Sources with improved testing Signed-off-by: Shivam Saxena <[email protected]> * Adding MISO Raw to SMDM Transformer with unitesting and documentation. Signed-off-by: Shivam Saxena <[email protected]> * Restructuring SMDM Transformers, Adding Usage & Meta data support in geneeric way. Signed-off-by: Shivam Saxena <[email protected]> * Fixing naming conventions and adding testcases for Meta data Signed-off-by: Shivam Saxena <[email protected]> * Changing MDM Types to Classes instead of String for supportive columns Signed-off-by: Shivam Saxena <[email protected]> * Removing unnecessary spaces Signed-off-by: Shivam Saxena <[email protected]> * Fixing bug with Python3.10 Signed-off-by: Shivam Saxena <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Adding DF show for MisoToMDM Testcases Signed-off-by: Shivam Saxena <[email protected]> * MisoToMDM Test cases: Adding show for all DFs Signed-off-by: Shivam Saxena <[email protected]> * Removing timezone from dates for MISOToMDM Transformer class Signed-off-by: Shivam Saxena <[email protected]> * Removing show statements from MisoToMDM Transformer test cases Signed-off-by: Shivam Saxena <[email protected]> * Converting Column names into CamelCasing for ISOs Signed-off-by: Shivam Saxena <[email protected]> * Fixing spark.py and meters utils testcases Signed-off-by: Shivam Saxena <[email protected]> * Fixing Small code smell Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: PaveeG <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Jul 12, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added mkdocs, weather src connector, test case Signed-off-by: Pawel <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Signed-off-by: Pawel <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Jul 12, 2023
… MISO (#321) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Adding timezone support in ISO Sources with improved testing Signed-off-by: Shivam Saxena <[email protected]> * Adding MISO Raw to SMDM Transformer with unitesting and documentation. Signed-off-by: Shivam Saxena <[email protected]> * Restructuring SMDM Transformers, Adding Usage & Meta data support in geneeric way. Signed-off-by: Shivam Saxena <[email protected]> * Fixing naming conventions and adding testcases for Meta data Signed-off-by: Shivam Saxena <[email protected]> * Changing MDM Types to Classes instead of String for supportive columns Signed-off-by: Shivam Saxena <[email protected]> * Removing unnecessary spaces Signed-off-by: Shivam Saxena <[email protected]> * Fixing bug with Python3.10 Signed-off-by: Shivam Saxena <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Adding DF show for MisoToMDM Testcases Signed-off-by: Shivam Saxena <[email protected]> * MisoToMDM Test cases: Adding show for all DFs Signed-off-by: Shivam Saxena <[email protected]> * Removing timezone from dates for MISOToMDM Transformer class Signed-off-by: Shivam Saxena <[email protected]> * Removing show statements from MisoToMDM Transformer test cases Signed-off-by: Shivam Saxena <[email protected]> * Converting Column names into CamelCasing for ISOs Signed-off-by: Shivam Saxena <[email protected]> * Fixing spark.py and meters utils testcases Signed-off-by: Shivam Saxena <[email protected]> * Fixing Small code smell Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: PaveeG <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Jul 13, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added mkdocs, weather src connector, test case Signed-off-by: Pawel <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Signed-off-by: Pawel <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Jul 13, 2023
… MISO (#321) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Adding timezone support in ISO Sources with improved testing Signed-off-by: Shivam Saxena <[email protected]> * Adding MISO Raw to SMDM Transformer with unitesting and documentation. Signed-off-by: Shivam Saxena <[email protected]> * Restructuring SMDM Transformers, Adding Usage & Meta data support in geneeric way. Signed-off-by: Shivam Saxena <[email protected]> * Fixing naming conventions and adding testcases for Meta data Signed-off-by: Shivam Saxena <[email protected]> * Changing MDM Types to Classes instead of String for supportive columns Signed-off-by: Shivam Saxena <[email protected]> * Removing unnecessary spaces Signed-off-by: Shivam Saxena <[email protected]> * Fixing bug with Python3.10 Signed-off-by: Shivam Saxena <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * Remove Eventhub Docs (#316) * Remove doc Signed-off-by: GBBBAS <[email protected]> * Update to environment.yml Signed-off-by: GBBBAS <[email protected]> * Update to environment file Signed-off-by: GBBBAS <[email protected]> * Add copyright to Environment.yml Signed-off-by: GBBBAS <[email protected]> * Remove comments on Environment.yml Signed-off-by: GBBBAS <[email protected]> * Change environment.yml back now that bug is fixed Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Adding DF show for MisoToMDM Testcases Signed-off-by: Shivam Saxena <[email protected]> * MisoToMDM Test cases: Adding show for all DFs Signed-off-by: Shivam Saxena <[email protected]> * Removing timezone from dates for MISOToMDM Transformer class Signed-off-by: Shivam Saxena <[email protected]> * Removing show statements from MisoToMDM Transformer test cases Signed-off-by: Shivam Saxena <[email protected]> * Converting Column names into CamelCasing for ISOs Signed-off-by: Shivam Saxena <[email protected]> * Fixing spark.py and meters utils testcases Signed-off-by: Shivam Saxena <[email protected]> * Fixing Small code smell Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: PaveeG <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Jul 27, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added weather transformer, docs, test - modified source weather Signed-off-by: PaveeG <[email protected]> * refactored code Signed-off-by: PaveeG <[email protected]> * modified weather source unit test Signed-off-by: PaveeG <[email protected]> * reformated code Signed-off-by: PaveeG <[email protected]> * updated camel casing in weather transformer and tests Signed-off-by: PaveeG <[email protected]> * removed spark session from tests Signed-off-by: PaveeG <[email protected]> * changed source test case Signed-off-by: PaveeG <[email protected]> * added weather transformer Signed-off-by: PaveeG <[email protected]> * added component Signed-off-by: PaveeG <[email protected]> * removed duplicates Signed-off-by: PaveeG <[email protected]> * changed if expression Signed-off-by: PaveeG <[email protected]> * merge Signed-off-by: PaveeG <[email protected]> * fixed logic expression Signed-off-by: PaveeG <[email protected]> * merge Signed-off-by: PaveeG <[email protected]> * removed duplicate strings in test Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
JamesKnBr
added a commit
that referenced
this pull request
Aug 1, 2023
* remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added weather transformer, docs, test - modified source weather Signed-off-by: PaveeG <[email protected]> * refactored code Signed-off-by: PaveeG <[email protected]> * modified weather source unit test Signed-off-by: PaveeG <[email protected]> * reformated code Signed-off-by: PaveeG <[email protected]> * updated camel casing in weather transformer and tests Signed-off-by: PaveeG <[email protected]> * removed spark session from tests Signed-off-by: PaveeG <[email protected]> * changed source test case Signed-off-by: PaveeG <[email protected]> * added weather transformer Signed-off-by: PaveeG <[email protected]> * added component Signed-off-by: PaveeG <[email protected]> * removed duplicates Signed-off-by: PaveeG <[email protected]> * changed if expression Signed-off-by: PaveeG <[email protected]> * merge Signed-off-by: PaveeG <[email protected]> * fixed logic expression Signed-off-by: PaveeG <[email protected]> * merge Signed-off-by: PaveeG <[email protected]> * removed duplicate strings in test Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
GBBBAS
added a commit
that referenced
this pull request
Aug 2, 2023
* add python delta source and destination Signed-off-by: JamesKnBr <[email protected]> * Updates for destination Signed-off-by: rodalynbarce <[email protected]> * add delta source and destination Signed-off-by: JamesKnBr <[email protected]> * update delta destination Signed-off-by: JamesKnBr <[email protected]> * added tests to delta source Signed-off-by: JamesKnBr <[email protected]> * Added delta destination test Signed-off-by: rodalynbarce <[email protected]> * Added init Signed-off-by: rodalynbarce <[email protected]> * Doc updates Signed-off-by: rodalynbarce <[email protected]> * tidy delta source and destination Signed-off-by: JamesKnBr <[email protected]> * doc updates and paramater fix (#398) Signed-off-by: cching95 <[email protected]> * fix meta data tag name error and update unit test (#401) Signed-off-by: cching95 <[email protected]> * Feature/00320 - Weather Transformer (#387) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Rebase main (#308) * remove print statement in twa Signed-off-by: cching95 <[email protected]> * v0.2.0 (#121) * Add Releases Feed to Docs Release page (#69) * fixes Add Releases Feed to Docs page #68 Signed-off-by: GBBBAS <[email protected]> * Mkdocs test fixes Signed-off-by: GBBBAS <[email protected]> * Add unit tests Signed-off-by: GBBBAS <[email protected]> * Fix Code Smell Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Update Packages and Doc Logos (#76) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Fix Logo Alignment (#78) * Upgrade Packages Signed-off-by: GBBBAS <[email protected]> * Upgrade Functions Packages Signed-off-by: GBBBAS <[email protected]> * Add logos Signed-off-by: GBBBAS <[email protected]> * Add logo to pypi readme Signed-off-by: GBBBAS <[email protected]> * Remove pydantic models Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Remove strawberry type Signed-off-by: GBBBAS <[email protected]> * Remove GraphQL Signed-off-by: GBBBAS <[email protected]> * Upgrade GraphQL Package Signed-off-by: GBBBAS <[email protected]> * Logo Size Changes Signed-off-by: GBBBAS <[email protected]> * Logo fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * fixes #77 (#79) Signed-off-by: GBBBAS <[email protected]> * add spark session (#80) * set up spark sessions Signed-off-by: cching95 <[email protected]> * adding unit tests for spark session Signed-off-by: cching95 <[email protected]> * remove tests for spark session Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> * add constants in pipeline utils Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Pipelines as Extras libraries (#82) Signed-off-by: GBBBAS <[email protected]> * Spark pipeline source Event hub and destination Event hub (#83) * add source eventhub to pipelines Signed-off-by: cching95 <[email protected]> * updates for documentation Signed-off-by: cching95 <[email protected]> * updates to mkdocs Signed-off-by: cching95 <[email protected]> * added unit tests Signed-off-by: cching95 <[email protected]> * documentation for eventhub source Signed-off-by: cching95 <[email protected]> * fix spelling error Signed-off-by: cching95 <[email protected]> * add source eventhub destination Signed-off-by: cching95 <[email protected]> * added destination source documentation Signed-off-by: cching95 <[email protected]> * remove unit tests to revisit later Signed-off-by: cching95 <[email protected]> * fix mkdoc errors Signed-off-by: cching95 <[email protected]> * fix code smells Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Spark pipeline source delta and destination delta (#84) * Spark pipeline source delta and destination delta Signed-off-by: rodalynbarce <[email protected]> * fix mkdocs errors Signed-off-by: rodalynbarce <[email protected]> * docstring amendments Signed-off-by: rodalynbarce <[email protected]> * Added to docstrings on delta source & destination Signed-off-by: JamesKnBr <[email protected]> * added query type for eventhubs Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: cching95 <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> * Added delta sharing with docs (#85) Signed-off-by: JamesKnBr <[email protected]> * Unit Tests for sources (#88) * add pipeline utils unit tests Signed-off-by: cching95 <[email protected]> * add unit test for eventhub and delta Signed-off-by: cching95 <[email protected]> * Unit Test Fixes Signed-off-by: GBBBAS <[email protected]> * remove test spark Signed-off-by: cching95 <[email protected]> * add unit test for destination delta Signed-off-by: cching95 <[email protected]> * fix eventhub spell errors Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Co-authored-by: GBBBAS <[email protected]> * Add pipeline eventhub body transformer (#89) * add transform eventhub Signed-off-by: cching95 <[email protected]> * transformer docs set up Signed-off-by: cching95 <[email protected]> * documentation for transformer eventhub body Signed-off-by: cching95 <[email protected]> * add transformer eventhub unit tests Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Added pipeline source autoloader and unit test (#93) Signed-off-by: rodalynbarce <[email protected]> * Pipeline Executor (#95) * Dependency Injector Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Utilities Interface Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Executor Signed-off-by: GBBBAS <[email protected]> * Add Pipeline Execute Test Signed-off-by: GBBBAS <[email protected]> * fixes #90 Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Step Order fix Signed-off-by: GBBBAS <[email protected]> * Sonarqube fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Delta Table Create Utility (#97) * Add to docs site Signed-off-by: GBBBAS <[email protected]> * Update Delta Table Name Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Signed-off-by: GBBBAS <[email protected]> * Add Delta Table Create Test Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * remove print statement in twa (#99) Signed-off-by: cching95 <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * Pipeline Deployment (#102) * Add DBX Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment Updates (#103) * Pipeline Deployment Updates Signed-off-by: GBBBAS <[email protected]> * Update to run logic of Pipeline Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment (#104) Signed-off-by: GBBBAS <[email protected]> * Unit test for spark pipeline eventhub destination (#105) * eventhub destination unit test Signed-off-by: cching95 <[email protected]> * add unit test for spark eventhub destination Signed-off-by: cching95 <[email protected]> * add spark eventhub write stream unit test Signed-off-by: cching95 <[email protected]> * update exception handling for eventhub and delta Signed-off-by: cching95 <[email protected]> * update exception in utilities Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Fix for Dependency Injection (#106) Signed-off-by: GBBBAS <[email protected]> * Unit tests for source and destination streams (#108) * streaming unit test for source eventhub Signed-off-by: cching95 <[email protected]> * add delta read stream unit test Signed-off-by: cching95 <[email protected]> * add unit test for delta destination streaming Signed-off-by: cching95 <[email protected]> * remove extra test Signed-off-by: cching95 <[email protected]> * remove code smell Signed-off-by: cching95 <[email protected]> * add previous line of code back Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Pipeline Deployments and Pipeline Secrets (#111) * Fix for Dependency Injection Signed-off-by: GBBBAS <[email protected]> * Pipeline Deployment And Secrets Signed-off-by: GBBBAS <[email protected]> * Add System Type Docs Signed-off-by: GBBBAS <[email protected]> * Updates for Secrets Signed-off-by: GBBBAS <[email protected]> * Code Smell fix Signed-off-by: GBBBAS <[email protected]> * Refactor Pipeline Secret Conversion Logic Signed-off-by: GBBBAS <[email protected]> * import required objects Signed-off-by: GBBBAS <[email protected]> * Code smell fix Signed-off-by: GBBBAS <[email protected]> * Code Smell Fix Signed-off-by: GBBBAS <[email protected]> * Fix Code Smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Added fails tests to pipeline sources (#112) * Added fails tests to pipeline sources Signed-off-by: JamesKnBr <[email protected]> * Added fails tests for pipeline destinations Signed-off-by: JamesKnBr <[email protected]> * Fixed code smell Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> * Fix for dockerbuild error (#114) Signed-off-by: GBBBAS <[email protected]> * Fix for docker build (#115) Signed-off-by: GBBBAS <[email protected]> * Cleanup Dockerfile (#116) Signed-off-by: GBBBAS <[email protected]> * Pipeline Secrets, Converters and Deployment Updates (#119) * Updates for Pipelines Signed-off-by: GBBBAS <[email protected]> * Update DBX Documentation Signed-off-by: GBBBAS <[email protected]> * Updates for Pipeline Deployment Signed-off-by: GBBBAS <[email protected]> * Remove package.json Signed-off-by: GBBBAS <[email protected]> * Fix code smells Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * time weighted average bug fix (#120) * fix twa group by dataframe return Signed-off-by: cching95 <[email protected]> * bug fixes for groupby and apply method Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> * v0.4.0 (#304) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Feature/00264 (#272) * EdgeX Transformer (#271) * added transformer component Signed-off-by: rodalynbarce <[email protected]> * added edgeX test Signed-off-by: JamesKnBr <[email protected]> * update test Signed-off-by: JamesKnBr <[email protected]> * test updates Signed-off-by: rodalynbarce <[email protected]> * added kafka destination write format Signed-off-by: JamesKnBr <[email protected]> * component update Signed-off-by: rodalynbarce <[email protected]> * removed timestamp format Signed-off-by: JamesKnBr <[email protected]> * updated docs Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> * Adding support for MISO Sources Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Fixing sonar smells Signed-off-by: Shivam Saxena <[email protected]> * Removing ISO Runner file Signed-off-by: Shivam Saxena <[email protected]> * Making ISO methods internal Signed-off-by: Shivam Saxena <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> * Add Partition Pruning to non broadcast join PCDM Merge (#274) * Add Partition Pruning on non broadcast join merge Signed-off-by: GBBBAS <[email protected]> * Update DropDuplicates Signed-off-by: GBBBAS <[email protected]> * Fix Drop Duplicates Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * update docs (#286) * update docs Signed-off-by: JamesKnBr <[email protected]> * linked issues page Signed-off-by: JamesKnBr <[email protected]> * changed issues link Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> * Fix mkdocs colour bug (#291) * update Signed-off-by: cching95 <[email protected]> * fix colour issue on mkdocs Signed-off-by: cching95 <[email protected]> * fix colour bug on homepage Signed-off-by: cching95 <[email protected]> --------- Signed-off-by: cching95 <[email protected]> * Add Filter Parameter and TagName field mapping for OPC Publisher Transformer (#296) * Additional OPC Publisher Logic Signed-off-by: GBBBAS <[email protected]> * Add Device ID Filter Signed-off-by: GBBBAS <[email protected]> * Update Docs Signed-off-by: GBBBAS <[email protected]> * Update to Filter Logic Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Weather Domain and Data Model (#294) * added new overview and data model Signed-off-by: PaveeG <[email protected]> * adding signoff Signed-off-by: PaveeG <[email protected]> * added overview and data model Signed-off-by: PaveeG <[email protected]> * Adding signoff Signed-off-by: Author Name <[email protected]> Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: PaveeG <[email protected]> * Refactor for odbc and functions folders (#299) * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Pyspark 3.4.0 and delta-spark 2.4.0 support (#297) * Preview Support of Pyspark 3.4.0 Signed-off-by: GBBBAS <[email protected]> * Fix for running github actions tests Signed-off-by: GBBBAS <[email protected]> * Updates for delta-spark release candidate Signed-off-by: GBBBAS <[email protected]> * Update tests Signed-off-by: GBBBAS <[email protected]> * Downgrade Turbodbc to include 3.8 Signed-off-by: GBBBAS <[email protected]> * Add Spark Connect Signed-off-by: GBBBAS <[email protected]> * Updates to packages Signed-off-by: GBBBAS <[email protected]> * Updates for release of 2.4.0 Signed-off-by: GBBBAS <[email protected]> * Add hvac back Signed-off-by: GBBBAS <[email protected]> * Fixes for tests Signed-off-by: GBBBAS <[email protected]> * Remove Whitespace Signed-off-by: GBBBAS <[email protected]> * Build sdist and wheel Signed-off-by: GBBBAS <[email protected]> * Change micromamba Action Signed-off-by: GBBBAS <[email protected]> * Update Tests Workflow Signed-off-by: GBBBAS <[email protected]> * Code Smells Signed-off-by: GBBBAS <[email protected]> * Sonarqube Bug Fix Signed-off-by: GBBBAS <[email protected]> * Update Readme with logo Signed-off-by: GBBBAS <[email protected]> * Center table Signed-off-by: GBBBAS <[email protected]> * Update readme Signed-off-by: GBBBAS <[email protected]> * Folder Refactor Signed-off-by: GBBBAS <[email protected]> * Code smell fixes Signed-off-by: GBBBAS <[email protected]> * Updates for refactoriung spark connector Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Add OPC UA Transformer parameters (#301) Signed-off-by: GBBBAS <[email protected]> * Update for Micromamba Github Actions Parameters (#302) * Update micromamba parameters Signed-off-by: GBBBAS <[email protected]> * Update for Sonarqube Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: GBBBAS <[email protected]> * Upgrade FastAPI package (#303) Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> * Resolve imports on deprecated folders Signed-off-by: GBBBAS <[email protected]> * Updates to remove unwanted files Signed-off-by: GBBBAS <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> Co-authored-by: PaveeG <[email protected]> * Merge main to develop Signed-off-by: GBBBAS <[email protected]> * added weather transformer, docs, test - modified source weather Signed-off-by: PaveeG <[email protected]> * refactored code Signed-off-by: PaveeG <[email protected]> * modified weather source unit test Signed-off-by: PaveeG <[email protected]> * reformated code Signed-off-by: PaveeG <[email protected]> * updated camel casing in weather transformer and tests Signed-off-by: PaveeG <[email protected]> * removed spark session from tests Signed-off-by: PaveeG <[email protected]> * changed source test case Signed-off-by: PaveeG <[email protected]> * added weather transformer Signed-off-by: PaveeG <[email protected]> * added component Signed-off-by: PaveeG <[email protected]> * removed duplicates Signed-off-by: PaveeG <[email protected]> * changed if expression Signed-off-by: PaveeG <[email protected]> * merge Signed-off-by: PaveeG <[email protected]> * fixed logic expression Signed-off-by: PaveeG <[email protected]> * merge Signed-off-by: PaveeG <[email protected]> * removed duplicate strings in test Signed-off-by: PaveeG <[email protected]> --------- Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]> * API Updates (#404) Signed-off-by: GBBBAS <[email protected]> * AMQP value decoding from Kafka Headers (#403) Signed-off-by: GBBBAS <[email protected]> * Return Properties initial value if not populated (#405) Signed-off-by: GBBBAS <[email protected]> * Delete run_delta_stream.py Signed-off-by: JamesKnBr <[email protected]> * fix code smells Signed-off-by: JamesKnBr <[email protected]> * Added test for dataframe type Signed-off-by: rodalynbarce <[email protected]> * updated delta destination and yaml Signed-off-by: JamesKnBr <[email protected]> * remove delta-sharing from yaml Signed-off-by: JamesKnBr <[email protected]> * add python delta sharing source Signed-off-by: JamesKnBr <[email protected]> --------- Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: rodalynbarce <[email protected]> Signed-off-by: cching95 <[email protected]> Signed-off-by: GBBBAS <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Signed-off-by: Shivam Saxena <[email protected]> Signed-off-by: PaveeG <[email protected]> Signed-off-by: JamesKnBr <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: cching95 <[email protected]> Co-authored-by: PaveeG <[email protected]> Co-authored-by: GBBBAS <[email protected]> Co-authored-by: Amber-Rigg <[email protected]> Co-authored-by: NooraKubati <[email protected]> Co-authored-by: rodalynbarce <[email protected]> Co-authored-by: IW-SS <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add option to filter iot hub messages by module and provide an option to specify the field to be used for TagName mapping. Resolves #295