Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@Amber-Rigg
Copy link
Contributor

Closing Tasks #397 and #429 for ECMWF integration. Downloading the Transforming .nc files

Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
@Amber-Rigg Amber-Rigg added the enhancement New feature or request label Aug 18, 2023
@Amber-Rigg Amber-Rigg requested a review from JamesKnBr August 18, 2023 11:26
@Amber-Rigg Amber-Rigg self-assigned this Aug 18, 2023
Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
This was linked to issues Aug 18, 2023
@GBBBAS GBBBAS added pipelines Pipeline components and ingestion framework and removed enhancement New feature or request labels Aug 20, 2023
@GBBBAS GBBBAS changed the title Feature/00397 - ECMWF Source and Transform ECMWF Source and Transformer Components Aug 20, 2023
GBBBAS
GBBBAS previously approved these changes Aug 20, 2023
Signed-off-by: GBBBAS <[email protected]>
@sonarqubecloud
Copy link

SonarCloud Quality Gate failed.    Quality Gate failed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 3 Code Smells

90.5% 90.5% Coverage
3.8% 3.8% Duplication

idea Catch issues before they fail your Quality Gate with our IDE extension sonarlint SonarLint

@GBBBAS GBBBAS merged commit 3f0e9bd into develop Aug 20, 2023
@GBBBAS GBBBAS deleted the feature/00397 branch August 20, 2023 18:51
GBBBAS added a commit that referenced this pull request Aug 21, 2023
* Fix for mkdocs build (#448)

* Fix for mkdocs

Signed-off-by: GBBBAS <[email protected]>

* Update to mkdocstrings-python

Signed-off-by: GBBBAS <[email protected]>

---------

Signed-off-by: GBBBAS <[email protected]>

* Honeywell APM transformers (#446)

* typo change

Signed-off-by: JamesKnBr <[email protected]>

* Add Honeywell transformers

Signed-off-by: JamesKnBr <[email protected]>

---------

Signed-off-by: JamesKnBr <[email protected]>
Signed-off-by: JamesKnBr <[email protected]>

* Update mkdocs packages (#449)

* Update packages

Signed-off-by: GBBBAS <[email protected]>

* Update databricks-sql-connector

Signed-off-by: GBBBAS <[email protected]>

* Update mkdocs plugin

Signed-off-by: GBBBAS <[email protected]>

---------

Signed-off-by: GBBBAS <[email protected]>

* ECMWF Source and Transformer Components (#447)

* ECMWF Weather Forecast API Integration

Signed-off-by: Amber-Rigg <[email protected]>

* Forecast Transformation and Extract for ECMWF .nc

Signed-off-by: Amber-Rigg <[email protected]>

* Documentation on Source and transformer

Signed-off-by: Amber-Rigg <[email protected]>

* Dcoumentation on source component

Signed-off-by: Amber-Rigg <[email protected]>

* Unit tests

Signed-off-by: Amber-Rigg <[email protected]>

* Remove MARS seperated

Signed-off-by: Amber-Rigg <[email protected]>

* Initial Unit Tests

Signed-off-by: Amber-Rigg <[email protected]>

* Update spacing

Signed-off-by: Amber-Rigg <[email protected]>

* ECMWF Documentation and New structure

Signed-off-by: Amber-Rigg <[email protected]>

* Update environments

Signed-off-by: Amber-Rigg <[email protected]>

* Update Env

Signed-off-by: Amber-Rigg <[email protected]>

* Transformer Unit Test

Signed-off-by: Amber-Rigg <[email protected]>

* remove file

Signed-off-by: Amber-Rigg <[email protected]>

* Unit tests for transfomer

Signed-off-by: Amber-Rigg <[email protected]>

* Unit testing

Signed-off-by: Amber-Rigg <[email protected]>

* Unit Testing

Signed-off-by: Amber-Rigg <[email protected]>

* Improve tests

Signed-off-by: Amber-Rigg <[email protected]>

* Import config

Signed-off-by: Amber-Rigg <[email protected]>

* Unit Test for nc_extract

Signed-off-by: Amber-Rigg <[email protected]>

* ECMWF BASE unit test

Signed-off-by: Amber-Rigg <[email protected]>

* unit test of ecmwf read_batch

Signed-off-by: Amber-Rigg <[email protected]>

* weather forecast unit tests

Signed-off-by: Amber-Rigg <[email protected]>

* Unit Tests with Smaller nc

Signed-off-by: Amber-Rigg <[email protected]>

* Init cls method

Signed-off-by: Amber-Rigg <[email protected]>

* Update env for netCDF4

Signed-off-by: Amber-Rigg <[email protected]>

* Update xarray for python 3.8

Signed-off-by: Amber-Rigg <[email protected]>

* xarray python compatible

Signed-off-by: Amber-Rigg <[email protected]>

* xarray and 2.8 python

Signed-off-by: Amber-Rigg <[email protected]>

* reducing

Signed-off-by: Amber-Rigg <[email protected]>

* Updates for ECMWF

Signed-off-by: GBBBAS <[email protected]>

* Update to filenames

Signed-off-by: GBBBAS <[email protected]>

* Updates for documentation

Signed-off-by: GBBBAS <[email protected]>

---------

Signed-off-by: Amber-Rigg <[email protected]>
Signed-off-by: GBBBAS <[email protected]>
Co-authored-by: GBBBAS <[email protected]>

* Black Code Formatter (#450)

* Update environment

Signed-off-by: GBBBAS <[email protected]>

* Black Code Readme

Signed-off-by: GBBBAS <[email protected]>

* Add to tests

Signed-off-by: GBBBAS <[email protected]>

* Dev container

Signed-off-by: GBBBAS <[email protected]>

* Add to settings

Signed-off-by: GBBBAS <[email protected]>

* Update settings

Signed-off-by: GBBBAS <[email protected]>

* Update devcontainer

Signed-off-by: GBBBAS <[email protected]>

* Black code formatting

Signed-off-by: GBBBAS <[email protected]>

---------

Signed-off-by: GBBBAS <[email protected]>

* Pandas version updates (#451)

* Pandas version update

Signed-off-by: GBBBAS <[email protected]>

* Move langchain

Signed-off-by: GBBBAS <[email protected]>

* Update to xarray versions

Signed-off-by: GBBBAS <[email protected]>

---------

Signed-off-by: GBBBAS <[email protected]>

---------

Signed-off-by: GBBBAS <[email protected]>
Signed-off-by: JamesKnBr <[email protected]>
Signed-off-by: JamesKnBr <[email protected]>
Signed-off-by: Amber-Rigg <[email protected]>
Co-authored-by: JamesKnBr <[email protected]>
Co-authored-by: Amber-Rigg <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pipelines Pipeline components and ingestion framework

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

EMCWF.nc Transformer Component ECMWF Source Component

3 participants