Thanks to visit codestin.com
Credit goes to github.com

Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
221 commits
Select commit Hold shift + click to select a range
6534667
Initial commit
romeokienzler Jun 16, 2021
17c947a
Update README.md
romeokienzler Jun 16, 2021
87e99ae
test component
Jun 16, 2021
94cfbbd
Update README.md
romeokienzler Jun 22, 2021
06478db
Update README.md
romeokienzler Jun 22, 2021
865d236
1st iteration on mlx upload + nbconvert
Jun 24, 2021
2bb79a3
Merge branch 'main' of github.com:romeokienzler/c3 into main
Jun 24, 2021
d0305ce
name, description and envs extractable from notebook
Jun 24, 2021
d5e7244
start parsing for requirements
Jun 25, 2021
244cc1c
start implementing kfp component writer
Jun 25, 2021
af46cc1
finalize kfp_component
Jun 25, 2021
569cd5e
add test trigger script
Jul 5, 2021
a958562
finish kfp component builder
Jul 30, 2021
96112fa
fix test_component.yaml
Aug 2, 2021
db7f3ed
find and work on env lines
Aug 11, 2021
6ff1149
add support for parsing description and data type
Aug 12, 2021
2a4ef31
start working on command
Aug 13, 2021
6d2a7e1
add dummy parameters
Aug 14, 2021
22bc222
fix missing comma
Aug 16, 2021
771b10b
fix
Aug 16, 2021
2c358af
fix
Aug 16, 2021
eb8efc7
fix
Aug 16, 2021
e536df8
fix
Aug 16, 2021
c7c3006
fix
Aug 18, 2021
ca3f751
fix template problem
Aug 23, 2021
fe30069
release candidate 1
Aug 23, 2021
c1e738a
add generator scripts
Sep 6, 2021
43d581e
fix
Sep 6, 2021
bc0759b
ongoing work
Oct 28, 2021
971667a
commit for backup
Nov 25, 2021
e216ade
add argument check
Oct 26, 2022
e5a2bd8
clear v1 of the tool
Nov 23, 2022
f4e918c
remove vscode clutter
Nov 23, 2022
129380d
add v2 of C3
Nov 23, 2022
0529267
add README.md
romeokienzler Feb 27, 2023
b34ee57
Update README.md
romeokienzler Feb 27, 2023
8e09650
improve .gitignore
romeokienzler Jun 1, 2023
74b9c28
Support < 1 outputs
miragecoa Jun 27, 2023
de826a6
Merge pull request #1 from miragecoa/main
romeokienzler Jul 1, 2023
a0c3055
add additional data types
romeokienzler Jul 7, 2023
d9ac049
on the way to a pypi package
romeokienzler Jul 17, 2023
b1adf9b
add kubernetes job as compiler target
romeokienzler Jul 20, 2023
f6b855e
bugfix: fix notebook.py to work with new notebook format
romeokienzler Jul 21, 2023
fa698c5
changes for hiwot
romeokienzler Jul 21, 2023
400cf1a
fix: :adhesive_bandage: specify build platform
fredotieno Jul 25, 2023
eaca499
fix: :adhesive_bandage: include hyphen in regex, to capture libs with…
fredotieno Jul 25, 2023
37ec9f4
fix: :adhesive_bandage: use repository var
fredotieno Jul 25, 2023
5a63002
Merge pull request #5 from fredotieno/uat-jul
romeokienzler Aug 14, 2023
9ef5a88
fix: :adhesive_bandage: use curly brackets for parameter list generation
fredotieno Aug 16, 2023
4888aad
Merge pull request #7 from fredotieno/c3-issue-6
romeokienzler Aug 16, 2023
50dae11
allow multiple additional files
Jubeku Aug 18, 2023
3beff0d
Merge pull request #9 from Jubeku/main
romeokienzler Aug 18, 2023
c986e4b
Corrected misspelling
blumenstiel Aug 30, 2023
7606404
Added getting started to README.md
blumenstiel Aug 30, 2023
bc30155
Replace "_" with "-" in container name
blumenstiel Sep 1, 2023
a709f6f
Delete local copies after containerization
blumenstiel Sep 1, 2023
32d4ef0
Delete local copies after containerization
blumenstiel Sep 4, 2023
ba0a652
Added the cpython compiler
blumenstiel Sep 4, 2023
fe60bf5
Added an operator example
blumenstiel Sep 12, 2023
094cf34
Update ReadMe
blumenstiel Sep 13, 2023
8a27a85
Add GettingStarted
blumenstiel Sep 13, 2023
01cdd14
Convert notebooks to py scripts
blumenstiel Sep 13, 2023
ea92df6
fixed remove temporary files
blumenstiel Sep 14, 2023
e99ceae
fixed description and file_path copy
blumenstiel Sep 14, 2023
18e422b
Adding additional code at each script for logging and setting cli par…
blumenstiel Sep 14, 2023
043b1d7
Moved templates to src/templates
blumenstiel Sep 16, 2023
ef43220
Added grid wrapper
blumenstiel Sep 16, 2023
94ae7e3
Removed nb compiler because of nb converter
blumenstiel Sep 16, 2023
f459f43
Updated create_operator and create_grid_wrapper
blumenstiel Oct 9, 2023
42b356a
Removed pre- and post-process from grid_wapper
blumenstiel Oct 10, 2023
dc64611
Added cos grip wrapper
blumenstiel Oct 10, 2023
a5d810a
fixed additional files error
blumenstiel Oct 10, 2023
6787e91
Updated error handling in grid wrapper and fixed cos processing
blumenstiel Oct 12, 2023
b41be58
Fixed typo in cos grid wrapper
blumenstiel Oct 13, 2023
018ed1a
Updated GettingStarted.md
blumenstiel Oct 16, 2023
66da434
Remove grid wrapper component
blumenstiel Oct 16, 2023
7ff076f
Add auto-incremental image version
blumenstiel Oct 17, 2023
c7dfe6f
Replaced os.system with subprocess.run
blumenstiel Oct 17, 2023
b209cef
Updated code for additional_files and kfp yaml
blumenstiel Oct 17, 2023
9e6bab7
Moved file_path and additional_files to positional arguments
blumenstiel Oct 18, 2023
9870f15
Changed default version to 0.1
blumenstiel Oct 18, 2023
33f7295
Moved templates to c3 dir
blumenstiel Oct 18, 2023
2991d4d
Removed old files
blumenstiel Oct 18, 2023
29ed351
Added pypi package code
blumenstiel Oct 18, 2023
42b6729
Update ReadMe and add LICENSE file
blumenstiel Oct 18, 2023
4000d34
Create python-publish.yml
blumenstiel Oct 18, 2023
0baf79f
Updated examples
blumenstiel Oct 18, 2023
689fab7
Changed package version
blumenstiel Oct 18, 2023
2d25001
Updated GettingStarted.md
blumenstiel Oct 18, 2023
59c8051
Updated GettingStarted.md
blumenstiel Oct 19, 2023
b4b8872
Added tests
blumenstiel Oct 19, 2023
9d5312c
Renate scripts to c3.create... and minor fixes
blumenstiel Oct 19, 2023
4533ab2
Merge pull request #14 from claimed-framework/dev
romeokienzler Oct 19, 2023
661d281
Fixed auto-increase version and added test
blumenstiel Oct 23, 2023
a323dd8
Replaced dot with underscore in script name
blumenstiel Oct 23, 2023
3122d9c
Added automated release version and version arg
blumenstiel Oct 23, 2023
2924370
Fix automated release version
blumenstiel Oct 23, 2023
21dda4f
Removed package version arg
blumenstiel Oct 23, 2023
cb5a74a
fix gridwrapper
blumenstiel Oct 23, 2023
2e1a42d
Added tests for create_gridwrapper
blumenstiel Oct 23, 2023
a3b5e2e
fix #19
romeokienzler Oct 24, 2023
7b10f7b
Merge pull request #20 from romeokienzler/main
romeokienzler Oct 24, 2023
37f365f
Added nbconvert and ipython
blumenstiel Oct 24, 2023
cd18edf
Fixed default value from env variables
blumenstiel Oct 24, 2023
bf9e25f
Fixed None default value
blumenstiel Oct 24, 2023
6468197
Fix default value
blumenstiel Oct 24, 2023
ff92da8
Stop processing after docker error
blumenstiel Oct 24, 2023
6f27b30
Merge pull request #21 from claimed-framework/add_nbconvert
romeokienzler Oct 24, 2023
be7d71a
add / improve examples
romeokienzler Nov 6, 2023
a68b826
Changed grid wrapper timeout to 3 hours
blumenstiel Nov 9, 2023
10bc3bf
Added R script compiler
blumenstiel Nov 9, 2023
23eee30
Fixed working dir error
blumenstiel Nov 9, 2023
d552167
Fixed some errors
blumenstiel Nov 14, 2023
15a6b98
Fixed no-cache
blumenstiel Nov 14, 2023
3054311
Fixed default values for py scripts
blumenstiel Nov 14, 2023
a5dd7ad
Added CWL, fixed some issues, created functions for application files
blumenstiel Nov 15, 2023
dcd5135
Fixed outputs, changed working dir
blumenstiel Nov 17, 2023
00890a2
Fixed error
blumenstiel Nov 17, 2023
b0b7143
add generated artifacts and cwl workflow example
romeokienzler Nov 22, 2023
4209176
Added output paths
blumenstiel Nov 23, 2023
a3a2975
Updated GettingStarted.md
blumenstiel Nov 23, 2023
dd212a9
Reset dynamic pypi version
blumenstiel Nov 23, 2023
4abe9a6
Merge pull request #28 from blumenstiel/main
romeokienzler Nov 23, 2023
8d0dc8f
add 'ask for stars' comment
romeokienzler Nov 23, 2023
7245212
Merge branch 'claimed-framework:main' into main
romeokienzler Nov 23, 2023
fd5ffdf
Fix interface issue in grid wrapper
blumenstiel Jan 15, 2024
47c9107
Avoid overwriting job yaml #15
blumenstiel Jan 15, 2024
8e72391
Add home dir to requirements.txt #27
blumenstiel Jan 15, 2024
736f840
Updated additional files and include wildcards
blumenstiel Jan 15, 2024
6205b4f
Minor fixes
blumenstiel Jan 15, 2024
dfaa1c9
Add DEBUG note
blumenstiel Jan 15, 2024
459fcfe
Merge pull request #26 from romeokienzler/main
romeokienzler Jan 16, 2024
aaff33e
Merge pull request #35 from blumenstiel/main
romeokienzler Jan 16, 2024
76d5ef6
Update GettingStarted.md
blumenstiel Jan 25, 2024
302b167
Update GettingStarted.md
blumenstiel Feb 1, 2024
04b6d61
Added --skip-logging argument
blumenstiel Feb 1, 2024
bff4f9d
Fixed cwl type error
blumenstiel Feb 1, 2024
2ecc666
Minor fixes
blumenstiel Feb 1, 2024
72b7cd7
Added ipython version for notebooks
blumenstiel Feb 1, 2024
a92900b
Add grid_process default value
blumenstiel Feb 1, 2024
8e2ab60
Make repository optional and renamed test_mode to local_mode
blumenstiel Feb 1, 2024
3f6501d
Added --keep-generated-files
blumenstiel Feb 1, 2024
d639127
Merge pull request #39 from blumenstiel/main
romeokienzler Feb 7, 2024
aad0e37
add nbformat requirement to python docker template
romeokienzler Feb 13, 2024
80f2e0c
Merge pull request #42 from romeokienzler/main
blumenstiel Feb 14, 2024
1d64c5a
Fixed pip installs for notebook and minor changes
blumenstiel Feb 20, 2024
a41b9bc
Merge branch 'main' into main
blumenstiel Feb 20, 2024
0295c56
Merge pull request #44 from blumenstiel/main
romeokienzler Feb 20, 2024
dd01481
add csv support
romeokienzler Feb 20, 2024
4287496
add pandas as requirements
romeokienzler Feb 22, 2024
7f55446
add csv support, move to cos connection strings
romeokienzler Feb 22, 2024
171a5cf
Merge pull request #46 from romeokienzler/main
romeokienzler Feb 22, 2024
9f721cd
add csv support
romeokienzler Feb 20, 2024
6bc9fc9
add pandas as requirements
romeokienzler Feb 22, 2024
5955f4b
add csv support, move to cos connection strings
romeokienzler Feb 22, 2024
96950e1
Update cos_grid_wrapper_template.py
romeokienzler Feb 22, 2024
48f8aa5
Update __init__.py
romeokienzler Feb 22, 2024
e0875f2
Update grid_wrapper_template.py
romeokienzler Feb 22, 2024
5678f75
Create s3kv_grid_wrapper_template.py
romeokienzler Feb 22, 2024
186eaba
Update create_gridwrapper.py
romeokienzler Feb 22, 2024
5948558
Merge branch 'main' into romeokienzler-patch-1
romeokienzler Feb 23, 2024
996c8b8
Merge pull request #47 from romeokienzler/romeokienzler-patch-1
romeokienzler Feb 23, 2024
b765e83
fix constant name issue
romeokienzler Feb 23, 2024
9b8bd61
Merge pull request #48 from claimed-framework/romeokienzler-patch-1
blumenstiel Feb 26, 2024
cc1d66c
Update create_gridwrapper.py
romeokienzler Mar 1, 2024
34911a5
Update s3kv_grid_wrapper_template.py
romeokienzler Mar 1, 2024
6b411a7
Merge pull request #49 from claimed-framework/v0.3.0-hotfix1-1
romeokienzler Mar 1, 2024
0d391c0
Fix cos batch file for cos grid wrapper
blumenstiel Mar 5, 2024
6fcaf90
Merge branch 'claimed-framework:main' into main
blumenstiel Mar 6, 2024
63538a4
Fix cos grid wrapper
blumenstiel Mar 6, 2024
6b4df41
Fix grid wrapper
blumenstiel Mar 8, 2024
692cd1a
Fix inputs error
blumenstiel Mar 8, 2024
36a7b7d
Updated grid wrapper
blumenstiel Mar 8, 2024
b288ccb
Updated tests
blumenstiel Mar 8, 2024
c3d718c
Added s3 batch file connection
blumenstiel Mar 8, 2024
f518331
Moved cos gw to legacy gw
blumenstiel Mar 8, 2024
260a385
Unified functionality for cos and s3kv grid wrapper
blumenstiel Mar 8, 2024
749284f
Fix cos grid wrapper
blumenstiel Mar 8, 2024
1f1b424
Updated GettingStarted
blumenstiel Mar 8, 2024
1ef40c0
Grid wrapper fixes
blumenstiel Mar 8, 2024
c3d3f2e
Merge pull request #50 from blumenstiel/main
romeokienzler Mar 9, 2024
c6160db
add operator utils and tests
Mar 25, 2024
d27c57a
Merge branch 'claimed-framework:main' into main
romeokienzler Mar 25, 2024
2ac399f
Merge pull request #53 from romeokienzler/main
romeokienzler Mar 25, 2024
e08161a
Added plattfrom arg and added docker buildx
blumenstiel Mar 27, 2024
dba1fe8
Merge pull request #54 from blumenstiel/main
romeokienzler Mar 27, 2024
e43f8f8
Fix kfp yaml name
blumenstiel Mar 28, 2024
46cee2e
Merge pull request #55 from blumenstiel/main
blumenstiel Mar 28, 2024
1ad3e18
Fix non-alpha chars in requirements file name
blumenstiel Apr 2, 2024
9501971
Merge pull request #58 from blumenstiel/main
romeokienzler Apr 3, 2024
21659c7
Added argument dockerfile
blumenstiel Apr 8, 2024
ab746e1
Fixed typo
blumenstiel Apr 8, 2024
09c8ab0
Merge pull request #61 from blumenstiel/main
romeokienzler Apr 8, 2024
555f088
add containerless operator builder
romeokienzler Jun 20, 2024
a16e729
Merge pull request #63 from romeokienzler/main
romeokienzler Jun 20, 2024
4bf6687
create cwl task for containerless operator
romeokienzler Jun 20, 2024
7113a45
Merge branch 'claimed-framework:main' into main
romeokienzler Jun 20, 2024
6da7a3e
Merge pull request #64 from romeokienzler/main
romeokienzler Jun 20, 2024
944b1d9
add version information of generated containerless zip
romeokienzler Jun 21, 2024
7066e78
Merge branch 'main' of github.com:romeokienzler/c3
romeokienzler Jun 21, 2024
dc14085
Merge branch 'claimed-framework:main' into main
romeokienzler Jun 21, 2024
ddc26d5
Merge pull request #65 from romeokienzler/main
romeokienzler Jun 21, 2024
0245adf
finish c3 containerless operator generation
romeokienzler Jun 26, 2024
bd1c19a
Merge pull request #66 from romeokienzler/main
romeokienzler Jun 26, 2024
bd1ea19
Moved operator code in dockerfile template
blumenstiel Aug 8, 2024
1665c2f
Merge pull request #67 from blumenstiel/main
blumenstiel Dec 13, 2024
017282e
Added image_version arg
blumenstiel Dec 13, 2024
8b70a35
Merge branch 'claimed-framework:main' into main
blumenstiel Dec 13, 2024
87f2c96
Merge pull request #68 from blumenstiel/main
romeokienzler Dec 13, 2024
bebb6f5
add simple grid wrapper
romeokienzler Feb 21, 2025
d136144
Update GettingStarted.md
romeokienzler Feb 21, 2025
31366e3
Merge pull request #69 from claimed-framework/romeokienzler-patch-2
romeokienzler Feb 21, 2025
0a747ee
Update GettingStarted.md
romeokienzler Mar 21, 2025
87a10bd
Merge pull request #70 from claimed-framework/romeokienzler-patch-2
romeokienzler Mar 21, 2025
6315b2e
add EU funding notice
romeokienzler Jul 2, 2025
8b97cc6
Merge pull request #71 from claimed-framework/romeokienzler-patch-3
romeokienzler Jul 2, 2025
d3deed4
folder grid wrapper
duckieuibm Aug 19, 2025
0356320
add c3_create_gridwrapper ouput for folder_grid_wrapper
duckieuibm Aug 19, 2025
fa90db6
improve documentation for folder grid wrapper
duckieuibm Aug 22, 2025
bf91c00
Merge pull request #72 from bila9630/main
romeokienzler Aug 22, 2025
b721e3e
Merge remote-tracking branch 'c3/main' into merge-c3v3
romeokienzler Nov 11, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions .github/workflows/python-publish.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
# This workflow will upload a Python Package using Twine when a release is created
# For more information see: https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-python#publishing-to-package-registries

# This workflow uses actions that are not certified by GitHub.
# They are provided by a third-party and are governed by
# separate terms of service, privacy policy, and support
# documentation.

name: Upload Python Package

on:
release:
types: [published]

permissions:
contents: read

jobs:
deploy:

runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v3
- name: Set up Python
uses: actions/setup-python@v3
with:
python-version: '3.x'
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install build
- name: Build package
run: python -m build
- name: Publish package
uses: pypa/gh-action-pypi-publish@27b31702a0e7fc50959f5ad993c78deac1bdfc29
with:
user: __token__
password: ${{ secrets.PYPI_API_TOKEN }}
61 changes: 2 additions & 59 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,61 +1,4 @@
.DS_Store
*.secrets
.ipynb_checkpoints
data/*
*.log
*.swp
HMP_Dataset

**/.ipynb_checkpoints/*
**/.virtual_documents/*
assets/.METADATA/job_run.*
assets/job_run
__pypackages__/
__pycache__/
*.py[cod]
*$py.class
*.so
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
*.manifest
*.spec
pip-log.txt
pip-delete-this-directory.txt
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/
*.mo
*.pot
local_settings.py
db.sqlite3
db.sqlite3-journal
instance/
.webassets-cache
.scrapy
docs/_build/
.pybuilder/
profile_default/
ipython_config.py
celerybeat-schedule
celerybeat.pid
.spyderproject
.spyproject
.ropeproject
.mypy_cache/
.pyre/
.pytype/
cython_debug/
venv/
.venv/
__pycache__
.ipynb_checkpoints/
Loading
Loading