Thanks to visit codestin.com
Credit goes to github.com

Skip to content
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
74 commits
Select commit Hold shift + click to select a range
1d7c685
added requirements-tensorflow-tpu.txt and tpu configuration in .kokoro
kharshith-k Jun 16, 2025
19b5e6b
updated .kokoro/github/ubuntu/tpu/build.sh with jax and torch backend…
kharshith-k Jun 16, 2025
d203ca3
Merge branch 'keras-team:master' into tf-tpu
kharshith-k Jun 18, 2025
f45e5d0
Changed the tpu CI config files path to .github from .kokoro
kharshith-k Jun 18, 2025
6771cc0
Added new job in .github/workflows/actions.yml to run TPU tests
kharshith-k Jun 18, 2025
87d36e7
fixed runs-on option in acvtions.yml for tpu_build job to run on self…
kharshith-k Jun 18, 2025
9901298
Added another runner in the actions TPU job
kharshith-k Jun 18, 2025
be97210
Update continuous.cfg
kharshith-k Jun 18, 2025
a1cd5c3
Update presubmit.cfg
kharshith-k Jun 18, 2025
c5e3a5c
Merge branch 'keras-team:master' into tf-tpu
kharshith-k Jun 23, 2025
f0ab676
Update actions.yml
kharshith-k Jun 23, 2025
09161d7
Developed Dockerfile for TPU build job in actions.yml
kharshith-k Jun 24, 2025
9a3948f
Merge branch 'keras-team:master' into tf-tpu
kharshith-k Jun 24, 2025
058fdff
Update actions.yml
kharshith-k Jun 24, 2025
d47e39e
Included few more runners in tpu_build job
kharshith-k Jun 26, 2025
a6a59d7
Merge branch 'keras-team:master' into tf-tpu
kharshith-k Jun 26, 2025
ba4f6ae
Using linux-x86-ct6e-44-1tpu
kharshith-k Jun 26, 2025
a5a3624
Modified requirement-commmon.txt and updated requirements-tensorflow-…
kharshith-k Jun 30, 2025
b9998af
Added Dtypes_TPU_tests.py and requirements-jax-tpu.txt
kharshith-k Jul 22, 2025
f68be97
Progress bar now handles `steps_per_execution`. (#21422)
hertschuh Jun 26, 2025
1018abf
Fix symbolic call of `logsumexp` with int axis. (#21428)
hertschuh Jun 27, 2025
0da77e4
Only allow deserialization of `KerasSaveable`s by module and name. (#…
hertschuh Jun 29, 2025
cb639c5
commented tensorflow deps
kharshith-k Jul 2, 2025
c0d1743
Added log of dtypes_test_tpu.py and the test script for the same
kharshith-k Jul 2, 2025
306e6e7
modified dtypes_test_tpu.py as per pre-commit standards
kharshith-k Jul 2, 2025
4e584fc
Added TPU initiaization and teardown functionalities in conftest.py, …
kharshith-k Jul 3, 2025
bb09e95
Added dtypes_test_TPU.py and dtypes_new_test.py, modified conftest.py
kharshith-k Jul 9, 2025
8a63d09
Added Dcokerfile and tests list command
kharshith-k Jul 23, 2025
4651454
Updated Dockerfile
kharshith-k Jul 28, 2025
40af241
Restored Dockerfile to previous changes
kharshith-k Jul 28, 2025
64420d5
updated actions.yml file to install and configure docker engine on se…
kharshith-k Jul 28, 2025
da84de5
Merge branch 'keras-team:master' into tf-tpu
kharshith-k Jul 28, 2025
d69277d
updated actions.yml file to include container option
kharshith-k Jul 28, 2025
1c307fc
updated actions.yml file to include container option without volume b…
kharshith-k Jul 28, 2025
693886b
updated actions.yml file to change TPU
kharshith-k Jul 28, 2025
e74b851
Updated container path in build-and-test-on-tpu job
kharshith-k Jul 29, 2025
d31b3c4
seperated TPU workflow from actions.yml
kharshith-k Jul 29, 2025
a70d19e
updated trigger condition for TPU tests workflow
kharshith-k Jul 29, 2025
5f5b609
updated container usage configuration for TPU tests workflow
kharshith-k Jul 29, 2025
72e729f
updated env vars for TPU tests workflow
kharshith-k Jul 29, 2025
e129299
updated env vars parsing syntax in TPU tests workflow
kharshith-k Jul 29, 2025
3fe5b57
updated env vars syntax in TPU tests workflow
kharshith-k Jul 29, 2025
10df307
updated env vars syntax in TPU tests workflow
kharshith-k Jul 29, 2025
dd21e09
updated env vars syntax in TPU tests workflow
kharshith-k Jul 29, 2025
328628f
updated env vars syntax in TPU tests workflow
kharshith-k Jul 29, 2025
01f0c17
updated image name in TPU tests workflow
kharshith-k Jul 29, 2025
3e41c37
updated image name with generic ubuntu image
kharshith-k Jul 29, 2025
5e55c2c
updated tpu-tests to use ghcr
kharshith-k Jul 29, 2025
ea9ff88
updated tpu-tests to store built image as local tar
kharshith-k Jul 29, 2025
6d92aa9
updated image name from ubuntu:22.04 to docker:24.0-cli in tpu tests …
kharshith-k Jul 29, 2025
3c75bf8
updated image name from docker:24.0-cli to ubuntu:22.04 in tpu tests…
kharshith-k Jul 29, 2025
1589a75
added volume mount from host in load-and-test-job
kharshith-k Jul 29, 2025
36bd682
Merge branch 'keras-team:master' into tf-tpu
kharshith-k Jul 29, 2025
04112cf
Reverted tpu-tests.yml to version using ghcr.io for image storage
kharshith-k Jul 29, 2025
87d7ad8
Removed custom dtypes_test files for TPU testing and restored origina…
kharshith-k Aug 12, 2025
6cb097c
Updated tpu-tests.yml to pull image from GCP artifact registry
kharshith-k Aug 12, 2025
4829f1b
Resolved conflicts in actions.yml
kharshith-k Aug 12, 2025
a2eb306
Added a workflow to check service accounts associated with self hoste…
kharshith-k Aug 12, 2025
23579c4
Made find_sa.yml specific to linux-x86-ct6e-44-1tpu
kharshith-k Aug 12, 2025
dac6433
Added container tag to find_sa.yml
kharshith-k Aug 12, 2025
05461c1
Checking SA for linux-x86-ct5lp-112-4tpu
kharshith-k Aug 12, 2025
078dcee
Checking SA for linux-x86-ct6e-44-1tpu-nxgm7-runner-vb87c
kharshith-k Aug 12, 2025
016c68d
Using SA for auth in tpu-tests
kharshith-k Aug 12, 2025
02657f0
Updated SA with container tag for auth in tpu-tests
kharshith-k Aug 12, 2025
7167952
Added docker socket mount test
kharshith-k Aug 12, 2025
543cf65
Updated tpu-tests to just pull and test the image from artifact regis…
kharshith-k Aug 14, 2025
a2401c0
Added pytest command to the workflow
kharshith-k Aug 14, 2025
a98c748
added grain installation command
kharshith-k Aug 14, 2025
71c5b8b
Pruned unwanted files
kharshith-k Aug 19, 2025
5522a2b
included grain in requirements.txt
kharshith-k Aug 19, 2025
7173c6d
Updated tpu-tests.yml to use python image and explicitly install spec…
kharshith-k Aug 22, 2025
a7dc789
Renamed tpu-tests to tpu-tests-jax and logging TPU device kind
kharshith-k Aug 22, 2025
e509e6d
Added a step to check gcloud installation
kharshith-k Aug 22, 2025
a7ec63b
Running pytest on generic tpu workflow
kharshith-k Aug 25, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Developed Dockerfile for TPU build job in actions.yml
  • Loading branch information
kharshith-k committed Jun 24, 2025
commit 09161d716a3de5b6bfecb7a7da9633246dd6a99e
17 changes: 10 additions & 7 deletions .github/workflows/actions.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,14 +24,17 @@ jobs:
KERAS_HOME: .github/workflows/config/${{ matrix.backend }}
KERAS_BACKEND: tensorflow
steps:
- uses: actions/checkout@v4 # Checks-out your repository under $GITHUB_WORKSPACE, so your workflow can access it.
- uses: actions/checkout@v4

- name: Make script executable
run: chmod +x .github/workflows/tpu/build.sh # Assuming your script is named my-script.sh
- name: Build and run Docker image for TPU tests
run: |
docker build -f .github/workflows/tpu/Dockerfile -t keras-tpu-test .
docker run --rm \
-e PYTHON=${{ matrix.python-version }} \
-e KERAS_HOME=.github/workflows/config/${{ matrix.backend }} \
-e KERAS_BACKEND=tensorflow \
keras-tpu-test

- name: Run my shell script
run: .github/workflows/tpu/build.sh # Execute the script

build:
strategy:
fail-fast: false
Expand Down Expand Up @@ -148,4 +151,4 @@ jobs:
pip uninstall -y keras keras-nightly
pip install -e "." --progress-bar off --upgrade
- name: Run pre-commit
run: pre-commit run --all-files --hook-stage manual
run: pre-commit run --all-files --hook-stage manual
28 changes: 28 additions & 0 deletions .github/workflows/tpu/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
FROM python:3.10-slim

ENV KERAS_HOME=/github/workspace/.github/workflows/config/tensorflow \
KERAS_BACKEND=tensorflow

RUN apt-get update && apt-get install -y --no-install-recommends \
git \
sudo \
&& rm -rf /var/lib/apt/lists/*

# Copy the entire codebase into the container
COPY . /github/workspace
WORKDIR /github/workspace

# Create and activate venv, install pip/setuptools/psutil, then run tests
RUN cd src/github/keras && \
pip install -U pip setuptools && \
pip install -U psutil && \
pip install -r requirements-tensorflow-tpu.txt && \
pip uninstall -y keras keras-nightly && \
python3 -c 'import tensorflow as tf;print(tf.__version__);print(tf.config.list_physical_devices("TPU"))' && \
python3 -c 'import tensorflow as tf;assert len(tf.config.list_physical_devices("TPU")) > 0' && \
pytest keras --ignore keras/src/applications \
--ignore keras/src/layers/merging/merging_test.py \
--cov=keras \
--cov-config=pyproject.toml

CMD ["bash"]