Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@dashanji
Copy link
Member

What do these changes do?

The pr is to use the local registry of kind for repartition dask e2e test.

If the repartition e2e test passed, we can consider replacing all e2e tests here as it can resolve problems like No space left on device error on CI. Also, the pr needs to wait for the e2e tool to support for testing on a existing kubernetes cluster.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 11, 2023

✅ Doc deploy preview ready: https://deploy-preview-pr-1137--v6d.netlify.app

@sighingnow
Copy link
Member

The dask CI looks work!

Could you please revise all k8s test cases to use the local registry?

Thanks!

@dashanji
Copy link
Member Author

No problem. I have added the feature testing on a existing kubernetes cluster to the e2e tool yesterday. Until it's merged, we can revise all e2e tests more smoothly.

@dashanji dashanji force-pushed the use-local-registry-in-kind branch 2 times, most recently from 1eb10df to 7587ff5 Compare January 12, 2023 09:40
@dashanji dashanji changed the title [WIP] Test repartition dask with local registry Revise all e2e tests to use the kind cluster with local registry Jan 12, 2023
@dashanji dashanji force-pushed the use-local-registry-in-kind branch from 979b543 to fd76a65 Compare January 13, 2023 03:03
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why ghcr instead of local registry?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The local registry is only for testing, for others using vineyard operator in their environment, the image should be able to be downloaded normally.

@dashanji dashanji force-pushed the use-local-registry-in-kind branch from cfaf6d9 to 6de711c Compare January 13, 2023 08:57
@dashanji dashanji force-pushed the use-local-registry-in-kind branch from 6de711c to 12a1cdf Compare January 13, 2023 08:58
@dashanji
Copy link
Member Author

The bugs in the failover demo are fixed here.

run: |
touch /tmp/e2e-k8s.config
export KUBECONFIG=/tmp/e2e-k8s.config
bash k8s/test/hack/build-kind-cluster-with-local-registry.sh
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest moving the "install cert-manager" and "deploying vineyardd cluster" steps to here as well to further reduce the duplications in "xxxx/e2e.yaml"s.

Copy link
Member Author

@dashanji dashanji Jan 13, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sense to me.

kubectl apply -f -
#sleep 120
#kubectl describe pod $(kubectl get po -l app=dask-repartition-job2 -n vineyard-job -oname | awk -F '/' '{print $2}') -n vineyard-job
#kubectl logs -f $(kubectl get po -l app=dask-repartition-job2 -n vineyard-job -oname | awk -F '/' '{print $2}') -n vineyard-job
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove the temporary debug lines.

@dashanji dashanji force-pushed the use-local-registry-in-kind branch from 1dc745d to eb5002a Compare January 16, 2023 02:39
kind load docker-image vineyardcloudnative/vineyard-operator:latest
docker tag vineyardcloudnative/vineyard-operator:latest localhost:5001/vineyard-operator:latest
docker push localhost:5001/vineyard-operator:latest
export IMG=localhost:5001/vineyard-operator:latest
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not make install-vineyard-operator as you have already added the target in Makefile?

@dashanji dashanji force-pushed the use-local-registry-in-kind branch from d0aeb91 to f3d6d1d Compare January 16, 2023 03:38
Signed-off-by: Ye Cao <[email protected]>
@dashanji dashanji force-pushed the use-local-registry-in-kind branch from f3d6d1d to 5ed19da Compare January 16, 2023 04:02
@dashanji
Copy link
Member Author

dashanji commented Jan 16, 2023

Done, please take another look at this. @sighingnow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants