Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[fix] Move performance tests to local mac mini #3290

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mihran113 merged 10 commits into from
Feb 18, 2025
Merged

[fix] Move performance tests to local mac mini #3290

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
6337338
[fix] Move performance tests to local mac mini
mihran113 Feb 11, 2025
f7a76a9
Temporarily disable unit tests
mihran113 Feb 11, 2025
856a2ee
Black magic
mihran113 Feb 11, 2025
e1e7fde
More black magic
mihran113 Feb 11, 2025
8b2710d
Try non-editable install
mihran113 Feb 11, 2025
97dd87f
Revert black magic
mihran113 Feb 11, 2025
d0ca56b
Init perf repos
mihran113 Feb 11, 2025
9bfabd4
Use existing perf logs
mihran113 Feb 11, 2025
a764373
Update baselines
mihran113 Feb 13, 2025
83a4ad3
Enable and fix unit-tests
mihran113 Feb 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/pull-request.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,8 +68,8 @@ jobs:

storage-performance-checks:
needs: run-checks
concurrency: perf-tests
runs-on: [self-hosted, performance-tests]
concurrency: storage-performance-checks
runs-on: [self-hosted, perf-tests]
name: Performance tests
steps:
- name: checkout
Expand Down
42 changes: 21 additions & 21 deletions performance_tests/BASELINE
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,21 +1,21 @@
test_collect_metrics_data_0 1.8545958518981933
test_collect_metrics_data_1 1.9959398269653321
test_collect_metrics_data_2 10.835494375228881
test_collect_metrics_data_3 1.8672633171081543
test_collect_runs_data_0 0.8988437175750732
test_collect_runs_data_1 1.039186429977417
test_collect_runs_data_2 3.469265604019165
test_collect_runs_data_3 0.9486905574798584
test_query_metrics_0 1.6766140460968018
test_query_metrics_1 1.6763684749603271
test_query_metrics_2 1.6051365375518798
test_query_metrics_3 1.5391615390777589
test_query_runs_0 0.8991998672485352
test_query_runs_1 0.9259328842163086
test_query_runs_2 0.839762544631958
test_query_runs_3 0.832861852645874
test_container_open 0.1440361499786377
test_iterative_access 4.000607919692993
test_random_access_0 0.663770055770874
test_random_access_1 1.4745195388793946
test_random_access_2 2.424658107757568
test_collect_metrics_data_0 0.3717397689819336
test_collect_metrics_data_1 0.3963047981262207
test_collect_metrics_data_2 2.7405614376068117
test_collect_metrics_data_3 0.3710219860076904
test_collect_runs_data_0 0.17322354316711425
test_collect_runs_data_1 0.20246338844299316
test_collect_runs_data_2 0.7970072269439697
test_collect_runs_data_3 0.1911233901977539
test_query_metrics_0 0.311903190612793
test_query_metrics_1 0.3122593879699707
test_query_metrics_2 0.3092495441436768
test_query_metrics_3 0.288785982131958
test_query_runs_0 0.17433061599731445
test_query_runs_1 0.17484822273254394
test_query_runs_2 0.17181901931762694
test_query_runs_3 0.1616499423980713
test_container_open 0.04026708602905273
test_iterative_access 1.1857992172241212
test_random_access_0 0.14068403244018554
test_random_access_1 0.26419754028320314
test_random_access_2 0.3941319942474365
2 changes: 1 addition & 1 deletion performance_tests/conftest.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ def pytest_sessionstart(session):
_init_test_repos()
else:
# github actions performance tests on self hosted runner
os.chdir('/home/ubuntu/performance_logs/')
os.chdir('/Users/github/workers/perf-tests/actions-runner/_work/performance_logs')
time.sleep(10)


Expand Down
1 change: 1 addition & 0 deletions tests/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
torch
tensorflow
deeplake<4.0.0 # update when proper documentation is available
azure-storage-blob # for deeplake
# hub
fastapi>=0.87.0
httpx
Expand Down