• Created a django admin command for creating users and approving them for a competition, given a list of users/emails.
• Replaced organization logos on homepage with ScaDS.AI logo.
• Adjusted Caddyfile for external account binding.
• Enabled TLS/HTTPS for minio by sharing the certificates from caddy. They currently need to be copied manually/automatically. Reverse proxying likely wouldn't work without a subdomain.
• Disabled CODALAB_IGNORE_CLEANUP_STEP because with big file submissions it takes up too much space.
• reverse proxy to flower and rabbit management
• redirect home page to the first published competition for everyone except staff

In addition to the instructions.

If the site loads but looks like CSS/JS is missing, check the builder container and if it ran properly.

The config for the outgoing server in the Thunderbird mailbox FAQ basically shows how to set up the email sending.

• The .env doesn't need to be modified.
• Django debug settings don't need to be changed.
• Buckets don't need to be adjusted manually.
• Add 127.0.0.1 minio to /etc/hosts.
• Comment out the first TLS block in the Caddyfile.
• Change the connection string in the createbuckets docker compose service back to http://minio:$MINIO_PORT.

.env should likely have:

ALLOWED_HOSTS=localhost,hackathon.scads.ai
SUBMISSIONS_API_URL=https://hackathon.scads.ai/api
DOMAIN_NAME=hackathon.scads.ai
AWS_S3_ENDPOINT_URL=https://hackathon.scads.ai:9000/

• Change all secrets in .env

• In addition to port 443, open at least port tcp/9000.

• It seems it is not necessary to set the public bucket to read and write, as it is described in the deployment instructions.

• minio TLS: create the following service. Maybe minio also needs to be restarted to use new certificate files.

  # /etc/systemd/system/copy_certificates_to_minio.service
  
  [Unit]
  Description=Copy caddy's certificates to minio
  
  [Service]
  ExecStart=/bin/bash -c "cd /home/hackathon/DIRECTORY HERE && mkdir -p certs/minio && cp -a caddy_data/caddy/certificates/acme.pki.cert.tu-dresden.de/hackathon.scads.ai/hackathon.scads.ai.key $_/private.key && mkdir -p certs/minio && sudo cp -a caddy_data/caddy/certificates/acme.pki.cert.tu-dresden.de/hackathon.scads.ai/hackathon.scads.ai.crt $_/public.crt"
  Type=oneshot
  

  # /etc/systemd/system/copy_certificates_to_minio.timer
  
  [Unit]
  Description=Copy caddy's certificates to minio
  
  [Timer]
  OnBootSec=1min
  OnUnitActiveSec=2min
  
  [Install]
  WantedBy=timers.target
  

• The following service is used but it might not be necessary (anymore).

  # /etc/systemd/system/keep_codabench_worker_running.service
  
  [Unit]
  Description=Start the Codabench compute worker again because sometimes it shuts down (either because connection loss or because of the VM causing it somehow)
  
  [Service]
  Type=oneshot
  ExecStart=/usr/bin/docker compose -f /home/hackathon/DIRECTORY HERE/docker-compose.yml up -d compute_worker
  

  # /etc/systemd/system/keep_codabench_worker_running.timer
  
  [Unit]
  Description=Restart Codabench compute_worker container every hour
  
  [Timer]
  OnCalendar=*:0/30
  
  [Install]
  WantedBy=timers.target
  

• Check that the correct domain is set in the Site model, otherwise links in emails might use the wrong domain.

Codabench is an open-source web-based platform that enables researchers, developers, and data scientists to collaborate, with the goal of advancing research fields where machine learning and advanced computation is used. Codabench helps to solve many common problems in the arena of data-oriented research through its online community where people can share worksheets and participate in competitions and benchmarks. It can be seen as a version 2 of CodaLab Competitions.

To see Codabench in action, visit codabench.org.

• Codabench Wiki

To participate, or even organize your own benchmarks or competitions, you don't need to install anything, you just need to sign in an instance of the platform (e.g. this one). If you wish to configure your own instance of Codabench platform, here are the instructions:

$ cp .env_sample .env
$ docker compose up -d
$ docker compose exec django ./manage.py migrate
$ docker compose exec django ./manage.py generate_data
$ docker compose exec django ./manage.py collectstatic --noinput

You can now login as username "admin" with password "admin" at http://localhost/

If you ever need to reset the database, use the script ./reset_db.sh

For more information about installation, checkout Codabench Basic Installation Guide and How to Deploy Server.

Copyright (c) 2020-2022, Université Paris-Saclay. This software is released under the Apache License 2.0 (the "License"); you may not use the software except in compliance with the License.

The text of the Apache License 2.0 can be found online at: http://www.opensource.org/licenses/apache2.0.php

@article{codabench,
    title = {Codabench: Flexible, easy-to-use, and reproducible meta-benchmark platform},
    author = {Zhen Xu and Sergio Escalera and Adrien Pavão and Magali Richard and
              Wei-Wei Tu and Quanming Yao and Huan Zhao and Isabelle Guyon},
    journal = {Patterns},
    volume = {3},
    number = {7},
    pages = {100543},
    year = {2022},
    issn = {2666-3899},
    doi = {https://doi.org/10.1016/j.patter.2022.100543},
    url = {https://www.sciencedirect.com/science/article/pii/S2666389922001465}
}