Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add codex_metric_yshift_av1 submission#60

Merged
YassineYousfi merged 1 commit into
commaai:masterfrom
xa8zz:codex/compression-harness
Apr 30, 2026
Merged

Add codex_metric_yshift_av1 submission#60
YassineYousfi merged 1 commit into
commaai:masterfrom
xa8zz:codex/compression-harness

Conversation

@xa8zz

@xa8zz xa8zz commented Apr 27, 2026

Copy link
Copy Markdown
Contributor

submission name:

codex_metric_yshift_av1

upload zipped archive.zip

https://github.com/xa8zz/comma_video_compression_challenge/releases/download/codex_metric_yshift_av1_v1/archive.zip

report.txt

=== Evaluation config ===
  batch_size: 16
  device: mps
  num_threads: 2
  prefetch_queue_depth: 4
  report: submissions/codex_metric_yshift_av1/report.txt
  seed: 1234
  submission_dir: submissions/codex_metric_yshift_av1
  uncompressed_dir: ./videos
  video_names_file: ./public_test_video_names.txt
=== Evaluation results over 600 samples ===
  Average PoseNet Distortion: 0.00085142
  Average SegNet Distortion: 0.00566394
  Submission file size: 867,354 bytes
  Original uncompressed size: 37,545,489 bytes
  Compression Rate: 0.02310142
  Final score: 100*segnet_dist + √(10*posenet_dist) + 25*rate = 1.24

does your submission require gpu for evaluation (inflation)?

no

did you include the compression script? and want it to be merged?

yes

additional comments

hai i built a benchmark harness for gpt 5.5 and left them with the benchmark + a VPS overnight and woke up to them having a good score

i havent read the code but it works well. hopefully it's good 👍

Archive SHA256: d77b3359693fb104214a7ff38e226709b86575fa04963b51620bb9a16130c114

@github-actions

Copy link
Copy Markdown

Thanks for the submission @xa8zz! 🤏

A maintainer will review your PR shortly.

To run the evaluation, a maintainer will trigger the eval workflow with your PR number.

@github-actions github-actions Bot requested a review from YassineYousfi April 27, 2026 22:28
@xa8zz xa8zz marked this pull request as ready for review April 27, 2026 22:33
@github-actions

Copy link
Copy Markdown

Eval Results: codex_metric_yshift_av1

=== Evaluation config ===
  batch_size: 16
  device: cpu
  num_threads: 2
  prefetch_queue_depth: 4
  report: submissions/codex_metric_yshift_av1/report.txt
  seed: 1234
  submission_dir: submissions/codex_metric_yshift_av1
  uncompressed_dir: /home/runner/work/comma_video_compression_challenge/comma_video_compression_challenge/videos
  video_names_file: /home/runner/work/comma_video_compression_challenge/comma_video_compression_challenge/public_test_video_names.txt
=== Evaluation results over 600 samples ===
  Average PoseNet Distortion: 0.00085153
  Average SegNet Distortion: 0.00566388
  Submission file size: 867,354 bytes
  Original uncompressed size: 37,545,489 bytes
  Compression Rate: 0.02310142
  Final score: 100*segnet_dist + √(10*posenet_dist) + 25*rate = 1.24

@YassineYousfi YassineYousfi merged commit c7ea912 into commaai:master Apr 30, 2026
1 check passed
@github-actions

github-actions Bot commented May 5, 2026

Copy link
Copy Markdown

Eval Failed: codex_metric_yshift_av1

Job failed

View logs

@YassineYousfi

Copy link
Copy Markdown
Collaborator

@xa8zz Congratulations on making it onto the leaderboard! I hope you had fun competing in the challenge and learned something new along the way. If you are looking for a job or internship, please email [email protected] with a link to this PR. See you in the next challenge!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants