Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@tevko
Copy link
Collaborator

@tevko tevko commented Aug 8, 2025

No description provided.

tevko and others added 29 commits July 3, 2025 10:19
* fix instance size variable so large jobs are processed

* add to docker
* fix instance size variable so large jobs are processed

* add to docker

* update install script
* fix instance size variable so large jobs are processed

* add to docker

* update install script

* replace all instances of old var
Full Integration of OIDC authentication system.
Deprecation of legacy cookie-based auth.
Upgrade client-admin app.
OIDC Simulator for dev/test environments.
* add astro version of client-participation

* minor style updates

* begin moving over translations

* port over translations

* ssr

* Use real convo data

* dynamically update title

* more translations

* wire in voting capability

* get voting working

* cors

* type check

* impliment convo closed status

* admin mod, prio stub

* hclust route checkpoitn

* labels working

* remove logging, get towards hclust

* hclust explration 22

* contour plot

* contours

* prio take 1

* distances

* remove dead 600 file

* add more defense for small models

* topic prioritize mock

* webpack build size

* topic sections

* merge fix

* add simple route

* Restructure priority calculation to use group-based extremity

- Remove priority calculation from math pipeline (conversation.py)
  * Delete _importance_metric and _priority_metric methods
  * Remove priority computation from recompute() method
  * Math pipeline now focuses on PCA, clustering, and representativeness

- Add dedicated priority calculation script (502_calculate_priorities.py)
  * Implements PriorityCalculator class with group-based extremity
  * Matches Clojure priority formula: (importance * scaling_factor)^2
  * Retrieves extremity values from Delphi_CommentExtremity table
  * Updates priorities in Delphi_CommentRouting table

- Update pipeline execution order (run_delphi.py, run_delphi.sh)
  * Math pipeline → UMAP pipeline → Extremity calculation → Priority calculation
  * Ensures priorities use group-based extremity instead of PCA-based
  * Maintains separation of concerns between mathematical and priority calculations

This fixes the priority calculation bug where all priorities were 0 due to
missing extremity values, and implements proper group-based extremity usage
as requested for the Pakistan conversation analysis.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <[email protected]>

* Refactor priority calculation: separate formulas from service logic

- Extract priority formulas into polismath/conversation/priority.py
  * Create PriorityCalculator class with static methods for core formulas
  * Port importance_metric and priority_metric from Clojure implementation
  * Add convenience methods: calculate_comment_priority, validate_inputs, explain_priority
  * Pure mathematical logic with no I/O dependencies for better testability

- Refactor umap_narrative/502_calculate_priorities.py to use extracted formulas
  * Rename class from PriorityCalculator to PriorityService (clearer distinction)
  * Import and use PriorityCalculator.calculate_comment_priority()
  * Remove duplicate formula implementations (38 lines removed)
  * Focus service on DynamoDB operations and data orchestration

Benefits:
- Better separation of concerns: formulas vs data processing
- Improved testability: mathematical logic can be unit tested independently
- Enhanced reusability: priority formulas can be used in other contexts
- Cleaner maintainability: formula changes only need to happen in one place

Tested successfully with conversation 36324:
- 807 comments processed
- Priority statistics: min=0, max=3, avg=2.36
- All priorities calculated using group-based extremity values

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <[email protected]>

* Revert "Refactor priority calculation: separate formulas from service logic"

This reverts commit cfd829d.

* topic agenda collapse prototype tetris-y

* topic agenda setting demo

* begin basic bulk upload capability

* save state

* split by distance doesn't owrk

* sentence transformer model

* componetize

* drive detail

* more specifics

* log archetypal comments

* dynamo table and node services

* Don't crash when we have not votes.

* suppress logging

* differnet approach for prepended labesl

* Te arch updates topicmod (#2086)

* add polis mod access and remove table scans

* add comments back

* more comment fixes

* add footer links

* begin dockerization

* dockerize and new route structure

* wire in xid

* get alpha embed working

* prune comments

* connect comment form

* translations fixes, hook up subscribe form

* css fixes

* fix env vars

* Colinmegill/topic prio (#2103)

* showing topics in participant view

* logo color / p slightly more minimal change

---------

Co-authored-by: Colin Megill <[email protected]>

* perf adjustments

* remove console log

* minor fixes

* compilation fixes

* more auth

* get auth working

* return vote response

* participation alpha qa and better topic loading

* add hide header ability

* update headerless

* turn off eslint for now

* prep alpha for prod deploy

---------

Co-authored-by: Colin Megill <[email protected]>
Co-authored-by: Christian Weilbach <[email protected]>
Co-authored-by: Claude <[email protected]>
@tevko tevko merged commit 5a31863 into stable Aug 8, 2025
4 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants