Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Fix/priority search #37

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 117 commits into from
Oct 3, 2025
Merged

Fix/priority search #37

merged 117 commits into from
Oct 3, 2025

Conversation

chinganc
Copy link
Member

@chinganc chinganc commented Sep 12, 2025 •
edited
Loading

This PR finishes the PrioritySearch

It's been tested on the convex optimization and some prompt optimization problems.
It supports

  • Running multiple optimizers in parallel
  • Branching out optimizers along their update chains. This is useful for using optimizer with memory and multiple optimizers.

Changes to core in PR:

  1. ModelWrapper is now moved to the top module as Model so that classed decorated by @trace.model can be pickled.
  2. The old implementation of Algorithm.save and Algorithm.load at the abstract class level are commented out. We will leave that to the subclasses.
  3. Some minor bug fixes.

NOTE
-Resuming experiments. will be done in future PRs

allenanie and others added 28 commits August 18, 2025 12:06
@allenanie
Update README.md
05de9c1 
Remove mailing list
@allenanie
update webpage links
712e3b4
@allenanie
merge
0ccfe56
@chinganc
Merge branch 'main' into v0.2.0
9b40d17
@chinganc
Merge branch 'experimental' into v0.2.0
1b7f990
@allenanie
add a testing / example code to see if search methods work
c1bffd1
@allenanie
add an import that was missing
0b196ce
@allenanie
reward is already the negative of the loss -- no need to negate it
e24f121
@allenanie
Merge branch 'experimental' of https://github.com/AgentOpt/OpenTrace …
374cc09 
…into fix/priority_search
@chinganc
Remove dependency of SearchTemplate on Minibatch. Fix various bugs.
a9828c2
@chinganc
Allow customizing exploitation criterion.
2934b52
@chinganc
Minor update the convex_fn example
d98dc59
@chinganc
Update priority_search to track optimizer
7e49a17
@chinganc
Add support of multiple optimizers
0cfcaab
@chinganc
Fix some bugs of using multi optimizers due hasing def of ModuleCandi…
4377bee 
…date
@chinganc
Add an example of using multi-optimizers
1fcb0bc
@chinganc
Remove subbatch arg in PrioritySearch. Use num_batches instead.
4e539c3
@chinganc
Merge branch 'experimental' into fix/priority_search
3956fd8
@chinganc
Add time as priority
c77dcaa
@chinganc
Fix a bug of testing first params twice.
a8b2479
@chinganc
Add save and resume. Fix bugs in tests.
b79a940
@chinganc
Merge branch 'experimental' into fix/priority_search
1dc3b7e
@chinganc
Update save and load of Optimzier, ModelWrapper, Guide, by implementing
0a8f465
@chinganc
Make ModelWrapper pickleable
16ef98a
@chinganc
Add Model class
98c96a1
@chinganc
Add trace.Model
043b837
@chinganc
add a toy test
3b2c571
@chinganc
Resume seems to work now
15b398d
chinganc and others added 20 commits September 18, 2025 07:41
@chinganc
Add self._enforce_using_data_collecting_candidates
8905f8c
@chinganc
Fix the bug of the incorrect fix in 6d938bc
831b034
@chinganc
Merge branch 'fix/bundle_deepcopy' into fix/priority_search
267cfbf
@chinganc
Fix merge error
03e3861
@chinganc
Remove copy overwrites in ModuleCandidate
4ecad9a
@chinganc
Merge branch 'fix/GRAPH_memory_overflow' into fix/priority_search
ce0a6eb
@chinganc
Merge branch 'fix/GRAPH_memory_overflow' into fix/priority_search
e227a37
@chinganc
Merge branch 'experimental' into fix/priority_search
adc451d
@allenanie
Merge branch 'fix/priority_search' of https://github.com/AgentOpt/Ope…
5fcc1b3 
…nTrace into fix/priority_search_pickling
@allenanie
push the fix to model.export() -- all tests now pass, unit tests un…
69e5512 
…commented.
@allenanie
Merge pull request #39 from AgentOpt/fix/priority_search_pickling
4fae0fc 
add a saving method to pre-save source code
@allenanie
fixed the error (due to name shadowing), commented out more test case…
cd4e533 
…s for export
@chinganc
Add num_steps to SearchTemplate
4874004
@chinganc
Move assertion into match_candidates_and_samples
55684cc
@chinganc
Add StreamingPrioritySearch
ee76a49
@chinganc
Fix the bug of PS using optimizer with memory
6fe6f25 
- Make the copied modules' parameter nodes have the same as the original one, so that optimizer's memory works.
- Add a flag to allow using the same optimizer instance across search
- Remove commented code
@chinganc
Fix memory due to tracking optimizers in PS
135b33e
@doxav
Separate priority_search_on_convex_fn into dedicated PrioritySearch a…
de4a77a 
…nd multi algo BENCH
@chinganc
Merge pull request #47 from doxav/fix/priority_search
82294b0 
added GEPA in examples/priority_search_on_convex_fn.py
@doxav
add full benchmark conversion from LM4AD and run using examples/train…
7cce332 
…ers_benchmark.py (see howto: examples/trainer_benchmark_HOWTO.md)
allenanie
allenanie reviewed Sep 27, 2025
View reviewed changes
Copy link
Member

@allenanie allenanie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few files that need to be removed (including one that I accidentally committed/pushed). No immediate implementation problem spotted.

@chinganc chinganc mentioned this pull request Oct 3, 2025
Closed
@chinganc chinganc merged commit ca80cea into experimental Oct 3, 2025
1 check passed
@chinganc chinganc deleted the fix/priority_search branch October 3, 2025 19:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@allenanie allenanie allenanie left review comments

@adith387 adith387 Awaiting requested review from adith387

Assignees

@chinganc chinganc

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@chinganc @xuanfeiren @allenanie @doxav