Skip to content

Add supervised methods#360

Open
ArtemVazh wants to merge 30 commits into
mainfrom
supervised_methods
Open

Add supervised methods#360
ArtemVazh wants to merge 30 commits into
mainfrom
supervised_methods

Conversation

@ArtemVazh

@ArtemVazh ArtemVazh commented Jun 25, 2025

Copy link
Copy Markdown
Collaborator
  1. Added support for supervised methods: SAPLMA, Sheeps, MIND, SATRMD, LookBackLens, and TAD. To adjust the target metric used during training, you can modify the configuration by setting stat_calculators.5.cfg.target_metric=AlignScore.
  2. Introduced separate calculators for attention and embedding processing: These calculators receive raw data from greedy_probs.py and process it independently.
  3. Added layer control for supervised and density-based methods: Added a layer (or layers) parameter to specify the required layers for each method. This enables layer selection in the manager prior to execution, allowing extraction data only from necessary layers. This is required since current calculators still rely on static meta_info and do not support dynamic layer-specific statistics.
  4. Improved statistic sorting logic: Training statistics are now initialized only after inference statistics. This enables specifying parameters in the builder environment that determine which statistics are initialized and needed for the training run - preventing unnecessary data extraction.
  5. Minor fix: Disabled verbose output in AlignScore.
  6. To use supervised methods, set the parameter estimators=default_estimators_with_supervised
  7. To set the threshold for the quality metric in the supervised method, set the parameters estimators.42.cfg.metric_thr=0.85 estimators.43.cfg.metric_thr=0.85 estimators.44.cfg.metric_thr=0.85 estimators.45.cfg.metric_thr=0.85

@ArtemVazh ArtemVazh requested a review from IINemo June 25, 2025 15:44
@ArtemVazh ArtemVazh force-pushed the supervised_methods branch 2 times, most recently from 9c12f56 to aaea31f Compare August 25, 2025 09:29
@ArtemVazh

Copy link
Copy Markdown
Collaborator Author

estimators.49.cfg.metric_thr=0.85 estimators.50.cfg.metric_thr=0.85 estimators.51.cfg.metric_thr=0.85 estimators.52.cfg.metric_thr=0.85

@IINemo

IINemo commented Dec 28, 2025

Copy link
Copy Markdown
Owner

Could you please update the pull request, for compatibility with main?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants