Skip to content

Conversation

c-bata
Copy link
Member

@c-bata c-bata commented Apr 23, 2021

What this PR does / why we need it:

Added Sobol's quasirandom sequence support. See the paper S. Joe and F. Y. Kuo, Remark on Algorithm 659: Implementing Sobol's quasirandom sequence generator, ACM Trans. Math. Softw. 29, 49-57 (2003). for details.

np.random.rand() (seed=0) Sobol (Goptuna)
random-seed0 sobol

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Refs #1283

Special notes for your reviewer:

None.

Release note:

Support Sobol's Quasirandom Sequence using Goptuna.

[AlgorithmsEnum.BAYESIAN_OPTIMIZATION]: 'Bayesian Optimization',
[AlgorithmsEnum.TPE]: 'Tree of Parzen Estimators',
[AlgorithmsEnum.CMAES]: 'Covariance Matrix Adaptation: Evolution Strategy',
[AlgorithmsEnum.SOBOL]: 'Sobol Quasirandom Sequence',
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I cheked the new Katib UI.

ScreenShot 2021-04-23 21 52 44

@c-bata c-bata changed the title Support Sobol's Quasirandom Sequence Algorithm using Goptuna. Support Sobol's Quasirandom Sequence using Goptuna. Apr 26, 2021
Copy link
Member

@andreyvelich andreyvelich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the great contribution @c-bata!
Just one small question from me.
cc @gaocegege @johnugeorge

* [TPE](#tpe)
* [SMAC](#smac)
* [CMA-ES](#cma-es)
* [Sobol](#sobol)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should have the table somewhere in the docs with all supported Frameworks and Algorithms that these Suggestions support. Eventually, we don't need to modify the proposals docs.
WDYT @gaocegege @c-bata @johnugeorge ?
We can do it in the following PR.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should have the table somewhere in the docs with all supported Frameworks and Algorithms that these Suggestions support. Eventually, we don't need to modify the proposals docs.

Sounds good! Should I revert the changes of suggestion.md?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can leave this change in suggestion.md for now.
That will simplify the process for us to create the doc table.

@andreyvelich
Copy link
Member

LGTM from my side, @gaocegege @johnugeorge @kimwnasptd Please take a look.
/lgtm

Copy link
Member

@gaocegege gaocegege left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍
/lgtm

Thanks for your contribution! 🎉 👍

I haven't read the paper, but the demo looks great!

@andreyvelich
Copy link
Member

@c-bata Please can you also add Sobol algorithm support to the documentation: https://www.kubeflow.org/docs/components/katib/experiment/#search-algorithms-in-detail
/approve

@google-oss-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andreyvelich, c-bata

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@c-bata
Copy link
Member Author

c-bata commented May 8, 2021

@andreyvelich Thank you! I've just opened kubeflow/website#2703 👍

@yanniszark yanniszark mentioned this pull request May 17, 2021
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants