Load args from env vars as long as var starts with H2OGPT_

[achraf-mer]

No description provided.

[achraf-mer]

@ChathurindaRanasinghe I only changed here, can you please review and also check other places where env vars are needed. Thanks

[achraf-mer]

please review post merge.

[pseudotensor]

Cool thanks!

[pseudotensor]

Thanks. I was thinking of something related a month ago. I wanted to be able to set any parameter of main() via ENV. Thanks for this, since I think it takes care of that too.

What about just H2OGPT_x . Why need _PARAM? Also, ok to allow all lower-case too like we do in DAI? Thanks!

[achraf-mer]

Thanks. I was thinking of something related a month ago. I wanted to be able to set any parameter of main() via ENV. Thanks for this, since I think it takes care of that too.

What about just H2OGPT_x . Why need _PARAM? Also, ok to allow all lower-case too like we do in DAI? Thanks!

ok, done in 4b90733

no prioritization for now (i.e. all caps taking precedence) can do if needed.

also, Fire is not very lenient, for example, this works:
H2OGPT_LOAD_EXLLAMA=True or --load_exllama=True

but with lower case t it doesn't:
H2OGPT_LOAD_EXLLAMA=true or --load_exllama=true

[pseudotensor]

Thanks. I was thinking of something related a month ago. I wanted to be able to set any parameter of main() via ENV. Thanks for this, since I think it takes care of that too.
What about just H2OGPT_x . Why need _PARAM? Also, ok to allow all lower-case too like we do in DAI? Thanks!

ok, done in 4b90733

no prioritization for now (i.e. all caps taking precedence) can do if needed.

also, Fire is not very lenient, for example, this works: H2OGPT_LOAD_EXLLAMA=True or --load_exllama=True

but with lower case t it doesn't: H2OGPT_LOAD_EXLLAMA=True or --load_exllama=True

Ok, I think you mean 2nd case to be "true". ya, it's not toml, it's ok.

Ya, and no need for prioritization like in DAI IMO. Thanks!

[achraf-mer]

Ok, I think you mean 2nd case to be "true". ya, it's not toml, it's ok.

Ya, and no need for prioritization like in DAI IMO. Thanks!

oops, that's right, sorry, updated.

[pseudotensor]

Can you add a note and example here?

https://github.com/h2oai/h2ogpt/blob/main/docs/FAQ.md#what-envs-can-i-pass-to-control-h2ogpt

Thanks!

We can keep all those older envs for now, don't want to break things if others using them.

But good to know how to generally set the env for any main() parameters.

[achraf-mer]

Can you add a note and example here?

https://github.com/h2oai/h2ogpt/blob/main/docs/FAQ.md#what-envs-can-i-pass-to-control-h2ogpt

Thanks!

We can keep all those older envs for now, don't want to break things if others using them.

But good to know how to generally set the env for any main() parameters.

added here: https://github.com/h2oai/h2ogpt/blob/am/load_args_from_env/docs/FAQ.md#what-envs-can-i-pass-to-control-h2ogpt