Update latest commits #35

datquocnguyen · 2022-09-06T02:31:03Z

What does this PR do?

Fixes # (issue)

Before submitting

This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
Did you read the contributor guideline,
Pull Request section?
Was this discussed/approved via a Github issue or the forum? Please add a link
to it if that's the case.
Did you make sure to update the documentation with your changes? Here are the
documentation guidelines, and
here are tips on formatting docstrings.
Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

Co-authored-by: ydshieh <[email protected]>

…q` (huggingface#18711) and friends.

* improve add_tokens documentation * format

…ace#18733)

…r_search (huggingface#18700) * Add minor doc-string change to include hp_name * fix: missing type-information for kwargs * fix: missing white-space in hyperparameter_search doc-strings

Co-authored-by: ydshieh <[email protected]>

* Add TFXGLM models * Add todo: self.supports_xla_generation = False Co-authored-by: Daniel Stancl <[email protected]> Co-authored-by: Daniel Stancl <[email protected]> Co-authored-by: Joao Gante <[email protected]> Co-authored-by: Daniel <[email protected]> Co-authored-by: Patrick von Platen <[email protected]>

…e#18741) Bumps [nbconvert](https://github.com/jupyter/nbconvert) from 6.3.0 to 6.5.1. - [Release notes](https://github.com/jupyter/nbconvert/releases) - [Commits](jupyter/nbconvert@6.3.0...6.5.1) --- updated-dependencies: - dependency-name: nbconvert dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…ert (huggingface#18742) Bumps [nbconvert](https://github.com/jupyter/nbconvert) from 6.3.0 to 6.5.1. - [Release notes](https://github.com/jupyter/nbconvert/releases) - [Commits](jupyter/nbconvert@6.3.0...6.5.1) --- updated-dependencies: - dependency-name: nbconvert dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* fixed docstring typos * Added missing colon Co-authored-by: 김주영 <[email protected]>

… than `encode` + `pad` for a fast tokenizer (huggingface#18693) * add warning to let the user know that the method is slower that for a fast tokenizer * user warnings * fix layoutlmv2 * fix layout* * change warnings into logger.warning

…tr (huggingface#18720) * fixed incorrect param to hasattr * simplified condition checks * code cleanup

* Implement ONNX support for Longformer Fix repo consistency check complaints Fix value mismatches Add pooler output for default model Increase validation atol to accommodate multiple-choice error Fix copies Fix chunking for longer sequence lengths Add future comment * Fix issue in mask_invalid_locations * Remove torch imports in configuration_longformer * Change config access to fix LED * Push opset version to support tril * Work in review comments (mostly style) * Add Longformer to ONNX tests

* Automatic detection for framework to use when exporting to ONNX * Log message change * Incorporating PR comments, adding unit test * Adding tf for pip install for run_tests_onnxruntime CI * Restoring past changes to circleci yaml and test_onnx_v2.py, tests moved to tests/onnx/test_features.py * Fixup * Adding test to fetcher * Updating circleci config to log more * Changing test class name * Comment typo fix in tests/onnx/test_features.py Co-authored-by: lewtun <[email protected]> * Moving torch_str/tf_str to self.framework_pt/tf * Remove -rA flag in circleci config Co-authored-by: lewtun <[email protected]>

…18752)

* add first generation tutorial * VisionEnocderDecoder gradient checkpointing * remove generation * add tests

…rsion dependent for now (huggingface#18749) * add first generation tutorial * remove generation * make version dependent expected values * Apply suggestions from code review * Update tests/models/wav2vec2_with_lm/test_processor_wav2vec2_with_lm.py * fix typo

* Fix incomplete FlaxBert outputs * fix big_bird electra roberta

* Fix broken link * Trigger CI Co-authored-by: Stas Bekman <[email protected]>

Co-authored-by: ydshieh <[email protected]>

Co-authored-by: Lysandre Debut <[email protected]> Co-authored-by: ydshieh <[email protected]>

…ngface#18804)

Co-authored-by: Niels Rogge <[email protected]>

Co-authored-by: ydshieh <[email protected]>

* add docstring for BartForCausalLM * doc-style fic

* initial implementation. * add: working model till image classification. * add: initial implementation that passes intg tests. Co-authored-by: Amy <[email protected]> * chore: formatting. * add: tests (still breaking because of config mismatch). Coo-authored-by: Yih <[email protected]> * add: corrected tests and remaning changes. * fix code style and repo consistency. * address PR comments. * address Amy's comments. * chore: remove from_pt argument. * chore: add full-stop. * fix: TFLite model conversion in the doc. * Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py Co-authored-by: Sylvain Gugger <[email protected]> * Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py Co-authored-by: Sylvain Gugger <[email protected]> * Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py Co-authored-by: Sylvain Gugger <[email protected]> * Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py Co-authored-by: Sylvain Gugger <[email protected]> * Update src/transformers/models/mobilevit/modeling_tf_mobilevit.py Co-authored-by: Sylvain Gugger <[email protected]> * apply formatting. * chore: remove comments from the example block. * remove identation in the example. Co-authored-by: Amy <[email protected]> Co-authored-by: Sylvain Gugger <[email protected]>

* Cache results of is_torch_tpu_available() * Update src/transformers/utils/import_utils.py * Update src/transformers/utils/import_utils.py

* Add Image2TextGenerationPipeline to supported pipelines * Add Flax and Tensorflow support * Add Flax and Tensorflow small tests * Add default model for Tensorflow * Add docstring * Fix doc style * Add tiny models for pytorch and flax * Remove flax from pipeline. Fix tests * Use ydshieh/vit-gpt2-coco-en as a default for both PyTorch and Tensorflow * Fix Tensorflow support Co-authored-by: Olivier Dehaene <[email protected]>

…onAnswering tests (huggingface#18854) * Pin revision for tests * Fixup * Update revision in models * Shorten revisions Co-authored-by: Ankur Goyal <[email protected]>

* update * 🖍 add missing files * 📝 add nested sections * 🖍 align titles with tasks * oops * remove quotes from titles

Co-authored-by: Olivier Dehaene <[email protected]>

* Add clarification * Add another clarification * Apply suggestion Co-authored-by: Niels Rogge <[email protected]>

Co-authored-by: Niels Rogge <[email protected]>

* Clean up utils.hub using the latest from hf_hub * Adapt test * Address review comment * Fix test

Co-authored-by: ydshieh <[email protected]>

…ingface#18856) * Fix number of examples for iterable datasets in multiprocessing * Add stronger check

…arguments) (huggingface#18651)

…ngface#18865) Co-authored-by: ydshieh <[email protected]>

Co-authored-by: ydshieh <[email protected]>

* PegasusX Initial commit * rename * pegasus X implementation * pegx update * pegx fix * pegasus-x fixes * pegx updates * cleanup * cleanup * cleanup * tests * stylefixes * Documentation update * Model hub fix * cleanup * update * update * testfix * Check fix * tweaks for merging * style * style * updates for pr * style * change pegasus-x repo

* 📝 update docs landing page * 🖍 apply feedbacks * apply feedbacks * apply feedbacks, use <br> for list

* 📝 first draft * oops add to toctree * make style * 📝 add inference section * 🖍 make style * 📝 add images * 🖍 apply feedbacks * remove num_labels and pytorch block * apply feedbacks, add colab notebook Co-authored-by: Steven <[email protected]>

* 📝 update quicktour * 📝 add trainer section * 🖍 markdown table, apply feedbacks * ✨ make style * add tf training section * make style

* bias as a layer * alias the bias (hah, it rhymes) * add comment with info

* add first generation tutorial * [Pegasus X] correct naming * [Generation] Remove

* Add type hints to XLM-Roberta-XL models * Format

* update the translation

Update latest commits

ydshieh and others added 30 commits August 23, 2022 11:10

Unpin detectron2 (huggingface#18727)

84beb8a

Co-authored-by: ydshieh <[email protected]>

Removing warning of model type for `microsoft/tapex-base-finetuned-wt…

891704b

…q` (huggingface#18711) and friends.

improve add_tokens docstring (huggingface#18687)

4386980

* improve add_tokens documentation * format

CLI: Don't check the model head when there is no model head (huggingf…

6faf283

…ace#18733)

Update perf_infer_gpu_many.mdx (huggingface#18744)

c12dbdc

Add minor doc-string change to include hp_name param in hyperparamete…

a442884

…r_search (huggingface#18700) * Add minor doc-string change to include hp_name * fix: missing type-information for kwargs * fix: missing white-space in hyperparameter_search doc-strings

fix pipeline_tutorial.mdx doctest (huggingface#18717)

cecf9f9

Co-authored-by: ydshieh <[email protected]>

fixed docstring typos (huggingface#18739)

dcff504

* fixed docstring typos * Added missing colon Co-authored-by: 김주영 <[email protected]>

examples/run_summarization_no_trainer: fixed incorrect param to hasat…

c55d6e4

…tr (huggingface#18720) * fixed incorrect param to hasattr * simplified condition checks * code cleanup

streamlining 'checkpointing_steps' parsing (huggingface#18755)

e944244

CLI: Improved error control and updated hub requirement (huggingface#…

06a6a4b

…18752)

[VisionEncoderDecoder] Add gradient checkpointing (huggingface#18697)

8869bf4

* add first generation tutorial * VisionEnocderDecoder gradient checkpointing * remove generation * add tests

Fix incomplete outputs of FlaxBert (huggingface#18772)

21f6f58

* Fix incomplete FlaxBert outputs * fix big_bird electra roberta

Fix broken link DeepSpeed documentation link (huggingface#18783)

f2fbe44

* Fix broken link * Trigger CI Co-authored-by: Stas Bekman <[email protected]>

fix missing block when there is no failure (huggingface#18775)

5f06a09

Co-authored-by: ydshieh <[email protected]>

fix a possible typo in auto feature extraction (huggingface#18779)

b10a3b3

Fix memory leak issue in torch_fx tests (huggingface#18547)

8b67f20

Co-authored-by: Lysandre Debut <[email protected]> Co-authored-by: ydshieh <[email protected]>

Fix mock in test_cached_files_are_used_when_internet_is_down (huggi…

169b8cd

…ngface#18804)

Add SegFormer and ViLT links (huggingface#18808)

f1fd460

Co-authored-by: Niels Rogge <[email protected]>

send model to the correct device (huggingface#18800)

da5bb29

Co-authored-by: ydshieh <[email protected]>

Revert to and safely handle flag in owlvit config (huggingface#18750)

8c4a114

Add docstring for BartForCausalLM (huggingface#18795)

da02b40

* add docstring for BartForCausalLM * doc-style fic

up (huggingface#18805)

5c70217

sayakpaul and others added 29 commits September 1, 2022 10:35

Cache results of is_torch_tpu_available() (huggingface#18777)

1c381f3

* Cache results of is_torch_tpu_available() * Update src/transformers/utils/import_utils.py * Update src/transformers/utils/import_utils.py

Tie weights after preparing the model in run_clm (huggingface#18855)

c61f116

Pin revision for LayoutLMForQuestionAnswering and TFLayoutLMForQuesti…

23fab60

…onAnswering tests (huggingface#18854) * Pin revision for tests * Fixup * Update revision in models * Shorten revisions Co-authored-by: Ankur Goyal <[email protected]>

Split docs on modality (huggingface#18205)

142e12a

* update * 🖍 add missing files * 📝 add nested sections * 🖍 align titles with tasks * oops * remove quotes from titles

if learning rate is a tensor, get item (float) (huggingface#18861)

9b3eb81

Fix naming issue with ImageToText pipeline (huggingface#18864)

129d732

Co-authored-by: Olivier Dehaene <[email protected]>

[LayoutLM] Add clarification to docs (huggingface#18716)

c60dd98

* Add clarification * Add another clarification * Apply suggestion Co-authored-by: Niels Rogge <[email protected]>

Add OWL-ViT to the appropriate section (huggingface#18867)

17981fa

Co-authored-by: Niels Rogge <[email protected]>

Clean up utils.hub using the latest from hf_hub (huggingface#18857)

38c3cd5

* Clean up utils.hub using the latest from hf_hub * Adapt test * Address review comment * Fix test

pin Slack SDK to 3.18.1 to avoid failing issue (huggingface#18869)

0ab465a

Co-authored-by: ydshieh <[email protected]>

Fix number of examples for iterable datasets in multiprocessing (hugg…

9e346f7

…ingface#18856) * Fix number of examples for iterable datasets in multiprocessing * Add stronger check

postpone bnb load until it's needed (huggingface#18859)

c5be7ca

Generate: validate model_kwargs on TF (and catch typos in generate …

9196f48

…arguments) (huggingface#18651)

A script to download artifacts and perform CI error statistics (huggi…

4e29b3f

…ngface#18865) Co-authored-by: ydshieh <[email protected]>

Remove cached torch_extensions on CI runners (huggingface#18868)

ecdf9b0

Co-authored-by: ydshieh <[email protected]>

Update docs landing page (huggingface#18590)

bf9d506

* 📝 update docs landing page * 🖍 apply feedbacks * apply feedbacks * apply feedbacks, use <br> for list

Add Trainer to quicktour (huggingface#18723)

65fb71b

* 📝 update quicktour * 📝 add trainer section * 🖍 markdown table, apply feedbacks * ✨ make style * add tf training section * make style

TF: TFMarianMTModel final logits bias as a layer (huggingface#18833)

7f27e00

* bias as a layer * alias the bias (hah, it rhymes) * add comment with info

Mention TF and Flax checkpoints (huggingface#18894)

591cfc6

Correct naming pegasus x (huggingface#18896)

badb9d2

* add first generation tutorial * [Pegasus X] correct naming * [Generation] Remove

Update perf_train_gpu_one.mdx (huggingface#18442)

17c634f

Add type hints to XLM-Roberta-XL models (huggingface#18475)

cfd623a

* Add type hints to XLM-Roberta-XL models * Format

Update Chinese documentation (huggingface#18893)

c6d3dab

* update the translation

Generate: get the correct beam index on eos token (huggingface#18851)

d4dbd7c

Merge pull request #34 from huggingface/main

5a7b682

Update latest commits

datquocnguyen merged commit 6833da7 into main Sep 6, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update latest commits #35

Update latest commits #35

Uh oh!

datquocnguyen commented Sep 6, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

50 participants

Update latest commits #35

Update latest commits #35

Uh oh!

Conversation

datquocnguyen commented Sep 6, 2022

What does this PR do?

Before submitting

Who can review?

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

50 participants