-
Notifications
You must be signed in to change notification settings - Fork 4k
ARROW-13189: [R] Disable row-level metadata application on datasets #10646
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
r/R/metadata.R
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: looks like a typo where you say "this is apply"?
|
Other than minor thing about typo (or phrasing) LGTM |
nealrichardson
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A few notes, though I don't understand this code all that well and defer to you
r/R/metadata.R
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this message deserve more explanation? Trying to think of what I would do if I saw that message.
Also:
| warning("Row-level metadata has been discarded") | |
| warning("Row-level metadata has been discarded", call. = FALSE) |
r/tests/testthat/test-metadata.R
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What happens if I ds %>% select(part) %>% collect(), do I get the warning? I'd think I shouldn't.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yup, that works without warning (like it should as you say):
> ds %>% select(part) %>% collect()
# A tibble: 4 x 1
part
* <int>
1 1
2 1
3 2
4 3
>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'll add a test that asserts that though, it's a quick + easy test
Co-authored-by: Neal Richardson <[email protected]>
ab7f0d7 to
0569f3e
Compare
…ed. Also warn/don't save row-level metadata with datasets.
|
Ok, I've made a few changes (including avoiding the now deprecated |
No description provided.