ARROW-6532 [R] write_parquet() uses writer properties (general and arrow specific)#5451

Closed

romainfrancois wants to merge 31 commits intoapache:masterfrom

romainfrancois:ARROW-6532/write_parquet_compression

Commits on Sep 27, 2019

Make write_parquet() generic, internal impl using streams rather than file path for more flexibility
romainfrancois
committed
passing down the right stream
romainfrancois
committed
lint
romainfrancois
committed
Exposing classes parquet::arrow::ArrowWriterProperties and parquet::arrow::WriterProperties to R side
romainfrancois
committed
+ ParquetWriterProperties$create() and associated ParquetWriterProperties_Builder class skeleton
romainfrancois
committed
Expose options from ParquetWriterProperties and ParquetArrowWriterProperties to write_parquet()
romainfrancois
committed
lint
romainfrancois
committed
+ compression_level= in write_parquet()
romainfrancois
committed
document()
romainfrancois
committed
More flexible compression= and compression_level=
romainfrancois
committed
More flexible arguments use_dictionary= and write_statistics=
romainfrancois
committed
using make_valid_time_unit()
romainfrancois
committed
Remove $default() methods and use $create() wityh default arguments instead.
romainfrancois
committed
using assert_that()
romainfrancois
committed
align arguments following tidyverse style guide
romainfrancois
committed
==.Table
romainfrancois
committed
add test helper so that we actually can test parquet roundtrip
romainfrancois
committed
Remove the _ from builder classes
romainfrancois
committed
M%ake compression_from_name() vectorized
romainfrancois
committed
define and use internal make_valid_version() function
romainfrancois
committed
suggestsions from @nealrichardson
romainfrancois
committed
abstract various ParquetWriterPropertiesBuilder$set_*() methods
romainfrancois
committed
wrong length for use_dictionary and write_statistics
romainfrancois
committed
Test ==.Table
romainfrancois
committed
added all.equal.Object() that uses ==
romainfrancois
committed
Update r/R/parquet.R

romainfrancois
and
nealrichardson
committed
Move read_parquet() and write_parquet() to top of the file
romainfrancois
committed
rework documentation for write_parquet()
romainfrancois
committed
implement ==.Object that calls $Equals instead of implementing for each class.
romainfrancois
committed
rename arguments to `x` and `sink`
romainfrancois
committed
test make_valid_version()
romainfrancois
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

ARROW-6532 [R] write_parquet() uses writer properties (general and arrow specific)#5451

ARROW-6532 [R] write_parquet() uses writer properties (general and arrow specific)#5451
romainfrancois wants to merge 31 commits intoapache:masterfrom
romainfrancois:ARROW-6532/write_parquet_compression

Commits on Sep 27, 2019

Make write_parquet() generic, internal impl using streams rather than file path for more flexibility

passing down the right stream

lint

Exposing classes parquet::arrow::ArrowWriterProperties and parquet::arrow::WriterProperties to R side

+ ParquetWriterProperties$create() and associated ParquetWriterProperties_Builder class skeleton

Expose options from ParquetWriterProperties and ParquetArrowWriterProperties to write_parquet()

lint

+ compression_level= in write_parquet()

document()

More flexible compression= and compression_level=

More flexible arguments use_dictionary= and write_statistics=

using make_valid_time_unit()

Remove $default() methods and use $create() wityh default arguments instead.

using assert_that()

align arguments following tidyverse style guide

==.Table

add test helper so that we actually can test parquet roundtrip

Remove the _ from builder classes

M%ake compression_from_name() vectorized

define and use internal make_valid_version() function

suggestsions from @nealrichardson

abstract various ParquetWriterPropertiesBuilder$set_*() methods

wrong length for use_dictionary and write_statistics

Test ==.Table

added all.equal.Object() that uses ==

Update r/R/parquet.R

Move read_parquet() and write_parquet() to top of the file

rework documentation for write_parquet()

implement ==.Object that calls $Equals instead of implementing for each class.

rename arguments to `x` and `sink`

test make_valid_version()