testunit fails: `expect_snapshot()` requires the 3rd edition.

[nunotexbsd]

FreeBSD amd64
R-4.5.1

* snapshot-file/foo.r
  * snapshot-file/secret.txt
  Error: Test failures
  Execution halted
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes ... OK
* checking running R code from vignettes ...
  'custom-expectation.Rmd' using 'UTF-8'... OK
  'parallel.Rmd' using 'UTF-8'... OK
  'skipping.Rmd' using 'UTF-8'... OK
  'snapshotting.Rmd' using 'UTF-8'... failed
  'special-files.Rmd' using 'UTF-8'... OK
  'test-fixtures.Rmd' using 'UTF-8'... OK
  'third-edition.Rmd' using 'UTF-8'... failed
 ERROR
Errors in running code in vignettes:
when running code in 'snapshotting.Rmd'
  ...
Error in `edition_require(3, "expect_snapshot()")`: 

Backtrace:
    x
 1. \-testthat::expect_snapshot(cat(bullets("a")))
 2.   \-testthat:::edition_require(3, "expect_snapshot()")


  When sourcing 'snapshotting.R':
Error: Test failed
Execution halted
when running code in 'third-edition.Rmd'
  ...
Error in `edition_require(3, "expect_snapshot()")`: `expect_snapshot()` requires the 3rd edition.
Backtrace:
    x
 1. \-testthat::expect_snapshot(f())
 2.   \-testthat:::edition_require(3, "expect_snapshot()")


  When sourcing 'third-edition.R':
Error: Test failed
Execution halted

* checking re-building of vignette outputs ... SKIPPED
* DONE

Status: 2 ERRORs, 1 NOTE
See
  '/wrkdirs/usr/ports/devel/R-cran-testthat/work/testthat.Rcheck/00check.log'
for details.

*** Error code 1

Log:
00check.log

[hadley]

Can you please provide more details on how you're running R CMD check?

[nunotexbsd]

Can you please provide more details on how you're running R CMD check?

# R CMD check
Error: no packages were specified

Could you give a complete command to execute?

[hadley]

I want you to tell me what command you ran to get the output above.

[nunotexbsd]

Ok, I'm on a clean jail under poudriere FreeBSD ports framework (packager).

On testhat interactive jail, after compile, I do a make test and get the output above.

Looking at framework scripts: make testis:

do-test:
        @${FIND} ${WRKSRC} \( -name '*.o' -o -name '*.so' \) -delete
        @cd ${WRKDIR} ; ${SETENVI} ${WRK_ENV} ${MAKE_ENV} _R_CHECK_FORCE_SUGGESTS_=FALSE \
        ${R_COMMAND} ${R_PRECMD_CHECK_OPTIONS} CMD check \
        ${R_POSTCMD_CHECK_OPTIONS} ${PORTNAME}
.  endif

Using --no-manual results changes and for what I see requires the 3rd edition error is gone:

R CMD check --no-manual:

<snip>
* checking for portable use of $(BLAS_LIBS) and $(LAPACK_LIBS) ... OK
* checking use of PKG_*FLAGS in Makefiles ... OK
* checking compiled code ... NOTE
File ‘testthat/libs/testthat.so’:
  Found non-API calls to R: ‘BODY’, ‘CLOENV’, ‘FORMALS’, ‘SET_BODY’,
    ‘SET_CLOENV’, ‘SET_FORMALS’

Compiled code should not call non-API entry points in R.

See ‘Writing portable packages’ in the ‘Writing R Extensions’ manual,
and section ‘Moving into C API compliance’ for issues with the use of
non-API entry points.
* checking installed files from ‘inst/doc’ ... OK
* checking files in ‘vignettes’ ... OK
* checking examples ... OK
* checking for unstated dependencies in ‘tests’ ... OK
* checking tests ...
  Running ‘test-catch.R’
  Running ‘testthat.R’
 ERROR
Running the tests in ‘tests/testthat.R’ failed.
Last 13 lines of output:

  [ FAIL 3 | WARN 12 | SKIP 130 | PASS 933 ]
  Deleting unused snapshots:
  • R4.0/snapshot-file/version.txt
  • R4.1/snapshot-file/version.txt
  • R4.2/snapshot-file/version.txt
  • R4.3/snapshot-file/version.txt
  • R4.4/snapshot-file/version.txt
  • snapshot-file/a.txt
  • snapshot-file/foo.csv
  • snapshot-file/foo.png
  • snapshot-file/foo.r
  • snapshot-file/secret.txt
  Error: Test failures
  Execution halted
* checking for unstated dependencies in vignettes ... OK
* checking package vignettes ... OK
* checking re-building of vignette outputs ... OK
* DONE

Status: 1 ERROR, 1 NOTE
See
  ‘/wrkdirs/usr/ports/devel/R-cran-testthat/work/testthat.Rcheck/00check.log’
for details.

*** Error code 1

EDIT: Update results for R CMD check with --no-manual

[hadley]

I can reproduce the test failures and I'll have a fix momentarily. The other issues seem like there's something weird with your check setup — I suggest finding a member of the R community who is also into FreeBSD and get them to help.