File tree Expand file tree Collapse file tree 1 file changed +9
-5
lines changed Expand file tree Collapse file tree 1 file changed +9
-5
lines changed Original file line number Diff line number Diff line change 1- # v2.1 (TBD)
1+ # v2.1 (2017-11-16)
2+
3+ New features:
4+ - If the environment variable ` LOG_TRANSFERS=true ` is given, transferred files will now be logged as they are being transferred.
5+ Logging only occurs if the file is actually transferred, not if the target is found to be up-to-date.
26
37Changes:
48- Giving an invalid URL in ` jobs[].from.url ` now results in immediate failure during configuration parsing instead of
59 indeterministic errors later on.
610- It is now an error for ` jobs[].from.url ` to not have a trailing slash. For now, a missing trailing slash will be added
711 and execution will continue, but this error will become fatal in a future version.
812- The README now includes anti-usecases, in the "Do NOT use if..." section.
9- - If the environment variable ` LOG_TRANSFERS=true ` is now given, transferred files will be logged as they are being transferred.
10- Logging only occurs if the file is actually transferred, not if the target is found to be up-to-date.
1113
1214Bugfixes:
1315- Percent-encoded URLs in directory listings are now decoded correctly.
@@ -38,13 +40,15 @@ Bugfixes:
3840
3941# v1.1 (2017-08-21)
4042
41- Changes :
43+ New features :
4244- Add a simple retry logic:
4345 - A failed directory listing will be postponed and retried up to two times at the end of scraping.
4446 - A failed file transfer will be postponed and retried once when all other transfers have completed.
45- - Exit with non-zero status when any directory listing or file transfer fails.
4647- Report number of failed directory listings.
4748
49+ Changes:
50+ - Exit with non-zero status when any directory listing or file transfer fails.
51+
4852Bugfixes:
4953- Report failure when a source file cannot be retrieved (instead of uploading the error message to the target).
5054
You can’t perform that action at this time.
0 commit comments