perf: Clean up resources with docling-parse v4, no parsed_page output by default

[cau-git]

This PR targets memory efficiency, in particular with long documents.

• Calls PdfDocument.unload_pages API on docling-parse v4 where necessary on the pipelines (introduced with v4.2.2)
• Deletes the Page.parsed_page after work, unless pipeline_options.generate_parsed_page option is requesting to keep them (changes previous default)

TODO

• Recreate uv.lock with final docling-parse 4.2.x version after fixing release

Notes:

• New behaviour that the Page.parsed_page is unavailable by default in the conversion result, also when using other PDF backends.

Issue resolved by this Pull Request:
Resolves #2077

Checklist:

• Documentation has been updated, if necessary.
• Examples have been added, if necessary.
• Tests have been added, if necessary.

[github-actions]

✅ DCO Check Passed

Thanks @cau-git, all your commits are properly signed off. 🎉

[mergify]

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

• title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?(!)?:

[dolfim-ibm]

lgtm

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

[dosubot]

Documentation updates
No documents were updated by changes in this PR

^{How did I do? Any feedback?}