Sourced from unstructured's releases.

0.15.0

Enhancements

• Improve text clearing process in email partitioning. Updated the email partitioner to remove both =\n and =\r\n characters during the clearing process. Previously, only =\n characters were removed.
• Bump unstructured.paddleocr to 2.8.0.1.
• Refine HTML parser to accommodate block element nested in phrasing. HTML parser no longer raises on a block element (e.g. <p>, <div>) nested inside a phrasing element (e.g. <strong> or <cite>). Instead it breaks the phrasing run (and therefore element) at the block-item start and begins a new phrasing run after the block-item. This is consistent with how the browser determines element boundaries in this situation.
• Install rewritten HTML parser to fix 12 existing bugs and provide headroom for refinement and growth. A rewritten HTML parser resolves a collection of outstanding bugs with HTML partitioning and provides a firm foundation for further elaborating that important partitioner.
• CI check for dependency licenses Adds a CI check to ensure dependencies are appropriately licensed.

Features

• Add support for specifying OCR language to partition_pdf(). Extend language specification capability to PaddleOCR in addition to TesseractOCR. Users can now specify OCR languages for both OCR engines when using partition_pdf().
• Add AstraDB source connector Adds support for ingesting documents from AstraDB.

Fixes

• Remedy error on Windows when nltk binaries are downloaded. Work around a quirk in the Windows implementation of tempfile.NamedTemporaryFile where accessing the temporary file by name raises PermissionError.
• Move Astra embedded_dimension to write config

Sourced from unstructured's changelog.

0.15.0

Enhancements

• Improve text clearing process in email partitioning. Updated the email partitioner to remove both =\n and =\r\n characters during the clearing process. Previously, only =\n characters were removed.
• Bump unstructured.paddleocr to 2.8.0.1.
• Refine HTML parser to accommodate block element nested in phrasing. HTML parser no longer raises on a block element (e.g. <p>, <div>) nested inside a phrasing element (e.g. <strong> or <cite>). Instead it breaks the phrasing run (and therefore element) at the block-item start and begins a new phrasing run after the block-item. This is consistent with how the browser determines element boundaries in this situation.
• Install rewritten HTML parser to fix 12 existing bugs and provide headroom for refinement and growth. A rewritten HTML parser resolves a collection of outstanding bugs with HTML partitioning and provides a firm foundation for further elaborating that important partitioner.
• CI check for dependency licenses Adds a CI check to ensure dependencies are appropriately licensed.

Features

• Add support for specifying OCR language to partition_pdf(). Extend language specification capability to PaddleOCR in addition to TesseractOCR. Users can now specify OCR languages for both OCR engines when using partition_pdf().
• Add AstraDB source connector Adds support for ingesting documents from AstraDB.

Fixes

• Remedy error on Windows when nltk binaries are downloaded. Work around a quirk in the Windows implementation of tempfile.NamedTemporaryFile where accessing the temporary file by name raises PermissionError.
• Move Astra embedded_dimension to write config

• ec59abf enhancement: improve text clearing process in email partitioning (#3422)
• 1df7908 feat: save file id for all fsspec connectors if present (#3405)
• 0eb461a refactor: restructure PDF/Image example document organization (#3410)
• 5d38703 bugfix: google drive connector metadata safegaurds (#3407)
• e99e5a8 rfctr(file): make FileType enum a file-type descriptor (#3411)
• 35ee6bf bugfix: conform all connectors to be added to registry (#3408)
• a5c9a36 rfctr(file): improve file-type auto-detect (#3409)
• 48bdf94 feat: partition_pdf() support language specification for PaddleOCR (#3400)
• 6b1d5f2 rfctr: move astra arg (#3383)
• 56ca39c rfctr(file): improve filetype tests (#3402)
• Additional commits viewable in compare view

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)