This release adds support for XHTML, Lotus-1-2-3, KML, and shell scripts. Changes were made to make mimetype behave more file linux $ file --mime utility

https://github.com/gabriel-vasile/mimetype_tests repo is now used for running comparisons betweem mimetype and $ file --mime. It contains 50 000 samples and mimetype identifies the same format as $ file --mime for ~97% of them.

What's Changed

• charset: remove dependency on x/net for parsing html in #669
• CSV: replace stdlib reader with a parser that allocates less in #672
• svg: make detection harder in #674
• pdf: relax check to match file in #677
• csv: stop mutating input byte slices; for #680 in #681
• charset: remove dependency on mime in #684
• mso_office: increase limit of checked entries from 4 to 100 in #685
• jar: replace application/jar with application/java-archive in #686
• Zip container improvements in #687
• Jar first entry inside a zip in #688
• svg+html: better handling for comments in #689
• xhtml: add support in #690
• misc: behave more like file in #691
• lotus-1-2-3: add support in #695
• Add support for zipped KML files by @dmlambea in #693
• shell: add support by @scop in #694
• ruby: add support by @scop in #700
• python: associate with python2 and python3 shebangs by @scop in #699
• vsdx: add support in #702
• oneNote: add support in #703

New Contributors

• @dmlambea made their first contribution in #693
• @scop made their first contribution in #694

Full Changelog: v1.4.9...v1.4.10-rc1

This release adds support for XHTML, Lotus-1-2-3, KML, and shell scripts. Changes were made to make mimetype behave more file linux $ file --mime utility

https://github.com/gabriel-vasile/mimetype_tests repo is now used for running comparisons betweem mimetype and $ file --mime. It contains 50 000 samples and mimetype identifies the same format as $ file --mime for ~97% of them.

What's Changed

• charset: remove dependency on x/net for parsing html in #669
• CSV: replace stdlib reader with a parser that allocates less in #672
• svg: make detection harder in #674
• pdf: relax check to match file in #677
• csv: stop mutating input byte slices; for #680 in #681
• charset: remove dependency on mime in #684
• mso_office: increase limit of checked entries from 4 to 100 in #685
• jar: replace application/jar with application/java-archive in #686
• Zip container improvements in #687
• Jar first entry inside a zip in #688
• svg+html: better handling for comments in #689
• xhtml: add support in #690
• misc: behave more like file in #691
• lotus-1-2-3: add support in #695
• Add support for zipped KML files by @dmlambea in #693
• shell: add support by @scop in #694

New Contributors

• @dmlambea made their first contribution in #693
• @scop made their first contribution in #694

Full Changelog: v1.4.9...v1.4.10-rc1

What's Changed

• SRT detection: reduce allocs by @gabriel-vasile in #636
• json: more benchmarking by @gabriel-vasile in #640
• Bump golang.org/x/net from 0.33.0 to 0.39.0 in the gomod
• json: add parser with query capacity by @gabriel-vasile in #652
• feat: add support for GLTF by @gabriel-vasile in #655

Full Changelog: v1.4.8...v1.4.9

What's Changed

• Add support for APK; close #345 in #624
• (cve_fix)bump golang.org/x/net to v0.33.0 to fix CVE-2024-45338 by @sonasingh46 in #623
• zstd: check for skippable frames as well; fix #619 in #621

New Contributors

• @sonasingh46 made their first contribution in #623

Full Changelog: v1.4.7...v1.4.8

What's Changed

• remove torrent testdata; closes #398 by @gabriel-vasile in #597
• add support for CBOR files by @gabriel-vasile in #598
• Remove macho fixtures by @gabriel-vasile in #602
• remove most of the files from testdata by @gabriel-vasile in #603
• Bump golang.org/x/net from 0.30.0 to 0.31.0 in the gomod group by @dependabot in #605
• rename application/javascript to text/javascript by @gabriel-vasile in #604

Full Changelog: v1.4.6...v1.4.7

What's Changed

• Improve ftyp detection in #564
• CSV/TSV use a pool of buffered readers to avoid allocs by in #573
• feat: Add parquet file detection by @kwkelly in #578
• add application/xml as alias of text/xml in #581
• retract v1.4.4; closes #575 in #591
• action for benchmarking detectors in #590
• Remove GPL file by @canadacow in #583

New Contributors

• @kwkelly made their first contribution in #578
• @canadacow made their first contribution in #583

Full Changelog: v1.4.5...v1.4.6

What's Changed

• json: improve performance by using a pool of scanners in #535
• tar: remove strconv dependency for tar checksum octal numbers in #536
• zip: use []byte instead of string to prevent allocs in #537
• remove tarbomb from testdata folder in #540
• Updating RTF Magic number to match https://www.iana.org/assignments/media-types/application/rtf by @zdiff in #544
• alias text/rtf to application/rtf in #547
• reduce project size by moving mimetype.gif to testdata in #548
• Bump golang.org/x/net from 0.25.0 to 0.27.0 in the gomod group across 1 directory by @dependabot in #552
• remove exe from testdata in #561

New Contributors

• @zdiff made their first contribution in #544

Full Changelog: v1.4.4...v1.4.5

What's Changed

Security fixes:

Update golang.org/x/net to latest. Fixes: CVE-2023-45288

Performance improvements:

• Change tar detection to use checksum instead of legal ranges of values in #466
• ftyp: exit asap to prevent mem allocs in #517
• Improve x-subrip detection performance in #524
• improve performance for text detection in #532
• Using io.ReadAll instead of ioutil.ReadAll by @phihungtf in #525

Benchmarks:

before:
BenchmarkText/application/x-ndjson-8              663314              2027 ns/op            4306 B/op          6 allocs/op
BenchmarkSliceRand-8                              688160              1690 ns/op             728 B/op         75 allocs/op
BenchmarkSrt-8                                    946042              1089 ns/op            4240 B/op          5 allocs/op
after:
BenchmarkText/application/x-ndjson-8             1930292               678.6 ns/op           160 B/op          4 allocs/op
BenchmarkSliceRand-8                             1232066              1173 ns/op             160 B/op          4 allocs/op
BenchmarkSrt-8                                   3235448               368.8 ns/op            64 B/op          2 allocs/op

New Contributors

• @phihungtf made their first contribution in #525

Full Changelog: v1.4.3...v1.4.4

What's Changed

• Switch csv and tsv method 'sv' from ReadAll() to stream each record with Read() by @splashing-atom in #355
• Bump golang.org/x/net from 0.8.0 to 0.17.0 by @dependabot in #441
• enable reusing records in csv/tsv detection by @gabriel-vasile in #443

New Contributors

• @splashing-atom made their first contribution in #355

Full Changelog: v1.4.2...v1.4.3

What's Changed

• Improve mov detection; closes #302 by @gabriel-vasile in #304
• [codespell] Fix typos. by @mdosch in #303
• Detect UStar tar archives by @chrisnovakovic in #308
• add jxr support #155 by @dijotmathews in #312
• Added support for JXS file format by @V-R-Dighe in #319
• Bump golang.org/x/net from 0.7.0 to 0.8.0 by @dependabot in #367

New Contributors

• @mdosch made their first contribution in #303
• @chrisnovakovic made their first contribution in #308
• @dijotmathews made their first contribution in #312
• @V-R-Dighe made their first contribution in #319

Full Changelog: v1.4.1...v1.4.2