[转]tika支持的文件格式

[转]tika支持的文件格式SupportedDocumentFormatsThispagelistsallthedocumentformatssupportedbytheparsersinApacheTika1.13.Followthelinkstothevariousparserclassjavadocsformoredetailedinformatio…

大家好,又见面了,我是你们的朋友全栈君。如果您正在找激活码,请点击查看最新教程,关注关注公众号 “全栈程序员社区” 获取激活教程,可能之前旧版本教程已经失效.最新Idea2022.1教程亲测有效,一键激活。

Jetbrains全家桶1年46,售后保障稳定

Supported Document Formats

This page lists all the document formats supported by the parsers in Apache Tika 1.13. Follow the links to the various parser class javadocs for more detailed information about each document format and how it is parsed by Tika.

Please note that Apache Tika is able to detect a much wider range of formats than those listed below, this page only documents those formats from which Tika is able to extract metadata and/or textual content.

HyperText Markup Language

The HyperText Markup Language (HTML) is the lingua franca of the web. Tika uses the TagSouplibrary to support virtually any kind of HTML found on the web. The output from the HtmlParserclass is guaranteed to be well-formed and valid XHTML, and various heuristics are used to prevent things like inline scripts from cluttering the extracted text content.

XML and derived formats

The Extensible Markup Language (XML) format is a generic format that can be used for all kinds of content. Tika has custom parsers for some widely used XML vocabularies like XHTML, OOXML and ODF, but the default DcXMLParser class simply extracts the text content of the document and ignores any XML structure. The only exception to this rule are Dublin Core metadata elements that are used for the document metadata.

Microsoft Office document formats

Microsoft Office and some related applications produce documents in the generic OLE 2 Compound Document and Office Open XML (OOXML) formats. The older OLE 2 format was introduced in Microsoft Office version 97 and was the default format until Office version 2007 and the new XML-based OOXML format. The OfficeParser and OOXMLParser classes use Apache POI libraries to support text and metadata extraction from both OLE2 and OOXML documents.

Old, pre-OLE2 Excel files (Excel 2, 3 and 4) are handled by the OldExcelParser.

OpenDocument Format

The OpenDocument format (ODF) is used most notably as the default format of the OpenOffice.org office suite. The OpenDocumentParser class supports this format and the earlier OpenOffice 1.0 format on which ODF is based.

iWorks document formats

The various iWorks document formats (Numbers, Pages, Keynote) are supported by theIWorkPackageParser class, which extracts text and metadata.

Portable Document Format

The PDFParser class parsers Portable Document Format (PDF) documents using the Apache PDFBoxlibrary.

Electronic Publication Format

The EpubParser class supports the Electronic Publication Format (EPUB) used for many digital books.

The FictionBookParser class supports the xml-based Fiction Book publishing format.

Rich Text Format

The RTFParser class uses the standard javax.swing.text.rtf feature to extract text content from Rich Text Format (RTF) documents.

Compression and packaging formats

Tika uses the Commons Compress library to support various compression and packaging formats. TheCompressorParser class handles parsing of the top level compression formats, then PackageParserclass and its subclasses parse the packaging formats and then pass the unpacked document streams to a second parsing stage using the parser instance specified in the parse context. Formats supported include Tar, AR, CPIO, Zip, 7Zip, Gzip, BZip2, XZ and Pack200.

Additionally, the RARParser class supports the RAR archive format, which isn’t supported by Commons Compress.

Text formats

Extracting text content from plain text files seems like a simple task until you start thinking of all the possible character encodings. The TXTParser class uses encoding detection code from theICU project to automatically detect the character encoding of a text document.

Feed and Syndication formats

The FeedParser class supports the RSS and Atom feed syndication formats.

The IptcAnpaParser class supports the IPTC ANPA News Wire feed format.

Help formats

The ChmParser class supports the CHM Help format.

Audio formats

Tika can detect several common audio formats and extract metadata from them. Even text extraction is supported for some audio files that contain lyrics or other textual content. Extracted metadata includes sampling rates, channels, format information, artists, titles etc. The AudioParser andMidiParser classes use standard javax.sound features to process simple audio formats. The Mp3Parserclass adds support for the widely used MP3 format, and the MP4Parser class provides it for MP4 audio. The Ogg family of audio formats (Vorbis, Speex, Opus, Flac etc) are supported by theVorbisParserOpusParserSpeexParser and FlacParser classes.

Image formats

The ImageParser class uses the standard javax.imageio feature to extract simple metadata from image formats supported by the Java platform, such as PNG, GIF and BMP. More complex image metadata is available through the JpegParser class and TiffParser classes that uses the metadata-extractor library to supports Exif metadata extraction from Jpeg and Tiff images. The PSDParser class extracts metadata from PSD images. The BPGParser class extracts simple metadata from BPG (Better Portable Graphics) images. The WebPParser class extracts simple metadata from WebP image format. The ICNSParser class extracts simple metadata from the Apple ICNS icon image format.

When extracting from images, it is also possible to chain in Tesseract via the TesseractOCRParserto have OCR performed on the contents of the image.

Video formats

Tika supports the Flash video format using a simple parsing algorithm implemented in the FLVParserclass.

The MP4 family of video formats (MP4, Quicktime, 3GPP etc) is supported by the MP4Parser class, which extracts metadata on the video, along with audio stream (if present).

For the Ogg family of video formats, a limited amount of metadata is extracted by the OggParserclass. There is also an experimental TheoraParser class which extracts only limited metadata, pending a consensus on the “right” way to return metadata for audio streams along with the video metadata.

As an alternative to the metadata-focused parsers above, the PooledTimeSeriesParser can be used (if the required tool is installed) to generate a numeric representation of the video suitable for similarity searches. More details on this approach, and setup instructions for the parser + tool, can be found on the Tika wiki page for the parser.

Java class files and archives

The ClassParser class extracts class names and method signatures from Java class files, and theZipParser class supports also jar archives.

Source code

The SourceCodeParser class handles a number of source code formats, including Java, C, C++ and Groovy. It provides a formatted form of the code, along with some simple metadata.

Mail formats

The MboxParser can extract email messages from the mbox format used by many email archives and Unix-style mailboxes.

The RFC822Parser can process single email messages in the RFC 822 format used by many email clients in their archives / exports.

The OutlookPSTParser can extract email messages from the Microsoft Outlook PST email format.

The OutlookExtractor (part of OfficeParser) is able to extract email messages from the Microsoft Outlook MSG email format.

The TNEFParser can extract email attachments from the Microsoft TNEF (Transport Neutral Encoding Format, aka Winmail.dat) used with some Microsoft email clients.

CAD formats

The DWGParser can extract simple metadata from the DWG CAD format.

Font formats

The TrueTypeParser class can extract simple metadata from the TrueType font format. TheAdobeFontMetricParser class does something similar for Adobe Font Metrics files.

Scientific formats

The DIFParser is able to extract attribute metadata from the GCMD Directory Interchange Format (DIF) scientific file format.

The GDALParser is able to extract attribute metadata from the GDAL scientific file format.

The GeographicInformationParser is able to extract attribute metadata from the ISO-19139 georgraphic information file format.

The GeoParser is makes use of a pre-built collection of a geographic gazetteer, to resolve geographic entities into their positions into the metadata

The GribParser is able to extract attribute metadata from the Grib scientific file format.

The HDFParser is able to extract attribute metadata from the HDF scientific file format.

The ISArchiveParser is able to extract attribute metadata from the ISA-Tab (ISA Tools) family of scientific file formats.

The NetCDFParser is able to extract attribute metadata from the NetCDF scientific file format.

The MatParser is able to extract attribute metadata from the Matlab scientific file format.

Executable programs and libraries

The ExecutableParser can extract metadata information on platforms, architectures and types from a range of executable formats and libraries, such as Windows Executables and Linux / BSD programs and libraries.

Crypto formats

The Pkcs7Parser is able to parse the contents of PKCS7 signed messages, but doesn’t include any information from the outer PKCS7 wrapper.

Database formats

The SQLite3Parser is able to extract content from SQLite3 files, in a tabular form. However, it requires that the is manually added to the classpath first, as that binary jar isn’t shipped as standard.

The JackcessParser is able to extract metadata and content in a tabular form, from Microsoft Access database files.

Full list of Supported Formats

  • org.apache.tika.parser.asm.ClassParser
    • application/java-vm
  • org.apache.tika.parser.audio.AudioParser
    • audio/x-wav
    • audio/basic
    • audio/x-aiff
  • org.apache.tika.parser.audio.MidiParser
    • application/x-midi
    • audio/midi
  • org.apache.tika.parser.chm.ChmParser
    • application/vnd.ms-htmlhelp
    • application/x-chm
    • application/chm
  • org.apache.tika.parser.code.SourceCodeParser
    • text/x-c++src
    • text/x-groovy
    • text/x-java-source
  • org.apache.tika.parser.crypto.Pkcs7Parser
    • application/pkcs7-signature
    • application/pkcs7-mime
  • org.apache.tika.parser.dif.DIFParser
    • application/dif+xml
  • org.apache.tika.parser.dwg.DWGParser
    • image/vnd.dwg
  • org.apache.tika.parser.epub.EpubParser
    • application/x-ibooks+zip
    • application/epub+zip
  • org.apache.tika.parser.executable.ExecutableParser
    • application/x-msdownload
    • application/x-sharedlib
    • application/x-elf
    • application/x-object
    • application/x-executable
    • application/x-coredump
  • org.apache.tika.parser.external.ExternalParser
    • video/avi
    • video/mpeg
    • video/x-msvideo
  • org.apache.tika.parser.feed.FeedParser
    • application/atom+xml
    • application/rss+xml
  • org.apache.tika.parser.font.AdobeFontMetricParser
    • application/x-font-adobe-metric
  • org.apache.tika.parser.font.TrueTypeParser
    • application/x-font-ttf
  • org.apache.tika.parser.gdal.GDALParser
    • application/x-gsc
    • image/x-ozi
    • application/x-pds
    • image/eir
    • application/x-usgs-dem
    • application/aaigrid
    • application/x-bag
    • application/elas
    • application/x-rs2
    • application/x-tsx
    • application/x-lcp
    • image/geotiff
    • application/x-mbtiles
    • application/x-cappi
    • application/x-netcdf
    • application/x-gsag
    • application/x-epsilon
    • application/x-ace2
    • application/jaxa-pal-sar
    • image/x-pcraster
    • application/x-msgn
    • image/arg
    • application/x-hdf
    • image/x-mff
    • application/x-kro
    • image/x-hdf5-image
    • image/x-dimap
    • image/x-srp
    • image/big-gif
    • application/x-envi
    • application/x-cosar
    • application/x-ntv2
    • image/bmp
    • application/x-doq2
    • application/x-bt
    • application/x-kml
    • application/x-gmt
    • application/x-rst
    • application/vrt
    • application/pcisdk
    • application/x-ctg
    • application/x-e00-grid
    • application/x-rik
    • image/ida
    • image/x-mff2
    • application/sdts-raster
    • application/x-snodas
    • image/jp2
    • image/sar-ceos
    • application/terragen
    • application/x-wcs
    • application/leveller
    • application/x-ingr
    • application/x-gtx
    • image/sgi
    • application/x-pnm
    • image/raster
    • application/fits
    • application/x-r
    • image/gif
    • application/x-envi-hdr
    • application/x-http
    • application/x-rmf
    • application/x-ecrg-toc
    • application/aig
    • application/x-rpf-toc
    • image/adrg
    • application/x-srtmhgt
    • application/x-generic-bin
    • application/jdem
    • image/x-airsar
    • application/x-webp
    • application/x-ngs-geoid
    • application/x-pcidsk
    • image/x-fujibas
    • application/x-wms
    • application/x-map
    • image/ceos
    • application/xpm
    • application/x-zmap
    • image/envisat
    • application/x-ers
    • application/x-doq1
    • application/x-isis2
    • application/x-nwt-grd
    • application/x-ppi
    • image/ilwis
    • application/x-isis3
    • application/x-nwt-grc
    • application/x-blx
    • application/gff
    • application/x-ndf
    • image/jpeg
    • application/x-geo-pdf
    • application/x-l1b
    • image/fit
    • application/x-gsbg
    • application/x-sdat
    • application/x-ctable2
    • application/x-grib
    • application/x-coasp
    • application/x-dipex
    • application/grass-ascii-grid
    • image/fits
    • application/x-til
    • application/x-dods
    • image/png
    • application/x-gxf
    • application/x-gs7bg
    • application/x-cpg
    • application/x-lan
    • application/x-xyz
    • image/bsb
    • application/x-p-aux
    • application/dted
    • application/x-rasterlite
    • image/nitf
    • image/hfa
    • application/x-fast
    • application/x-los-las
  • org.apache.tika.parser.geo.topic.GeoParser
    • application/geotopic
  • org.apache.tika.parser.geoinfo.GeographicInformationParser
    • text/iso19139+xml
  • org.apache.tika.parser.grib.GribParser
    • application/x-grib2
  • org.apache.tika.parser.hdf.HDFParser
    • application/x-hdf
  • org.apache.tika.parser.html.HtmlParser
    • text/html
    • application/vnd.wap.xhtml+xml
    • application/x-asp
    • application/xhtml+xml
  • org.apache.tika.parser.image.BPGParser
    • image/bpg
    • image/x-bpg
  • org.apache.tika.parser.image.ICNSParser
    • image/icns
  • org.apache.tika.parser.image.ImageParser
    • image/png
    • image/vnd.wap.wbmp
    • image/bmp
    • image/x-xcf
    • image/gif
    • image/x-icon
    • image/x-ms-bmp
  • org.apache.tika.parser.image.PSDParser
    • image/vnd.adobe.photoshop
  • org.apache.tika.parser.image.TiffParser
    • image/tiff
  • org.apache.tika.parser.image.WebPParser
    • image/webp
  • org.apache.tika.parser.iptc.IptcAnpaParser
    • text/vnd.iptc.anpa
  • org.apache.tika.parser.isatab.ISArchiveParser
    • application/x-isatab
  • org.apache.tika.parser.iwork.IWorkPackageParser
    • application/vnd.apple.keynote
    • application/vnd.apple.iwork
    • application/vnd.apple.numbers
    • application/vnd.apple.pages
  • org.apache.tika.parser.jpeg.JpegParser
    • image/jpeg
  • org.apache.tika.parser.mail.RFC822Parser
    • message/rfc822
  • org.apache.tika.parser.mat.MatParser
    • application/x-matlab-data
  • org.apache.tika.parser.mbox.MboxParser
    • application/mbox
  • org.apache.tika.parser.mbox.OutlookPSTParser
    • application/vnd.ms-outlook-pst
  • org.apache.tika.parser.microsoft.JackcessParser
    • application/x-msaccess
  • org.apache.tika.parser.microsoft.OfficeParser
    • application/x-tika-msoffice-embedded; format=ole10_native
    • application/msword
    • application/vnd.visio
    • application/vnd.ms-project
    • application/x-tika-msworks-spreadsheet
    • application/x-mspublisher
    • application/vnd.ms-powerpoint
    • application/x-tika-msoffice
    • application/sldworks
    • application/x-tika-ooxml-protected
    • application/vnd.ms-excel
    • application/vnd.ms-outlook
  • org.apache.tika.parser.microsoft.OldExcelParser
    • application/vnd.ms-excel.workspace.3
    • application/vnd.ms-excel.workspace.4
    • application/vnd.ms-excel.sheet.2
    • application/vnd.ms-excel.sheet.3
    • application/vnd.ms-excel.sheet.4
  • org.apache.tika.parser.microsoft.TNEFParser
    • application/vnd.ms-tnef
    • application/x-tnef
    • application/ms-tnef
  • org.apache.tika.parser.microsoft.ooxml.OOXMLParser
    • application/vnd.ms-word.document.macroenabled.12
    • application/vnd.ms-excel.addin.macroenabled.12
    • application/x-tika-ooxml
    • application/vnd.openxmlformats-officedocument.wordprocessingml.template
    • application/vnd.ms-powerpoint.addin.macroenabled.12
    • application/vnd.openxmlformats-officedocument.spreadsheetml.template
    • application/vnd.openxmlformats-officedocument.wordprocessingml.document
    • application/vnd.openxmlformats-officedocument.presentationml.template
    • application/vnd.ms-powerpoint.slideshow.macroenabled.12
    • application/vnd.openxmlformats-officedocument.presentationml.presentation
    • application/vnd.ms-powerpoint.presentation.macroenabled.12
    • application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
    • application/vnd.openxmlformats-officedocument.presentationml.slideshow
    • application/vnd.ms-excel.template.macroenabled.12
    • application/vnd.ms-excel.sheet.macroenabled.12
    • application/vnd.ms-word.template.macroenabled.12
  • org.apache.tika.parser.mp3.Mp3Parser
    • audio/mpeg
  • org.apache.tika.parser.mp4.MP4Parser
    • video/x-m4v
    • application/mp4
    • video/3gpp
    • video/3gpp2
    • video/quicktime
    • audio/mp4
    • video/mp4
  • org.apache.tika.parser.netcdf.NetCDFParser
    • application/x-netcdf
  • org.apache.tika.parser.odf.OpenDocumentParser
    • application/x-vnd.oasis.opendocument.presentation
    • application/vnd.oasis.opendocument.chart
    • application/x-vnd.oasis.opendocument.text-web
    • application/x-vnd.oasis.opendocument.image
    • application/vnd.oasis.opendocument.graphics-template
    • application/vnd.oasis.opendocument.text-web
    • application/x-vnd.oasis.opendocument.spreadsheet-template
    • application/vnd.oasis.opendocument.spreadsheet-template
    • application/vnd.sun.xml.writer
    • application/x-vnd.oasis.opendocument.graphics-template
    • application/vnd.oasis.opendocument.graphics
    • application/vnd.oasis.opendocument.spreadsheet
    • application/x-vnd.oasis.opendocument.chart
    • application/x-vnd.oasis.opendocument.spreadsheet
    • application/vnd.oasis.opendocument.image
    • application/x-vnd.oasis.opendocument.text
    • application/x-vnd.oasis.opendocument.text-template
    • application/vnd.oasis.opendocument.formula-template
    • application/x-vnd.oasis.opendocument.formula
    • application/vnd.oasis.opendocument.image-template
    • application/x-vnd.oasis.opendocument.image-template
    • application/x-vnd.oasis.opendocument.presentation-template
    • application/vnd.oasis.opendocument.presentation-template
    • application/vnd.oasis.opendocument.text
    • application/vnd.oasis.opendocument.text-template
    • application/vnd.oasis.opendocument.chart-template
    • application/x-vnd.oasis.opendocument.chart-template
    • application/x-vnd.oasis.opendocument.formula-template
    • application/x-vnd.oasis.opendocument.text-master
    • application/vnd.oasis.opendocument.presentation
    • application/x-vnd.oasis.opendocument.graphics
    • application/vnd.oasis.opendocument.formula
    • application/vnd.oasis.opendocument.text-master
  • org.apache.tika.parser.pdf.PDFParser
    • application/pdf
  • org.apache.tika.parser.pkg.CompressorParser
    • application/zlib
    • application/x-gzip
    • application/x-bzip2
    • application/x-compress
    • application/x-java-pack200
    • application/gzip
    • application/x-bzip
    • application/x-xz
  • org.apache.tika.parser.pkg.PackageParser
    • application/x-tar
    • application/java-archive
    • application/x-archive
    • application/zip
    • application/x-cpio
    • application/x-tika-unix-dump
    • application/x-7z-compressed
  • org.apache.tika.parser.pkg.RarParser
    • application/x-rar-compressed
  • org.apache.tika.parser.rtf.RTFParser
    • application/rtf
  • org.apache.tika.parser.txt.TXTParser
    • text/plain
  • org.apache.tika.parser.video.FLVParser
    • video/x-flv
  • org.apache.tika.parser.xml.DcXMLParser
    • application/xml
    • image/svg+xml
  • org.apache.tika.parser.xml.FictionBookParser
    • application/x-fictionbook+xml
  • org.gagravarr.tika.FlacParser
    • audio/x-oggflac
    • audio/x-flac
  • org.gagravarr.tika.OggParser
    • audio/ogg
    • application/kate
    • application/ogg
    • video/daala
    • video/x-ogguvs
    • video/x-ogm
    • audio/x-oggpcm
    • video/ogg
    • video/x-dirac
    • video/x-oggrgb
    • video/x-oggyuv
  • org.gagravarr.tika.OpusParser
    • audio/opus
    • audio/ogg; codecs=opus
  • org.gagravarr.tika.SpeexParser
    • audio/ogg; codecs=speex
    • audio/speex
  • org.gagravarr.tika.TheoraParser
    • video/theora
  • org.gagravarr.tika.VorbisParser
    • audio/vorbis
版权声明:本文内容由互联网用户自发贡献,该文观点仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请联系我们举报,一经查实,本站将立刻删除。

发布者:全栈程序员-站长,转载请注明出处:https://javaforall.net/215928.html原文链接:https://javaforall.net

(0)
全栈程序员-站长的头像全栈程序员-站长


相关推荐

  • mysql前缀索引使用,Mysql:前缀索引与索引[通俗易懂]

    mysql前缀索引使用,Mysql:前缀索引与索引[通俗易懂]可以像普通索引一样使用mysql前缀索引吗?如果有一些TEXT列,则前缀索引的长度为例如1,查询是:SELECT*FROMtableWHEREtextcol=’ab’它会给我所有以’a’开头的行还是会检查整列值?一般来说,我很想知道使用前缀索引时是否有任何警告.不考虑性能,如果任何查询必须以不同方式编写,或者客户端是否必须执行额外逻辑,则更多.解决方法:如果你想一下,MySQL仍会给你…

    2022年5月10日
    41
  • 关于平面图到对偶图的转化

    关于平面图到对偶图的转化闲话哇对偶图真的是个好东西,昨天考NOI2010的时候前两道很快做完了,看着t3发呆了1个多小时,啥也想不出来.看着网格图突然想到听说bzoj1001狼抓兔子可以用对偶图求解.对偶图是啥我也不知道,听说把面看成点,连边后跑一边最短路就可以了.但是当时想到这个突然发现自己不会建对偶图,看时间还有一个多小时,于是建了8种可能的图,每一个都跑一遍spfa,发现有一个可以过样例,手

    2022年5月26日
    40
  • angular7 父组件向子组件传值

    angular7 父组件向子组件传值1.新建子组件app-child2.在父组件中引用子组件<app-child[value1]=”fatherValue”></app-child>2.在子组件中使用@Input接受父组件传的值@Input()value1:string;value1就是父组件传到子组件的值了,可以在子组件中去使用…

    2022年6月5日
    29
  • 妈妈再也不用担心我的博客访问量了(一个可以刷博客访问量的小程序java)「建议收藏」

    妈妈再也不用担心我的博客访问量了(一个可以刷博客访问量的小程序java)「建议收藏」前言:相信很多写博客的朋友,会苦恼于博客访问量上不去的问题。博主最近工作比较新手动谢了个小程序,一个可以刷访问量的程序。当然主要是针对csdn博客。有了他就再也不必担心博客访问量上不去的问题了。注:博客最主要还是要自己做好seo优化,以及提高博客内容质量。本篇文章,仅供学习交流。大家如果有问题,可以留言。一,废话少说,看图:软件点击jar包直接运行:如下:稍后查看博客访问量会有变化哟,博主

    2022年6月17日
    22
  • 初识kafka

    初识kafka

    2021年11月27日
    59
  • Android中的shell循环命令

    Android中的shell循环命令新建test.txt,写入:i=0;while[$(($i))-le5];doi=$(($i+1));echo$i;done;执行这个文件adbshell<test.txt

    2022年7月24日
    7

发表回复

您的邮箱地址不会被公开。 必填项已用 * 标注

关注全栈程序员社区公众号