Information and documentation -- WARC file format
(Only available in English)
This standard was last reviewed* in 2014.
ISO 28500:2009 specifies the WARC file format:
- to store both the payload content and control information from mainstream Internet application layer protocols, such as the Hypertext Transfer Protocol (HTTP), Domain Name System (DNS), and File Transfer Protocol (FTP);
- to store arbitrary metadata linked to other stored data (e.g. subject classifier, discovered language, encoding);
- to support data compression and maintain data record integrity;
- to store all control information from the harvesting protocol (e.g. request headers), not just response information;
- to store the results of data transformations linked to other stored data;
- to store a duplicate detection event linked to other stored data (to reduce storage in the presence of identical or substantially similar resources);
- to be extended without disruption to existing functionality;
- to support handling of overly long records by truncation or segmentation, where desired.
Document published on: 2009-05-15 Edition: 1 (Monolingual) ICS: 35.240.30 Status: Published Stage: 90.92 (2014-11-24) TC/SC: ISO/TC 46/SC 4 Number of Pages: 28
Revised by: ISO/NP 28500
No corrigenda or amendments available