File Exchange

image thumbnail

Wayback Machine API

version 1.6 (65.6 KB) by Rik
This functions acts as an API for the Wayback Machine (web.archive.org).

3 Downloads

Updated 28 Jun 2020

GitHub view license on GitHub

With this function you can download captures to the Internet Archive (archive.org) that matches a date pattern. If the current time matches the pattern and there is no valid capture, a capture will be generated.
This code enables you to use a specific web page in your processing, without the need to check if the page has changed its structure or is not available at all.
This script should work on all Matlab releases and on Octave (test file included), as well as every OS (tested on Windows, Ubuntu and MacOS).

For non-text captures (images, javascript, CSS files, etc), the flags can be used (see the help text for details).

At some point (probably midway 2019), it became possible that this script would download a file that looks as if it was a capture, while it actually was a copy of the live page (without a save being triggered). The reason behind this is some change in how archive.org handles requests, although it is not clear to me what this change is. An attempt is being made to prevent this and trigger a save explicitly.

Licence: CC by-nc-sa 4.0
Logo partially adapted from: https://commons.wikimedia.org/wiki/File:Blank_globe.svg

Cite As

Rik (2020). Wayback Machine API (https://github.com/thrynae/WBM/releases/tag/1.6), GitHub. Retrieved .

Comments and Ratings (0)

Updates

1.6

See release notes for this release on GitHub: https://github.com/thrynae/WBM/releases/tag/1.6

1.5.0.1

uploaded wrong file

1.5.0.0

more input options, much better robustness (including handling of changes in archive.org), and updated dependencies

1.4.0.0

test function is now included, new input parsing, more robust method for file reading, and minor tweaks

1.3.0.0

small bugfixes

1.2.0.0

minor improvements
added compatibility for R13 (MATLAB 6.5)

1.1.0.0

Connection check failed on Ubuntu; this is now fixed

MATLAB Release Compatibility
Created with R2020a
Compatible with R13SP1 to any release
Platform Compatibility
Windows macOS Linux