Bulk Download Entire Website with wget Command [Linux]

Tadashi Shigeoka ·  Tue, May 24, 2022

I’ll introduce how to bulk download an entire website using the wget command.

Linux | リナックス

Background: Backup Static Site

I researched and practiced how to bulk download using the wget command for the purpose of backing up a WordPress website with only a few pages.

wget Options Sample for Bulk Download

wget \\
--mirror \\
--page-requisites \\
--span-hosts \\
--quiet --show-progress \\
--no-parent \\
--convert-links \\
--no-check-certificate \\
--adjust-extension \\
--execute robots=off \\
https://example.com
  • Don't use --span-hosts option if there are many external links

Above, I bulk downloaded an entire website using the wget command.

That’s all from the Gemba.

Reference Information