So using my linux terminal, I can run a command to download all pdfs from a website
wget -A pdf -m -p -E -k -K -np http://site/path/
but I want to automate the process. For example run the command for multiple urls and then process the downloaded files later using Python/Jupyter notebook. The wget library in Python is different and it does not allow me to use the same options/parameters that I can use in wget on my Linux machine. So, how can I achieve the same thing using Python?
You can just use the os library so it would look something like this
import os
os.system('wget -A pdf -m -p -E -k -K -np http://site/path/')
And with that you are just passing a command to the system.
System, so you decide what's inside the string. Just try it, and if it does not work, ask a new question by showing your failed attempt.
You don't need Python for that.
#!/bin/bash
for url in "http://site/path/" "https://example.com/another"
do
wget -A pdf -m -p -E -k -K -np "$url"
done
