wget

问题 I want to create a cronjob that every X time goes to open a webpage. This webpage is password protected by .htaccess (user=admin, passwor=pass). The instruction I give is the following: wget --user=admin --password='pass' http://www.mywebsite.com/test.php But cron gives me the following error: --2012-05-02 10:14:01-- http://www.mywebsite.com/test.php Resolving www.mywebsite.com... IP Connecting to www.mywebsite.com|IP|:80... connected. HTTP request sent, awaiting response... 401 Authorization

问题 I want to create a cronjob that every X time goes to open a webpage. This webpage is password protected by .htaccess (user=admin, passwor=pass). The instruction I give is the following: wget --user=admin --password='pass' http://www.mywebsite.com/test.php But cron gives me the following error: --2012-05-02 10:14:01-- http://www.mywebsite.com/test.php Resolving www.mywebsite.com... IP Connecting to www.mywebsite.com|IP|:80... connected. HTTP request sent, awaiting response... 401 Authorization

问题 Closed. This question is off-topic. It is not currently accepting answers. Want to improve this question? Update the question so it's on-topic for Stack Overflow. Closed 7 years ago . I'm using Wget to make http requests to a fresh web server. I am doing this to warm the MySQL cache. I do not want to save the files after they are served. wget -nv -do-not-save-file $url Can I do something like -do-not-save-file with wget? 回答1: Use q flag for quiet mode, and tell wget to output to stdout with O

问题 In order to provide a service for webmasters, I need to download the public part of their site. I'm currently doing it using wget on my server, but it introduce a lot of load, and I'd like to move that part to the client side. Does an implementation of wget exists in Javascript? If it exists, I could zip the files and send them to my server for processing, that would allow me to concentrate on the core business for my app. I know some compression library exists in Js (such as zip.js), but I

问题 I am having a bit of trouble in coding a process or a script that would do the following: I need to get data from the URL of: nomads.ncep.noaa.gov/dods/gfs_hd/gfs_hd20140430/gfs_hd_00z But the file URL's (the days and model runs change), so it has to assume this base structure for variables. Y - Year M - Month D - Day C - Model Forecast/Initialization Hour F- Model Frame Hour Like so: nomads.ncep.noaa.gov/dods/gfs_hd/gfs_hdYYYYMMDD/gfs_hd_CCz This script would run, and then import that date

问题 I have a HTTPS-site that needs an intermediate-certificate to verify the servers SSL-certificate. If I put the intermediate-cert into /etc/ssl/certs (and make the hash-link) then openssl s_client -connect IP:PORT will work. Otherwise I get a verification error. Where does wget look for certificates? I only can make it work if I explicitly set --ca-directory in wget. So it seems openssl looks into /etc/ssl/certs and wget does not. Thanks! EDIT If I run wget with -d then I see without --ca

问题 How do you to split a very large directory, containing potentially millions of files, into smaller directories of some custom defined maximum number of files, such as 100 per directory, on UNIX? Bonus points if you know of a way to have wget download files into these subdirectories automatically. So if there are 1 million .html pages at the top-level path at www.example.com , such as /1.html /2.html ... /1000000.html and we only want 100 files per directory, it will download them to folders

问题 How do you to split a very large directory, containing potentially millions of files, into smaller directories of some custom defined maximum number of files, such as 100 per directory, on UNIX? Bonus points if you know of a way to have wget download files into these subdirectories automatically. So if there are 1 million .html pages at the top-level path at www.example.com , such as /1.html /2.html ... /1000000.html and we only want 100 files per directory, it will download them to folders