Commands tagged download sorted by votes

Commands tagged download (36)

sorted by

Create a package list for offline download
This is sample output - yours may be different.
0

sudo apt-get <apt-get command and options> --print-uris -qq | sed -n "s/'$[^ ]\+$' $[^ ]\+$ $[^ ]\+$ MD5Sum:$[^ ]\+$/wget -c \1/p" > dowload_deb_list.txt

totti · 2013-02-09 09:36:53 5
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 5
axel -a -n 3 http://somelink-to-download/
This is sample output - yours may be different.
0

using 3 thread to download some big file

kyle · 2015-02-02 08:49:24 8
Download curl with follow redirects
This is sample output - yours may be different.
0

curl -L -O https://access.redhat.com/site/documentation/en-US/Red_Hat_Directory_Server/9.0/pdf/9.1_Release_Notes/Red_Hat_Directory_Server-9.0-9.1_Release_Notes-en-US.pdf

carlosesteves · 2015-05-06 16:12:45 9
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 24
Curl download multiple files using integer range

There's other expansions as well such as `{one,two,three}'. Check the curl docs for more.
This is sample output - yours may be different.
0

curl -O "http://www.dspguide.com/CH[1-34].PDF"

CMCDragonkai · 2015-11-26 06:34:40 13
grab all m4a file from bbc radio 4 extra for some easy audio ebbok listening

use get_iplay to download all listed content from http://www.bbc.co.uk/radio4extra run every night to make sure no episodes are missed
This is sample output - yours may be different.
0

get_iplayer --type=radio --channel "Radio 4 Extra" | grep : | awk '{ if ( NR > 1 ) { print } }'|sed 's/:.*//' |sed '$ d' > pidlist && while read p; do get_iplayer --get --fields=pid $p; done <pidlist && rm pidlist

dunryc · 2016-01-16 17:20:54 11
use curl to resume a failed download

If you are downloading a big file (or even a small one) and the connection breaks or times out, use this command in order to RESUME the download where it failed, instead of having to start downloading from the beginning. This is a real win for downloading debian ISO images over a buggy DSL modem. Take the partially downloaded file and cat it into the STDIN of curl, as shown. Then use the "-C -" option followed by the URL of the file you were originally downloading. Show Sample Output
This is sample output - yours may be different.
```
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 17.1M  100 17.1M    0     0   746k      0  0:00:23  0:00:23 --:--:--  793k
```
-1

cat file-that-failed-to-download.zip | curl -C - http://www.somewhere.com/file-I-want-to-download.zip >successfully-downloaded.zip

linuxrawkstar · 2009-08-05 13:33:06 21
Get all the HTTP HEAD responses from a list of urls in a file

urls.txt should have a fully qualified url on each line prefix with rm log.txt; to clear the log change curl command to curl --head $file | head -1 >> log.txt to just get the http status Show Sample Output
This is sample output - yours may be different.
```
==log.txt:==
/downloads HTTP/1.1 301 Moved Permanently
/downloads/ HTTP/1.1 404 Not Found
/downloads/downloads/press/logos.zip HTTP/1.1 200 OK
```
-1

for file in `cat urls.txt`; do echo -n "$file " >> log.txt; curl --head $file >> log.txt ; done

Glutnix · 2010-10-19 02:54:13 6
download wallpaper random

cortesia de http://blog.mamalibre.com.ar//?q=node/378#comment-622993358
This is sample output - yours may be different.
-1

for i in $(wget -O- -U "" "http://wallbase.cc/random/23/e..." --quiet|grep wallpaper/|grep -oe 'http://wallbase.cc[^"]*'); do wget $(wget -O- -U "" $i --quiet|grep -oe 'http://[^"]*\.jpg');done

mama21mama · 2012-08-19 11:06:30 21
Download a file securely via a remote SSH server
This is sample output - yours may be different.
-4

scp $user@$server:$path/to/file .

burned · 2010-08-02 16:26:10 5
< 1 2

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Bare Metal IRC Client

Uses the extremely cool utilities netcat and expect. "expect" logs in & monitors for server PING checks. When a PING is received it sends the PONG needed to stay connected. IRC commands to try: HELP, TIME, MOTD, JOIN and PRIVMSG The "/" in front of IRC commands are not needed, e.g. type JOIN #mygroup Learn about expect: http://tldp.org/LDP/LGNET/issue48/fisher.html The sample output shows snippets from an actual IRC session. Please click UP button if you like it!

happened to find this not bad software to keep my files and folders safe! Even the free trial version has the fantastic functions to protect any private files from being seen by anyone except me. With it I can encrypt, hide or lock anything I want, amazin

I noticed some spammer posted an advertisement here for "not bad" encryption. Unfortunately, their software only runs under Microsoft Windows and fails to work from the commandline. My shell script improves upon those two aspects, with no loss in security, using the exact same "military-grade" encryption technology, which has the ultra-cool codename "ROT-13". For extra security, I recommend running ROT-13 twice.

full path listing in /directory/path/* of javascript files.

file listing in /directory/path/* of specific files such as javascript(js) .

list files recursively by size

access to last touched or created file with arrow_up_key immediately after displaying the file list

Display recursive file list (newest file displayed at the end) and be free to access last file in the list simply by pressing arrow_up_key i.e. open it with joe editor. BTW IMHO the list of files with newest files at the end is often more informative. Put this 'lsa' function somewhere in your .bashrc and issue $ . ~/.bashrc or $ source ~/.bashrc to have access to the 'lsa' command immediately. . (the function appends command "joe last_file_in_the_list" at the end of command history)

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Recover a deleted file

grep searches through a file and prints out all the lines that match some pattern. Here, the pattern is some string that is known to be in the deleted file. The more specific this string can be, the better. The file being searched by grep (/dev/sda1) is the partition of the hard drive the deleted file used to reside in. The ?-a? flag tells grep to treat the hard drive partition, which is actually a binary file, as text. Since recovering the entire file would be nice instead of just the lines that are already known, context control is used. The flags ?-B 25 -A 100? tell grep to print out 25 lines before a match and 100 lines after a match. Be conservative with estimates on these numbers to ensure the entire file is included (when in doubt, guess bigger numbers). Excess data is easy to trim out of results, but if you find yourself with a truncated or incomplete file, you need to do this all over again. Finally, the ?> results.txt? instructs the computer to store the output of grep in a file called results.txt. Source: http://spin.atomicobject.com/2010/08/18/undelete?utm_source=y-combinator&utm_medium=social-media&utm_campaign=technical

Download entire website for offline viewing

?mirror : turn on options suitable for mirroring. -p : download all files that are necessary to properly display a given HTML page. ?convert-links : after the download, convert the links in document for local viewing. -P ./LOCAL-DIR : save all the files and directories to the specified directory.

Find files changed between dates defined by ctime of two files specified by name

This command finds all the files whose status has changed between the ctime of the older and newer . Very useful if you can see from an ls listing a block of consecutive files you want to move or delete, but can't figure out exactly the time range by date.

show the difference

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged download

Commands tagged download (36) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged download (36)

sorted by