Commands by bugmenot

Commands by bugmenot (62)

sorted by

Download the last most popular 20 pictures from 500px

This command downloads the actual 20 most popular pictures from the website 500px. It uses a random name due to the fact the the pictures in 500px are stored with the same name. UPDATED: doesn't work if no referrer is specified: --referer='http://500px.com/'
This is sample output - yours may be different.
0

for line in `wget --referer='http://500px.com/' --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="$[^"]*$".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done

bugmenot · 2012-12-07 16:14:36 1
Remove the first character of each line in a file

http://www.ivorde.ro/How_to_remove_first_last_character_from_a_string_using_SED-75.html
This is sample output - yours may be different.
-5

cat files |sed 's/.$.*$/\1/'

bugmenot · 2012-12-06 22:59:16 0
Multi-segment directory downloading with lftp

It works best if you first login and then do the fetch: lftp -u user,pass ftp://site.com/ mirror -c --parallel=3 --use-pget-n=5 "Some folder"
This is sample output - yours may be different.
0

lftp -u user,pass ftp://site.com/ -e 'mirror -c --parallel=3 --use-pget-n=5 "Some folder"'

bugmenot · 2012-11-24 11:29:48 1
Create a tar archive from a text list without trailing slash in directories
This is sample output - yours may be different.
0

star -c -v -f myarchive.tar -no-dirslash list=list.txt

bugmenot · 2012-11-05 17:39:38 0
Remove all leading and trailing slashes on each line of a text file

There can be more than one trailing slash, all of them will be removed.
This is sample output - yours may be different.
-1

sed -e "s,/\+$,," -e "s,^/\+,," file.txt

bugmenot · 2012-11-02 21:08:30 0
Remove lines ending or trailing at least one slash (/)
This is sample output - yours may be different.
-5

cat file.txt | grep -v /$ > newfile.txt

bugmenot · 2012-10-31 01:55:07 1
Extract android adb ab backup to tar format (only works for non encrypted backups)
This is sample output - yours may be different.
1

dd if=mybackup.ab bs=24 skip=1 | openssl zlib -d > mybackup.tar

bugmenot · 2012-10-28 10:33:07 0
Backup a pendrive or disk under windows with dd

Blocksize (bs) is not mandatory. It's only needed when the count option is specified.
This is sample output - yours may be different.
0

dd.exe --progress if=\\.\Volume{0b1a0cbe-11da-11c0-ab53-003045c00008} of=pendrive.img

bugmenot · 2012-10-13 08:25:48 0
cmatrix

apt-get install cmatrix cmatrix-xfont wmctrl transset-df Need to restart computer for mtx font to work Commands while cmatrix is running: 1 - 9 = Change speed SHIFT + 1 - 7 = change colors Q = Quit Tested in Ubuntu 10.04
This is sample output - yours may be different.
-1

xterm +u8 -fn mtx -maximized -T "There is no spoon!" -e cmatrix -bxa -u 3 & sleep .1s && wmctrl -r :ACTIVE: -b add,fullscreen && transset-df -a &

bugmenot · 2012-09-28 04:46:28 0
Delete recursively only empty folders on present dir
This is sample output - yours may be different.
3

find ./ -empty -type d -delete

bugmenot · 2012-08-09 13:01:35 0
List recursively only empty folders on present dir
This is sample output - yours may be different.
0

find ./ -empty -type d -print

bugmenot · 2012-08-09 13:01:04 0
Delete empty directories only in present level
This is sample output - yours may be different.
-1

find ./ -maxdepth 1 -empty -type d -delete

bugmenot · 2012-08-09 12:58:46 4
List empty directories only in present level
This is sample output - yours may be different.
0

find ./ -maxdepth 1 -empty -type d -print

bugmenot · 2012-08-09 12:58:06 0
Remove very large or problematic directories under Windows from Command Prompt

When it says "Invalid Directory Name"
This is sample output - yours may be different.
-6

rd /S /Q directory

bugmenot · 2012-08-07 18:08:36 0
Erase to factory a pendrive, disk or memory card, and watch the progress
This is sample output - yours may be different.
6

sudo shred -vz -n 0 /dev/sdb

bugmenot · 2012-08-06 22:37:44 0
Make a list of files, folders and subfolders from windows command prompt

You can redirect the pipe to > file.txt See more here: http://ss64.com/nt/dir.html
This is sample output - yours may be different.
-8

dir /ad /s /b

bugmenot · 2012-08-06 21:37:03 0
Limit the transfer rate of a pipe with pv

-L RATE, --rate-limit RATE Limit the transfer to a maximum of RATE bytes per second. A suffix of "k", "m", "g", or "t" can be added to denote kilobytes (*1024), megabytes, and so on. It must be an integer.
This is sample output - yours may be different.
2

pv /dev/urandom -L 3m -i 0.3 > /dev/null

bugmenot · 2012-07-29 00:46:09 0
Create a tar archive with pax containing a set of files

NOTE that pax goes always recursively, for that reason -d option should be added when you don't want to go recursively into directories.
This is sample output - yours may be different.
0

find path -name '*' -type f | pax -wd > txtarchive.tar

bugmenot · 2012-07-29 00:44:51 0
Create a tar archive with cpio containing a set of files
This is sample output - yours may be different.
0

find path -name '*' -type f | cpio -ov -H ustar -F txtarchive.tar

bugmenot · 2012-07-29 00:44:12 1
Limit the transfer rate and size of data over a pipe

This example will close the pipe after transferring 100MB at a speed of 3MB per second.
This is sample output - yours may be different.
6

cat /dev/urandom | pv -L 3m | dd bs=1M count=100 iflag=fullblock > /dev/null

bugmenot · 2012-07-29 00:42:16 2
Find inside files two different patterns in the same line and for matched files show number of matched lines

The option -print0 for find and -0 for grep help prevent issue with weird characters or spaces in filenames. Furthermore with xargs there is no limited number of arguments that find can throw.
This is sample output - yours may be different.
1

find . -name '*' -type f -print0 | xargs -0 grep -n pattern1 | grep pattern2

bugmenot · 2012-07-29 00:40:06 0
How to run a shell script on a remote host using ftp

You can upload via ftp the script.sh in unix text format, and then upload a file called run.txt to execute once the script. Such script can be multiline. If the script fails a failed.txt will be generated that you can see via ftp.
This is sample output - yours may be different.
0

watch -n10 "if test -e run.txt ; then chmod +x script.sh && ./script.sh && rm run.txt || rm run.txt && echo > failed.txt ; fi"

bugmenot · 2012-07-29 00:38:08 1
Create a tar archive with all files of a certain type found in present dir and subdirs

Note: the tar archive must not exist in order to create it. If exists it will only be updated and no already existent files in present search will still remain in the tar archive. The update option has to be used instead of create because the command tar may be executed more than once depending on the number of arguments that find throws. You can see maximum number of arguments with 'getconf ARG_MAX'
This is sample output - yours may be different.
4

find ./ -type f -name "*.txt" -exec tar uvf myarchives.tar {} +

bugmenot · 2012-07-29 00:35:58 2
Emulating netcat -e (netcat-traditional or netcat-openbsd) with the gnu-netcat

Then just nc servername 2600 and ./script.sh kill the client with ctrl+c. You can reconnect several times. kill the server with exit
This is sample output - yours may be different.
8

mkfifo foo ; nc -lk 2600 0<foo | /bin/bash 1>foo

bugmenot · 2012-07-29 00:33:41 0
Remove from PATH paths containing a string

If there are spaces won't work.
This is sample output - yours may be different.
0

export PATH= $(echo $PATH | tr ':' '\n' | awk '!/matching string/' | paste -sd:)

bugmenot · 2012-07-29 00:30:54 0
< 1 2 3 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Generate MD5 of string and output only the hash checksum

backup system over ssh, exlucde common dirs

Prepend a text to a file.

Using the sed -i (inline), you can replace the beginning of the first line of a file without redirecting the output to a temporary location.

A line across the entire width of the terminal

Use tput cols to find the width of the terminal and set it as the minimum field width.

remove accented chars

Random play a mp3 file

Pick a mp3 at random and play it. Assumes the availability of locate with an updated db and mpg123 Not the most useful command I guess, but all of the really useful ones are taken...

colored prompt

It colors the machine name and current directory different colors for easy viewing.

Preserve user variables when running commands with sudo.

In this case the current user has proxy variable set which allows access to the rpm on the internet but needs root privs to install it. Running sudo -E preserves the current user proxy var and allows the rpm install to be executed with sudo.

ls -hog --> a more compact ls -l

I often deal with long file names and the 'ls -l' command leaves very little room for file names. An alternative is to use the -h -o and -g flags (or together, -hog). * The -h flag produces human-readable file size (e.g. 91K instead of 92728) * The -o suppresses the owner column * The -g suppresses the group column Since I use to alias ll='ls -l', I now do alias ll='ls -hog'

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by bugmenot