All commands

All commands (14,187)

sorted by

Optimal way of deleting huge numbers of files

Using xargs is better than: find /path/to/dir -type f -exec rm \-f {} \; as the -exec switch uses a separate process for each remove. xargs splits the streamed files into more managable subsets so less processes are required.
This is sample output - yours may be different.
12

find /path/to/dir -type f -print0 | xargs -0 rm

root · 2009-01-26 11:30:47 63
Display PHP files that directly instantiate a given class

This greps all PHP files for a given classname and displays both the file and the usage. Show Sample Output
This is sample output - yours may be different.
```
tao/tests/filter/TestUrl.php:        $this->objFilter = new filter_Url();
tao/classes/local/view/Photos.php:        $objFilter  = new filter_Url();
```
1

find . -name "*.php" -exec grep \-H "new filter_" {} \;

root · 2009-01-26 10:43:09 73
Run the last command as root

Useful when you forget to use sudo for a command. "!!" grabs the last run command.
This is sample output - yours may be different.
1219

sudo !!

root · 2009-01-26 10:26:48 263
Creates a customized search command

Creates a command alias ('cr' in the above example) that searches the contents of files matching a set of file extensions (C & C++ source-code in the above example) recursively within the current directory. Search configured to be in colour, ignore-case, show line numbers and show 4 lines of context. Put in shell initialisation file of your choice. Trivially easy to use, e.g: cr sha1_init Show Sample Output
This is sample output - yours may be different.
```
./openssl/signatures.c-600-xmlSecOpenSSLDsaSha1EvpInit(EVP_MD_CTX *ctx)
./openssl/signatures.c-601-{
./openssl/signatures.c:602:    return SHA1_Init(ctx->md_data);
./openssl/signatures.c-603-}
./openssl/signatures.c-604-
--
./openssl/signatures.c-706-    NULL,
./openssl/signatures.c-707-#else /* XMLSEC_OPENSSL_096 */
./openssl/signatures.c:708:    SHA1_Init,
./openssl/signatures.c-709-    SHA1_Update,
./openssl/signatures.c-710-    SHA1_Final,
```
0

alias cr='find . 2>/dev/null -regex '\''.*\.$c\|cpp\|pc\|h\|hpp\|cc$$'\'' | xargs grep --color=always -ni -C2'

chrisdrew · 2009-01-26 08:54:25 56
Outputs a sorted list of disk usage to a text file

Recursively searches current directory and outputs sorted list of each directory's disk usage to a text file. Show Sample Output
This is sample output - yours may be different.
```
712     .
328     ./test
176     ./lib
144     ./doc
100     ./test/data
96      ./lib/rake
64      ./doc/release_notes
```
6

du | sort -gr > file_sizes

chrisdrew · 2009-01-26 01:12:54 62
Watch how fast the files in a drive are being deleted

This can be useful when a large remove operation is taking place.
This is sample output - yours may be different.
6

watch "df | grep /path/to/drive"

root · 2009-01-25 21:16:41 674
Execute a command at a given time

This is an alternative to cron which allows a one-off task to be scheduled for a certain time.
This is sample output - yours may be different.
266

echo "ls -l" | at midnight

root · 2009-01-25 21:07:42 86
Analyse an Apache access log for the most common IP addresses

This uses awk to grab the IP address from each request and then sorts and summarises the top 10.
This is sample output - yours may be different.
22

tail -10000 access_log | awk '{print $1}' | sort | uniq -c | sort -n | tail

root · 2009-01-25 21:01:52 47
Add SVN keywords property to all PHP and Javascript files
This is sample output - yours may be different.
3

find . $ -name "*.php" -o -name "*.js" $ -exec svn propset svn:keywords Id {} \;

root · 2009-01-24 00:54:35 63
Count files beneath current directory (including subfolders)
This is sample output - yours may be different.
18

find . -type f | wc -l

root · 2009-01-23 17:19:32 74

Display the top ten running processes - sorted by memory usage

ps returns all running processes which are then sorted by the 4th field in numerical order and the top 10 are sent to STDOUT. Show Sample Output

106

ps aux | sort -nk +4 | tail

root · 2009-01-23 17:12:33 295

Checks all MySQL tables

See http://dev.mysql.com/doc/refman/5.0/en/myisamchk.html for further details. You can also repair all tables by running: myisamchk -r *.MYI
This is sample output - yours may be different.
-2

myisamchk /path/to/mysql/files/*.MYI

root · 2009-01-22 10:20:00 133
‹ First < 566 567 568

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Network Folder Copy with Monitoring ( tar + nc + pv )

Transfer tar stream thru nc with pv montoiring taken from: http://www.catonmat.net/blog/unix-utilities-pipe-viewer/

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Use mplayer to save video streams to a file

I use this command to save RTSP video streams over night from one of our national TV stations, so I won't have to squeeze the data through my slow internet connection when I want to watch it the next day. For ease of use, you might want to put this in a file: #!/bin/bash FILE="`basename \"$1\"`" mplayer -dumpstream -dumpfile "$FILE" -playlist "$1"

Show me a histogram of the busiest minutes in a log file:

Busiest seconds: $ cat /var/log/secure.log | awk '{print substr($0,0,15)}' | uniq -c | sort -nr | awk '{printf("\n%s ",$0) ; for (i = 0; i

FAST Search and Replace for Strings in all Files in Directory

I needed a way to search all files in a web directory that contained a certain string, and replace that string with another string. In the example, I am searching for "askapache" and replacing that string with "htaccess". I wanted this to happen as a cron job, and it was important that this happened as fast as possible while at the same time not hogging the CPU since the machine is a server. So this script uses the nice command to run the sh shell with the command, which makes the whole thing run with priority 19, meaning it won't hog CPU processing. And the -P5 option to the xargs command means it will run 5 separate grep and sed processes simultaneously, so this is much much faster than running a single grep or sed. You may want to do -P0 which is unlimited if you aren't worried about too many processes or if you don't have to deal with process killers in the bg. Also, the -m1 command to grep means stop grepping this file for matches after the first match, which also saves time.

Apache CLF access log format to CSV converter

- excel date compatible with a separate hour field - added a fixed 1 for easier request counter aggregation - split URL in directory, filename, fileext, query - used with tomcat valve with response bytes replaced by elapsed time

delay execution of a command that needs lots of memory and CPU time until the resources are available

[ 2000 -ge "$(free -m | awk '/buffers.cache:/ {print $4}')" ] returns true if less than 2000 MB of RAM are available, so adjust this number to your needs. [ $(echo "$(uptime | awk '{print $10}' | sed -e 's/,$//' -e 's/,/./') >= $(grep -c ^processor /proc/cpuinfo)" | bc) -eq 1 ] returns true if the current machine load is at least equal to the number of CPUs. If either of the tests returns true we wait 10 seconds and check again. If both tests return false, i.e. 2GB are available and machine load falls below number of CPUs, we start our command and save it's output in a text file. The ( ( ... ) & ) construct lets the command run in background even if we log out. See http://www.commandlinefu.com/commands/view/3115/ .

Have netcat listening on your ports and use telnet to test connection

This will start a netcat process listening on port 666. If you are able connect to your your server, netcat will receive the data being sent and spit it out to the screen (it may look like random garbage, so you might want to redirect it to a file).

batch crop images whit ImageMagick

Just starting to get in love with mogrify.

Compress blank lines

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)

All commands (14,187) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

All commands (14,187)

sorted by