Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Automatically update all the installed python packages
This is sample output - yours may be different.
0

for i in `pip list -o --format legacy|awk '{print $1}'` ; do pip install --upgrade $i; done

bakhru · 2016-11-03 22:05:21 16
Quickly search OpenVZ container by IP and enter it
This is sample output - yours may be different.
0

vzctl enter `vzlist -a | grep $CONTAINER_IP 2 | awk '{ print $1}'`

fugitive · 2016-11-14 22:10:16 16
Retrieve a download count for URLs in apache logs
This is sample output - yours may be different.
0

zgrep 'pattern' /var/logs/apache2/access.log* | awk '{print $7}' | sort -n | uniq -c | sort -rn

funkjedi · 2016-11-30 20:14:28 15
Substitute from "." to "_" character in the 2nd column of a csv file, sending the output to newfile.csv
This is sample output - yours may be different.
0

awk 'BEGIN {FS=OFS=","} {if(NF==2);gsub(/\./,"_",$2)} 1 ' file.csv > newfile.csv

fernandofei · 2016-12-03 00:16:51 13
uncompress file that is compressed multiple times

Abort/Break with CTRL-C when no output is shown anymore (break while true loop). Show Sample Output
This is sample output - yours may be different.
```
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0 -- using error.log.0.bz2.0.bz2.0.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out -- using error.log.0.bz2.0.bz2.0.out.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out.out -- using error.log.0.bz2.0.bz2.0.out.out.out
```
0

while true; do for bzipfile in $(file *|egrep bzip2|awk '{print $1'}|cut -d':' -f1); do bunzip2 $bzipfile; done; done

tapestreamer · 2016-12-12 16:12:18 15
all users with terminal sessions
This is sample output - yours may be different.
0

ps axno user,tty | awk '$1 >= 1000 && $1 < 65530 && $2 != "?"' | sort -u

aalex · 2017-01-06 21:05:38 16
ip from hostname domain

get the dns recorded ip adress of the domain Show Sample Output
This is sample output - yours may be different.
```
82.165.230.17
82.165.229.138
```
0

getent hosts web.de | awk '{ print $1 }'

aysadk · 2017-01-15 14:34:15 18
get the resolution of desktop

get the resolution of current desktop settings Show Sample Output
This is sample output - yours may be different.
```
1368x768+0+0
```
0

xwininfo -root | grep 'geometry' | awk '{print $2;}'

aysadk · 2017-01-15 14:35:35 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Output ranges from length(L) and width(W)
This is sample output - yours may be different.
0

awk -v L=100 -v W=9 'BEGIN{C=0;while(C<L){A=C;B=C+W-1;if((L-1)<B){B=L-1};print A"\t"B;system("");C=B+1}}'

akanehara · 2017-02-10 06:11:50 21
See memory usage precentage
This is sample output - yours may be different.
0

cat /proc/meminfo | awk -v"RS=~" '{print "Total:", $2/1024000, "GiB","|","In Use:",100-$5/$2*100"%"}'

Moshem · 2017-02-20 12:20:01 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Check the connection of the maximum number of IP

Check the connection of the maximum number of IP Show Sample Output
This is sample output - yours may be different.
```
      2 10.177.137.104
      2 10.139.17.154
      1 10.219.144.207
      1 10.137.2.204
      1 10.137.138.17
      1 10.130.0.238
```
0

netstat -na | grep ESTABLISHED | awk '{print$5}' | awk -F : '{print$1}' | sort | uniq -c | sort -r

casechen · 2017-03-26 12:12:09 17
Get the total length of all video / audio in the current dir (and below) in H:m:s

Uses soxi instead of mplayer
This is sample output - yours may be different.
0

soxi -D * | awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

hufman · 2017-04-08 17:37:03 15

Run a job in the background and prefix it's output with some string. This is particularly useful if you are running inside a docker container in a startup script (sue me, I'll run two jobs in a docker container if I want to) and you can run something like: /usr/sbin/nginx 2>&1 | awk '{print "[NGINX] " $0}' & /opt/jws-3.1/tomcat8/bin/catalina.sh run 2>&1 | awk '{print "[TOMCAT] " $0}' & while true; do ; done it can also be combined with tee to create a file log as well as a stdout log, for example if the script above where a script called "/bin/start-container.sh" then you could run /bin/start-container.sh | tee /var/log/containerlogs Show Sample Output

nginx 2>&1 | awk '{print "[NGINX] " $0}' &

hvindin · 2017-04-25 22:18:38 20

Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Get the total length of all video / audio in the current dir (and below) in H:m:s

All the other example fail when running in a folder containing too many files due to * being saturated. This command does not use *, allowing me to run it in one folder containing over 300000 audio files. As to running on so many files, I used GNU parallel in order to spawn as many processes as cores, tremendously fasting up the process. Show Sample Output
This is sample output - yours may be different.
```
0:11:3
```
0

ls|grep ".wav"|parallel -j$(nproc) soxi -D {}|awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

jupiter126 · 2017-05-02 21:37:24 20
get process id of command
This is sample output - yours may be different.
0

processid=$(ps aux | grep 'nginx' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-13 22:42:33 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

get processid of running process

alternative to pidof command Show Sample Output
This is sample output - yours may be different.
```
12345
```
0

processid =$(ps aux | grep 'ProcessName' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-21 19:52:12 17
get the public ip adress of server on shell
This is sample output - yours may be different.
0

ifconfig | grep "inet addr:" | cut -d: -f2 | awk {'print($1)'} | grep -v 127.0

aysadk · 2017-05-23 21:43:15 17
Remove blank lines from a file using grep and save output to new file
This is sample output - yours may be different.
0

awk NF

aktau · 2017-05-24 12:08:27 17
split email by @ with awk

splitting email by @ with awk Show Sample Output
This is sample output - yours may be different.
```
xxx.com
```
0

echo $mail | awk -F'@' '{print $2}'

aysadk · 2017-05-24 22:36:28 17
List all IP's connected to port 80
This is sample output - yours may be different.
0

netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head

kumarrav90 · 2017-05-28 10:57:14 15
‹ First < 44 45 46 47 48 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Open a man page as a PDF in Gnome

Would be better if gnome-open would accept std in Should be doable in KDE - anyone?

Matrix Style

Same as the cool matrix style command ( http://www.commandlinefu.com/commands/view/3652/matrix-style ), except replacing the printed character with randomness. The command mentioned is much faster and thus more true to the matrix. However, mine can be optimized, but I wasted ... i mean spent enough time on it already

Perl Simple Webserver

First we accept a socket and fork the server. Then we overload the new socket as a code ref. This code ref takes one argument, another code ref, which is used as a callback. The callback is called once for every line read on the socket. The line is put into $_ and the socket itself is passed in to the callback. Our callback is scanning the line in $_ for an HTTP GET request. If one is found it parses the file name into $1. Then we use $1 to create an new IO::All file object... with a twist. If the file is executable("-x"), then we create a piped command as our IO::All object. This somewhat approximates CGI support. Whatever the resulting object is, we direct the contents back at our socket which is in $_[0].

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Create a new file

Instant mirror from your laptop + webcam

Flips the y-axis to emulate a real mirror, uses low resolution for speed, this will also hide blemishes and the like :)

Quick HTML image gallery from folder contents with Perl

This includes a title attribute so you can see the file name by hovering over an image. Also will hoover up any image format - jpg, gif and png.

Bitcoin Brainwallet Exponent Calculator

A bitcoin "brainwallet" is a secret passphrase you carry in your brain. The Bitcoin Brainwallet Exponent Calculator is one of three functions needed to calculate the bitcoin PRIVATE key. Roughly, the formula is exponent = sha256 (passphrase) Note that this is a bash function, which means you have to type its name to invoke it. You can check the accuracy of the results here http://brainwallet.org

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by