Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Automatically update all the installed python packages
This is sample output - yours may be different.
0

for i in `pip list -o --format legacy|awk '{print $1}'` ; do pip install --upgrade $i; done

bakhru · 2016-11-03 22:05:21 16
Quickly search OpenVZ container by IP and enter it
This is sample output - yours may be different.
0

vzctl enter `vzlist -a | grep $CONTAINER_IP 2 | awk '{ print $1}'`

fugitive · 2016-11-14 22:10:16 16
Retrieve a download count for URLs in apache logs
This is sample output - yours may be different.
0

zgrep 'pattern' /var/logs/apache2/access.log* | awk '{print $7}' | sort -n | uniq -c | sort -rn

funkjedi · 2016-11-30 20:14:28 15
Substitute from "." to "_" character in the 2nd column of a csv file, sending the output to newfile.csv
This is sample output - yours may be different.
0

awk 'BEGIN {FS=OFS=","} {if(NF==2);gsub(/\./,"_",$2)} 1 ' file.csv > newfile.csv

fernandofei · 2016-12-03 00:16:51 13
uncompress file that is compressed multiple times

Abort/Break with CTRL-C when no output is shown anymore (break while true loop). Show Sample Output
This is sample output - yours may be different.
```
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0 -- using error.log.0.bz2.0.bz2.0.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out -- using error.log.0.bz2.0.bz2.0.out.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out.out -- using error.log.0.bz2.0.bz2.0.out.out.out
```
0

while true; do for bzipfile in $(file *|egrep bzip2|awk '{print $1'}|cut -d':' -f1); do bunzip2 $bzipfile; done; done

tapestreamer · 2016-12-12 16:12:18 15
all users with terminal sessions
This is sample output - yours may be different.
0

ps axno user,tty | awk '$1 >= 1000 && $1 < 65530 && $2 != "?"' | sort -u

aalex · 2017-01-06 21:05:38 16
ip from hostname domain

get the dns recorded ip adress of the domain Show Sample Output
This is sample output - yours may be different.
```
82.165.230.17
82.165.229.138
```
0

getent hosts web.de | awk '{ print $1 }'

aysadk · 2017-01-15 14:34:15 18
get the resolution of desktop

get the resolution of current desktop settings Show Sample Output
This is sample output - yours may be different.
```
1368x768+0+0
```
0

xwininfo -root | grep 'geometry' | awk '{print $2;}'

aysadk · 2017-01-15 14:35:35 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Output ranges from length(L) and width(W)
This is sample output - yours may be different.
0

awk -v L=100 -v W=9 'BEGIN{C=0;while(C<L){A=C;B=C+W-1;if((L-1)<B){B=L-1};print A"\t"B;system("");C=B+1}}'

akanehara · 2017-02-10 06:11:50 21
See memory usage precentage
This is sample output - yours may be different.
0

cat /proc/meminfo | awk -v"RS=~" '{print "Total:", $2/1024000, "GiB","|","In Use:",100-$5/$2*100"%"}'

Moshem · 2017-02-20 12:20:01 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Check the connection of the maximum number of IP

Check the connection of the maximum number of IP Show Sample Output
This is sample output - yours may be different.
```
      2 10.177.137.104
      2 10.139.17.154
      1 10.219.144.207
      1 10.137.2.204
      1 10.137.138.17
      1 10.130.0.238
```
0

netstat -na | grep ESTABLISHED | awk '{print$5}' | awk -F : '{print$1}' | sort | uniq -c | sort -r

casechen · 2017-03-26 12:12:09 17
Get the total length of all video / audio in the current dir (and below) in H:m:s

Uses soxi instead of mplayer
This is sample output - yours may be different.
0

soxi -D * | awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

hufman · 2017-04-08 17:37:03 15

Run a job in the background and prefix it's output with some string. This is particularly useful if you are running inside a docker container in a startup script (sue me, I'll run two jobs in a docker container if I want to) and you can run something like: /usr/sbin/nginx 2>&1 | awk '{print "[NGINX] " $0}' & /opt/jws-3.1/tomcat8/bin/catalina.sh run 2>&1 | awk '{print "[TOMCAT] " $0}' & while true; do ; done it can also be combined with tee to create a file log as well as a stdout log, for example if the script above where a script called "/bin/start-container.sh" then you could run /bin/start-container.sh | tee /var/log/containerlogs Show Sample Output

nginx 2>&1 | awk '{print "[NGINX] " $0}' &

hvindin · 2017-04-25 22:18:38 20

Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Get the total length of all video / audio in the current dir (and below) in H:m:s

All the other example fail when running in a folder containing too many files due to * being saturated. This command does not use *, allowing me to run it in one folder containing over 300000 audio files. As to running on so many files, I used GNU parallel in order to spawn as many processes as cores, tremendously fasting up the process. Show Sample Output
This is sample output - yours may be different.
```
0:11:3
```
0

ls|grep ".wav"|parallel -j$(nproc) soxi -D {}|awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

jupiter126 · 2017-05-02 21:37:24 20
get process id of command
This is sample output - yours may be different.
0

processid=$(ps aux | grep 'nginx' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-13 22:42:33 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

get processid of running process

alternative to pidof command Show Sample Output
This is sample output - yours may be different.
```
12345
```
0

processid =$(ps aux | grep 'ProcessName' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-21 19:52:12 17
get the public ip adress of server on shell
This is sample output - yours may be different.
0

ifconfig | grep "inet addr:" | cut -d: -f2 | awk {'print($1)'} | grep -v 127.0

aysadk · 2017-05-23 21:43:15 17
Remove blank lines from a file using grep and save output to new file
This is sample output - yours may be different.
0

awk NF

aktau · 2017-05-24 12:08:27 17
split email by @ with awk

splitting email by @ with awk Show Sample Output
This is sample output - yours may be different.
```
xxx.com
```
0

echo $mail | awk -F'@' '{print $2}'

aysadk · 2017-05-24 22:36:28 17
List all IP's connected to port 80
This is sample output - yours may be different.
0

netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head

kumarrav90 · 2017-05-28 10:57:14 15
‹ First < 44 45 46 47 48 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Validate all XML files in the current directory and below

If everything validates, there's no output. Can be handy to run on a cron job set up to email output.

Open a manpage in the default (graphical) web browser

An easy alias for opening a manpage, nicely HTML formatted, in your set internet browser. If you get a "command exited with status 3" error you need to install groff.

Easy file sharing from the command line using transfer.sh

Requires: curl xsel access to the internet(http://transfer.sh) This is an alias utilizing the transfer.sh service to make sharing files easier from the command line. I have modified the alias provided by transfer.sh to use xsel to copy the resulting URL to the clipboard. The full modified alias is as follows since commandlinefu only allows 255 characters: transfer() { if [ $# -eq 0 ]; then echo "No arguments specified. Usage:\necho transfer /tmp/test.md\ncat /tmp/test.md | transfer test.md"; return 1; fi if tty -s; then basefile=$(basename "$1" | sed -e 's/[^a-zA-Z0-9._-]/-/g'); curl --progress-bar --upload-file "$1" "https://transfer.sh/$basefile" |xsel --clipboard; else curl --progress-bar --upload-file "-" "https://transfer.sh/$1" |xsel --clipboard ; fi; xsel --clipboard; }

list block devices

Shows all block devices in a tree with descruptions of what they are.

Mac OS X: Change Color of the ls Command

I use terminal with black background on the Mac. Unfortunately, the default ls color for the directory is blue, which is very hard to see. By including the line above in my ~/.bash_profile file, I changed the directory's color to cyan, which is easer to see. For more information on the syntax of the LSCOLORS shell variable: $ man ls I tested this command on Mac OS X Leopard

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

get all bookmarks from all profiles from firefox

for i in $(ls /home/marco/.mozilla/firefox/*\.*/places.sqlite); do sqlite3 $i "SELECT strftime('%d.%m.%Y %H:%M:%S', dateAdded/1000000, 'unixepoch', 'localtime'),url FROM moz_places, moz_bookmarks WHERE moz_places.id = moz_bookmarks.fk ORDER BY dateAdded;"; done

Fetch the Gateway Ip Address

This is to fetch the Gateway Ip Address of a machine. Use the below format to put the value in a variable if you wish to find the gateway ip in a script $GATEWAY=$(netstat -nr | awk 'BEGIN {while ($3!="0.0.0.0") getline; print $2}')

Watch RX/TX rate of an interface in kb/s

Just a simple way without the need of additional tools. Of course, replace eth0 with your IF.

Add a progress counter to loop (see sample output)

For this hack you need following function: $ finit() { count=$#; current=1; for i in "$@" ; do echo $current $count; echo $i; current=$((current + 1)); done; } and alias: $ alias fnext='read cur total && echo -n "[$cur/$total] " && read' Inspired by CMake progress counters.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by