Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Automatically update all the installed python packages
This is sample output - yours may be different.
0

for i in `pip list -o --format legacy|awk '{print $1}'` ; do pip install --upgrade $i; done

bakhru · 2016-11-03 22:05:21 16
Quickly search OpenVZ container by IP and enter it
This is sample output - yours may be different.
0

vzctl enter `vzlist -a | grep $CONTAINER_IP 2 | awk '{ print $1}'`

fugitive · 2016-11-14 22:10:16 16
Retrieve a download count for URLs in apache logs
This is sample output - yours may be different.
0

zgrep 'pattern' /var/logs/apache2/access.log* | awk '{print $7}' | sort -n | uniq -c | sort -rn

funkjedi · 2016-11-30 20:14:28 15
Substitute from "." to "_" character in the 2nd column of a csv file, sending the output to newfile.csv
This is sample output - yours may be different.
0

awk 'BEGIN {FS=OFS=","} {if(NF==2);gsub(/\./,"_",$2)} 1 ' file.csv > newfile.csv

fernandofei · 2016-12-03 00:16:51 13
uncompress file that is compressed multiple times

Abort/Break with CTRL-C when no output is shown anymore (break while true loop). Show Sample Output
This is sample output - yours may be different.
```
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0 -- using error.log.0.bz2.0.bz2.0.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out -- using error.log.0.bz2.0.bz2.0.out.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out.out -- using error.log.0.bz2.0.bz2.0.out.out.out
```
0

while true; do for bzipfile in $(file *|egrep bzip2|awk '{print $1'}|cut -d':' -f1); do bunzip2 $bzipfile; done; done

tapestreamer · 2016-12-12 16:12:18 15
all users with terminal sessions
This is sample output - yours may be different.
0

ps axno user,tty | awk '$1 >= 1000 && $1 < 65530 && $2 != "?"' | sort -u

aalex · 2017-01-06 21:05:38 16
ip from hostname domain

get the dns recorded ip adress of the domain Show Sample Output
This is sample output - yours may be different.
```
82.165.230.17
82.165.229.138
```
0

getent hosts web.de | awk '{ print $1 }'

aysadk · 2017-01-15 14:34:15 18
get the resolution of desktop

get the resolution of current desktop settings Show Sample Output
This is sample output - yours may be different.
```
1368x768+0+0
```
0

xwininfo -root | grep 'geometry' | awk '{print $2;}'

aysadk · 2017-01-15 14:35:35 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Output ranges from length(L) and width(W)
This is sample output - yours may be different.
0

awk -v L=100 -v W=9 'BEGIN{C=0;while(C<L){A=C;B=C+W-1;if((L-1)<B){B=L-1};print A"\t"B;system("");C=B+1}}'

akanehara · 2017-02-10 06:11:50 21
See memory usage precentage
This is sample output - yours may be different.
0

cat /proc/meminfo | awk -v"RS=~" '{print "Total:", $2/1024000, "GiB","|","In Use:",100-$5/$2*100"%"}'

Moshem · 2017-02-20 12:20:01 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Check the connection of the maximum number of IP

Check the connection of the maximum number of IP Show Sample Output
This is sample output - yours may be different.
```
      2 10.177.137.104
      2 10.139.17.154
      1 10.219.144.207
      1 10.137.2.204
      1 10.137.138.17
      1 10.130.0.238
```
0

netstat -na | grep ESTABLISHED | awk '{print$5}' | awk -F : '{print$1}' | sort | uniq -c | sort -r

casechen · 2017-03-26 12:12:09 17
Get the total length of all video / audio in the current dir (and below) in H:m:s

Uses soxi instead of mplayer
This is sample output - yours may be different.
0

soxi -D * | awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

hufman · 2017-04-08 17:37:03 15

Run a job in the background and prefix it's output with some string. This is particularly useful if you are running inside a docker container in a startup script (sue me, I'll run two jobs in a docker container if I want to) and you can run something like: /usr/sbin/nginx 2>&1 | awk '{print "[NGINX] " $0}' & /opt/jws-3.1/tomcat8/bin/catalina.sh run 2>&1 | awk '{print "[TOMCAT] " $0}' & while true; do ; done it can also be combined with tee to create a file log as well as a stdout log, for example if the script above where a script called "/bin/start-container.sh" then you could run /bin/start-container.sh | tee /var/log/containerlogs Show Sample Output

nginx 2>&1 | awk '{print "[NGINX] " $0}' &

hvindin · 2017-04-25 22:18:38 20

Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Get the total length of all video / audio in the current dir (and below) in H:m:s

All the other example fail when running in a folder containing too many files due to * being saturated. This command does not use *, allowing me to run it in one folder containing over 300000 audio files. As to running on so many files, I used GNU parallel in order to spawn as many processes as cores, tremendously fasting up the process. Show Sample Output
This is sample output - yours may be different.
```
0:11:3
```
0

ls|grep ".wav"|parallel -j$(nproc) soxi -D {}|awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

jupiter126 · 2017-05-02 21:37:24 20
get process id of command
This is sample output - yours may be different.
0

processid=$(ps aux | grep 'nginx' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-13 22:42:33 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

get processid of running process

alternative to pidof command Show Sample Output
This is sample output - yours may be different.
```
12345
```
0

processid =$(ps aux | grep 'ProcessName' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-21 19:52:12 17
get the public ip adress of server on shell
This is sample output - yours may be different.
0

ifconfig | grep "inet addr:" | cut -d: -f2 | awk {'print($1)'} | grep -v 127.0

aysadk · 2017-05-23 21:43:15 17
Remove blank lines from a file using grep and save output to new file
This is sample output - yours may be different.
0

awk NF

aktau · 2017-05-24 12:08:27 17
split email by @ with awk

splitting email by @ with awk Show Sample Output
This is sample output - yours may be different.
```
xxx.com
```
0

echo $mail | awk -F'@' '{print $2}'

aysadk · 2017-05-24 22:36:28 17
List all IP's connected to port 80
This is sample output - yours may be different.
0

netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head

kumarrav90 · 2017-05-28 10:57:14 15
‹ First < 44 45 46 47 48 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

comment current line(put # at the beginning)

Count the number of pages of all PDFs in current directory and all subdirs, recursively

Perl one-liner to determine number of days since the Unix epoch

There are some environments that use this value for password and account expiration. It's helpful to be able to quickly determine the number of days since the Unix epoch (dse) when working directly with the configuration files as an administrator.

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

Generate a graph of package dependencies

Requires: imagemagick and graphviz On Debian systems, displays a graph of package dependencies. Works also with other image formats, like svg : $ apt-cache dotty bash | dot -T svg | display

make 100 directories with leading zero, 001...100, using bash3.X

Do a command but skip recording it in the bash command history

Note the extra space before the command (I had to put it as an underscore since the website eats up preceding spaces). That's all it takes. Now if you check your history with "$ history", it wont show up.

Create a new file

Sed can refference parts of the pattern in the replacement:

Adding Color Escape Codes to global CC array for use by echo -e

I was looking for the fastest way to create a bunch of ansi escapes for use in echo -e commands throughout a lot of my shell scripts. This is what I came up with, and I actually stick that loop command in a function and then just call that at the beginning of my scripts to not clutter the environment with these escape codes, which can wreck havok on my terminal when I'm dumping the environment. More of a cool way to store escape ansi codes in an array. You can echo them like: $ echo -e "${CC[15]}This text is black on bright green background." I usually just use with a function: $ # setup_colors - Adds colors to array CC for global use $ # 30 - Black, 31 - Red, 32 - Green, 33 - Yellow, 34 - Blue, 35 - Magenta, 36 - Blue/Green, 37 - White, 30/42 - Black on Green '30\;42' $ function setup_colors(){ declare -ax CC; for i in `seq 0 7`;do ii=$(($i+7));CC[$i]="\033[1;3${i}m";CC[$ii]="\033[0;3${i}m";done;CC[15]="\033[30;42m"; export R='\033[0;00m';export X="\033[1;37m"; }; $ export -f setup_colors CC[15] has a background of bright green which is why it is separate. R resets everything, and X is my default font of bright white. $ CC[15]="\033[30;42m"; R=$'\033[0;00m'; X=$'\033[1;37m' Those are just my favorite colors that I often use in my scripts. You can test which colors by running $ for i in $(seq 0 $((${#CC[@]} - 1))); do echo -e "${CC[$i]}[$i]\n$R"; done See: http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html for more usage.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by