Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Automatically update all the installed python packages
This is sample output - yours may be different.
0

for i in `pip list -o --format legacy|awk '{print $1}'` ; do pip install --upgrade $i; done

bakhru · 2016-11-03 22:05:21 16
Quickly search OpenVZ container by IP and enter it
This is sample output - yours may be different.
0

vzctl enter `vzlist -a | grep $CONTAINER_IP 2 | awk '{ print $1}'`

fugitive · 2016-11-14 22:10:16 16
Retrieve a download count for URLs in apache logs
This is sample output - yours may be different.
0

zgrep 'pattern' /var/logs/apache2/access.log* | awk '{print $7}' | sort -n | uniq -c | sort -rn

funkjedi · 2016-11-30 20:14:28 15
Substitute from "." to "_" character in the 2nd column of a csv file, sending the output to newfile.csv
This is sample output - yours may be different.
0

awk 'BEGIN {FS=OFS=","} {if(NF==2);gsub(/\./,"_",$2)} 1 ' file.csv > newfile.csv

fernandofei · 2016-12-03 00:16:51 13
uncompress file that is compressed multiple times

Abort/Break with CTRL-C when no output is shown anymore (break while true loop). Show Sample Output
This is sample output - yours may be different.
```
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0 -- using error.log.0.bz2.0.bz2.0.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out -- using error.log.0.bz2.0.bz2.0.out.out
bunzip2: Can't guess original name for error.log.0.bz2.0.bz2.0.out.out -- using error.log.0.bz2.0.bz2.0.out.out.out
```
0

while true; do for bzipfile in $(file *|egrep bzip2|awk '{print $1'}|cut -d':' -f1); do bunzip2 $bzipfile; done; done

tapestreamer · 2016-12-12 16:12:18 15
all users with terminal sessions
This is sample output - yours may be different.
0

ps axno user,tty | awk '$1 >= 1000 && $1 < 65530 && $2 != "?"' | sort -u

aalex · 2017-01-06 21:05:38 16
ip from hostname domain

get the dns recorded ip adress of the domain Show Sample Output
This is sample output - yours may be different.
```
82.165.230.17
82.165.229.138
```
0

getent hosts web.de | awk '{ print $1 }'

aysadk · 2017-01-15 14:34:15 18
get the resolution of desktop

get the resolution of current desktop settings Show Sample Output
This is sample output - yours may be different.
```
1368x768+0+0
```
0

xwininfo -root | grep 'geometry' | awk '{print $2;}'

aysadk · 2017-01-15 14:35:35 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Output ranges from length(L) and width(W)
This is sample output - yours may be different.
0

awk -v L=100 -v W=9 'BEGIN{C=0;while(C<L){A=C;B=C+W-1;if((L-1)<B){B=L-1};print A"\t"B;system("");C=B+1}}'

akanehara · 2017-02-10 06:11:50 21
See memory usage precentage
This is sample output - yours may be different.
0

cat /proc/meminfo | awk -v"RS=~" '{print "Total:", $2/1024000, "GiB","|","In Use:",100-$5/$2*100"%"}'

Moshem · 2017-02-20 12:20:01 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Check the connection of the maximum number of IP

Check the connection of the maximum number of IP Show Sample Output
This is sample output - yours may be different.
```
      2 10.177.137.104
      2 10.139.17.154
      1 10.219.144.207
      1 10.137.2.204
      1 10.137.138.17
      1 10.130.0.238
```
0

netstat -na | grep ESTABLISHED | awk '{print$5}' | awk -F : '{print$1}' | sort | uniq -c | sort -r

casechen · 2017-03-26 12:12:09 17
Get the total length of all video / audio in the current dir (and below) in H:m:s

Uses soxi instead of mplayer
This is sample output - yours may be different.
0

soxi -D * | awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

hufman · 2017-04-08 17:37:03 15

Run a job in the background and prefix it's output with some string. This is particularly useful if you are running inside a docker container in a startup script (sue me, I'll run two jobs in a docker container if I want to) and you can run something like: /usr/sbin/nginx 2>&1 | awk '{print "[NGINX] " $0}' & /opt/jws-3.1/tomcat8/bin/catalina.sh run 2>&1 | awk '{print "[TOMCAT] " $0}' & while true; do ; done it can also be combined with tee to create a file log as well as a stdout log, for example if the script above where a script called "/bin/start-container.sh" then you could run /bin/start-container.sh | tee /var/log/containerlogs Show Sample Output

nginx 2>&1 | awk '{print "[NGINX] " $0}' &

hvindin · 2017-04-25 22:18:38 20

Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Get the total length of all video / audio in the current dir (and below) in H:m:s

All the other example fail when running in a folder containing too many files due to * being saturated. This command does not use *, allowing me to run it in one folder containing over 300000 audio files. As to running on so many files, I used GNU parallel in order to spawn as many processes as cores, tremendously fasting up the process. Show Sample Output
This is sample output - yours may be different.
```
0:11:3
```
0

ls|grep ".wav"|parallel -j$(nproc) soxi -D {}|awk '{SUM += $1} END { printf "%d:%d:%d\n",SUM/3600,SUM%3600/60,SUM%60}'

jupiter126 · 2017-05-02 21:37:24 20
get process id of command
This is sample output - yours may be different.
0

processid=$(ps aux | grep 'nginx' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-13 22:42:33 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

get processid of running process

alternative to pidof command Show Sample Output
This is sample output - yours may be different.
```
12345
```
0

processid =$(ps aux | grep 'ProcessName' | grep -v grep| awk '{print $2}')

aysadk · 2017-05-21 19:52:12 17
get the public ip adress of server on shell
This is sample output - yours may be different.
0

ifconfig | grep "inet addr:" | cut -d: -f2 | awk {'print($1)'} | grep -v 127.0

aysadk · 2017-05-23 21:43:15 17
Remove blank lines from a file using grep and save output to new file
This is sample output - yours may be different.
0

awk NF

aktau · 2017-05-24 12:08:27 17
split email by @ with awk

splitting email by @ with awk Show Sample Output
This is sample output - yours may be different.
```
xxx.com
```
0

echo $mail | awk -F'@' '{print $2}'

aysadk · 2017-05-24 22:36:28 17
List all IP's connected to port 80
This is sample output - yours may be different.
0

netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head

kumarrav90 · 2017-05-28 10:57:14 15
‹ First < 44 45 46 47 48 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Quickly create an alias for changing into the current directory

Put the function in your .bashrc and use "map [alias]" to create the alias you want. Just be careful to not override an existing alias.

Stream and copy a video from lan

Requires a listening port on HOST eg. "cat movie.mp4 | nc -l 1356 " (cat movie.mp4 | nc -l PORT) Useful if you're impatient and want to watch a movie immediately and download it at the same time without using extra bandwidth. You can't seek (it'll crash and kill the stream) but you can pause it.

Calculate days on which Friday the 13th occurs

Alter the years in the first brace expansion to select your year range. Modify date format to your liking but leave " %w" at the end.

List out classes in of all htmls in directory

Lists out all classes used in all *.html files in the currect directory. usefull for checking if you have left out any style definitions, or accidentally given a different name than you intended. ( I have an ugly habit of accidentally substituting camelCase instead of using under_scores: i would name soemthing counterBox instead of counter_box) WARNING: assumes you give classnames in between double quotes, and that you apply only one class per element.

Convert numbers to SI notation

converts any number on the 'stdin' to SI notation. My version limits to 3 digits of precious (working with 10% resistors).

ARP Scan

A much quicker and (not dirtier) option. use the man page for help. On linux/ubuntu you will need to `sudo apt-get -y install arp-scan`.

find directory with most inodes/files

Find which directory in one filesystem that contains most inodes or files.

Create a tar archive with all files of a certain type found in present dir and subdirs

Note: the tar archive must not exist in order to create it. If exists it will only be updated and no already existent files in present search will still remain in the tar archive. The update option has to be used instead of create because the command tar may be executed more than once depending on the number of arguments that find throws. You can see maximum number of arguments with 'getconf ARG_MAX'

Remove an IP address ban that has been errantly blacklisted by denyhosts

download the denyhosts-remove script from http://www.atrixnet.com/remove-an-ip-address-ban-that-has-been-errantly-blacklisted-by-denyhosts/

add all files not under version control to repository

This should handle whitespaces well and will not get confused if your filenames have "?" in them

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by