Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Sum of RSS utilization in Linux

This command shows you how much is RSS utilization and real memory Show Sample Output
This is sample output - yours may be different.
```
4046.19
```
0

ps aux | awk '{sum+=$6} END {print sum / 1024}'

ara4sh · 2017-07-08 05:40:24 18
Get only headers from a website with curl even if it doesn't support HEAD

Some sites running on basic web servers don't support the HEAD request, so using "curl -I" on them doesn't work. This will automatically try "curl -I" at first and if that fails with a 4xx or 5xx status code, it falls back to "curl -i" and prints only the headers from that.
This is sample output - yours may be different.
0

curlh() { x="$(curl -Is -w '%{http_code}' "$@")"; if [[ "$(tail -n 1 <<< "$x")" == [45]* ]]; then curl -is "$@" | awk '{ if (!NF) { exit }; print }'; else head -n -1 <<< "$x"; fi; }

nyuszika7h · 2017-07-10 12:29:00 17
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each
This is sample output - yours may be different.
0

ps -ef |grep oracle |grep pmon |awk '{print $2}' |xargs -I {} ps eww {} |grep pmon |grep -v grep |awk '{print $5 " " $6 " " $0}' |sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' |cut -f1,2,3 -d" " 2010-03-23 20:36:59 User:

Izzamar075 · 2017-07-21 23:44:43 21
XZIP many catalogs

Find (by regular expression) and compress (xzip) catalogs then remove source catalogs
This is sample output - yours may be different.
0

find . -type d |awk '$1 ~ /[0-9]/ {print $0}' |xargs -P 4 -I NAME tar --remove-files -vcJf NAME.tar.xz NAME

Glafir · 2017-08-28 08:05:29 19
Total Apache memory
This is sample output - yours may be different.
0

ps -C httpd -o rss --no-headers | awk '{SUM += $1} END {printf("%.0f\n",SUM/1024)}'

melib00 · 2017-09-01 15:16:36 18
Get primary IP of the local machine

Plenty of commands out there for finding external IP, but sometimes getting the [internal] IP bound to the NIC handling Internet traffic is useful. Probably not production worthy, but a useful quick kludge. Assumes IPv4 and no fancy routing. Show Sample Output
This is sample output - yours may be different.
```
chris0x00@hal9000:~$ ifconfig $(route -n |grep -m1 -e ^'0\.0\.\0\.0' |awk '{print $NF}') |grep 'inet addr' |awk '{print $2}' |sed 's/addr://1'
10.0.1.36
```
0

ifconfig $(route -n |grep -m1 -e ^'0\.0\.\0\.0' |awk '{print $NF}') |grep 'inet addr' |awk '{print $2}' |sed 's/addr://1'

chris0x00 · 2017-09-01 20:09:26 23
Create unique IP and count list of hits against URL in Pound LB logs, redirect to file
This is sample output - yours may be different.
0

cat *pound* | grep someURL.com | awk '{print $7}'| uniq -c | sort -bgr >> uniqueIPwC.txt

MannWare · 2017-11-16 20:18:55 18
Automatically update all the installed python packages

There are two different ways that I would have done this. With the command posted or if you prefer xargs: pip freeze --local | awk -F "=" '{$1}' | xargs pip install -U # But this is a moot point considering the above replaces xargs
This is sample output - yours may be different.
0

pip freeze --local | awk -F "=" '{print "pip install -U "$1}' | sh

AdvancedThreat · 2017-11-26 16:11:18 19
Automatically update all the installed python packages

No need for grep or xargs
This is sample output - yours may be different.
0

pip freeze --local | awk -F= '{print "pip install -U "$1}' | sh

AdvancedThreat · 2017-11-26 17:28:45 18
easily strace all your apache processes

No need for grep or xargs
This is sample output - yours may be different.
0

ps auxw | awk '/(apache|httpd)/{print"strace -F -p " $2}' | sh

AdvancedThreat · 2017-11-26 17:34:41 20
Get account info from CLI

Get AWS Account ID of AWS Show Sample Output
This is sample output - yours may be different.
```
123456789012
```
0

aws sts get-caller-identity --output text | awk {'print $1'}

hoon · 2017-11-27 06:20:45 22
Kill all Zombie processes one-liner

May need to substitute 'awk' for 'gawk'.
This is sample output - yours may be different.
0

ps axo state,ppid | awk '!/PPID/$1~"Z"{print $2}' | xargs -r kill -9

epixoip · 2017-12-07 00:47:12 23
Change all the limits that can be changed to unlimited

Death to the user limits!
This is sample output - yours may be different.
0

for fl in $(ulimit -a | awk '{ gsub(":", "", $1); print $1}'); do ulimit $fl unlimited; done

untoreh · 2017-12-29 05:11:06 21
Read just the IP address of a device

To get only the address. Show Sample Output
This is sample output - yours may be different.
```
192.168.1.23
```
0

hostname -I | awk '{print $1}'

K33st · 2018-01-08 21:17:32 25
List sub dir, sort by size, the biggest at the end, with human presentation

i'm using -x : -x, --one-file-system skip directories on different file systems so mounts points aren't walked trough Show Sample Output
This is sample output - yours may be different.
```
0KiB	./dev
0KiB	./proc
0KiB	./sys
4KiB	./media
4KiB	./mnt
4KiB	./selinux
4KiB	./srv
6KiB	./boot
12KiB	./run
16KiB	./lost+found
48KiB	./tmp
56KiB	./home
792KiB	./opt
852KiB	./root
6MiB	./bin
16MiB	./sbin
22MiB	./lib64
30MiB	./etc
554MiB	./var
633MiB	./lib
1GiB	./usr
2GiB	.
```
0

du --max-depth=1 -x -k | sort -n | awk 'function human(x) { s="KMGTEPYZ"; while (x>=1000 && length(s)>1) {x/=1024; s=substr(s,2)} return int(x+0.5) substr(s,1,1)"iB" } {gsub(/^[0-9]+/, human($1)); print}'

bunam · 2018-01-24 21:33:27 26
get all my commands in terminal
This is sample output - yours may be different.
0

clear && sleep 5s && curl --silent "http://www.commandlinefu.com/commands/by/dunryc" | grep '<div class="command">'|sed 's/......$//'|sed 's/^.....................................//'|recode html..ascii|awk 'ORS="\n\n\n\n"'

dunryc · 2018-03-28 20:17:40 178
install only security patch on suse
This is sample output - yours may be different.
0

zypper lp | awk '$5=="security" { print "zypper install -y -n -t patch "$3}' | grep -v "needed" | sh +x

brennquin · 2018-04-04 22:14:45 159
Check the total memory usage of processes with a specific name

Get the total RESIDENT memory used by processes of a specific name. This means this is the MINIMUM used by a process, but some memory could be paged out to swap. Show Sample Output
This is sample output - yours may be different.
```
$ pids=$(pidof chrome); for p in ${pids[@]}; do cat /proc/$p/status | grep -i vmrss | awk '{print $2}'; done | while read m; do let t=$t+$m; echo $t; done | echo "$(tail -n 1) kB"
12613760 kB
```
0

pids=$(pidof chrome); for p in ${pids[@]}; do cat /proc/$p/status | grep -i vmrss | awk '{print $2}'; done | while read m; do let t=$t+$m; echo $t; done | echo "$(tail -n 1) kB"

tyzbit · 2018-04-08 16:43:35 159
check squid logs for time value greater than 9000ms
This is sample output - yours may be different.
0

cat squid.log| awk -v x=9000 '$2 >=x' | sort -hs| tail -n 100

calicowboy54 · 2018-04-11 21:04:20 153
Arch Linux sort installed packages by size

This version accounts for the MiB/KiB suffix output by pacman these days.
This is sample output - yours may be different.
0

pacman -Qi | grep 'Name\|Size\|Description' | cut -d: -f2 | paste - - - | awk -F'\t' 'BEGIN{ s["MiB"]=1024; s["KiB"]=1;} {split($3, a, " "); print a[1] * s[a[2]], "KiB", $1}' | sort -n

Timo · 2018-04-24 13:29:57 157
Kill all processes that listen to ports begin with 50 (50, 50x, 50xxx,...)
This is sample output - yours may be different.
0

sudo netstat -plnt | grep :50 | awk '{print $7}' | awk -F/ '{print $1}' | xargs kill -9

hiepdev · 2018-06-07 01:42:49 234
Update all Docker Images
This is sample output - yours may be different.
0

docker images | grep -v REPOSITORY | awk '{print $1}' | xargs -L1 docker pull

imjoseangel · 2018-07-19 09:14:14 48
Remove all intermediate docker images after build
This is sample output - yours may be different.
0

docker images | grep <none> | awk '{ print $3; }' | xargs docker rmi

hiepdev · 2018-07-31 03:25:58 311
Get primary IP of the local machine
This is sample output - yours may be different.
0

ifconfig $(route -n |awk '/0[.]0[.]0[.]0/{print $NF;exit}') | awk '/inet/{print $2}'

pawelkl · 2018-08-06 17:39:25 323
Get Hardware UUID in Mac OS X
This is sample output - yours may be different.
0

ioreg -d2 -c IOPlatformExpertDevice | awk -F\" '/IOPlatformUUID/{print $(NF-1)}'

n8felton · 2018-08-18 21:18:20 323
‹ First < 45 46 47 48 49 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

execute a command in case of success or execute a command in case of failure

Currency Conversion

eg: currency_convert 1 usd inr

send echo to socket network

Using netcat, usuallly installed on debian/ubuntu. Also to test against a sample server the following two commands may help echo got milk? | netcat -l -p 25 python -c "import SocketServer; SocketServer.BaseRequestHandler.handle = lambda self: self.request.send('got milk?\n'); SocketServer.TCPServer(('0.0.0.0', 25), SocketServer.BaseRequestHandler).serve_forever()"

Find the package that installed a command

find out how many days since given date

You can also do this for seconds, minutes, hours, etc... Can't use dates before the epoch, though.

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Give all those pictures the same name format, trailing zeros please for the right order, offset to merge different collections of pictures

When you have different digital cameras, different people, friends and you want to merge all those pictures together, then you get files with same names or files with 3 and 4 digit numbers etc. The result is a mess if you copy it together into one directory. But if you can add an offset to the picture number and set the number of leading zeros in the file name's number then you can manage. OFFS != 0 and LZ the same as the files currently have is not supported. Or left as an exercise, hoho ;) I love NF="${NF/#+(0)/}",it looks like a magic bash spell.

Blackhole any level zones via dnsmasq

Explanation It creates dnsmasq-com-blackhole.conf file with one line to route all domains of com zones to 0.0.0.0 You might use "address=/home.lab/127.0.0.1" to point allpossiblesubdomains.home.lab to your localhost or some other IP in a cloud.

Unix commandline history substitution like ^foo^bar BUT for multiple replacements

#1 You invoked a command chain. #2 You globaly replace the scriptnames and execute them direct #3 The new executed command chain [# ^foo^bar] would only replace the firts match [foo] with [bar].

Sniffing network to generate a pcap file in CLI mode on a remote host and open it via local Wireshark ( GUI ).

Then hit ^C to stop, get the file by scp, and you can now use wireshark like this : $ wireshark /tmp/sniff.pcap If you have tshark on remote host, you could use that : $ wireshark -k -i

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by