Commands using awk (1,418)
-
0eval `ls -1d * | awk '{print "zip -r "$1".zip "$1";"}'`
-
Opens all files in the index (modified plus not added yet) in tabs in vim.
0vim -p `git --porcelain | awk {print $2}` -
0awk '/Dec\/2012/ {print $1,$8}' logfile | grep -ivE '(.gif|.jpg|.png|favicon|.css|.js|robots.txt|wp-l|wp-term)' | sort | uniq -c | sort -rn | head -n 20
-
top 10 of access log
0awk '{ print $9 }' access.log | sort | uniq -c | sort -nr | head -n 10 -
This one has a better performance, as it is a one pass count with awk. For this script it might not matter, but for others it is a good optiomization.
0svn ls -R | egrep -v -e "\/$" | xargs svn blame | awk '{count[$2]++}END{for(j in count) print count[j] "\t" j}' | sort -rn -
0ps -A -o rss,command | grep [C]hrome | awk '{sum+=$1} END {printf("%sMB\n",sum/1024)}'
-
0awk '!($0 in array) { array[$0]; print }' temp
-
Display all pid less the 300 processes info
0ps aux | sort -n -k2 | awk '{if ($2 < 300) print($0)}' -
Rename all files in current directory by names from text file 'zzz'
0ls | paste --delimiters='*' - ./zzz | awk ' BEGIN{FS="*";} { system("mv " $1 " \"" $2 "\"") }' -
0more restart_weblogic.log | grep "LISTEN" | awk '{ print $7 }' | uniq | wc -l
-
0svn info | grep ^URL | awk -F\/ '{print $NF}'
-
I use this one-liner to search my sourcecode to find out where tags are named and since there's no easy way in XCode to see what values have already been used. Show Sample Output
0grep '.tag =' <file> | awk '{print $3}' | awk 'sub(/[;]/, x)' | sort -n -
NOTE: When doing these commands when asked for questions there might be flowing text from the pv doing the progress bar just continue typing as if its not there, close your eyes if it helps, there might be a yes or no question, type "yes" and ENTER to it, and also it will ask for a password, just put in your password and ENTER I talk alot more about this and alot of other variations of this command on my site: http://www.kossboss.com/linuxtarpvncssh Show Sample Output
0cd /srcfolder; tar -czf - . | pv -s `du -sb . | awk '{print $1}'` | ssh -c arcfour,blowfish-cbc -p 50005 root@destination.com "tar -xzvf - -C /dstfolder" -
Inner "ps...grep..." command searches for a process matching the specified . "lsof -p lists all file descriptors owned by . Includes open files, sockets, devices, etc... Show Sample Output
0sudo lsof -p `sudo ps aux | grep -i neo4j | grep -v grep | awk '{ print $2 }'` -
Counts of messages by recipient, with frozen messages excluded. Show Sample Output
0sudo /usr/sbin/exim -bp | sed -n '/\*\*\* frozen \*\*\*/,+1!p' | awk '{print $1}' | tr -d [:blank:] | grep @ | sort | uniq -c | sort -n -
I used this to get all the remote connection ip addresses connected to my server... I had to start storing and tracking this data so thats why i built this out... probably not optimal as far as the egrep regex but it works ;) Show Sample Output
0netstat -tn | awk '{print $5}' | egrep -v '(localhost|\*\:\*|Address|and|servers|fff|127\.0\.0)' | sed 's/:[0-99999999].*//g' -
0awk '{if(!seen[$0]++) {print $0;}}'
-
Use awk to sum and print the space used by a group of files. It works well as long as the space used is not bigger than 79094548.80... I found that upper limit when trying to find out what was the total amount of recoverable space from a set of directories: user@servername:/home/user/scripts>for dirName in aleph_bin aleph_sh aleph_work dailycheck INTERFAZ ; do echo "${dirName} = $(cat /tmp/purge_ocfs_dir.*.log | awk '{sum+=$5} END {printf "%4.2f", sum}') "; done aleph_bin = 79094548.80 aleph_sh = 79094548.80 aleph_work = 79094548.80 dailycheck = 79094548.80 INTERFAZ = 79094548.80 In the worst case scenario, the total number might be almost 137G. user@servername:/home/user/scripts>df -h /ocfs/* Filesystem Size Used Avail Use% Mounted on //argalephfsprod/aleph_bin$ 137G 38G 99G 28% /ocfs/aleph_bin //argalephfsprod/aleph_sh$ 137G 38G 99G 28% /ocfs/aleph_sh //argalephfsprod/aleph_work$ 280G 135G 146G 49% /ocfs/aleph_work //argalephfsprod/dailycheck$ 137G 38G 99G 28% /ocfs/dailycheck //argalephfsprod/INTERFAZ/ 137G 38G 99G 28% /ocfs/INTERFAZ Any suggestion about how to get the correct amount of space for total over 80 Mbytes? Show Sample Output
0ls -lt | awk '{sum+=$5} END {print sum}' -
perhaps you should use CMD[$2] instead of CMD[$4] Show Sample Output
0history | awk '{CMD[$4]++;count++;} END { for (a in CMD )print CMD[a] " " CMD[a]/count*100 "% " a }' | sort -nr | nl | column -t | head -n 10 -
0ls -lh file-name | awk '{ print $5}'
-
alias h="history | awk '{\$1=\"\";print substr(\$0,2)}'" # h [ 07/07/2013 10:04:53 ] alias h="history | awk '{\$1=\"\";print substr(\$0,2)}'"
0history | awk '{$1="";print substr($0,2)}' -
dumpfile is a CSV file, which its 1st field is a phone number in format CC+10 digits Empty lines are deleted, before the output in format "prefix,ocurrences" Show Sample Output
0cut -d, -f1 /var/opt/example/dumpfile.130610_subscriber.csv | cut -c3-5 | sort | uniq -c | sed -e 's/^ *//;/^$/d' | awk -F" " '{print $2 "," $1}' > SubsxPrefix.csv -
find the uptime and convert in minutes, works with AIX and Linux too Show Sample Output
0uptime | awk -F ',' ' {print $1" "$2}'|awk ' {print $3" "$4" "$5}' | sed '1,$s/:/ /' | awk ' {if ($4 =="user") print $1*60 + $2;else if ($2=="mins") print $1;else print $1*24*60 + $2*60 + $3}' -
This will strip out the relivent disk information from kvm. I'm using it to find disks on a SAN which are no longer in use. Show Sample Output
0while read X ; do printf "$X --"; virsh dumpxml $X | egrep "source dev|source file"; done< <(virsh list | awk '$1 ~ /^[1-9]/ { print $2 }') -
becuase im lazy and cant be bothered looking at the tv guide to choose a channel , any improvments or comments appreciated
0randchannelurl=$(lynx -dump http://www.tvcatchup.com/channels.html | grep watch | sed 's/^......//'| awk 'BEGIN { srand() } int(rand() * NR) == 0 { x = $0 } END { print x }') && firefox -new-window $randchannelurl - ‹ First < 36 37 38 39 40 > Last ›
What's this?
commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.
Check These Out
Stay in the loop…
- Follow the Tweets.
-
Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.
» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10 - Subscribe to the feeds.
-
Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):
Subscribe to the feed for:
- » all commands
- » commands with 3 up-votes (commandlinefu3)
- » commands with 10 up-votes (commandlinefu10)
- » commands using awk