Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

Updates file in all the zips

- all zips are in current folder - FILENAME is file name that should be subsitute in all zips (new version of this file is in current folder)
This is sample output - yours may be different.
0

ls *.zip|awk '{$a="zip -fo "$1" FILENAME"; system($a);}'

youkey · 2011-07-27 10:22:21 22
Generate an XKCD #936 style 4 word password

This does the same thing that the command 'j_melis' submitted, but does it a lot quicker. That command takes 43 seconds to complete on my system, while the command I submitted takes 6 seconds. Show Sample Output
This is sample output - yours may be different.
```
nukes
waken
Liszt
vain
```
0

shuf /usr/share/dict/words |grep "^[^']\{3,5\}$" |head -n4

menachem · 2011-08-24 03:43:55 3
Remove the last string character using rev and cut

In case sed and awk are not available you may use this to remove the last character from a string with "rev" and "cut". Show Sample Output
This is sample output - yours may be different.
```
command line
```
0

echo "command lines" | rev | cut -c 2- | rev

ztank1013 · 2011-09-21 11:27:52 6
Remove all unused kernels with apt-get

since awk was already there one can use it instead of the 2 greps. might not be faster, but fast enough
This is sample output - yours may be different.
0

apt-get remove $(dpkg -l | awk "/^ii linux-(image|headers)/ && ! /`uname -r`/ {print \$2}")

_john · 2011-10-09 13:58:47 4
Get all links of a website

This will get all links from a given URL, remove any duplicates, and output the result.
This is sample output - yours may be different.
0

lynx -dump http://example.com/ | awk '/http/{print $2}' | sort -u

mathias · 2011-10-13 09:49:36 6

un-unzip a file

Sometimes you unzip a file that has no root folder and it spews files all over the place. This will clean up all of those files by deleting them. Show Sample Output

unzip -l filename.zip |awk '{ if($4 != "Name" && $4 != "----") print $4}'|xargs -t rm -rf {}

hk0i · 2011-10-20 18:54:15 6

delete the files from the given directory except the PDF file
This is sample output - yours may be different.
0

ls -1 $PATH*/* | xargs file | awk -F":" '!($2~/PDF document/){print $1}' |xargs rm -rf

karuppasamy · 2011-11-02 04:42:32 3
Get the name or user running the process of specified PID

Gets the current system user running a process with the specified pid Show Sample Output
This is sample output - yours may be different.
```
nssy@yoda:~$ ps aux | grep 3698 | grep -v 'grep' | awk '{ print $1 }'
nssy
```
0

ps aux | grep PID | grep -v 'grep' | awk '{ print $1 }'

nssy · 2011-11-05 04:53:29 3
pull only the temp sensor data off of a netapp

if you can use this depends on which netapp you have, this netapp is an FAS2020 Show Sample Output
This is sample output - yours may be different.
```
netapp temp: "<N/A>, 28C (82F), 29C (84F), 33C (91F)"
```
0

/usr/bin/snmpwalk -v 1 -c public 10.0.0.22 1.3.6.1.4.1.789.1.21.1.2.1.25.1| awk -F : '{print "netapp temp:" $4 }'

ndhail · 2011-11-10 01:04:00 4
Get the name or user running the process of specified PID
This is sample output - yours may be different.
0

ps -p pid -o logname |tail -1

grep · 2011-11-21 01:33:02 3
gets all files committed to svn by a particular user since a particular date

svn log -v --> takes log of all Filter1 -------- -r {from}{to} --> gives from and to revision Filter2 -------- awk of line 'r'with numbers Assign user=3rd column [ie; username] Filter3 -------- if username = George print details Filter4 -------- Print lines starts with M/U/G/C/A/D [* A Added * D Deleted * U Updated * G Merged * C Conflicted] Filter5 -------- sort all files Filter6 ------- Print only uniq file's name alone. Show Sample Output
This is sample output - yours may be different.
```
/svnproject/somedir/childdir/bfile.txt
/svnproject/somedir/childdir2/afile1.txt
/svnproject/somedir2/childdir/zfile.txt
/svnproject/somedir/childdir3/yfile.txt
/svnproject/somedir5/childdir/xfile.txt
```
0

svn log -v -r{2009-11-1}:HEAD | awk '/^r[0-9]+ / {user=$3} /./{if (user=="george") {print}}' | grep -E "^ M|^ G|^ A|^ D|^ C|^ U" | awk '{print $2}' | sort | uniq

smilyface · 2011-12-05 07:36:44 3
Count the number of pages of all PDFs in current directory and all subdirs, recursively

This sums up the page count of multiple pdf files without the useless use of grep and sed which other commandlinefus use. Show Sample Output
This is sample output - yours may be different.
```
78
```
0

find -iname "*.pdf" -exec pdfinfo -meta {} \;|awk '{if($1=="Pages:"){s+=$2}}END{print s}'

Barabbas · 2011-12-13 15:02:11 3
list all users with UID bigger than 999 in /etc/passwd

To distinguish normal users from system users. Specify an UID, to list all all users with UID bigger than that in /etc/passwd.
This is sample output - yours may be different.
0

awk -F: '$3 > 999 { print $1 }' /etc/passwd

rockenrola · 2011-12-30 14:47:10 3
Show WebSphere AppServer uid|pid|cell|node|jvms

Tested in bash on AIX & Linux, used for WAS versions 6.0 & up. Sorts by node name. Useful when you have vertically-stacked instances of WAS/Portal. Cuts out all the classpath/optional parameter clutter that makes a simple "ps -ef | grep java" so difficult to sort through. Show Sample Output
This is sample output - yours may be different.
```
wasguy      14221350   ExampleCell1    Node1       WebSphere_Portal
wasguy      11141130   ExampleCell1    Node1       WebSphere_Portal_3
wasguy      11665646   ExampleCell1    Node1       nodeagent
wasguy      1769816    ExampleCell2    Node2       WebSphere_Portal
wasguy      10289222   ExampleCell2    Node2       WebSphere_Portal_3
wasguy      11665646   ExampleCell2    Node2       nodeagent
```
0

ps -ef | grep [j]ava | awk -F ' ' ' { print $1," ",$2,"\t",$(NF-2),"\t",$(NF-1),"\t",$NF } ' | sort -k4

drockney · 2012-01-05 16:05:48 3
diff two css files to create an overriding css (e.g. for wordpress child themes)

This will extract the differing CSS entries of two files. I've left the initial character (plus or space) in output to show the real differing line, remove the initial character to get a working CSS file. The output CSS file is usable by either adding it in a below the to original.css, or by only using the output but adding @import url("original.css"); in the beginning. This is very useful for converting Wordpress theme copies into real Wordpress child themes. Could exclude common lines within entries too, I guess, but that might not be worth the complexity. Show Sample Output
This is sample output - yours may be different.
```
+++ style.css	2012-01-12 08:33:13.486877866 +0100
@@ -1,1324 +1,1427 @@
 /* =Layout
 -------------------------------------------------------------- */
 
 /*
 LAYOUT: Two columns
 DESCRIPTION: Two-column fixed layout with one sidebar right of content
 */
 
 #container {
 	float: left;
+	margin: 0 -240px 0 38px;
 	width: 100%;
 }

 #content {
+	margin: 0 250px 0 0px;
 }
```
0

diff -U99999 original.css modified.css | awk '/^-/{next} {f=f"\n"$0} /^\+.*[^ ]/{yes=1} /}/ {if(yes){print f} f="";yes=0}'

unhammer · 2012-01-12 07:57:22 4
Show CPU idle and used time

This command displays the CPU idle + used time using stats from /proc/stat. Show Sample Output
This is sample output - yours may be different.
```
idle 	 used
72.4139% 21.1866%
```
0

grep "cpu " /proc/stat | awk -F ' ' '{total = $2 + $3 + $4 + $5} END {print "idle \t used\n" $5*100/total "% " $2*100/total "%"}'

Goez · 2012-01-21 04:12:50 3
Find files with size over 100MB and output with better lay-out

This command does a basic find with size. It also improves the printout given (more clearer then default) Adjusting the ./ will alter the path. Adjusting the "-size +100000k" will specify the size to search for. Show Sample Output
This is sample output - yours may be different.
```
goez@goez-laptop:~/test$ ls -sh
total 392M
102M 101MB_file  201M 200MB_file   91M 90MB_file
goez@goez-laptop:~/test$ find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'
./101MB_file : 101M
./200MB_file : 200M
```
0

find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'

Goez · 2012-01-21 04:19:35 5
Kill processes associated with PATTERN

Kill all process that concide whit PATTERN Show Sample Output
This is sample output - yours may be different.
```
kill 28310: No such process
```
0

ps -fea | grep PATTERN | awk {'print $2'} | xargs kill -9

luiscachog · 2012-01-27 20:31:36 3
Change time format in log, UNIX Timestamp to Human readable

It remove the square bracket and convert UNIX time to human readable time for all line of a stream (or file). Show Sample Output
This is sample output - yours may be different.
```
Input :
[1325199600] CURRENT SERVICE STATE: HOST01;Loopback;OK;HARD;1;Loopback0:UP:1 UP: OK
[1325199600] CURRENT SERVICE STATE: HOST01;Uptime Routers SFR;OK;HARD;1;Information only: 114 days

Ouput :
12/30/11 00:00:00 CURRENT SERVICE STATE: HOST01;Loopback;OK;HARD;1;Loopback0:UP:1 UP: OK
12/30/11 00:00:00 CURRENT SERVICE STATE: HOST01;Uptime Routers SFR;OK;HARD;1;Information only: 114 days
```
0

sed -r 's/(\[|])//g' | awk ' { $1=strftime("%D %T",$1); print }'

Zulu · 2012-02-03 13:07:37 4
See the total amount of data on an AIX machine

Not figured by me, but a colleague of mine. See the total amount of data on an AIX machine. Show Sample Output
This is sample output - yours may be different.
```
100 GB
```
0

print "$(lsvg -Lo |xargs lsvg -L|grep "TOTAL PPs"|awk -F"(" '{print$2}'|sed -e "s/)//g" -e "s/megabytes/+/g"|xargs|sed -e "s/^/(/g" -e "s/+$/)\/1000/g"|bc ) GB"

janvanderwijk · 2012-02-03 13:58:41 3
Output specific line in a very big file and exit afterwards

This will save parsing time for operations on very big files.
This is sample output - yours may be different.
0

awk 'FNR==100 {print;exit}' file

Testuser_01 · 2012-03-04 20:25:57 8
Get the total length of all video / audio in the current dir (and below) in H:m:s

Improvement on Coderjoe's Solution. Gets rid of grep and cut (and implements them in awk) and specifies some different mplayer options that speed things up a bit. Show Sample Output
This is sample output - yours may be different.
```
02:23:58
```
0

find /path/to/dir -iname "*.ext" -print0 | xargs -0 mplayer -really-quiet -cache 64 -vo dummy -ao dummy -identify 2>/dev/null | awk '/ID_LENGTH/{gsub(/ID_LENGTH=/,"")}{SUM += $1}END{ printf "%02d:%02d:%02d\n",SUM/3600,SUM%3600/60,SUM%60}'

DarkSniper · 2012-03-11 12:28:48 3
Print trending topics on Twitter

Prints top 5 twitter topics. Not very well written at all but none of the others worked.
This is sample output - yours may be different.
0

curl -s mobile.twitter.com/search | sed -n '/trend_footer_list/,/\ul>/p' | awk -F\> '{print $3}' | awk -F\< '{print $1}' | sed '/^$/d'

articmonkey · 2012-03-15 17:17:06 3
Show git branches by date - useful for showing active branches

Simpler and without all of the coloring gimmicks. This just returns a list of branches with the most recent first. This should be useful for cleaning your remotes. Show Sample Output
This is sample output - yours may be different.
```
master
testing
this-shit-works
```
0

for k in $(git branch | sed /\*/d); do echo "$(git log -1 --pretty=format:"%ct" $k) $k"; done | sort -r | awk '{print $2}'

dahuie · 2012-04-07 11:19:00 6
Get all links of a website
This is sample output - yours may be different.
0

lynx -dump http://www.domain.com | awk '/http/{print $2}' | egrep "^https{0,1}"

khaled_eng15 · 2012-04-23 10:41:02 3
‹ First < 7 8 9 10 11 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Check your spelling

For when you need a quick spell check.

Save the list of all available commands in your box to a file

When you press TAB twice in your prompt, bash tells you something like "Display all 4567 possibilities? (y or n)" But when you press "y" you only get the list in the terminal output and, if you want to save it to a file, you have to copy it by hand from the vterm screen. With this utility you save the list to a file or pipe it to another command at will You can use the file saved list to grep for a particular pattern, useful if you are searching for a command but you only remember a few letters

Converts to PDF all the OpenOffice.org files in the directory

Requieres unoconv (debian package)

Find recursively, from current directory down, files and directories whose names contain single or multiple whitespaces and replace each such occurrence with a single underscore.

Note the g for global in the perl expression; without it, only the first occurrence in the name would be replaced.

Annoying PROMPT_COMMAND animation

unset PROMPT_COMMAND to disable.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Save a file you edited in vim without the needed permissions

probably just like 1204, but uses tee as a filter (+ I actually understand how this one works)

Encoding from AVI to MPEG format

http://www.mplayerhq.hu/DOCS/HTML/en/menc-feat-mpeg.html MEncoder can create MPEG (MPEG-PS) format output files. Usually, when you are using MPEG-1 or MPEG-2 video, it is because you are encoding for a constrained format such as SVCD, VCD, or DVD. To change MEncoder's output file format, use the -of mpeg option. Creating an MPEG-1 file suitable to be played on systems with minimal multimedia support, such as default Windows installs: $ mencoder input.avi -of mpeg -mpegopts format=mpeg1:tsaf:muxrate=2000 \ -o output.mpg -oac lavc -lavcopts acodec=mp2:abitrate=224 -ovc lavc \ -lavcopts vcodec=mpeg1video:vbitrate=1152:keyint=15:mbd=2:aspect=4/3

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Define an alias with a correct completion

In Bash, when defining an alias, one usually loses the completion related to the function used in that alias (that completion is usually defined in /etc/bash_completion using the complete builtin). It's easy to reuse the work done for that completion in order to have smart completion for our alias. That's what is done by this command line (that's only an example but it may be very easy to reuse). Note 1 : You can use given command line in a loop "for old in apt-get apt-cache" if you want to define aliases like that for many commands. Note 2 : You can put the output of the command directly in your .bashrc file (after the ". /etc/bash_completion") to always have the alias and its completion

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by