Commands using sort sorted by votes

Commands using sort (800)

sorted by

list human readable files

include in the list human readable hidden files too: file .* *|grep 'ASCII text'|sort -rk2 more reliable command: ls|xargs file|grep 'ASCII text'|sort -rk2 and include hidden files: ls -a|xargs file|grep 'ASCII text'|sort -rk2
This is sample output - yours may be different.
1

file *|grep 'ASCII text'|sort -rk2

knoppix5 · 2019-08-23 00:47:07 149
List packages manually installed with process currently running

Sometimes we install programs, we forget about them, and they stay there wasting RAM. This one-liner try to find them. Show Sample Output
This is sample output - yours may be different.
```
atom
virtualbox
bluez
mosquitto
teamviewer
```
1

ps -eo cmd | awk '{print $1}'| sort -u | grep "^/" | xargs dpkg -S 2>/dev/null | awk -F: '{print $1}' | sort -u | xargs apt-mark showmanual

pabloab · 2020-03-26 06:16:45 81
Download mp3 files linked in a RSS podcast feed

Directly download all mp3 files of the desired podcast
This is sample output - yours may be different.
1

curl http://radiofrance-podcast.net/podcast09/rss_14726.xml | grep -Eo "(http|https)://[a-zA-Z0-9./?=_%:-]*mp3" | sort -u | xargs wget

pascalvaucheret · 2021-08-09 13:40:26 181
Find failures with journalctl

Sometimes things break. You can find the most recent errors using a combination of journalctl, along with the classic tools sort and uniq Show Sample Output
This is sample output - yours may be different.
```
898172 "/usr/bin/dockerd"
    752 "/usr/local/sbin/node_exporter"
     30 "/usr/bin/gnome-shell"
     26 "/usr/bin/cat"
     22 "/usr/libexec/gsd-media-keys"
[...]
```
1

journalctl --no-pager --since today --grep 'fail|error|fatal' --output json | jq '._EXE' | sort | uniq -c | sort --numeric --reverse --key 1

mikhail · 2021-12-22 22:27:17 214
Shows the largest files in your archives
This is sample output - yours may be different.
0

tar -tvjf backup.tar.bz2 | sort -nrk 3 | head

Sekenre · 2009-02-05 11:57:18 89
List RPM packages installed in current tree

shows all RPMs with files in the current directory & its subdirectories.
This is sample output - yours may be different.
0

find $PWD -exec rpm --query -f {} \; | sort -u | grep -v "not owned"

wwest4 · 2009-02-05 19:33:43 20
file sizes of current directory
This is sample output - yours may be different.
0

ls -la | awk '{print $5, " " ,$9}' | sort -rn

mnikhil · 2009-02-07 18:49:56 13
Sorting by rows

Save the script as: sort_file Usage: sort_file < sort_me.csv > out_file.csv This script was originally posted by Admiral Beotch in LinuxQuestions.org on the Linux-Software forum. I modified this script to make it more portable. Show Sample Output
This is sample output - yours may be different.
```
Sort values arranged in rows, like:
x3, x5, x1, x4, x7, x2, x6
x11, x13, x14, x8, x10, x12, x9
... ... ... ... ... ... ...
After executing the script, values will be horizontally sorted:
x1, x2, x3, x4, x5, x6, x7
x8, x9, x10, x11, x12, x13, x14
... ... ... ... ... ... ...
where x1, x2, ..., xn are integers
Each row can have n integers and 
x1 < x2 < x3, ..., < x7
x8 < x9 < x10, ..., < x14
..   ..   ..           ..
After executing the script, each row will be sorted in ascending order.
```
0

infile=$1 for i in $(cat $infile) do echo $i | tr "," "\n" | sort -n | tr "\n" "," | sed "s/,$//" echo done

iframe · 2009-07-12 21:23:37 6
Create a file list of all package files installed on your Red-Hat-like system for easy grepping

This will create the file /tmp/pkgdetails, which will contain a listing of all the files installed on your RPM-based system (RedHat, Fedora, CentOS, etc). Useful should the RPM system/database become corrupted to find which package installed which files.
This is sample output - yours may be different.
0

for i in `rpm -qva | sort ` ; do ; echo "===== $i =====" ; rpm -qvl $i ; done > /tmp/pkgdetails

tkunz · 2009-07-14 20:34:55 9
Lists unambigously names of all xml elements used in files in current directory

This one will work a little better, the regular expressions it is not 100% accurate for XML parsing but it will suffice any XML valid document for sure. Show Sample Output
This is sample output - yours may be different.
```
a
b
body
br
center
div
fieldset
font
form
func:function
func:result
h1
h2
h4
head
html
i
img
input
label
li
link
meta
noscript
option
p
sc
script
select
span
strong
style
table
tbody
td
textarea
th
title
tr
ul
xsl:apply-templates
xsl:attribute
xsl:call-template
xsl:choose
xsl:copy-of
xsl:for-each
xsl:if
xsl:include
xsl:otherwise
xsl:param
xsl:stylesheet
xsl:template
xsl:text
xsl:value-of
xsl:variable
xsl:when
xsl:with-param
```
0

grep -Eho '<[a-ZA-Z_][a-zA-Z0-9_-:]*' * | sort -u | cut -c2-

inkel · 2009-08-05 21:54:29 3
purge old stale messages on a qmail queue
This is sample output - yours may be different.
0

for i in `grep "unable to stat" /var/log/syslog | cut -d "/" -f 3 | sort | uniq`; do find /var/qmail/queue -name $i -type f -exec rm -v {} \; ; done

foob4r · 2009-08-21 22:03:39 3
List files and sizes

List files and sizes
This is sample output - yours may be different.
0

find / -type f -exec wc -c {} \; | sort -nr | head -100

hemanth · 2009-08-22 09:38:44 10
Search OpenSolaris packages and show only the pkg names

From there, just pkg install the package you need. Show Sample Output
This is sample output - yours may be different.
```
bob@mon01:/export/home/bob/carpet$ pkg search ruby | awk '{print $NF}' | sed -e 's;.*/$.*$\@.*;\1;' | sort -u
PACKAGE
SUNWDTraceToolkit
SUNWjruby
SUNWlibnb-ruby1
SUNWnetbeans-ruby
SUNWruby18
SUNWswig
libnb-ruby
netbeans
netbeans-ruby
ruby-dev
```
0

pkg search SEARCH_TERM | awk '{print $NF}' | sed -e 's;.*/$.*$\@.*;\1;' | sort -u

bpfx · 2009-09-06 23:27:49 3
Substitution cipher

This is just for fun. Show Sample Output
This is sample output - yours may be different.
```
yOCvVO RBTb
```
0

echo "Decode this"| tr [a-zA-Z] $(echo {a..z} {A..Z}|grep -o .|sort -R|tr -d "\n ")

dennisw · 2009-09-18 06:38:28 36
List your largest installed packages (on Debian/Ubuntu)

List packages and their disk usage in decreasing order. This uses the "Installed-Size" from the package metadata. It may differ from the actual used space, because e.g. data files (think of databases) or log files may take additional space. Show Sample Output
This is sample output - yours may be different.
```
342348  netbeans-ide
231728  kdelibs4-doc
121332  comixcursors
108796  openoffice.org-core
[...]
```
0

perl -ne '$pkg=$1 if m/^Package: (.*)/; print "$1\t$pkg\n" if m/^Installed-Size: (.*)/;' < /var/lib/dpkg/status | sort -rn | less

hfs · 2009-10-19 12:55:59 7
Sort movies by length, longest first

Similar but using mediainfo instead of totem-something
This is sample output - yours may be different.
0

for i in *.avi; do echo -n "$i:";mediainfo $i|head | grep PlayTime | cut -d: -f2 ; done | sort -t: -k2 -r

yooreck · 2009-11-09 12:42:20 3
Show sorted list of files with sizes more than 1MB in the current dir

GNU find + sort
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f -size +1M -printf "%f:%s\n" | sort -t":" -k2

unixmonkey7109 · 2009-11-21 03:47:39 3
Create unique email addresses directly from the US census site*Full command in comments

** Replace the ... in URLS with: www.census.gov/genealogy/www/data/1990surnames Couldn't fit in 256 Created on Ubuntu 9.10 but nothing out of the ordinary, should work anywhere with a little tweaking. 5163 is the number of unique first names you get when combine the male and female first name files from. http://www.census.gov/genealogy/www/data/1990surnames/names_files.html Show Sample Output
This is sample output - yours may be different.
```
stasia.palmer@test.domain
mozell.sybounheuan@test.domain
yuki.nypaver@test.domain
annamae.tilbury@test.domain
jaimee.warfield@test.domain
cassidy.mchugh@test.domain
daniele.makey@test.domain
ivelisse.besancon@test.domain
marylin.kocher@test.domain
```
0

paste -d "." <(curl http://.../dist.female.first http://.../dist.male.first | cut -d " " -f 1 | sort -uR) <(curl http://..../dist.all.last | cut -d " " -f 1 | sort -R | head -5163) | tr "[:upper:]" "[:lower:]" | sed 's/$/@test.domain/g'

connorsy · 2010-01-21 19:52:28 3
Linux zsh one-liner to Determine which processes are using the most swap space currently

Col 1 is swapped sum in kb Col 2 is pid of process Col 3 is command that was issued Show Sample Output
This is sample output - yours may be different.
```
 4428 9187 python/usr/share/system-config-printer/applet.py
 2012 9163 gnome-panel
 1516 9127 /usr/lib/gnome-settings-daemon/gnome-settings-daemon
 1408 18899 /usr/lib/gvfs/gvfsd-smb--spawner:1.9/org/gtk/gvfs/exec_spaw/4
 1040 1681 gnome-terminal
```
0

for i in $(ps -ef | awk '{print $2}') ; { swp=$( awk '/Swap/{sum+=$2} END {print sum}' /proc/$i/smaps ); if [[ -n $swp && 0 != $swp ]] ; then echo -n "\n $swp $i "; cat /proc/$i/cmdline ; fi; } | sort -nr

cbrinker · 2010-01-22 00:09:46 11
Find Duplicate Files (based on size first, then MD5 hash)

A bit shorter and parallelized. Depending on the speed of your cpu and your disk this may run faster. Parallel is from https://savannah.nongnu.org/projects/parallel/
This is sample output - yours may be different.
0

find -not -empty -type f -printf "%s\n" | sort | uniq -d | parallel find -type f -size {}c | parallel md5sum | sort | uniq -w32 --all-repeated=separate

unixmonkey8046 · 2010-01-28 08:40:18 4
Poor man's unsort (randomize lines)

If you need to randomize the lines in a file, but have an old sort commands that doesn't support the -R option, this could be helpful. It's easy enough to remember so that you can create it as a script and use that. It ain't real fast. It ain't safe. It ain't super random. Do not use it on untrusted data. It requires bash for the $RANDOM variable to work. Show Sample Output
This is sample output - yours may be different.
```
$ echo -e a\\nb\\nc | while read l; do echo $RANDOM "$l"; done | sort -n | cut -d " " -f 2-
c
a
b
```
0

while read l; do echo $RANDOM "$l"; done | sort -n | cut -d " " -f 2-

ketil · 2010-02-03 22:36:34 4
Count and show duplicate file names

Useful for C projects where header file names must be unique (e.g. when using autoconf/automake), or when diagnosing if the wrong header file is being used (due to dupe file names) Show Sample Output
This is sample output - yours may be different.
```
[user@localhost]$ find . -type f  |sed "s#.*/##g" |sort |uniq -c -d
      2 globals.h
      9 Makefile
      8 Makefile.bak
```
0

find . -type f |sed "s#.*/##g" |sort |uniq -c -d

shadycraig · 2010-02-17 11:59:54 5
sort selected lines in a text file to the beginning or end of the file.

This function is used to sort selected lines of a text file to the end of that file. Especially useful in cases where human intervention is necessary to sort out parts of a file. Let's say that you have a text file which contains the words rough slimy red fluff dough For whatever reason, you want to sort all words rhyming with 'tough' to the bottom of the file, and all words denoting colors to the top, while keeping the order of the rest of the file intact. '$EDITOR' will open, showing all of the lines in the given file, numbered with '0' padding. Adding a '~' to the beginning of the line will cause the line to sort to the end of the file, adding '!' will cause it to sort to the beginning. Show Sample Output
This is sample output - yours may be different.
```
$ 2end /tmp/2end.txt
~000001 rough
000002  slimy
!000003 red
~000004 fluff
000005  dough
$ cat /tmp/2end.txt 
red
slimy
dough
rough
fluff
```
0

2end () ( export LC_ALL=C; nl -n rz $1 > $1.tmp; ${EDITOR:-vi} $1.tmp; sort $1.tmp | sed -r 's/^.*[0-9]+\t+//' > $1; rm $1.tmp; )

bartonski · 2010-03-06 23:02:28 6
Count repeated lines, listing them in descending order of frequency

Finds all (not just adjacent) repeated lines in a file. Show Sample Output
This is sample output - yours may be different.
```
      6 G
      6 E
      6 C
      6 A
      4 F
      4 D
      4 B
      4 0.5
      4 0.1
      2 1
      2 0.9
      2 0.7
      2 0.4
      2 0.2
```
0

LC_ALL=C sort file | uniq -c | sort -n -k1 -r

drmaciver · 2010-03-23 12:09:04 3
Dump an rpm's package details (besides the files)

If you want to relocate a package on your own, or you just want to know what those PREIN/UN and POSTIN/UN scripts will do, this will dump out all that detail simply. You may want to expand the egrep out other verbose flags like CHANGELOGTEXT etc, as your needs require. It isn't clear, but the formatting around $tag is important: %{$tag} just prints out the first line, while [%{$tag }] iterates thru multi-line output, joining the lines with a space (yes, there's a space between the g and } characters. To break it out for all newlines, use [%{$tag\n}] but the output will be long. This is aside from rpm2cpio | cpio -ivd to extract the package files.
This is sample output - yours may be different.
0

rpm --querytags | egrep -v HEADERIMMUTABLE | sort | while read tag ; do rpm -q --queryformat "$tag: [%{$tag} ]\n" -p $SomeRPMfile ; done

DoNotRememberMe · 2010-03-25 05:40:48 3
‹ First < 15 16 17 18 19 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Compress and store the image of a disk over the network

Create an image of "device" and send it to another machine through the network ("target" and "port" sets the ip and port the stream will be sent to), outputting a progress bar On the machine that will receive, compress and store the file, use: $nc -l -p | 7z a -si -m0=lzma2 -mx=9 -ms=on Optionally, add the -v4g switch at the end of the line in order to split the file every 4 gigabytes (or set another size: accepted suffixes are k, m and g). The file will be compressed using 7z format, lzma2 algorithm, with maximum compression level and solid file activated. The compression stage will be executed on the machine which will store the image. It was planned this way because the processor on that machine was faster, and being on a gigabit network, transfering the uncompressed image wasn't much of a problem.

DELETE all those duplicate files but one based on md5 hash comparision in the current directory tree

This one-liner will the *delete* without any further confirmation all 100% duplicates but one based on their md5 hash in the current directory tree (i.e including files in its subdirectories). Good for cleaning up collections of mp3 files or pictures of your dog|cat|kids|wife being present in gazillion incarnations on hd. md5sum can be substituted with sha1sum without problems. The actual filename is not taken into account-just the hash is used. Whatever sort thinks is the first filename is kept. It is assumed that the filename does not contain 0x00. As per the good suggestion in the first comment, this one does a hard link instead: $ find . -xdev -type f -print0 | xargs -0 md5sum | sort | perl -ne 'chomp; $ph=$h; ($h,$f)=split(/\s+/,$_,2); if ($h ne $ph) { $k = $f; } else { unlink($f); link($k, $f); }'

List all files ever added in git repository

Watch the progress of 'dd'

Pressing ctrl-t will display the progress

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Split and join with split and cat.

`split -b 1k file` splits files into 1k chunks. Rejoin them with `cat x* > file`.

Get a list of all your VirtualBox virtual machines by name and UUID from the shell

A similar command that lists only the currently running VMs is thus: $ VBoxManage list runningvms ...the above showing a list of VMs by name and UUID in the same format as the "$ VBoxManage list vms" command

Download full FLAC albums from archive.org

The only zipped version of an album available for download is the lossy mp3 version. To download lossless files, because of their size, you must download them individually. This command scrapes the page for all the FLAC (or also SHN) files.

find . -name

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sort

Commands using sort (800) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sort (800)

sorted by