All commands

All commands (14,187)

sorted by

Get all upgradable deb packages in a single line

Works for debian and ubuntu based distros. Show Sample Output

apt list --upgradable | grep -v 'Listing...' | cut -d/ -f1 | tr '\r\n' ' ' | sed '$s/ $/\n/'

bugmenot · 2019-12-13 16:16:19 214

VI/VIM Anonymize email address in log file

The number 5 means to replace the leading and trailing 5 characters of an "@" in a log file with XXXX@XXXXX.
This is sample output - yours may be different.
-2

%s/.\{5\}@.\{5\}/XXXXX@XXXXXX/g

dasmna · 2019-12-12 15:37:17 92
Print all git repos from a user (only curl and grep)
This is sample output - yours may be different.
2

curl -s https://api.github.com/users/<username>/repos?per_page=1000 | grep -oP '(?<="git_url": ").*(?="\,)'

acavagni · 2019-12-11 20:55:13 237
Show all current listening programs by port and pid with SS instead of netstat
This is sample output - yours may be different.
4

ss -plunt

symgryph · 2019-12-09 17:44:55 99
Identify all amazon cloudformation scripts recursively using ripgrep

This assumes you are in the cwd of where you put your s3 scripts. Its useful if someone decides to create aws cloudformation scripts and doesn't add the 'yaml' or .yml extension. Show Sample Output
This is sample output - yours may be different.
```
2019-12-05/1264/123123123/StackSet-MyCoolScriptlimitCheckStack-P9PAO5WIAKQA
2019-12-05/1264/23123231123/ServiceUsageLimitMonitor-20181121-limitMySadness
```
1

rg -l "AWSTemplateFormatVersion: '2010-09-09'" *

symgryph · 2019-12-09 17:43:10 240
Print all git repos from a user

Python is installed on many boxes (in case you could not afford installing jq).
This is sample output - yours may be different.
0

curl -s "https://api.github.com/users/<username>/repos?per_page=1000" | python <(echo "import json,sys;v=json.load(sys.stdin);for i in v:; print(i['git_url']);" | tr ';' '\n')

grault · 2019-12-07 10:49:58 106
Print all git repos from a user

in case you could afford installing jq
This is sample output - yours may be different.
1

curl -s "https://api.github.com/users/<username>/repos?per_page=1000" | jq '.[].git_url'

grault · 2019-12-07 10:48:32 345
Convert CSV to JSON with miller

Using the csv tool `miller` you can transform a csv file into a json array of objects, where the properties are the values of the csv header line and the values are the values of the subsequent lines. Show Sample Output
This is sample output - yours may be different.
```
[
 { "H1": "a1", "H2": "a2", "H3": "a3" },
 { "H1": "b1", "H2": "b2", "H3": "b3" },
 { "H1": "c1", "H2": "c2", "H3": "c3" }
]
```
2

mlr --c2j --jlistwrap cat file.csv

pepa65 · 2019-12-06 07:16:58 107
Show top 50 running processes ordered by highest memory/cpu usage refreshing every 1s

http://alvinalexander.com/linux/unix-linux-process-memory-sort-ps-command-cpu for an overview of --sort available values
This is sample output - yours may be different.
6

watch -n1 "ps aux --sort=-%mem,-%cpu | head -n 50"

jgleeson · 2019-12-03 20:51:03 248

grep for minus (-) sign

Use flag "--" to stop switch parsing Show Sample Output

grep -- -

knoppix5 · 2019-11-29 23:45:06 112

Print all git repos from a user
This is sample output - yours may be different.
14

curl -s https://api.github.com/users/<username>/repos?per_page=1000 |grep git_url |awk '{print $2}'| sed 's/"$.*$",/\1/'

wuseman1 · 2019-11-19 20:31:19 262
create a nicely formatted example of a shell command and its output

Shell function which takes a bash command as its input, and displays the following formatted output: EXAMPLE: command OUTPUT: output from command Show Sample Output
This is sample output - yours may be different.
```
EXAMPLE:

    example ls -l

OUTPUT:

    EXAMPLE:
    
        ls -l
    
    OUTPUT:
    
        total 0
        -rw-rw-r-- 1 bartonc bartonc 0 Nov 10 13:58 a
        -rw-rw-r-- 1 bartonc bartonc 0 Nov 10 13:58 b
        -rw-rw-r-- 1 bartonc bartonc 0 Nov 10 13:58 c
```
8

example() { echo "EXAMPLE:"; echo; echo " $@"; echo; echo "OUTPUT:"; echo ; eval "$@" | sed 's/^/ /'; }

bartonski · 2019-11-10 19:08:23 126
Host cpu performance

Measure the cpu performance: In-case if the cpu is thermal throttling then you can find it using this command. Check the first line of the output. Example: Doing md5 for 3s on 16 size blocks: 11406892 md5's in 2.98s ? #(When cpu is not throttling) Doing md5 for 3s on 16 size blocks: 110692 md5's in 2.98s ?? #(When cpu is thermal throttling) Practical use case: Once we had cooling outage in data center which caused thermal throttling in some of the worker nodes. We used this tool to prove that some servers are not performing well because of the cpu thermal throttling. Show Sample Output
This is sample output - yours may be different.
```
Doing md5 for 3s on 16 size blocks: 11406892 md5's in 2.98s
Doing md5 for 3s on 64 size blocks: 8479926 md5's in 2.99s
Doing md5 for 3s on 256 size blocks: 4800618 md5's in 2.99s
Doing md5 for 3s on 1024 size blocks: 1719000 md5's in 2.98s
Doing md5 for 3s on 8192 size blocks: 249448 md5's in 2.99s
```
10

openssl speed md5

kharthigeyan · 2019-11-07 16:30:30 117
Make window transparent (50% opacity) in Gnome shell

Click window to change its opacity. Source: https://unix.stackexchange.com/a/494289
This is sample output - yours may be different.
1

xprop -format _NET_WM_WINDOW_OPACITY 32c -set _NET_WM_WINDOW_OPACITY 0x7FFFFFFF

yoyoyojomo · 2019-10-31 20:44:21 84
Set RGB gamma of secondary monitor

This command first determines whether a second screen is connected. If this is the case, it sets the screen's RGB gamma via xrandr. Useful for cheap or slightly defective monitors with a tint. In this example a yellowing/champagne color deviation is compensated for by decreasing the red and the green portion of the image.
This is sample output - yours may be different.
1

secondscreen=$(xrandr -q | grep " connected" | sed -n '2 p' | cut -f 1 -d ' '); [ "$secondscreen" ] && xrandr --output $secondscreen --gamma 0.6:0.75:1

lordtoran · 2019-10-28 13:12:08 308
Massive change of file extension (bash)

Change the file extension in batch. Useful to create output file names with same input name but distinct extension by including logic inside the loop
This is sample output - yours may be different.
2

for file in *.txt; do mv "$file" "${file%.txt}.xml"; done

neomefistox · 2019-10-24 04:35:10 214
Find dupe files by checking md5sum
This is sample output - yours may be different.
6

find /glftpd/site/archive -type f|grep '([0-9]\{1,9\})\.[^.]\+$'|parallel -n1 -j200% md5sum ::: |awk 'x[$1]++ { print $2 " :::"}'|sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,'

wuseman1 · 2019-10-22 16:02:15 150
Countdown Clock

I find the other timers are inaccurate. It takes some microseconds to perform the date function. Therefore, using date/time math to calculate the time for us results in millisecond accuracy. This is tailored to the BusyBox date function. May need to change things around for GNU date function. Show Sample Output
This is sample output - yours may be different.
```
00:03:00
```
-1

let T=$(date +%s)+3*60;while [ $(date +%s) -le $T ]; do let i=$T-$(date +%s); echo -ne "\r$(date -d"0:0:$i" +%H:%M:%S)"; sleep 0.3; done

davidk · 2019-10-22 15:04:21 141

Top 10 Memory Processes (reduced output to applications and %usage only)

Top 10 Memory Processes (reduced output to applications and %usage only) Show Sample Output

ps aux | sort -rk 4,4 | head -n 10 | awk '{print $4,$11}'

n0a110w · 2019-10-20 22:52:55 181

Console clock

You will see it on the corner of your running terminal. Show Sample Output
This is sample output - yours may be different.
```
 Sun Oct 20 05:48:44 JST 2019
```
7

while sleep 1; do tput sc; tput cup 0 $(($(tput cols)-29)); date; tput rc; done &

rakibfiha · 2019-10-19 20:50:48 107
Hide or show Desktop Icons on MacOS

Hides all Files and Folders on the MacOS Desktop. To show files and folders, type "true" instead of "false". "Finder" at the end is case sensitive, "finder" doesn’t work
This is sample output - yours may be different.
2

defaults write com.apple.finder CreateDesktop -bool false;killall Finder

vranx · 2019-10-18 12:13:56 111
Rename all files in a directory to the md5 hash
This is sample output - yours may be different.
2

for i in *; do sum=$(md5sum $i); mv -- "$i" "${sum%% *}"; done

malsploit · 2019-10-17 08:46:22 90

Print github url for the current url

Works for repos cloned via ssh or https. Show Sample Output

git remote -v | sed -n '/github.com.*push/{s/^[^[:space:]]\+[[:space:]]\+//;s|git@github.com:|https://github.com/|;s/\.git.*//;p}'

bartonski · 2019-10-11 16:50:22 265

List the binaries installed by a Debian package

GNU grep's perl-compatible regular expression(PCRE).
This is sample output - yours may be different.
1

binaries () { dpkg -L "$1" | grep -Po '.*/bin/\K.*'; }

metropolis · 2019-10-05 10:52:15 177
List the binaries installed by a Debian package

This shell function displays a list of binaries contained in an installed package; works on Debian based Linux distributions. Show Sample Output
This is sample output - yours may be different.
```
$ binaries findutils
find
xargs
```
1

binaries () { for f in $(dpkg -L "$1" | grep "/bin/"); do basename "$f"; done; }

lordtoran · 2019-10-05 10:37:51 439
‹ First < 9 10 11 12 13 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Getting the ip address of eth0

Parse a quoted .csv file

The $2, $3, $4 fields are arbitrary but note that the first field starts from $2 and the last field is $NF-1. This is due to the fact that the leading and trailing quotes are treated as field delimiters.

Schedule a script or command in x num hours, silently run in the background even if logged out

doesn't require "at", change the "2h" to whatever you want... (deafult unit for sleep is seconds)

Grab just the title of a youtube video

There's another version on here that uses GET but some people don't have lwp-request, so here's an alternative. It's also a little shorter and should work with most youtube URLs since it truncates at the first &

Expand shortened URLs

curl(1) is more portable than wget(1) across Unices, so here is an alternative doing the same thing with greater portability. This shell function uses curl(1) to show what site a shortened URL is pointing to, even if there are many nested shortened URLs. This is a great way to test whether or not the shortened URL is sending you to a malicious site, or somewhere nasty that you don't want to visit. The sample output is from: $ expandurl http://t.co/LDWqmtDM

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Show total size of each subdirectory, broken down by KB,MB,GB,TB

about how using internal separate field and store file content on variable

Find total Terabytes written to a SSD

You must have smartmontools installed for this to work. This also assumes you 512 byte sector sizes, this is pretty standard.

Start a SOCKS proxy to avoid a restrictive firewall

You may go to Internet by means of your home ssh server. You must configure your local proxy to send traffic through the proxy. Many programs allows that: firefox, pidgin, skype, gnome, etc. Your home ssh server must listen in any of the ports permitted by your enterprise firewall. That usually includes 80 and 443.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)

All commands (14,187) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

All commands (14,187)

sorted by