Commands by bugmenot

Commands by bugmenot (81)

sorted by

Copy a file with progress and save hash to a different file
This is sample output - yours may be different.
4

pv file.txt | tee >(sha1sum > file.sha1) > file-copy.txt

bugmenot · 2022-11-24 20:23:02 630
Clean or clean pacman and pamac cache
This is sample output - yours may be different.
0

sudo pacman -Scc && pamac clean -b

bugmenot · 2022-08-24 19:10:38 347
How to sum lines with decimals in awk

Read all lines using decimal marker as point, then add all them up and outputs the result. Show Sample Output
This is sample output - yours may be different.
```
2598.5
```
4

awk '{a+=$0}END{print a}' file

bugmenot · 2022-08-15 23:04:31 305
Extract content between the first " and the last " double quotes

Thanks to this user: https://stackoverflow.com/a/35636373/2394635 Show Sample Output
This is sample output - yours may be different.
```
checkin_resumestorevisit \"- "Online_V2.mt
```
1

s='Test "checkin_resumestorevisit \"- "Online_V2.mt" Run'; s=${s#*'"'}; s=${s%'"'*}; echo "$s"

bugmenot · 2022-01-08 16:16:18 227
List all installed kernels on Ubuntu except current one

Lists all installed kernels minus the current one. This is useful to uninstall older kernels that take too much space on /boot partition. Show Sample Output
This is sample output - yours may be different.
```
linux-image-5.11.0-38-generic
linux-modules-5.11.0-38-generic
linux-modules-extra-5.11.0-38-generic
```
4

dpkg -l 'linux-*' | sed '/^ii/!d;/'"$(uname -r | sed "s/$.*$-$[^0-9]\+$/\1/")"'/d;s/^[^ ]* [^ ]* $[^ ]*$.*/\1/;/[0-9]/!d'

bugmenot · 2021-10-30 22:32:29 238
Get all lines that start with a dot or period

Read a file or standard input and only outputs lines that start with a dot or period "." Show Sample Output
This is sample output - yours may be different.
```
.config
```
0

grep '^\.' file

bugmenot · 2021-08-22 16:04:11 160
Get a range on line with sed (first two)

Get the two first lines of a file and quit. Show Sample Output
This is sample output - yours may be different.
```
first-line
second-line
```
3

sed -n '1,2p;3q' file

bugmenot · 2021-07-16 07:29:15 138
Remove all the characters before last space per line including it
This is sample output - yours may be different.
1

echo 'The quick brown fox jumps over the lazy dog' | sed 's|.* ||'

bugmenot · 2021-07-16 07:17:08 116
Get line number 12 (or n) from a file

Extracts only file number 12 from file. It's meant for text files. Replace 12 with the number you want. First line starts at 1 not 0. We use q on next line so doesn't process any line more.
This is sample output - yours may be different.
2

sed -n '12p;13q' file

bugmenot · 2021-07-15 20:13:05 140
Replace all forward slashes with backward slashes

Use -i option to edit directly a file: sed -i 's|\/|\\|g' file Show Sample Output
This is sample output - yours may be different.
```
\usr\bin\
```
3

echo '/usr/bin/' | sed 's|\/|\\|g'

bugmenot · 2021-07-15 20:09:34 164
Replace all backward slashes with forward slashes

Use -i to edit file directly: sed -i 's|\\|\/|g' file Show Sample Output
This is sample output - yours may be different.
```
C:/Windows/
```
2

echo 'C:\Windows\' | sed 's|\\|\/|g'

bugmenot · 2021-07-15 20:07:37 123
Remove all the characters after last space per line including it

It his example removes ' dog', last space included. Show Sample Output
This is sample output - yours may be different.
```
The quick brown fox jumps over the lazy
```
0

echo 'The quick brown fox jumps over the lazy dog' | sed 's|$.*$ .*|\1|'

bugmenot · 2021-07-15 20:01:32 99
Download screenshot or frame from YouTube video at certain timestamp

Downloads the frame of given YouTube video at 8 minutes 14 seconds. Requested format is "299", which 1080p only video.
This is sample output - yours may be different.
-1

ffmpeg -ss 8:14 -i $(youtube-dl -f 299 --get-url URL) -vframes 1 -q:v 2 out.jpg

bugmenot · 2021-07-06 10:59:49 130
Print lines in a text file with numbers in first column higher or equal than a value

A text file contains thousands of numbers. This command prints lines were the number is greater or equal than a specified value (134000000). Show Sample Output
This is sample output - yours may be different.
```
134013941.402859
134298679.533591
134694074.478486
```
1

awk '$NF >= 134000000 {print $0}' single-column-numbers.txt

bugmenot · 2021-06-30 07:48:47 119
Calculate the mean or average of a single column of numbers in a text file

single-column-numbers.txt is a text file with 22658 rows (numbers) in a single column. Each number can range from 0 to 134298679.533591 and the dot is for the decimals. This is done with perl because awk can't sum such high numbers. Show Sample Output
This is sample output - yours may be different.
```
87553740.0874476
```
1

perl -lane '$total += $F[0]; END{print $total/$.}' single-column-numbers.txt

bugmenot · 2021-06-30 07:45:56 91

Remove all cached images for icons related to your profile

Run inside Command Prompt (cmd.exe) as admin. Note that you must close explorer.exe first, and even so some files will not be deleted, will say "Access is denied." To definitely delete them enter with another admin user or from other operating system and access the drive. Show Sample Output

DEL /F /S /Q /A %LocalAppData%\Microsoft\Windows\Explorer\thumbcache_*.db

bugmenot · 2020-03-27 16:53:23 59

Get all upgradable deb packages in a single line

Works for debian and ubuntu based distros. Show Sample Output

apt list --upgradable | grep -v 'Listing...' | cut -d/ -f1 | tr '\r\n' ' ' | sed '$s/ $/\n/'

bugmenot · 2019-12-13 16:16:19 35

List all ubuntu installed packages in a single line

This command lists all currently installed packages in ubuntu in a single line, for example to use later with apt install. Show Sample Output

bugmenot · 2019-08-26 15:16:21 37

delete at start of each line until character

Delete the beginning of each line until first match of given character, in this case it's ":" Does it on all lines. The given character is deleted also, and can be a space.
This is sample output - yours may be different.
0

sed 's/^[^:]*://g'

bugmenot · 2019-08-21 01:02:56 93
Remove all matches containing a string until its next space

Remove all arguments related to linux kernel from a list which uses space as item separator.
This is sample output - yours may be different.
0

sed 's/linux-[^ ]* \{0,1\}//g' /path/to/file

bugmenot · 2019-04-01 19:35:47 25
Extract thumbnails from EXIF metadata

It will generate a new file ending with "_ThumbnailImage.jpg" which is the embedded thumbnail inside the JPG for example.
This is sample output - yours may be different.
0

exiftool -a -b -W %d%f_%t%-c.%s -preview:all YourFileOrDirectory

bugmenot · 2018-07-26 09:41:08 75
Get the Volume labels all bitlocker volumes had before being encrypted

Get information of volume labels of bitlocker volumes, even if they are encrypted and locked (no access to filesystem, no password provided). Note that the volume labels can have spaces, but only if you name then before encryption. Renaming a bitlocker partition after being encrypted does not have the same effect as doing it before. Show Sample Output
This is sample output - yours may be different.
```
BitLocker Volume labels:
/dev/nvme0n1p3 -> "OS_Install"
/dev/sda1 -> "DATA"
/dev/sdb1 -> "MY PEN"
```
2

sudo echo "BitLocker Volume labels:" && sudo dislocker-find | xargs -I{} sh -c 'echo -n "{} ->+ " ; sudo dislocker-metadata -V {} | grep string' | sed 's/+.*string://' | sed "s/'[^ ]* /\"/g" | sed 's/\ [^ ]*$/"/'

bugmenot · 2018-04-29 01:00:11 31
list block devices

Shows all block devices in a tree with descruptions of what they are.
This is sample output - yours may be different.
5

sudo lsblk -o name,type,fstype,label,partlabel,model,mountpoint,size

bugmenot · 2018-04-25 00:16:39 27
Grep live log tailing
This is sample output - yours may be different.
0

tail -f some_log_file.log | grep the_thing_i_want

bugmenot · 2018-01-21 01:27:56 15
Ad blocking on Ubuntu phone/tablet with hosts file

Will append lines to the hosts file to do some basic ad blocking.
This is sample output - yours may be different.
4

sudo mount -o remount,rw / && sudo cp /etc/hosts /etc/hosts.old && wget http://winhelp2002.mvps.org/hosts.txt && cp /etc/hosts ~/ && cat hosts.txt >> hosts && sudo cp hosts /etc/hosts

bugmenot · 2016-06-06 15:01:19 9
1 2 3 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Run a command when a file is changed

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

What is my public IP address

Clean output, if used in scripts: $ GET checkip.dyndns.org|grep -o '[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}' or $ GET icanhazip.com

find duplicate processes

This command will allow to search for duplicate processes and sort them by their run count. Note that if there are same processes run by different users you'll see only one user in the result line, so you'll need to do: $ ps aux | grep to see all users that run this command.

list files recursively by size

Print trending topics on Twitter

Print current running shell, PID

works as well as echo $0, but also prints process id, which pts you're using. echo $SHELL doesn't always get updated when changing shells, so this is a better solution than that. Just one more variation on a theme.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Alias TAIL for automatic smart output

Run the alias command, then issue $ps aux | tail and resize your terminal window (putty/console/hyperterm/xterm/etc) then issue the same command and you'll understand. $ ${LINES:-`tput lines 2>/dev/null||echo -n 12`} Insructs the shell that if LINES is not set or null to use the output from `tput lines` ( ncurses based terminal access ) to get the number of lines in your terminal. But furthermore, in case that doesn't work either, it will default to using the default of 80. The default for TAIL is to output the last 10 lines, this alias changes the default to output the last x lines instead, where x is the number of lines currently displayed on your terminal - 7. The -7 is there so that the top line displayed is the command you ran that used TAIL, ie the prompt. Depending on whether your PS1 and/or PROMPT_COMMAND output more than 1 line (mine is 3) you will want to increase from -2. So with my prompt being the following, I need -7, or - 5 if I only want to display the commandline at the top. ( http://www.askapache.com/linux/bash-power-prompt.html ) 275MB/748MB [7995:7993 - 0:186] 06:26:49 Thu Apr 08 [askapache@n1-backbone5:/dev/pts/0 +1] ~ $ In most shells the LINES variable is created automatically at login and updated when the terminal is resized (28 linux, 23/20 others for SIGWINCH) to contain the number of vertical lines that can fit in your terminal window. Because the alias doesn't hard-code the current LINES but relys on the $LINES variable, this is a dynamic alias that will always work on a tty device.

Output the content of your Active Directory in a CSV file

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by bugmenot