Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Ensuring that the IP has no strange characters

This command validates if exist any character different in 0-255 and dot. If any characters different is typed the error menssage is showing. Show Sample Output
This is sample output - yours may be different.
```
IP="192.168.1.1"
checking=`echo ${IP} | sed "s/[0-9\.]//g"`;
if [ "${checking}" != "" ]; 
   then 
           echo "Please type only numeric characters separated for dot";
   exit;
fi
```
0

echo ${IP} | sed "s/[0-9\.]//g"

andregyn62 · 2015-10-19 18:20:03 11
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 24
Search irssi logs for specific pattern and display time and matching lines
This is sample output - yours may be different.
0

find ~/irclogs/ -type f -printf "%T+\t%p\n" | sort | cut -f2 | xargs -I {} sed -n "/^\-\-\-/ {x; /searched phrase/ p;x;h}; /searched phrase/ {H;};" {}

jnxy · 2015-11-03 14:00:50 10
finds all bean ids in all xml files from the current folder

finds all xml files greps them for extracts the bean id sorts the ids creates a list of distinct entries, a unique list of bean ids Show Sample Output
This is sample output - yours may be different.
```
groupManager
groupPermissionsDelegate
groupPermissionsDelegate
handleResolver
hashRegistry
hazelcastCacheCompactor
hazelcastCacheConfigManager
```
0

find . -iname "*.xml" | xargs cat | grep '<bean[^>]\+id=' | sed 's/.*id="$[^"]\+$".*/\1/g' | sort | uniq -u

gruzilla · 2015-11-06 07:57:22 10
Efficiently print a line deep in a huge log file

Get two different lines like this: sed -n '1000000p;2000000{p;q;}' < massive-log-file.log See also: http://www.commandlinefu.com/commands/view/6043/print-just-line-4-from-a-textfile
This is sample output - yours may be different.
0

sed -n '1000000{p;q;}' < massive-log-file.log

bariumbitmap · 2015-11-20 19:43:41 28

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
show number of established TCP connections
This is sample output - yours may be different.
0

ss -s | sed -n '/.*estab $[0-9]*$.*/s//\1/p'

phrik · 2015-12-08 12:35:22 11
remove all development packages in ubuntu

its not the prettiest but it should do the job. This one liner removes all ubuntu packages whose name ends with *-dev
This is sample output - yours may be different.
0

sudo apt-get remove $(dpkg -l \*-dev | grep ^ii | sed 's/\-dev.*/-dev/' | sed -r 's/.{4}//')

tarfoh · 2015-12-11 14:02:31 12
Google Authenticator. Setup a user and email them a QR code.

Requirements: Google Authenticator is configured as per document (http://blogs.vmware.com/consulting/files/2015/02/VMW_15Q1_TD_Horizon-View-Google-Authenticator_021715_FINAL_EMonjoin.pdf) including the patch at the end of the document. Login as the user to be provisioned. su username Command will: 1. Silently provision a user for Google Authenticator (TOTP) 2. Remove the unnecessary (and unsecure) code that uses google.com to create the QR code in browser. 3. Decode URL (first instance) 4. Decode URL (second instance) 5. Create a QR code 6. Send email to an account with the QR Code attached User scans QR code with Google Authenticator.
This is sample output - yours may be different.
0

google-authenticator -tdfo -i "Company" -l "GAuth" -r 3 -R 30 -w 17 -Q UTF8 | cut -c 62- | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e | qrencode -o qrcode.png | sendemail -t user@domain.com -f sender@domain.com -u "QR" -a qrcode.png

mooves · 2015-12-14 06:52:08 12
yet another random password generator.

this one includes special characters. note some some chars may be disallowed on windows systems. *nix will allow pretty much any character in a password except a carriage return. you do not want non printing characters in your password, so this is limited to the printable chars displayed on a keyboard , less space and return. edited to fix minor typo Show Sample Output
This is sample output - yours may be different.
```
3dV-fcb]t"
```
0

tr -dc '[:print:]' < /dev/urandom | fold -w10 |head -n1 |sed 's/ //g'

wr250 · 2016-01-09 13:43:16 12
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
grab all m4a file from bbc radio 4 extra for some easy audio ebbok listening

use get_iplay to download all listed content from http://www.bbc.co.uk/radio4extra run every night to make sure no episodes are missed
This is sample output - yours may be different.
0

get_iplayer --type=radio --channel "Radio 4 Extra" | grep : | awk '{ if ( NR > 1 ) { print } }'|sed 's/:.*//' |sed '$ d' > pidlist && while read p; do get_iplayer --get --fields=pid $p; done <pidlist && rm pidlist

dunryc · 2016-01-16 17:20:54 11
Show UDID of iPhone

this is what i needed on ubuntu 12.04 for ios 9
This is sample output - yours may be different.
0

lsusb -s `lsusb | grep "Apple" | cut -d ' ' -f 2`:`lsusb | grep "Apple" | cut -d ' ' -f 4 | sed 's/://'` -v | grep iSerial | awk '{print $3}'

dormi · 2016-01-19 09:08:27 10
Git reset added new files

1. No for-loop, but xargs. 2. Append "--" in git-reset HEAD command to deal with filenames contained leading hyphen/minus sign (-). 3. Add "--porcelain" option in git-status command for easy-to-parse format when scripting. 4. Add "--no-run-if-empty" option in xargs command to prevent you run it twice and accidentally reset all staged changes. 5. Use zero byte (NUL character) as line terminator instead of newline (\n) to make it more robust to deal with filename with whitespaces. pipe#1: git-status. pipe#2: Use "grep" to filter out "non-added" files. pipe#3: use "sed" to Trim out the leading three characters, reserve the filename. pipe#4: xargs + git-reset... p.s. The "HEAD" in git-reset can be omitted . And, maybe, the third part of this shell pipe (sed) has potential to be enhanced.
This is sample output - yours may be different.
0

git status --porcelain -z | grep -zZ '^A[ MD] ' | sed -z 's/^...//' | xargs -0 --no-run-if-empty git reset HEAD --

goldie · 2016-01-24 16:20:08 10
easily trace all Nginx processes

Nginx (and other webservers like Apache) can be awkward to trace. They run as root, then switch to another user once they're ready to serve web pages. They also have a "master" process and multiple worker processes. The given command finds the process IDs of all Nginx processes, joins them together with a comma, then traces all of them at once with "sudo strace." System trace output can be overwhelming, so we only capture "networking" output. TIP: to kill this complex strace, do "sudo killall strace". Compare with a similar command: http://www.commandlinefu.com/commands/view/11918/easily-strace-all-your-apache-processes Show Sample Output
This is sample output - yours may be different.
```
# grab an Nginx web page:
#     curl -so /dev/null localhost

[pid  1145] accept4(6, {sa_family=AF_INET, sin_port=htons(57358), sin_addr=inet_addr("127.0.0.1")}, [16], SOCK_NONBLOCK) = 10
[pid  1145] recvfrom(10, "GET / HTTP/1.1\r\nUser-Agent: curl"..., 1024, 0, NULL, NULL) = 73
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [1], 4) = 0
[pid  1145] sendfile(10, 11, [0], 612)  = 612
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [0], 4) = 0
[pid  1145] recvfrom(10, 0xa7e1c0, 1024, 0, 0, 0) = -1 EAGAIN (Resource temporarily unavailable)
[pid  1145] recvfrom(10, "", 1024, 0, NULL, NULL) = 0
```
0

sudo strace -e trace=network -p `pidof nginx | sed -e 's/ /,/g'`

shavenwarthog · 2016-01-28 18:48:16 12
underscore to camelCase

Convert Underscore to CamelCase Show Sample Output
This is sample output - yours may be different.
```
ThisIsLargeExampleWithUpperCaseToo
```
0

echo "this_is_a_large_example_With_Upper_case_too" | sed -re 's/(_([a-zA-Z]))+([a-zA-Z]+)+/\U\2\L\3/g;s/(^[a-z])/\U\1/')

iharob · 2016-01-31 17:03:19 13
Strip beginning numbers in a filename

This oneliner will remove the number which begins a filename.
This is sample output - yours may be different.
0

find . -type f | sed 's|$.*/$[^A-Z]*$[A-Z].*$|mv \"&\" \"\1\2\"|' | sh

leatherface · 2016-02-01 11:29:20 13
Takes and displays screenshot of Android phone over adb.
This is sample output - yours may be different.
0

adb shell "screencap -p | base64" | sed 's/\r$//' | base64 -d | display

killer · 2016-02-13 12:45:40 12
Get just LAN IP without all the extra stuff

I just needed to store the LAN IP (for ipv4) in a variable for a specific task in a bash script. I figured I'd share. I sent it to a variable with VAR=$(stuff) and used it later on. I put the exit 0 in the if statement to make it so that it breaks if there are more than one IPv4 addresses assigned. I only wanted the first one. Edit: Bear in mind, my network mask is a double digit number so if you have a smaller nw mask you'd need to edit the sed statement. Show Sample Output
This is sample output - yours may be different.
```
192.168.1.245
```
0

ip addr show | grep "inet " | while read INET IP TRASH; do if [ $IP != "127.0.0.1/8" ]; then echo $IP; exit 0; fi; done | sed s:/[1-9][1-9]:"":

Meh · 2016-04-07 17:46:20 11
Inverted cowsay

It's quite fun to invert text using "flip.pl" (ref: http://ubuntuforums.org/showthread.php?t=2078323 ). Slightly more challenging is to flip a whole "cowsay". :-) Show Sample Output
This is sample output - yours may be different.
```
$ echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"
                ||     ||
                ||----w |
            (--)/       )/\/
         /  (oo)/-------
        /   v--v
 ------------------------ 
< ?dn &#654;&#592;&#653; &#613;&#596;&#305;&#613;&#653; >
 ------------------------ 
```
0

echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"

mpb · 2016-04-08 11:41:44 28

Human readable docker stats output

Show Sample Output

docker stats --no-stream $( docker ps -q ) | sed -e "$( docker ps --format "{{.ID}} {{.Names}}" | sed -e "s/$.*$ $.*$/s\/\1\/\2\t\/g;/" )"

gtron · 2016-04-14 15:20:13 12

Solaris 11, test which version your IPS pkg will update you to.

Above example is upgrading Solaris from 11.1SRU20.0.5 to 11.2SRU15.0.5. Patches are not applied options "-nv" are for dryrun and verbose output. Show Sample Output
This is sample output - yours may be different.
```
# pkg update -nv | sed -n '/entire/{N;p;}'
  entire
    0.5.11,5.11-0.175.1.20.0.5.0:20140613T162323Z -> 0.5.11,5.11-0.175.2.15.0.5.1:20151026T231525Z
```
0

pkg update -nv | sed -n '/entire/{N;p;}'

apaton · 2016-04-15 20:48:49 12
Get HTTP Codes for All Websites in Apache Configuration files.

Check that all websites on the current server are working as expected. This is a quick easy way to do that. Show Sample Output
This is sample output - yours may be different.
```
projectivemotion.com,200
www.projectivemotion.com,301
amadomartinez.mx,200
anotherwebsite.com,301
somethinghappening.com,500
anothererror.com,500
```
0

grep -h 'Server$Name\|Alias$' /etc/httpd/conf.d/*.conf | sed 's#\s*Server$Name\|Alias$\s*##g' | tr ' ' "\n" | xargs -I{} sh -c 'echo {},`curl -s -o /dev/null -w "%{http_code}" {}`'

AmadoMartinez · 2016-05-13 17:16:52 10

Block all traffic from an Autonomous System (AS) Network (e.g. Facebook)

Retrieves AS route prefixes for IPv4 and IPv6, aggregates the routes to the minimal set, and adds netfilter rules to reject them. Relies on two helpers: IPv4 - "aggregate" by Joe Abley (package name 'aggregate'), IPv6 - "aggregate6" by Job Snijders ( https://github.com/job/aggregate6 ) Show Sample Output

ASN=32934; for IP in 4 6; do whois -h riswhois.ripe.net \!${IP/4/g}as${ASN} | sed -n '2 p' | tr \ \\n | aggregate${IP/4/} | while read NET; do ip${IP/4/}tables -I INPUT -S ${NET} -j REJECT; done; done

iam_TJ · 2016-05-29 09:45:34 10

‹ First < 38 39 40 41 42 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Find the package that installed a command

Shows users and 'virtual users' on your a unix-type system

Shows a list of users that currently running processes are executing as. YMMV regarding ps and it's many variants. For example, you might need: $ ps -axgu | cut -f1 -d' ' | sort -u

check open ports without netstat or lsof

Print out your hard drive to a jet-direct compatible printer.

Where 192.168.1.2 is a printer with jet-direct. No, I don't suggest this as a backup method.

Create a backup of the file.

It will create a backup of the filename. The advantage is that if you list the folder the backups will be sorted by date. The command works on any unix in bash.

Processor / memory bandwidthd? in GB/s

Read 32GB zero's and throw them away. How fast is your system?

Resize an image to at least a specific resolution

This command will resize an image (keeping the aspect ratio) to a specific resolution, meaning the resulting image will never be smaller than this resolution. For example, if we have a 2048x1000 image, the output would be 1229x600, not 1024x600 or 1024x500. Same thing for the height, if the image is 2000x1200, the output would be 1024x614.

Matrix Style

Another wall matrix :)

Turn On/Off Keyboard LEDs via commandline

Usefull as a light blink to remember events, mails, intrusions, etc... yet another output Since nobody ever uses the scroll lock function... Usefull to interface a linux system with some hardware, for example, opto interfacing the keyboard led to a relay to remotely reset, etc. ( a simple LDR glued over the LED will do the trick ) xset led 3 turns on the third led, ie, Scroll lock xset -led 3 turns it off xset led 1 turns on Numerical Lock led ( doesn t work on all computer ) xset led 2 turns on Caps Lock led ( idem ) Using it as a reset watchdog, the relay expected light pulses. Shall the computer hangs, the relay releases and reset the machine ( discharge of a capacitor ) ;-)

prevent large files from being cached in memory (backups!)

We all know... $ nice -n19 for low CPU priority. $ ionice -c3 for low I/O priority. nocache can be useful in related scenarios, when we operate on very large files just a single time, e.g. a backup job. It advises the kernel that no caching is required for the involved files, so our current file cache is not erased, potentially decreasing performance on other, more typical file I/O, e.g. on a desktop. http://askubuntu.com/questions/122857 https://github.com/Feh/nocache http://packages.debian.org/search?keywords=nocache http://packages.ubuntu.com/search?keywords=nocache To undo caching of a single file in hindsight, you can do $ cachedel To check the cache status of a file, do $ cachestats

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by