Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Ensuring that the IP has no strange characters

This command validates if exist any character different in 0-255 and dot. If any characters different is typed the error menssage is showing. Show Sample Output
This is sample output - yours may be different.
```
IP="192.168.1.1"
checking=`echo ${IP} | sed "s/[0-9\.]//g"`;
if [ "${checking}" != "" ]; 
   then 
           echo "Please type only numeric characters separated for dot";
   exit;
fi
```
0

echo ${IP} | sed "s/[0-9\.]//g"

andregyn62 · 2015-10-19 18:20:03 11
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 24
Search irssi logs for specific pattern and display time and matching lines
This is sample output - yours may be different.
0

find ~/irclogs/ -type f -printf "%T+\t%p\n" | sort | cut -f2 | xargs -I {} sed -n "/^\-\-\-/ {x; /searched phrase/ p;x;h}; /searched phrase/ {H;};" {}

jnxy · 2015-11-03 14:00:50 10
finds all bean ids in all xml files from the current folder

finds all xml files greps them for extracts the bean id sorts the ids creates a list of distinct entries, a unique list of bean ids Show Sample Output
This is sample output - yours may be different.
```
groupManager
groupPermissionsDelegate
groupPermissionsDelegate
handleResolver
hashRegistry
hazelcastCacheCompactor
hazelcastCacheConfigManager
```
0

find . -iname "*.xml" | xargs cat | grep '<bean[^>]\+id=' | sed 's/.*id="$[^"]\+$".*/\1/g' | sort | uniq -u

gruzilla · 2015-11-06 07:57:22 10
Efficiently print a line deep in a huge log file

Get two different lines like this: sed -n '1000000p;2000000{p;q;}' < massive-log-file.log See also: http://www.commandlinefu.com/commands/view/6043/print-just-line-4-from-a-textfile
This is sample output - yours may be different.
0

sed -n '1000000{p;q;}' < massive-log-file.log

bariumbitmap · 2015-11-20 19:43:41 28

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
show number of established TCP connections
This is sample output - yours may be different.
0

ss -s | sed -n '/.*estab $[0-9]*$.*/s//\1/p'

phrik · 2015-12-08 12:35:22 11
remove all development packages in ubuntu

its not the prettiest but it should do the job. This one liner removes all ubuntu packages whose name ends with *-dev
This is sample output - yours may be different.
0

sudo apt-get remove $(dpkg -l \*-dev | grep ^ii | sed 's/\-dev.*/-dev/' | sed -r 's/.{4}//')

tarfoh · 2015-12-11 14:02:31 12
Google Authenticator. Setup a user and email them a QR code.

Requirements: Google Authenticator is configured as per document (http://blogs.vmware.com/consulting/files/2015/02/VMW_15Q1_TD_Horizon-View-Google-Authenticator_021715_FINAL_EMonjoin.pdf) including the patch at the end of the document. Login as the user to be provisioned. su username Command will: 1. Silently provision a user for Google Authenticator (TOTP) 2. Remove the unnecessary (and unsecure) code that uses google.com to create the QR code in browser. 3. Decode URL (first instance) 4. Decode URL (second instance) 5. Create a QR code 6. Send email to an account with the QR Code attached User scans QR code with Google Authenticator.
This is sample output - yours may be different.
0

google-authenticator -tdfo -i "Company" -l "GAuth" -r 3 -R 30 -w 17 -Q UTF8 | cut -c 62- | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e | qrencode -o qrcode.png | sendemail -t user@domain.com -f sender@domain.com -u "QR" -a qrcode.png

mooves · 2015-12-14 06:52:08 12
yet another random password generator.

this one includes special characters. note some some chars may be disallowed on windows systems. *nix will allow pretty much any character in a password except a carriage return. you do not want non printing characters in your password, so this is limited to the printable chars displayed on a keyboard , less space and return. edited to fix minor typo Show Sample Output
This is sample output - yours may be different.
```
3dV-fcb]t"
```
0

tr -dc '[:print:]' < /dev/urandom | fold -w10 |head -n1 |sed 's/ //g'

wr250 · 2016-01-09 13:43:16 12
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
grab all m4a file from bbc radio 4 extra for some easy audio ebbok listening

use get_iplay to download all listed content from http://www.bbc.co.uk/radio4extra run every night to make sure no episodes are missed
This is sample output - yours may be different.
0

get_iplayer --type=radio --channel "Radio 4 Extra" | grep : | awk '{ if ( NR > 1 ) { print } }'|sed 's/:.*//' |sed '$ d' > pidlist && while read p; do get_iplayer --get --fields=pid $p; done <pidlist && rm pidlist

dunryc · 2016-01-16 17:20:54 11
Show UDID of iPhone

this is what i needed on ubuntu 12.04 for ios 9
This is sample output - yours may be different.
0

lsusb -s `lsusb | grep "Apple" | cut -d ' ' -f 2`:`lsusb | grep "Apple" | cut -d ' ' -f 4 | sed 's/://'` -v | grep iSerial | awk '{print $3}'

dormi · 2016-01-19 09:08:27 10
Git reset added new files

1. No for-loop, but xargs. 2. Append "--" in git-reset HEAD command to deal with filenames contained leading hyphen/minus sign (-). 3. Add "--porcelain" option in git-status command for easy-to-parse format when scripting. 4. Add "--no-run-if-empty" option in xargs command to prevent you run it twice and accidentally reset all staged changes. 5. Use zero byte (NUL character) as line terminator instead of newline (\n) to make it more robust to deal with filename with whitespaces. pipe#1: git-status. pipe#2: Use "grep" to filter out "non-added" files. pipe#3: use "sed" to Trim out the leading three characters, reserve the filename. pipe#4: xargs + git-reset... p.s. The "HEAD" in git-reset can be omitted . And, maybe, the third part of this shell pipe (sed) has potential to be enhanced.
This is sample output - yours may be different.
0

git status --porcelain -z | grep -zZ '^A[ MD] ' | sed -z 's/^...//' | xargs -0 --no-run-if-empty git reset HEAD --

goldie · 2016-01-24 16:20:08 10
easily trace all Nginx processes

Nginx (and other webservers like Apache) can be awkward to trace. They run as root, then switch to another user once they're ready to serve web pages. They also have a "master" process and multiple worker processes. The given command finds the process IDs of all Nginx processes, joins them together with a comma, then traces all of them at once with "sudo strace." System trace output can be overwhelming, so we only capture "networking" output. TIP: to kill this complex strace, do "sudo killall strace". Compare with a similar command: http://www.commandlinefu.com/commands/view/11918/easily-strace-all-your-apache-processes Show Sample Output
This is sample output - yours may be different.
```
# grab an Nginx web page:
#     curl -so /dev/null localhost

[pid  1145] accept4(6, {sa_family=AF_INET, sin_port=htons(57358), sin_addr=inet_addr("127.0.0.1")}, [16], SOCK_NONBLOCK) = 10
[pid  1145] recvfrom(10, "GET / HTTP/1.1\r\nUser-Agent: curl"..., 1024, 0, NULL, NULL) = 73
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [1], 4) = 0
[pid  1145] sendfile(10, 11, [0], 612)  = 612
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [0], 4) = 0
[pid  1145] recvfrom(10, 0xa7e1c0, 1024, 0, 0, 0) = -1 EAGAIN (Resource temporarily unavailable)
[pid  1145] recvfrom(10, "", 1024, 0, NULL, NULL) = 0
```
0

sudo strace -e trace=network -p `pidof nginx | sed -e 's/ /,/g'`

shavenwarthog · 2016-01-28 18:48:16 12
underscore to camelCase

Convert Underscore to CamelCase Show Sample Output
This is sample output - yours may be different.
```
ThisIsLargeExampleWithUpperCaseToo
```
0

echo "this_is_a_large_example_With_Upper_case_too" | sed -re 's/(_([a-zA-Z]))+([a-zA-Z]+)+/\U\2\L\3/g;s/(^[a-z])/\U\1/')

iharob · 2016-01-31 17:03:19 13
Strip beginning numbers in a filename

This oneliner will remove the number which begins a filename.
This is sample output - yours may be different.
0

find . -type f | sed 's|$.*/$[^A-Z]*$[A-Z].*$|mv \"&\" \"\1\2\"|' | sh

leatherface · 2016-02-01 11:29:20 13
Takes and displays screenshot of Android phone over adb.
This is sample output - yours may be different.
0

adb shell "screencap -p | base64" | sed 's/\r$//' | base64 -d | display

killer · 2016-02-13 12:45:40 12
Get just LAN IP without all the extra stuff

I just needed to store the LAN IP (for ipv4) in a variable for a specific task in a bash script. I figured I'd share. I sent it to a variable with VAR=$(stuff) and used it later on. I put the exit 0 in the if statement to make it so that it breaks if there are more than one IPv4 addresses assigned. I only wanted the first one. Edit: Bear in mind, my network mask is a double digit number so if you have a smaller nw mask you'd need to edit the sed statement. Show Sample Output
This is sample output - yours may be different.
```
192.168.1.245
```
0

ip addr show | grep "inet " | while read INET IP TRASH; do if [ $IP != "127.0.0.1/8" ]; then echo $IP; exit 0; fi; done | sed s:/[1-9][1-9]:"":

Meh · 2016-04-07 17:46:20 11
Inverted cowsay

It's quite fun to invert text using "flip.pl" (ref: http://ubuntuforums.org/showthread.php?t=2078323 ). Slightly more challenging is to flip a whole "cowsay". :-) Show Sample Output
This is sample output - yours may be different.
```
$ echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"
                ||     ||
                ||----w |
            (--)/       )/\/
         /  (oo)/-------
        /   v--v
 ------------------------ 
< ?dn &#654;&#592;&#653; &#613;&#596;&#305;&#613;&#653; >
 ------------------------ 
```
0

echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"

mpb · 2016-04-08 11:41:44 28

Human readable docker stats output

Show Sample Output

docker stats --no-stream $( docker ps -q ) | sed -e "$( docker ps --format "{{.ID}} {{.Names}}" | sed -e "s/$.*$ $.*$/s\/\1\/\2\t\/g;/" )"

gtron · 2016-04-14 15:20:13 12

Solaris 11, test which version your IPS pkg will update you to.

Above example is upgrading Solaris from 11.1SRU20.0.5 to 11.2SRU15.0.5. Patches are not applied options "-nv" are for dryrun and verbose output. Show Sample Output
This is sample output - yours may be different.
```
# pkg update -nv | sed -n '/entire/{N;p;}'
  entire
    0.5.11,5.11-0.175.1.20.0.5.0:20140613T162323Z -> 0.5.11,5.11-0.175.2.15.0.5.1:20151026T231525Z
```
0

pkg update -nv | sed -n '/entire/{N;p;}'

apaton · 2016-04-15 20:48:49 12
Get HTTP Codes for All Websites in Apache Configuration files.

Check that all websites on the current server are working as expected. This is a quick easy way to do that. Show Sample Output
This is sample output - yours may be different.
```
projectivemotion.com,200
www.projectivemotion.com,301
amadomartinez.mx,200
anotherwebsite.com,301
somethinghappening.com,500
anothererror.com,500
```
0

grep -h 'Server$Name\|Alias$' /etc/httpd/conf.d/*.conf | sed 's#\s*Server$Name\|Alias$\s*##g' | tr ' ' "\n" | xargs -I{} sh -c 'echo {},`curl -s -o /dev/null -w "%{http_code}" {}`'

AmadoMartinez · 2016-05-13 17:16:52 10

Block all traffic from an Autonomous System (AS) Network (e.g. Facebook)

Retrieves AS route prefixes for IPv4 and IPv6, aggregates the routes to the minimal set, and adds netfilter rules to reject them. Relies on two helpers: IPv4 - "aggregate" by Joe Abley (package name 'aggregate'), IPv6 - "aggregate6" by Job Snijders ( https://github.com/job/aggregate6 ) Show Sample Output

ASN=32934; for IP in 4 6; do whois -h riswhois.ripe.net \!${IP/4/g}as${ASN} | sed -n '2 p' | tr \ \\n | aggregate${IP/4/} | while read NET; do ip${IP/4/}tables -I INPUT -S ${NET} -j REJECT; done; done

iam_TJ · 2016-05-29 09:45:34 10

‹ First < 38 39 40 41 42 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

monitor my process group tree

Display a block of text with AWK

I find this terribly useful for grepping through a file, looking for just a block of text. There's "grep -A # pattern file.txt" to see a specific number of lines following your pattern, but what if you want to see the whole block? Say, the output of "dmidecode" (as root): $ dmidecode | awk '/Battery/,/^$/' Will show me everything following the battery block up to the next block of text. Again, I find this extremely useful when I want to see whole blocks of text based on a pattern, and I don't care to see the rest of the data in output. This could be used against the '/etc/securetty/user' file on Unix to find the block of a specific user. It could be used against VirtualHosts or Directories on Apache to find specific definitions. The scenarios go on for any text formatted in a block fashion. Very handy.

Get an authorization code from Google

This is a basis for other Google API commands.

burn an ISO image to writable CD

Does life get much easier? Read up about wodim for an understanding of its origins in relation to the older `cdrecord` utility

See system users

Display connections histogram

Displays a connection histogram of active tcp connections. Works even better under an alias. Thanks @Areis1 for sharing this one.

Create a backup of the file.

It will create a backup of the filename. The advantage is that if you list the folder the backups will be sorted by date. The command works on any unix in bash.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Check if a domain is available for purchase

A quick alias to check if a domain is already registered or if it's available for purchase.

Bitcoin Brainwallet Exponent Calculator

A bitcoin "brainwallet" is a secret passphrase you carry in your brain. The Bitcoin Brainwallet Exponent Calculator is one of three functions needed to calculate the bitcoin PRIVATE key. Roughly, the formula is exponent = sha256 (passphrase) Note that this is a bash function, which means you have to type its name to invoke it. You can check the accuracy of the results here http://brainwallet.org

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by