Commands using iconv sorted by votes

Commands using iconv (16)

sorted by

Batch convert files to utf-8

taken from http://blog.ofirpicazo.com/linux/batch-convert-files-to-utf-8/
This is sample output - yours may be different.
17

find . -name "*.php" -exec iconv -f ISO-8859-1 -t UTF-8 {} -o ../newdir_utf8/{} \;

afinzel · 2009-02-12 13:07:54 28
Convert mysql database from latin1 to utf8

MySQL: CHARSET from latin1 to utf8
This is sample output - yours may be different.
9

mysqldump --add-drop-table -uroot -p "DB_name" | replace CHARSET=latin1 CHARSET=utf8 | iconv -f latin1 -t utf8 | mysql -uroot -p "DB_name"

paradox · 2009-02-16 16:23:27 936
Outputs files with ascii art in the intended form.

Files containing ascii art (e.g. with .nfo extension) are typically not correctly reproduced at the command line when using cat. With iconv one can easily write a wrapper to solve this: #!/bin/bash if [ -z "$@" ]; then echo "Usage: $(basename $0) file [file] ..." else iconv -f437 -tutf8 "$@"; fi exit 0
This is sample output - yours may be different.
9

iconv -f437 -tutf8 asciiart.nfo

speaker · 2009-07-11 23:50:05 8
Convert a bunch of HTML files from ISO-8859-1 to UTF-8 file encoding in a folder and all sub-folders

This is my first attempt at converting all HTML files to UTF-8 file encoding, including all subfolders. Theres probably a much more compact way to do it, but I'm quite proud of it with my windows background ;)
This is sample output - yours may be different.
8

for x in `find . -name '*.html'` ; do iconv -f ISO-8859-1 -t UTF-8 $x > "$x.utf8"; rm $x; mv "$x.utf8" $x; done

unixmonkey1789 · 2009-02-25 08:16:01 14
Convert encoding of given files from one encoding to another
This is sample output - yours may be different.
4

iconv -f utf8 -t utf16 /path/to/file

imsaar · 2009-12-01 21:02:58 4
Convert one file from ISO-8859-1 to UTF-8.

Nothing fancy it just converts one file from one character encoding into another one.
This is sample output - yours may be different.
3

iconv --from-code=ISO-8859-1 --to-code=UTF-8 iso.txt > utf.txt

jsiei97 · 2009-08-09 14:22:09 5
clear all non-ascii chars of file.txt
This is sample output - yours may be different.
2

iconv -c -f utf-8 -t ascii file.txt

kev · 2011-11-05 08:27:03 5
remove accented chars
This is sample output - yours may be different.
1

iconv -f utf8 -t ascii//TRANSLIT <output-file>

jonatasnona · 2013-03-14 19:12:29 25
Slugify: converts strings in any language into Slugs (friendly names to use in URLs and filenames)

Slug the part of an URL which identifies a page using human-readable keywords. Slugs are used to construct friendly URLs (often for permalinks) that are easy to type, descriptive, and easy to remember. Show Sample Output
This is sample output - yours may be different.
```
function slugify() { tr '[:upper:]' '[:lower:]' <<< "$(sed -z -r -e 's~[^[:alnum:]]+~ ~g' -e 's~ (he|here|how|it|she|there|what|when|where|who) s ~ \1 is ~gi' -e 's~^ *~~;s~ *$~~' -e 's~ +~-~g' - <<< " $(iconv -c -t ASCII//TRANSLIT//IGNORE - <<< " $@ " ) ")"; }


# testing special characters and spaces:
slugify " Test: µÀÁÂÃÄÅÆÇÈÉÊËÌÍÎÏÐÑÒÓÔÕÖØÙÚÛÜÝß      and àáâãäåæçèéêëìíîïðñòóôõöøùúûüýÿ ";

# output:
test-uaaaaaaaeceeeeiiiidnoooooouuuuyss-and-aaaaaaaeceeeeiiiidnoooooouuuuyy
```
1

function slugify() { tr '[:upper:]' '[:lower:]' <<< "$(sed -z -r -e 's~[^[:alnum:]]+~ ~g' -e 's~^ *~~;s~ *$~~' -e 's~ +~-~g' - <<< "$(iconv -c -t ASCII//TRANSLIT//IGNORE - <<< "$@" )")"; }

mikhail · 2019-06-08 17:45:57 42
prepare unicode text saved from Microsoft Excel 2003 for unix console

Sometimes you want to work on data sheets by using heirloom unic commands like cut, paste, sed, sort, wc and good old awk. But your user works on Microsoft Excel spreadsheet. The idea: 1) ask your user to save it as "Unicode Text" from Microsoft Excel and send the document to you; 2) use the given command to convert it to UTF-8 text. We carefully convert "\r\n" to local end-of-line character; and to convert "\n" (in Excel, means linebreak within the table cell") to "\r", which is carrier return but not end-of-line in Unix. If the "\n" is not replaced with "\r", for example, wc -l will report incorrect column number.
This is sample output - yours may be different.
0

iconv -f UTF16LE -t UTF-8 < SOURCE | awk 'BEGIN { RS="\r\n";} { gsub("\n", "\r"); print;}' > TARGET

zhangweiwu · 2010-04-04 07:16:57 4
Convert encoding of a file
This is sample output - yours may be different.
0

iconv -f utf8 -t utf16 /path/to/file

binfalse · 2010-08-31 22:39:09 5
a simple interactive tool to convert Simplified Chinese (typed by pinyin) to Traditional Chinese 简繁中文转换

a simple interactive tool to convert Simplified Chinese (typed by pinyin) to Traditional Chinese Show Sample Output
This is sample output - yours may be different.
```
Simplied Chinese:
&#40857;&#30340;&#20256;&#20154;
Traditional Chinese:
&#40845;&#30340;&#20659;&#20154;
&#31616;&#32321;&#20013;&#25991;&#36716;&#25442;
Traditional Chinese:
&#31777;&#32321;&#20013;&#25991;&#36681;&#25563;
```
0

echo "Simplied Chinese:"; while read -r line; do echo "Traditional Chinese:"; echo $line | iconv -f utf8 -t gb2312 | iconv -f gb2312 -t big5 | iconv -f big5 -t utf8; done

dexterhu · 2011-03-11 12:26:25 16
Convert any encoding to UTF8
This is sample output - yours may be different.
0

iconv -f $(file -bi filename.ext | sed -e 's/.*[ ]charset=//') -t utf8 filename.ext > filename.ext

Adrien · 2014-01-23 13:58:06 10
Convert one's Java source file encoding

One of my friends committed his code in the encoding of GB2312, which broke the build job. I have to find his code and convert.
This is sample output - yours may be different.
-1

find . -name "*.java" -type f -perm +600 -print | xargs -I _ sh -c 'grep -q hexianmao _ && iconv -f gb2312 -t utf8 -o _ -c _ '

Sunng · 2011-03-08 13:02:25 8
Create nthash
This is sample output - yours may be different.
-1

echo -n "password" | iconv -t utf-16le | openssl dgst -md4

damncool · 2011-09-22 16:29:41 3
Post to twitter via curl, Windows version

Aside from curl one will need iconv windows binary since windows lacks a native utf-8 cli interface. In my case I need a proxy in China and iconv to convert gbk status string into utf-8. GnuWin32 is a good choice with loads of coreutils natively ported to Windows "FOR /f" is the solution to pass iconv output to curl.
This is sample output - yours may be different.
-5

FOR /f %%g in ('echo %1 ^| iconv -f gbk -t utf-8') DO curl -x proxy:port -u user:pass -d status=%%g -d source="cURL" http://twitter.com/statuses/update.xml

MeaCulpa · 2010-07-21 04:53:54 4

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Batch rename extension of all files in a folder, in the example from .txt to .md

echo unicode characters

Compress excutable files in place.

The gzexe utility allows you to compress executables in place and have them automatically uncompress and execute when you run them. FYI: You can compress any executable sha-bang scripts as well (py, pl, sh, tcl, etc.).

repeat any string or char n times without spaces between

(here is character '+' repeated 80 times) Sometimes needed to enhance the title of the script.

View dmesg output in human readable format

Lists the size of certain file in every 10 seconds

watch is a command especially designed for doing this job

Throttling Bandwidth On A Mac

sudo ipfw pipe 1 config bw 50KByte/s Set the bandwidth (bw) limit to any number you want. For example you could have a 15kb pipe for X application and then a 100kb pipe for another application and attach things to those pipes. If a port isn’t attached to a pipe, it runs at full speed. Change the number (in this case 1) to a different number for a different pipe. The next step is to attach your port. sudo ipfw add 1 pipe 1 src-port 80 In this case anything on port 80 (http) will be set to a limit of 50Kbyte/s. If you want to attach a second port to this pipe, repeat the command but change the port number at the end. src : http://www.mactricksandtips.com/2008/12/throttling-bandwidth-on-a-mac.html

Search specified $TEXT1 and Replace that by specified arg ($TEXT2)

ls only directories

Like normal ls, but only lists directories. Can be used with -l to get more details (ls -lad */)

Parse m3u playlist file for total time

Parse an m3u file with seconds for each item and output the length of the entire playlist

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using iconv

Commands using iconv (16) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using iconv (16)

sorted by