The Book of Knowled- The Book of Knowledge

• The Book of Knowled- The Book of Knowledge
  • Unicode.md
  • Tips for Unicode
  • Composing Unicode
    • iconv: convert between encodings
    • Bash: convert escaped text to unicode
    • Convert unicode to escaped text
    • Vim - Composing
    • Vim - Cut and Paste

Unicode.md

Tips for Unicode

Composing Unicode

• The Official Character Code Charts
• More Unicode than you knew existed

iconv: convert between encodings

Use the file command to determine the current encoding. Then use the iconv command to set a new encoding.

$  file GroupList
GroupList: Little-endian UTF-16 Unicode text, with CRLF, CR line terminators
$ iconv  -f utf-16 -t utf-8 GroupList -o GroupList.txt
$  file GroupList.txt
GroupList.txt: UTF-8 Unicode (with BOM) text, with CRLF line terminators)

Bash: convert escaped text to unicode

$ printf "%b\n"  "\u00e1"
á
$ printf "It is %s%bF\n" 72 "\u00b0"
It is 72°F
$ printf "%b\n" '\uFF30\uFF21\uFF35\uFF2C'
 ＰＡＵＬ
$ printf "%b\n" '\uFF30\uFF41\uFF55\uFF4C'
 Ｐａｕｌ

#### For an entire file

$ printf '%b\n' "$(<data)"
This is a test
It is 72°F
  ¡ ¢ £ ¤ ¥ ¦ § ¨ ©

Convert unicode to escaped text

$:     echo ãçé |
>        while read -n 1 u
>        do [[ -n "$u" ]] && printf '\\u%04x' "'$u"
>        done
\u00e3\u00e7\u00e9

Vim - Composing

To enter Unicode characters in vim, you can use the following steps:

1. In command mode, press Ctrl + V. This will put vim into visual block mode.
2. Use the arrow keys to move the cursor to the desired location where you want to enter the Unicode character.
3. Once the cursor is in the desired position, press u.
4. Enter the four-digit hexadecimal code for the Unicode character you want to insert. For example, if you want to enter the character ‘á’ (U+00E1), you would enter 00e1.
5. Press Enter to insert the Unicode character into your vim document.

Note: Make sure your vim configuration supports Unicode characters.

Vim - Cut and Paste

Common characters to cut and Paste: