UTF-8 is a multibyte character encoding of the Unicode character set, made up of one or more bytes. Unlike some other encodings such as UTF-16, the UTF-8 encoding is upward compatible with 7-bit ASCII characters, and can be processed to some degree by applications that are only aware of bytes.

learn more… | top users | synonyms (1)

10
votes
2answers
693 views

Is there a MySQL performance benchmark to measure the impact of utf8_unicode_ci versus utf8_general_ci?

I read here and there that using the utf8_unicode_ci collation ensures a better treatment of unicode text (for example, it knowns how to expand characters such as 'œ' into 'oe' for searching and ...
8
votes
6answers
7k views

How to find out if a terminal supports UTF-8

I'm setting up the CPAN module for perl on CentOs 5, and one of the questions is 'Does your terminal support UTF-8?' (paraphrased). How do I find out?
6
votes
4answers
3k views

Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd

I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. ...
6
votes
2answers
4k views

Linux not interpreting UTF8 encoded characters

So, having the following file Adán-y-Eva-50x50.jpg when I try to access it, apache translates it to Ad\xc3\xa1n-y-Eva-50x50.jpg and won't find it, even though it exists. This happens only for ...
6
votes
2answers
10k views

How to get system locale in Windows 7 cmd?

How can I get system locale in Windows 7? I mean something like: cs_CZ.UTF-8 I tried writing "locale" in the command line but that doesn't work in Windows. Any suggestions?
6
votes
3answers
2k views

UTF-8 and !# shell scripts

Is there a way to configure bash on Linux (red hat and ubuntu) to allow shell scripts to be encoded in UTF-8? I can't find a simple way to change just one little thing and have the whole system just ...
6
votes
4answers
21k views

Change filesystem encoding to UTF-8 in Ubuntu

How to find out what charset encoding is used by current file system and how to change it to UTF-8? EDIT: Here is the output of mount: /dev/sdb6 on / type ext3 (rw,relatime,errors=remount-ro) tmpfs ...
5
votes
2answers
3k views

Lighttpd sending wrong headers for UTF-8 content

Ubuntu/Lighttpd is not serving my UTF-8 encoded files with the correct Content-Type header. It's sending Content-Type: text/html rather than Content-Type: text/html; charset=UTF-8. How do I configure ...
5
votes
5answers
2k views

Best way to make sure a MySQL database is fully in UTF8

After some problems with UTF8 and none-UTF8 strings, we're standardising on UTF8. One thing I need to do is check that everything is in UTF8 in the MySQL database? What do I need to check? Server ...
5
votes
1answer
217 views

Using UTF-8 in the /etc/passwd file. Any known issues?

I was recently asked to modify the GECOS field in the passwd file for a certain user so that it will contain his name with his original accented characters. My first was reaction was "sure, why not?" ...
4
votes
4answers
13k views

Debian, How to convert filesystem from ISO-8859-1 into UTF-8?

I have a old pc that is running Debian stable, that is in need of a upgrade. The problem is that it is using latin1 (ISO-8859-1) for everything, and since the rest of the world has moved to UTF-8 I ...
4
votes
5answers
4k views

Are there any disadvantages of using UTF8 in an oracle database?

We are installing ordering a configured oracle database and they are asking us what character encoding we would like to have. The application (in Java) is in English only but users are from different ...
4
votes
2answers
893 views

Are there any SMTP servers that support the SMTPUTF8 extension? [closed]

RFC 5321 limits email addresses to 7 bit US-ASCII encoding. RFC 6531 (a fairly new spec) allows email addresses in SMTP commands and IMF headers to be encoded in UTF-8. This SMTP extension makes ...
4
votes
1answer
548 views

Broken characters in filenames only in some directories

We have a web server running CentOS 5.8 that uses SVN for version control. When trying to switch to the latest revision, we got an error about the filenames of files in an upload directory: svn: ...
3
votes
3answers
2k views

How to make the 'less' command handle UTF-8?

On my Mac terminal, printing UTF-8 works in general, but the less doesn't work correctly. So this works correctly: $ echo -e '\xe2\x82\xac' € but piping it into less gives something like this: ...
3
votes
3answers
501 views

Mongo Client RedHat EL5 UT8 Support

# mongo MongoDB shell version: 1.6.4 Fri Mar 16 11:55:46 *** warning: spider monkey build without utf8 support. consider rebuilding with utf8 support connecting to: test Mongo Server seems to handle ...
3
votes
3answers
3k views

Set character_set_results UTF8 in MySQL my.cnf

how can I set the Variable character_set_results from latin1 to uft8? I thought it would be enough to add the following variable in my.cnf: default-character-set=utf8 But it not seem so: ...
2
votes
3answers
84 views

How to forbid non-UTF-8 filenames?

Is it possible to enforce, at filesystem level, that all created file entries will have valid UTF-8 names? I am using Btrfs.
2
votes
1answer
2k views

Can PuTTY be configured to display the following UTF-8 characters?

I'd like to be able to render the characters as seen in this tweet: I saved the tweet's JSON data and wrote a one-liner python script for testing. python -c 'import json,urllib; print ...
2
votes
1answer
1k views

problem executing a bash script with utf8 encoding

I have a bash script encoded in utf8 . Within the script i use sed command using § as a separator . Now when i run execute this script sed complains about the separator. If i use normal char as a ...
2
votes
2answers
423 views

`less` not able to display special characters

I stumbled upon bad special characters in some manpages: If your terminal is a "true" auto-margin terminal (it doesn▒<80><99>t allow the last position on the screen to be updated ...
2
votes
2answers
511 views

Can I convert my database/script to UTF-8?

How can I convert a database to support UTF-8 and convert it's old data from what ever encoding they're in to UTF-8 ? Extra Info: I'm running a server which has many websites on it, and one of them ...
2
votes
2answers
981 views

URL Encoding force UTF-8 in CentOS 6.4

I have a simple html website in a CentOS 6.4 server. In every html page i have set <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> I have already added in a .htaccess ...
2
votes
1answer
260 views

Utf-8 encoding for PHP-scripts creates “headers already sent”

If I upload php files that are encoded in UTF-8, instead of ANSI, it creates problems with "headers already sent" on the server. vi shows {feff} at the start and nano does not show the \ at the ...
2
votes
1answer
285 views

UnrealIRCD codepage doesn't exists?

I am trying to make utf8 codepage for my ircd server.. unrealircd.conf listen *:9999 { codepage "UTF8"; options { ssl; clientsonly; cp_utf; }; }; I ...
2
votes
0answers
152 views

Mount unix samba 4 share to osx client without mangled file names

I have a unix server (arch linux) with samba 4.1.12. The share has files inside it with utf-8 nfc encoding (standard utf-8). When I mount this samba share into an osx client (10.9.5), files with ...
2
votes
1answer
142 views

Is there a difference between en_US.utf8 and en_US.UTF-8?

Server info (DNS and IPs removed): cat /proc/version && uname -a && java -version Linux version 2.6.16.33-xenU (*************) (gcc version 4.1.1 20070105 (Red Hat 4.1.1-52)) #2 SMP ...
2
votes
1answer
385 views

Can not input or print Chinese on PuTTY

On Red Hat Enterprise Linux AS release 3, I've set my environment variable as below $ echo $LANG zh_CN.UTF-8 $ echo $LANGUAGE zh_CN.UTF-8 $ echo $SUPPORTED en_US.UTF-8:en_US:en:zh_CN.UTF-8 $ ...
1
vote
1answer
109 views

Is the Ext3 filename limited to 255 symbols or 255 bytes?

I cannot save the file with the name containing more than 127 Cyrillic UTF-8 symbols on my Ext3 filesystem. It is possible so save the files containing up to 255 English UTF-8 symbols though. So is ...
1
vote
1answer
82 views

Is writing/reading speed affected by the name of the files?

How can I find out, or does anybody know, if is faster storing/reading a file with Spanish/Greek/Cyrilic/etc... characters like mi-foto-españa-oíóáaç.jpg than mi-foto-espana-oioaac.jpg ?
1
vote
2answers
218 views

Recommendation for locale on server: ISO (latin) or UTF-8

What is the recommended locale setting on a server that is used as an web and database server. Are there any drawbacks not using UTF-8 as default?
1
vote
1answer
2k views

install mysql client and mysql-server with default charset utf8 to fedora 11

I only have utf8 characters to put into my db so like everything in the db is utf8. I tried 'yum install mysql mysql-server -with-charset=utf8' but it is not right. if i install using ''yum ...
1
vote
3answers
602 views

Apache2: Problems matching accented characters in query string using RewriteCond & RewriteRule

Working on a site where the plan is to move URLs from a query string format to a number based format. Lots of URLs exist that have unescaped accented & similar UTF8 characters in them. The ...
1
vote
1answer
2k views

Setting up trac with PostgreSQL - How to set encoding to UTF8?

So I've been looking to install trac on my debian server with PostgreSQL. I setup everything as per the docs but when trying to run trac-admin /path initenv I get this error for database encoding: ...
1
vote
1answer
293 views

Does having no dash in utf-8 in email messages makes charset unreadable?

Does having no dash in utf-8 in email messages headers can make email clients to display text wrong? Subject: Newsletter MIME-Version: 1.0 From: <> Reply-To: <> Content-Type: text/plain; ...
1
vote
1answer
399 views

cyrillic URLs in apache access log

My website is configured to include cyrilic urls for SEO reasons, using some RewriteRules. It wall works very well and the link look like this http://site.com/категория/новина.html now, the issue ...
1
vote
2answers
6k views

Informix “Database locale information mismatch”

I have informix 11.5 running in my Win-2003 box and few databases running in it. System databases have locale en_us.819 My custom databases have locale en_us.57372 (UTF8). There is also application ...
1
vote
2answers
1k views

Using Chinese Characters With Mod_Rewrite

I'm trying to create a rule using Chinese characters #RewriteRule ^zh(.*) /中文版$1 [L,R=301] creates error 500 when i change the file to UTF-8 #RewriteRule ^zh(.*) /%E4%B8%AD%E6%96%87%E7%89%88$1 ...
1
vote
1answer
505 views

How to access filenames with accents (show up as ?) on Apache server?

I manage a website that is based on directory listings (dessin.acswift.com). The website is in French, and many of the urls contain accents: /leçon 1 - identification & vocabulaire.html I ...
1
vote
1answer
330 views

motd with utf-8 encoding in Ubuntu Server 10.10

I've just changed default motd in Ubuntu (I edited /etc/update-motd.d/* files) and added some string in polish: echo "Aby uzyskać dodatkowe informacje i przykładowe skrypty wpisz:" but ...
1
vote
1answer
1k views

Importing UTF8 data into MySQL from a file causes truncation

I have a file called person.sql with 1 line: INSERT INTO Person (sFullname) VALUES ('Thomas Ågren'); If I run the following command from the shell: mysql --default-character-set=utf8 -uusername ...
1
vote
1answer
686 views

How to serve HTTP filenames with special characters?

Take the following blog page as a case: http://www.roney.com.br/2010/06/20/estados-do-brasil-um-pais-que-precisa-se-unir/ !Careful, it has tons of youtubes embedded, so is a slow load! It is a ...
1
vote
0answers
42 views

CygWin SSHD and UTF-8 BOM

The CygWin ssh server configuration file "config_sshd" seems to need to be written minus a byte order marker. The server will accept UTF-8 but obviously becomes confused if it sees what it thinks is ...
1
vote
0answers
125 views

iis 7.5 wont serve up korean characters in my classic asp application

I have a classic ASP website hosted in IIS 7.5 - using a classic application pool pipeline. I have all my .Net Globalization settings set to UTF-8 encoding. However when my site outputs Korean ...
1
vote
0answers
795 views

Mod_rewrite with UTF-8 accent, multiviews , .htaccess

Problem: with Mod_rewrite, multiview & Apache config Introduction: The website is in french and i had problem with unicode encoding and mod_rewrite within php wihtout multiviews Old server was ...
1
vote
1answer
967 views

DB2 Integrity Checks and Exception Tables

I am working on planning a migration of a DB2 8.1 database from a horrible IBM encoding to UTF-8 to support further languages etc. I am encountering an issue that I am stuck on. A few notes on this ...
1
vote
0answers
170 views

Problems with umlauts and git-svn

I've got the following problem: I checked out an GIT-repository created by tortoise-git under windows. German umlauts like "öäü" are shown as \x-Codes under my linux. That's basically no problem ...
1
vote
1answer
133 views

Meteor server unicode channel problem

When trying to subscribe to a channel named "public" with Meteor, a specialised web server for real-time push using COMET, I get the desired response: <script>ch("public",0)</script> ...
1
vote
1answer
135 views

What is the fastest way to convert MySQL columns to UTF8 from latin1 colums who's data is actually UTF8?

I have a MySQL table that has a number of columns with the latin1 character set. Because of driver issues, the columns actually contain utf8 data. I want to leave the data as-is but change the ...
0
votes
2answers
193 views

Why doesn't Firefox render this AWstats generated html?

XML Parsing Error: not well-formed Location: https://awstats.example.org/reports/www.example.org/2011/06/awstats.www.example.org.xml Line Number 603, Column 34: <tr><td ...