UTF-8 is a multibyte character encoding of the Unicode character set, made up of one or more bytes. Unlike some other encodings such as UTF-16, the UTF-8 encoding is upward compatible with 7-bit ASCII characters, and can be processed to some degree by applications that are only aware of bytes.

learn more… | top users | synonyms (1)

9
votes
2answers
636 views

Is there a MySQL performance benchmark to measure the impact of utf8_unicode_ci versus utf8_general_ci?

I read here and there that using the utf8_unicode_ci collation ensures a better treatment of unicode text (for example, it knowns how to expand characters such as 'œ' into 'oe' for searching and ...
8
votes
6answers
6k views

How to find out if a terminal supports UTF-8

I'm setting up the CPAN module for perl on CentOs 5, and one of the questions is 'Does your terminal support UTF-8?' (paraphrased). How do I find out?
6
votes
2answers
8k views

How to get system locale in Windows 7 cmd?

How can I get system locale in Windows 7? I mean something like: cs_CZ.UTF-8 I tried writing "locale" in the command line but that doesn't work in Windows. Any suggestions?
6
votes
3answers
2k views

UTF-8 and !# shell scripts

Is there a way to configure bash on Linux (red hat and ubuntu) to allow shell scripts to be encoded in UTF-8? I can't find a simple way to change just one little thing and have the whole system just ...
6
votes
4answers
20k views

Change filesystem encoding to UTF-8 in Ubuntu

How to find out what charset encoding is used by current file system and how to change it to UTF-8? EDIT: Here is the output of mount: /dev/sdb6 on / type ext3 (rw,relatime,errors=remount-ro) tmpfs ...
5
votes
2answers
3k views

Linux not interpreting UTF8 encoded characters

So, having the following file Adán-y-Eva-50x50.jpg when I try to access it, apache translates it to Ad\xc3\xa1n-y-Eva-50x50.jpg and won't find it, even though it exists. This happens only for ...
5
votes
5answers
2k views

Best way to make sure a MySQL database is fully in UTF8

After some problems with UTF8 and none-UTF8 strings, we're standardising on UTF8. One thing I need to do is check that everything is in UTF8 in the MySQL database? What do I need to check? Server ...
5
votes
2answers
2k views

Lighttpd sending wrong headers for UTF-8 content

Ubuntu/Lighttpd is not serving my UTF-8 encoded files with the correct Content-Type header. It's sending Content-Type: text/html rather than Content-Type: text/html; charset=UTF-8. How do I configure ...
4
votes
4answers
12k views

Debian, How to convert filesystem from ISO-8859-1 into UTF-8?

I have a old pc that is running Debian stable, that is in need of a upgrade. The problem is that it is using latin1 (ISO-8859-1) for everything, and since the rest of the world has moved to UTF-8 I ...
4
votes
5answers
4k views

Are there any disadvantages of using UTF8 in an oracle database?

We are installing ordering a configured oracle database and they are asking us what character encoding we would like to have. The application (in Java) is in English only but users are from different ...
4
votes
3answers
2k views

Converting UTF-8 NFD filenames to UTF-8 NFC, in either rsync or afpd

I have a home file server running FreeNAS 8. A few days ago I used rsync to upload my entire iTunes library from Mac so that I could load my library over the network instead of off a slow USB drive. ...
4
votes
1answer
204 views

Using UTF-8 in the /etc/passwd file. Any known issues?

I was recently asked to modify the GECOS field in the passwd file for a certain user so that it will contain his name with his original accented characters. My first was reaction was "sure, why not?" ...
4
votes
1answer
455 views

Broken characters in filenames only in some directories

We have a web server running CentOS 5.8 that uses SVN for version control. When trying to switch to the latest revision, we got an error about the filenames of files in an upload directory: svn: ...
4
votes
1answer
676 views

Are there any SMTP servers that support the SMTPUTF8 extension?

RFC 5321 limits email addresses to 7 bit US-ASCII encoding. RFC 6531 (a fairly new spec) allows email addresses in SMTP commands and IMF headers to be encoded in UTF-8. This SMTP extension makes ...
3
votes
2answers
2k views

How to make the 'less' command handle UTF-8?

On my Mac terminal, printing UTF-8 works in general, but the less doesn't work correctly. So this works correctly: $ echo -e '\xe2\x82\xac' € but piping it into less gives something like this: ...
3
votes
3answers
483 views

Mongo Client RedHat EL5 UT8 Support

# mongo MongoDB shell version: 1.6.4 Fri Mar 16 11:55:46 *** warning: spider monkey build without utf8 support. consider rebuilding with utf8 support connecting to: test Mongo Server seems to handle ...
3
votes
3answers
3k views

Set character_set_results UTF8 in MySQL my.cnf

how can I set the Variable character_set_results from latin1 to uft8? I thought it would be enough to add the following variable in my.cnf: default-character-set=utf8 But it not seem so: ...
2
votes
3answers
81 views

How to forbid non-UTF-8 filenames?

Is it possible to enforce, at filesystem level, that all created file entries will have valid UTF-8 names? I am using Btrfs.
2
votes
1answer
2k views

Can PuTTY be configured to display the following UTF-8 characters?

I'd like to be able to render the characters as seen in this tweet: I saved the tweet's JSON data and wrote a one-liner python script for testing. python -c 'import json,urllib; print ...
2
votes
1answer
1k views

problem executing a bash script with utf8 encoding

I have a bash script encoded in utf8 . Within the script i use sed command using § as a separator . Now when i run execute this script sed complains about the separator. If i use normal char as a ...
2
votes
2answers
490 views

Can I convert my database/script to UTF-8?

How can I convert a database to support UTF-8 and convert it's old data from what ever encoding they're in to UTF-8 ? Extra Info: I'm running a server which has many websites on it, and one of them ...
2
votes
1answer
219 views

Utf-8 encoding for PHP-scripts creates “headers already sent”

If I upload php files that are encoded in UTF-8, instead of ANSI, it creates problems with "headers already sent" on the server. vi shows {feff} at the start and nano does not show the \ at the ...
2
votes
2answers
360 views

`less` not able to display special characters

I stumbled upon bad special characters in some manpages: If your terminal is a "true" auto-margin terminal (it doesn▒<80><99>t allow the last position on the screen to be updated ...
2
votes
1answer
260 views

UnrealIRCD codepage doesn't exists?

I am trying to make utf8 codepage for my ircd server.. unrealircd.conf listen *:9999 { codepage "UTF8"; options { ssl; clientsonly; cp_utf; }; }; I ...
2
votes
1answer
57 views

Is there a difference between en_US.utf8 and en_US.UTF-8?

Server info (DNS and IPs removed): cat /proc/version && uname -a && java -version Linux version 2.6.16.33-xenU (*************) (gcc version 4.1.1 20070105 (Red Hat 4.1.1-52)) #2 SMP ...
2
votes
2answers
704 views

URL Encoding force UTF-8 in CentOS 6.4

I have a simple html website in a CentOS 6.4 server. In every html page i have set <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> I have already added in a .htaccess ...
1
vote
1answer
85 views

Is the Ext3 filename limited to 255 symbols or 255 bytes?

I cannot save the file with the name containing more than 127 Cyrillic UTF-8 symbols on my Ext3 filesystem. It is possible so save the files containing up to 255 English UTF-8 symbols though. So is ...
1
vote
1answer
80 views

Is writing/reading speed affected by the name of the files?

How can I find out, or does anybody know, if is faster storing/reading a file with Spanish/Greek/Cyrilic/etc... characters like mi-foto-españa-oíóáaç.jpg than mi-foto-espana-oioaac.jpg ?
1
vote
2answers
192 views

Recommendation for locale on server: ISO (latin) or UTF-8

What is the recommended locale setting on a server that is used as an web and database server. Are there any drawbacks not using UTF-8 as default?
1
vote
1answer
2k views

install mysql client and mysql-server with default charset utf8 to fedora 11

I only have utf8 characters to put into my db so like everything in the db is utf8. I tried 'yum install mysql mysql-server -with-charset=utf8' but it is not right. if i install using ''yum ...
1
vote
3answers
433 views

Apache2: Problems matching accented characters in query string using RewriteCond & RewriteRule

Working on a site where the plan is to move URLs from a query string format to a number based format. Lots of URLs exist that have unescaped accented & similar UTF8 characters in them. The ...
1
vote
1answer
2k views

Setting up trac with PostgreSQL - How to set encoding to UTF8?

So I've been looking to install trac on my debian server with PostgreSQL. I setup everything as per the docs but when trying to run trac-admin /path initenv I get this error for database encoding: ...
1
vote
1answer
271 views

Does having no dash in utf-8 in email messages makes charset unreadable?

Does having no dash in utf-8 in email messages headers can make email clients to display text wrong? Subject: Newsletter MIME-Version: 1.0 From: <> Reply-To: <> Content-Type: text/plain; ...
1
vote
1answer
371 views

cyrillic URLs in apache access log

My website is configured to include cyrilic urls for SEO reasons, using some RewriteRules. It wall works very well and the link look like this http://site.com/категория/новина.html now, the issue ...
1
vote
2answers
5k views

Informix “Database locale information mismatch”

I have informix 11.5 running in my Win-2003 box and few databases running in it. System databases have locale en_us.819 My custom databases have locale en_us.57372 (UTF8). There is also application ...
1
vote
2answers
941 views

Using Chinese Characters With Mod_Rewrite

I'm trying to create a rule using Chinese characters #RewriteRule ^zh(.*) /中文版$1 [L,R=301] creates error 500 when i change the file to UTF-8 #RewriteRule ^zh(.*) /%E4%B8%AD%E6%96%87%E7%89%88$1 ...
1
vote
1answer
463 views

How to access filenames with accents (show up as ?) on Apache server?

I manage a website that is based on directory listings (dessin.acswift.com). The website is in French, and many of the urls contain accents: /leçon 1 - identification & vocabulaire.html I ...
1
vote
1answer
318 views

motd with utf-8 encoding in Ubuntu Server 10.10

I've just changed default motd in Ubuntu (I edited /etc/update-motd.d/* files) and added some string in polish: echo "Aby uzyskać dodatkowe informacje i przykładowe skrypty wpisz:" but ...
1
vote
1answer
976 views

Importing UTF8 data into MySQL from a file causes truncation

I have a file called person.sql with 1 line: INSERT INTO Person (sFullname) VALUES ('Thomas Ågren'); If I run the following command from the shell: mysql --default-character-set=utf8 -uusername ...
1
vote
1answer
616 views

How to serve HTTP filenames with special characters?

Take the following blog page as a case: http://www.roney.com.br/2010/06/20/estados-do-brasil-um-pais-que-precisa-se-unir/ !Careful, it has tons of youtubes embedded, so is a slow load! It is a ...
1
vote
0answers
31 views

CygWin SSHD and UTF-8 BOM

The CygWin ssh server configuration file "config_sshd" seems to need to be written minus a byte order marker. The server will accept UTF-8 but obviously becomes confused if it sees what it thinks is ...
1
vote
0answers
102 views

iis 7.5 wont serve up korean characters in my classic asp application

I have a classic ASP website hosted in IIS 7.5 - using a classic application pool pipeline. I have all my .Net Globalization settings set to UTF-8 encoding. However when my site outputs Korean ...
1
vote
1answer
326 views

Can not input or print Chinese on PuTTY

On Red Hat Enterprise Linux AS release 3, I've set my environment variable as below $ echo $LANG zh_CN.UTF-8 $ echo $LANGUAGE zh_CN.UTF-8 $ echo $SUPPORTED en_US.UTF-8:en_US:en:zh_CN.UTF-8 $ ...
1
vote
0answers
729 views

Mod_rewrite with UTF-8 accent, multiviews , .htaccess

Problem: with Mod_rewrite, multiview & Apache config Introduction: The website is in french and i had problem with unicode encoding and mod_rewrite within php wihtout multiviews Old server was ...
1
vote
1answer
769 views

DB2 Integrity Checks and Exception Tables

I am working on planning a migration of a DB2 8.1 database from a horrible IBM encoding to UTF-8 to support further languages etc. I am encountering an issue that I am stuck on. A few notes on this ...
1
vote
0answers
161 views

Problems with umlauts and git-svn

I've got the following problem: I checked out an GIT-repository created by tortoise-git under windows. German umlauts like "öäü" are shown as \x-Codes under my linux. That's basically no problem ...
1
vote
1answer
116 views

Meteor server unicode channel problem

When trying to subscribe to a channel named "public" with Meteor, a specialised web server for real-time push using COMET, I get the desired response: <script>ch("public",0)</script> ...
1
vote
1answer
129 views

What is the fastest way to convert MySQL columns to UTF8 from latin1 colums who's data is actually UTF8?

I have a MySQL table that has a number of columns with the latin1 character set. Because of driver issues, the columns actually contain utf8 data. I want to leave the data as-is but change the ...
1
vote
0answers
131 views

Adding new word characters to UTF8 encoded mySQL table for a fulltext search

I have found in the docs where it describes how to add characters to the list of word characters used during fulltext searches. My table is encoded UTF8 and from what I can see, there isn't a ...
0
votes
2answers
165 views

Why doesn't Firefox render this AWstats generated html?

XML Parsing Error: not well-formed Location: https://awstats.example.org/reports/www.example.org/2011/06/awstats.www.example.org.xml Line Number 603, Column 34: <tr><td ...