Questions tagged [unicode]
Unicode is intended to be a universal character set for describing all the characters required for written text incorporating all writing systems, technical symbols and punctuation.
45
questions
42
votes
5
answers
25k
views
How to make the 'less' command handle UTF-8?
On my Mac terminal, printing UTF-8 works in general, but the less doesn't work correctly.
So this works correctly:
$ echo -e '\xe2\x82\xac'
€
but piping it into less gives something like this:
...
- 2,458
13
votes
2
answers
2k
views
Is there a MySQL performance benchmark to measure the impact of utf8_unicode_ci versus utf8_general_ci?
I read here and there that using the utf8_unicode_ci collation ensures a better treatment of unicode text (for example, it knowns how to expand characters such as 'œ' into 'oe' for searching and ...
- 4,005
11
votes
1
answer
21k
views
Can PuTTY be configured to display the following UTF-8 characters?
I'd like to be able to render the characters as seen in this tweet:
I saved the tweet's JSON data and wrote a one-liner python script for testing.
python -c 'import json,urllib; print json.load(...
- 273
10
votes
2
answers
1k
views
How to add non-latin entries in hosts file
Is there a way to add non-latin entries in /etc/hosts on windows?
Something like
127.0.0.1 локалхост
Tried the code above and also punycode with no luck
Yes, i know that this would break almost ...
- 339
10
votes
4
answers
3k
views
How can I check if PHP was compiled with the UNICODE version of the Win32 API?
This is related to this Stack Overflow post:
glob() can't find file names with multibyte characters on Windows?
I'm having issues with PHP and files that have multibyte characters on Windows. Here's ...
- 155
8
votes
5
answers
6k
views
Best way to make sure a MySQL database is fully in UTF8
After some problems with UTF8 and none-UTF8 strings, we're standardising on UTF8. One thing I need to do is check that everything is in UTF8 in the MySQL database? What do I need to check?
Server ...
- 32.3k
8
votes
1
answer
2k
views
Cisco FWSM -> ASA upgrade broke our mail server
We send mail with unicode asian characters to our mail server on the other side of our WAN... immediately after upgrading from a FWSM running 2.3(2) to an ASA5550 running 8.2(5), we saw failures on ...
- 8,339
5
votes
1
answer
2k
views
Special characters in ssh usernames
I've got a few users configured on LDAP, and would like them to be able to connect to a Linux machine via SSH using those users and password on the LDAP directory.
However, there are 2 issues I do not ...
sshuser
5
votes
1
answer
13k
views
Powershell 2: How to strip a specific character from a body of ASCII text
I am trying to strip odd characters from strings using PowerShell. I used the following output to attempt to learn on my own:
get-help about_regular_expressions
I am trying to take a string that is ...
- 812
4
votes
1
answer
4k
views
PuTTY not showing some UTF-8 characters
So many questions and answers about PuTTY and UTF-8 encoding...
Let me summarize: I'm using a patched Nerd Font (https://github.com/ryanoasis/nerd-fonts). It displays fine for most special characters, ...
- 628
4
votes
0
answers
2k
views
Nginx doesn't resolve files with special characters
My wordpress has a couple of images uploaded that have special characters in their file names.
For example: wp-content/uploads/2015/06/cambios-antes-y-después-de-hacer-ejercicio.jpg
I see in my ...
- 181
3
votes
1
answer
3k
views
Linux support for unicode filenames
I have a couple Linux fileserver running Samba, what do I need to do to support filenames with unicode characters?
Do particular filesystem have better support for Unicode?
Would I get better ...
- 132k
3
votes
3
answers
6k
views
UnicodeEncodeError when uploading files in Django admin
Note: I asked this question on StackOverflow, but I realize this might be a more proper place to ask this kind of question.
I'm trying to upload a file called 'Testaråäö.txt' via the Django admin app....
- 51
3
votes
1
answer
3k
views
How to view a remote unicode file via ssh?
I have a unicode file that contains Chinese characters. I have a local and a remote copy of it.
When I use less on the local file the characters are shown properly:
奥尔德林
However, when I ssh to the ...
- 2,458
3
votes
1
answer
777
views
using curl against my IDN doesn't work right; browsers are OK
I've registered www.❺➠.ws, which goes to the same IP as www.naildrivin5.com.
curl www.❺➠.ws
returns the homepage of www.naildrivin5.com. No problem. I modify apache to use name-based virtual hosts ...
- 173
3
votes
1
answer
1k
views
How can I get active directory users and computers to display unicode characters in user names?
In a test environment, we are seeing how you can manage Japanese usernames and english usernames on a Windows 2012 R2 domain controller in Windows 2012 domain.
AdsiEdit.msc displays Japanese ...
- 714
2
votes
2
answers
2k
views
Imapsync doesn't sync unicode characters properly
I am using imapsync to migrate my e-mail account from a CPanel (courier) mailserver to a Debian/Dovecot one. The issue I am facing has to do with some folders that contain Unicode characters. For ...
- 233
2
votes
1
answer
950
views
PHP: No mapping for the Unicode character..., for specific greek characters
I have a windows IIS server working with PHP. The user inserts a word via an HTML form, it goes to PHP and then PHP calls a COM dll (vb6) function passing the word to the function as a utf8 string.
...
- 105
2
votes
1
answer
2k
views
MS-DOS attrib +s 'path not found'
I have to put some specific icons on folders and I had success doing that over all folders except the one that have some special characters.
I'm using windows7.
How it is done?
creating a .ini file ...
2
votes
2
answers
300
views
Re-uploading file with unicode filename creates identical duplicate
I'm running a Django site on a Debian 6 system, with a gunicorn server and nginx 0.7.67 handling static files. The filesystem locale is set to sv_SE.UTF-8.
I got a problem where another user uploaded ...
- 51
2
votes
1
answer
339
views
Logcheck: wildcards which include non-latin characters
On my mail server, I have a custom logcheck rule as follows, which is intended to filter messages from deliver:
^\w{3} [ :0-9]{11} [._[:alnum:]-]+ deliver\.*\): msgid=.*: saved mail to.*$
...
- 131
1
vote
1
answer
494
views
Is there a way to force PostgreSQL to use the UTF-7 encoding for the connection?
I have a PostgreSQL database which uses an arcane text encoding, and I can't change that. Is there a way tostore text in UTF-7 transparently (for the informed client) so that the database engine doesn'...
1
vote
2
answers
3k
views
Using Chinese Characters With Mod_Rewrite
I'm trying to create a rule using Chinese characters
#RewriteRule ^zh(.*) /中文版$1 [L,R=301]
creates error 500 when i change the file to UTF-8
#RewriteRule ^zh(.*) /%E4%B8%AD%E6%96%87%E7%89%88$1 [L,R=...
- 784
1
vote
2
answers
324
views
Unicode versions of common UNIX text tools to run on Windows
I can't afford the MKS toolkit (also think its a bit overkill for my needs). So I was wondering is anyone knew of the standard set of unix text tools but that can handle unicode files under Windows.
...
- 244
1
vote
1
answer
2k
views
gunicorn behave differently when run from terminal and by service
I am using nginx+gunicorn+django for my website.
The following is my gunicorn.conf file:
description "Gunicorn daemon for Django project"
start on (local-filesystems and net-device-up IFACE=eth0)
...
- 113
1
vote
0
answers
37
views
IIS accepting requests with zero-width characters
We're running an API behind a pair of load-balanced IIS v10 servers that route the request to a pair of Tomcat servers (historical reasons for this architecture).
A couple of instances have come up ...
- 131
1
vote
0
answers
150
views
Hosting emoji domains quandary
I am trying to make my IIS8.5 to process IDN domains, including the domains with emoji characters. Since the application runs dynamic hostnames I bind by IP and protocol only. The IIS8.5 does fine ...
- 11
1
vote
0
answers
81
views
Ubuntu Bacula backup chinese (unicode) files
My bacula 5.0.2 on Ubuntu 10.04 LTS is unable to backup chinese/unicode text files. Not a permission issue because english text files like test.txt have no issues. Does anyone have any idea how?
The ...
- 11
1
vote
0
answers
531
views
Linux unicode/umlauts in URL
We have a website, where some pictures name using unicode, e.g. wildkräuter2_big.jpg.
Problem is - when anybody trying to access it - Apache 2.4 returns a 404 error:
$ curl -r 0-99 http://domain....
- 334
1
vote
1
answer
797
views
Problems with vim/locale as non-root user on Solaris
I do some work on a Solaris 10 machine, and my .vimrc is set up to show unicode characters for tabs and line endings:
set listchars=tab:▸\ ,eol:¬
This works out of the box on my OS X machine. On ...
- 111
0
votes
2
answers
432
views
Why doesn't Firefox render this AWstats generated html?
XML Parsing Error: not well-formed
Location: https://awstats.example.org/reports/www.example.org/2011/06/awstats.www.example.org.xml Line Number 603, Column 34:
<tr><td class="aws">-...
- 14.5k
0
votes
3
answers
4k
views
how does one quote unicode characters in mysql prompt or in SQL in general?
I have a weird unicode char in my mysql database
the value looks like this
card issuer bank didn<U+0092>t approve your payment
so what should be an apostrophe is a weird unicode char, ...
- 3,387
0
votes
1
answer
658
views
UNICODE version supported by SQL Server 2016
What is the Unicode standard version supported by SQL Server 2016? (I'm specifically interested in this version. However, information for 2014 or 2017 is welcome as well.)
I can't find this ...
- 404
0
votes
1
answer
150
views
mount and sync non english folder & file names
I'm trying to rsync a folder who's name contains non-english characters it breaks the whole rsync, how can I copy a folder even if they don't have english characters in it?
- 129
0
votes
0
answers
716
views
touch, why I get file name too long error
I have the file with name /home/lenka/Translations/Ф-119-Д/заключение об аннулировании, исправлении и-или дополнении акта о гражданском состоянии_рум-русс.docx
echo -n "/home/lenka/Translations/Ф-...
- 9
0
votes
0
answers
407
views
Displaying Ratio unicode character in putty
I'm wondering if this could be a putty bug.
I can't get displayed properly Unicode Character 'RATIO' (U+2236) https://www.fileformat.info/info/unicode/char/2236/index.htm
Basically it should look like ...
0
votes
1
answer
94
views
Different results for json_encode in Wordpress with php compiled with same configuration and libmbfl version
I have an older Debian server and a local install of Wordpress; I'm trying to track down why calling:
echo json_encode('😀');
on the Debian server results in "\ud83dde00" but on my local install, ...
- 324
0
votes
1
answer
1k
views
Debian 9 - libicu60 dependency while trying to install php7.0-intl
The title says it all... I'm trying to install the php intl extension on Debian 9 and get the following error :
php7.0-intl : Depends: libicu60 (>= 60.1-1~) but it is not installable
Debian repo ...
- 101
0
votes
1
answer
150
views
How can I set mysql connection charset to utf8 in apache mod_dbd?
How can I set connection charset to utf8 in apache mod_dbd with mysql driver? I could not find any corresponding parameter in DBDParams, something like this:
DBDParams host=localhost,dbname=my_db,...
- 325
0
votes
1
answer
308
views
Unicode characters in my PHP configuration
Earlier today I was having an issue where I couldn't setup my PHP7 remote interpreter on PhpStorm
I ended up finding out that I have unicode characters in my PHP configuration:
I have no idea how ...
- 101
0
votes
1
answer
654
views
Postfix header_checks and unicode regexp
Does postfix support unicode regular expressions like \p{Han} to detect unicode scripts? I would like to use them with header_checks.
0
votes
1
answer
908
views
Character set issues in Postgres upgrade
I am moving some databases from Postgres 7.4.8 to 8.4.5, on CentOS 5. In the old database the encoding is UNICODE. So I did a text pg_dump, created my new databases like so:
createdb --template ...
- 257
0
votes
1
answer
764
views
When I ncpmount a Novell server under Linux (Ubuntu 14.04), I do not see filenames with accented characters
I use Linux on my computer at work and the server uses Novell. I am friendly with the IT staff in a "don't bother us, and we won't bother you" kind of way, and I can usually fix my problems myself ...
0
votes
1
answer
340
views
Fail to get unicode URL in IIS 6
I setup an IIS server running at localhost and put 2 file with unicode file name, for e.g:
변태연.txt and 변태연.flv
The 2 files are all real but only 1 working:
localhost/변태연.txt
I don't know why? Do u ...
ByulTaeng
-1
votes
1
answer
757
views
filenames, ASCII unicode escaped sequences to UTF8 [closed]
I'm not sure if I've grasped the issue here so if I haven't just say so and I'll edit the title.
My problem is the following:
I have an Ubuntu 12.04 server (UTF-8 locale) to which users upload files ...
- 379