Tag Info

Hot answers tagged

10

There's no 100% accurate way really, but there's a way to give a good guess. There is a python library chardet which is available here: https://pypi.python.org/pypi/chardet e.g. See what the current LANG variable is set to: $ echo $LANG en_IE.UTF-8 Create a filename that'll need to be encoded with UTF-8 $ touch mÉ.txt Change our encoding and see ...


10

The problem here doesn't seem to be on your browser nor your Apache configuration. You need to double check the locale settings of your system. You need to check if the locale apache is running is UTF-8 enabled. To do so you may run the command: $ sudo su -l -c locale www-data where www-data is the apache user. Check if the locale returned doesn't ...


9

As outlined in http://dev.mysql.com/doc/refman/5.5/en/charset-unicode-sets.html this seems to be the correct behavior: utf8_general_ci also is satisfactory for both German and French, except that “ß” is equal to “s”, and not to “ss”. If this is acceptable for your application, you should use utf8_general_ci because it is faster. Otherwise, use ...


8

Bitstream Vera Sans Mono does not support the Chess Symbols section of UTF8. Courier New also does not currently support the Chess Symbols section of UTF8. You'll have to find a Unicode font that supports chess symbols. Consider DejaVu Sans Mono which is Bitsream Vera Sans Mono, just with more unicode characters (including the chess symbols). FYI, these are ...


8

Hmm, a quick package search doesn't give anything like a single, standalone utility. On the other hand, it shows that there's an appropriate Perl library, and it's easy enough to whip up a quick perl script. Something like: $ sudo apt-get install libmime-base32-perl And then a script like base32enc.pl: #!/usr/bin/perl use MIME::Base32 qw( RFC ); ...


7

You can manually set the content type for specific file extensions in the web.config file for each web site where this is needed. In the root for the site, find the web.config file and add the remove and mimeMap lines as below (or create the entire file if it doesn't already exist). <?xml version="1.0" encoding="UTF-8"?> <configuration> ...


6

In order for non-ASCII characters to work, all the programs involved must use the same character encoding. The encoding needs to be set: 1) in Putty (you have done that) 2) on the remote system (usually by setting the LANG env variable to a suitable locale) Then using non-ASCII on the console should work. The settings for vim are (mostly) independent of ...


5

How is the PHP code distributed to your servers? From version control? By copying it from developers workstation? rsyncing it from master server? What I'm thinking is that someone using Windows might have edited the PHP file generating the e-mails directly on that server, causing line feeds to be \r\n (DOS) instead of just \n (Unix). That might mess up the ...


5

If you pre-specify Content-length, Apache won't have to use chunked. Without Content-length, Apache has no option but to use it. To be clear: HTTP/1.0 manages it because Apache reads in the entire response before sending it along, so it know how large it'll be. This is hilariously inefficient, and slow, and AFAIK there's no way to enable this logic for ...


5

Each database in a cluster can have its own encoding, although this probably isn't useful for most people. When you create the cluster, the encoding you specify is used for the template1 and postgres databases, so it is the default for all new ones. You can create a new database from template0 in a different encoding, though. \encoding shows the encoding ...


5

You may find this useful, to test the current working directory (python 2.7): import chardet import os for n in os.listdir('.'): print '%s => %s (%s)' % (n, chardet.detect(n)['encoding'], chardet.detect(n)['confidence']) Result looks like: Vorlagen => ascii (1.0) examples.desktop => ascii (1.0) Öffentlich => ISO-8859-2 (0.755682154041) ...


5

E-mail without MIME support (which is optional) is defined by RFC 5322, and only allows "printable" ASCII characters. MIME extends this standard and allows other encoding schemes for certain fields (subject included). When encoding a header, you use the "Encoded-Word" method: The form is: "=?charset?encoding?encoded text?=". charset may be any ...


5

You don't. The web server is allowed to decode percent-encoded characters which don't decode to special characters before applying rewrite rules, and is allowed to decode the remainder of percent-encoded characters before passing the data to your web application. (See RFC 3986.) What you should be doing is applying the front controller pattern in your web ...


4

Human names aren't limited to US-ASCII so anything involving a person's name (e.g. To:, From:', Reply-to: and CC:) are legitimate. RFC 2047 shows examples of this. It wouldn't surprise me if product name headers (X-Mailer:) showed up with encoded characters as well.


4

You can use the following code in your httpd.conf if you have access, or even your .htaccess , to force Apache, to send an UTF-8 encoding header. AddDefaultCharset utf-8 AddType 'application/json; charset=UTF-8' .json


4

You are right that the convert extension doesn't support this in a nice way currently. That is, you cannot ask it to recode from encoding X to encoding Y. However, you can ask it to rename the files one by one for you! First create a file called rename.py with import sys for path in sys.stdin: old = path[:-1] # strip newline new = ...


3

Ok, answering my own question here, based on some googling and the helpful comments by mailq. In short: I installed and used mutt. I had to fiddle a bit with my setup: Inside the directory my_dir where fakemail was creating the mail files, I created the dirs new, cur and tmp and pointed fakemail to my_dir/new. Then I started mutt with mutt -f my_dir Now ...


3

It seems like you're going to a lot of trouble to work around a (severe IMHO) limitation in Notepad. Would it be possible to install a smarter text editor on the system, e.g. Notepad++?


3

In /etc/mysql/my.cnf add this line under [client] default-character-set=utf8


3

I have figured this out now, and perhaps the reason for the lack of answers was that my question omitted a crucial detail, which was that this is an ASP.NET web site. The content encoding is set in the Machine.config file when the .NET Framework is installed, and it defaults to UTF-8. You can edit this file which will affect the response encoding of all ...


3

I believe that FFserver can do what you're looking for. It's a part of the open source cross-platform FFmpeg suite, available at http://www.ffmpeg.org/


3

Your editor probably did insert a BOM "Byte Order Mark" in the beginning of the file. This is bad behaviour from your editor as BOMs are of no use in UTF-8 encoding, it is only usefull in UTF-16 or UTF-32. However, this behaviour seems to be common in several editors. Either, there is a way to specify that you do not want the BOM in your file (e.g. in ...


3

Nothing more complex than just plain old ASCII. I understand UTF-8 is backwards compatible with that so you should be ok with it. As an aside, I've been down the route of writing programs to control and get reports from various Cisco boxes, I started out using console connections but realised after a fairly short time that it really is not a long term ...


3

If its american gear, I think I can safely state that it just uses ASCII for its normal text. It probably won't perform any kind of character set checking, so user-defined names could be any character set as long as the individual bytes are valid as far as the device is concerned. If you receive gibberish from a serial connection, the port is configured ...


3

^[ is another representation for Escape (pressing Ctrl-[ is the same as pressing the escape key - the carat represents the control key). These are the beginning of ANSI color sequences. I don't think vim is going to show those colors (unless there's a filter that processes them). There is a plugin for vim called AnsiEsc that will display the results of ANSI ...


3

The above answer is incorrect. If request is HTTP/1.0, Apache never buffers the response before sending it (with Content-Length header). Of course Apache could do that, but there is more elegant solution that Apache uses: it responds with "Connection: close" header and closes connection as soon as it sends all the data. According to HTTP spec, the presence ...


3

According to this page you have to add the mime types to the server, in Apache it would be: AddType video/ogg .ogv AddType application/ogg .ogg


3

The % is being read as a back reference, so you need to escape the %.


3

It would appear that there is an encoding issue happening somewhere. I can't tell you where it is, but I can suggest how to find it. As I understand it, there are 5 places where the encoding could be being incorrectly handled or interpreted. These are: Browser turning characters into bytes to send to the web server Apache understanding those bytes to ...


2

It seems to be you database cluster have LATIN1 locale. When you are setting cluster, you can add --locale parameter - see this document for more informations. Your databases will be created according to this parameter. Some locale parameters you can set in the configuration file. For example my settings from /etc/postgresql/9.1/main/postgresql.conf: ...



Only top voted, non community-wiki answers of a minimum length are eligible