I am trying to make search unsing solr on my database. below is the snippet that create my solr index
<?xml version="1.0" encoding="UTF-8"?>
<dataConfig>
<dataSource batchSize="-1" convertType="true" driver="com.mysql.jdbc.Driver" password="" url="jdbc:mysql://localhost/mysolrdb" user="root"/>
<document name="items">
<entity name="root" pk="id" preImportDeleteQuery="data_source:1" query="select id,headline as title,body,date as datecreated from article" transformer="TemplateTransformer" deltaImportQuery="select id,headline as title,body from article where id='${dataimporter.delta.id}'" deltaQuery="select id from article where last_update_time > '${dataimporter.last_index_time}'">
<field column="data_source" template="1"/>
<field column="data_source_type" template="Jdbc"/>
<field column="data_source_name" template="elpis_syndigate"/>
</entity>
</document>
</dataConfig>
and the table in mysql is
show create table article; CREATE TABLE `article` ( `id` int(255) NOT NULL, ..other fields ) ENGINE=MyISAM DEFAULT CHARSET=utf8
now, some of the articles are written in non-english characters (Arabic). and solr is getting these articles as rubbish characters. although when i search for something i got a result, but it is in un-readable characters.
anyone faced the same case? how can i fix it?