Sync Problem (accent Character)

[Plamex]

Hi!

My problem: I want to synchronize between 2 Mysql server.

Parameters:

Source:

MySQL 4.1.13-Max server

UTF-8 Unicode (utf8)

(utf8_genetal_ci)

through: SQLyogTunnel.php

Dest (local server):

MySQL 4.1.18-nt

UTF-8 Unicode (utf8)

SQLYog Enterprise v5.2 Synchronization tool

Everything works good but in place of accent characters I can see only “?” characters.

How can I solve this problem ?

[peterlaursen]

Are you using HTTP-tunnelling?

If yes, this http://www.webyog.com/forums/index.php?showtopic=1915 probably is the reason

There is an issue with special characters an MySQL >= 4.1 with HTTP.

Can you INSERT those strings from GUI with the same connection?

Please write some string examples here!

[Plamex]

peterlaursen wrote on Mar 8 2006, 03:45 PM:

Are you using HTTP-tunnelling?

If yes, this http://www.webyog.com/forums/index.php?showtopic=1915 probably is the reason

There is an issue with special characters an MySQL >= 4.1 with HTTP.

Can you INSERT those strings from GUI with the same connection?

Please write some string examples here!

Yes I use proxy and HTTP tunnel too…

And the charset is hungarian …

In GUI the characters seems well … throught same connection but the synchronization works bad.

And if i export dump with phpmyadmint and import to local mysql with phpmyadmin the characters seems good.

In gui how can I make SQL export ? Tools -> Export Database as SQL statements not work (Error No. 1044 Access denied for user xxx@IP.% to database xxx.

For example from phpmyadmin dump ….

INSERT INTO `levelek` VALUES (225, 990091, '', 'következõ felhasználónévvel és jelszóval');

[peterlaursen]

Quote:

In gui how can I make SQL export ? Tools -> Export Database as SQL statements not work (Error No. 1044 Access denied for user xxx@IP.% to database xxx.

It that happens with HTTP-tunnel and user name has special charcater(s) to try replace in tunnelling file

$mysql = mysql_connect ( “$host:$port”, $username”, $pwd );

with

$mysql = mysql_connect ( “$host:$port”, “utf8-encode($username)”, $pwd );

But please be more precise on write isuue!

Can you write /INSERT/UPDATE) all those strings with Hungarian characters using HTTP-tunnel for the connection. Please try quite a lot of them! And from GUI as well as from SQL-pane.

[Plamex]

peterlaursen wrote on Mar 8 2006, 04:27 PM:

It that happens with HTTP-tunnel and user name has special charcater(s) to try replace in tunnelling file

$mysql = mysql_connect ( “$host:$port”, $username”, $pwd );

with

$mysql = mysql_connect ( “$host:$port”, “utf8-encode($username)”, $pwd );

But no special character in username. It is: otka

peterlaursen wrote on Mar 8 2006, 04:27 PM:

But please be more precise on write isuue!

Can you write /INSERT/UPDATE) all those strings with Hungarian characters using HTTP-tunnel for the connection. Please try quite a lot of them! And from GUI as well as from SQL-pane.

I can change INSERT/UPDATE all those strings with Hungarian characters in GUI and seems well.

But I find sometging ….

If i try to change local dest mysql server with GUI … and write spec characters it seems ? in GUI

Destanation local server has no http tunnel and I cant write spec characters with GUI. (I'v wrote and seems “?” )

[peterlaursen]

Have you checked either of these:

*Lock all tables for read

*Flush logs before dump

If yes try uncheck them.

Well this 'Turkish issue' appears with direct connection as well.

Could you try you can write plain INSERT statements from SQL-pane with those characters?

Actually I am surprised that it works with HTTP. But your ISP has probably set up a special character-encoding-schema with the PHP configuration.

[Plamex]

I have problem only with destanation side:

Dest (local server):

MySQL 4.1.18-nt

my.ini : default-character-set=utf8

>Could you try you can write plain INSERT statements from SQL-pane with those characters?

Yes. I tried insert with “paste SQL Statements” INSERT INTO … spec characters

… but no matter is this direct or tunneled connection.

The issue is:

[attachment=390:attachment]

?? characters …

> Have you checked either of these:

> *Lock all tables for read

> *Flush logs before dump

> If yes try uncheck them.

How can i do ? How will solve this my problem ?

I'v found something : If I connect to local dest server w GUI and run this query 'SET NAMES latin1'

afterwards

I can change (UPDATE/INSERT) spec characters … and it seems good. How can I applicate this into syncronization ?

I'v tried this :

into SQLyogTunnel.php in local dest server

WriteLog ( “Trying to connect” );

$mysql = mysql_connect ( “$host:$port”, $username, $pwd );

$sql = 'SET NAMES latin1;'

mysql_query($sql, $mysql);

and set tunnel in GUI. But it not works …

[Plamex]

Could you help me ?

[peterlaursen]

1)

Quote:

I'v found something : If I connect to local dest server w GUI and run this query 'SET NAMES latin1'

afterwards

I can change (UPDATE/INSERT) spec characters … and it seems good. How can I applicate this into syncronization ?

I am afraid it only seems to work! Those special characters will only bed read correctly by SQLyog. Any client that read the data corrrectly as UTF will not read the correct caracters. SQLyog insert wrong data, but 'reverses' the error when reading. Just as is the case when inserting localized object names into the Embedded database with 5.1 version.

2)

You cannot edit the tunnelling file this way! Dus to the nature of the HTTP-protocol SET NAMES must be done for each SQL-statement. Actually there is a set_names() function in the tunnelling file allready. You can edit this.

3)

Quote:

Could you help me ?

We have been disucssing this for more than a month now since it became obvious that there was a problem. As I wrote elsewhere, I believe that the only solution is that SQLyog communicates with the tunnelling file in UTF-8. Then a ANSI<>UTF coverter library (supporting ALL ANSI localisations) must be included with SQLyog.

I am afraid that I personally can't do more now.

4)

There is no chance that you can hve direct connection or SSH-tunnel to the server?

[Ritesh]

We are working on this issue and will get back soon.

[Plamex]

Ritesh wrote on Mar 10 2006, 04:46 AM:

We are working on this issue and will get back soon.

Please send to me the issue when coming …

[Author]

Posts