Copy Database To Different Db/server Problems

[c64audio]

Using 6.05 Enterprise Stable, Windows XP.

I've got two SSH-tunnelled servers open, and using the “copy database to different…” function is extremely ropey: in that I get access denied errors from the destination server. Now, both accounts are properly logged in, and sometimes the problem goes away when you “copy structure + data” as opposed to just copying the structure. Also structure synchronisation wizard gives me persistent “mysql server has gone away” errors.

Also, is there a “reconnect to server” option for SSH-tunnelled connections when you get “MySql server has gone away”? At the moment it seems I have to close the connection and start a new connection: which means I lose my query pane unless I copy to clipboard or save it: a real pain.

While I'm about it: it's an unimaginable pain that SJA for Linux doesn't support SSH tunnelling, presumably as a political decision since you're giving a version away free. My servers on the net are all Linux, and running SJA on a local Windows box behind ADSL to sync two large linux tables is just silly. I've paid for the package that allows SSH tunnelling: it's really annoying that there isn't a premium version of SJA for Linux that is fully functional.

Chris

[peterlaursen]

There is no attempt to reconnect in Structure Sync. But with the copy options there is!

[c64audio]

peterlaursen wrote on Aug 8 2007, 11:36 AM:

There is no attempt to reconnect in Structure Sync. But with the copy options there is!

Well, that partially answers one of the questions, but everything else is still current

1) Copying between two accounts open with SSH port forwarding tends to result in authentication/access denied errors (even if the account is correct): all the time when copying a table without data, and intermittently when copying a table with data

2) Structure synchronisation just plain doesn't work between two accounts open with SSH port forwarding: it complains about the MySql server having gone away, even though it's still live in both boxes

3) Occasionally MySql has gone away during an interactive session: why is there no menu option to reestablish the SSH link?

BTW: Email notification doesn't appear to work, and I've checked my spam filter: it wasn't in there.

Chris

[peterlaursen]

1) this is very strange! are you perfectly sure that this is consistently reproducable?

2) this is probably because connection is lost. The interactive session will reconnect but structure sync will not.

3) same reply as 3. As program reconnects automatically we have not implemented a manually reconnect option.

I believe your problems are issues with the server or with the connection. This does not mean we cannot improve on the 'tolerance' of the program. We will discuss if reconnect attempt can be implemented in Structure Sync. But there are limits to what you should expect from a client if problem is on the server or with the connection.

BTW (4) (mail notification not working): such error can happen on 3 different 'links of the chain':

1) failure on sender client side

2) failure on the server side

3) failure on recipient client side

.. and I think we should start to find out which is the case! We can arrange that you try our server and if we could try yours I think we would be able to find out. You can create a ticket where we can arrange details!

[c64audio]

peterlaursen wrote on Aug 8 2007, 10:00 PM:

1) this is very strange! are you perfectly sure that this is consistently reproducable?

2) this is probably because connection is lost. The interactive session will reconnect but structure sync will not.

3) same reply as 3. As program reconnects automatically we have not implemented a manually reconnect option.

I believe your problems are issues with the server or with the connection. This does not mean we cannot improve on the 'tolerance' of the program. We will discuss if reconnect attempt can be implemented in Structure Sync. But there are limits to what you should expect from a client if problem is on the server or with the connection.

BTW (4) (mail notification not working): such error can happen on 3 different 'links of the chain':

1) failure on sender client side

2) failure on the server side

3) failure on recipient client side

.. and I think we should start to find out which is the case! We can arrange that you try our server and if we could try yours I think we would be able to find out. You can create a ticket where we can arrange details!

The incident where I've got two SSH tunnelled accounts open in SqlYog at the same time and get an authentication error trying to copy tables between them is consistently reproduceable for me. It's also been working OK for most of the rest of the life of SqlYog, which I've had since, I think, version 3 or 4.

Also, interactive mode does not appear to try to reconnect when it gets the MySql Server has gone away message. What's so difficult about initialising the SSH connection again? It looks like it doesn't even try to do that, yet it's perfectly happy to reconnect when I disconnect and reconnect.

Chris

[c64audio]

c64audio wrote on Aug 12 2007, 08:43 PM:

The incident where I've got two SSH tunnelled accounts open in SqlYog at the same time and get an authentication error trying to copy tables between them is consistently reproduceable for me. It's also been working OK for most of the rest of the life of SqlYog, which I've had since, I think, version 3 or 4.

Also, interactive mode does not appear to try to reconnect when it gets the MySql Server has gone away message. What's so difficult about initialising the SSH connection again? It looks like it doesn't even try to do that, yet it's perfectly happy to reconnect when I disconnect and reconnect.

Chris

Another odd thing: I had a row which wouldn't update until I had removed () brackets from a text column: I got MySql generated syntax error messages.

And in addition, SqlYog has a nasty habit of occasionally crashing out when doing interactive data entry, especially entering data quite quickly into a column, pressing the down key each time.

Sorry, but I'm going to have to do a smiley to show how I feel…

[c64audio]

OK, I can see I'm on my own. 😡

I've been using SQLYog for years, recommended it to lots of poeple, and it's never been this broken for me. I guess I'll have to think about looking for something else. Customer service was already rude and offhand to a friend of mine, and I guess tech support is now equally dismissive.

Chris

[peterlaursen]

We have not been able to do progress with the issues that you reported. We have had nothing to write about, and this is why we did not write. So simple, really.

We have however decided to 'push' reconnect in Structure Sync to the 6.1 tree.

Some more specific comments:

Quote:

Iinteractive mode does not appear to try to reconnect

.. well it does! But it does not seem to be able to! How can you be sure that the change is not with your connection or the server and network that you connect to? Can you clearly identify differences in the behaviour of recent SQLyog versions compared to older versions? If you have such information, provide it (also if you think you allready did). We cannot relate to information we do not have or did not understand!

Quote:

and it's never been this broken for me

But i understand that you feel that it is after release of version 6? Please be SPECIFIC!

Quote:

Customer service was already rude and offhand to a friend of mine, and I guess tech support is now equally dismissive

. Mostly looks like it is me, your are reffering to? i will not dicuss anonymous persons in a public Forum, but this person is very welcome to create a ticket and point our attention to not only technical matters, but also if he is dissatisfied with 'procedure', 'attitude' and 'tone'.

Quote:

SqlYog has a nasty habit of occasionally crashing out when doing interactive data entry …

We will (again) try to reproduce this tomorrow. Until now we have not been able to.

'

[peterlaursen]

sorry .. I forgot this:

If you can reproduce a crash, please attach the DUMP file here

[peterlaursen]

The crash is not reproducable (3 persons, 3 systems) on our side!

a DUMP file and/or a very detailed reproducable test case would be appreciated!

[c64audio]

peterlaursen wrote on Aug 20 2007, 09:10 AM:

sorry .. I forgot this:

If you can reproduce a crash, please attach the DUMP file here

Dump file attached. You could probably recreate the problem by going to a cell, having a string in the clipboard: then press CTRL-V, down Arrow, CTRL-V, down arrow, quickly, as if you're trying to paste the same value into a whole column without using “update”.

As to your other comments:

My previous post was a complaint, it wasn't intended to be diagnostic, since I have already provided lots of information.

Specifically (and it's IRRITATING to have to repeat myself), I'll narrow myself to two showstoppers.

**** THE ACTUAL PROBLEMS *******

1) If you try and copy a table between two servers which are connected to using SSH tunnelling, you get an authentication error, DESPITE both connections still being live and the passwords being correct. I've attached a picture of the error, which is coming from the destination server: despite the fact that the open connection to the destination server is still live and functional, having been tested mere seconds before. (and is still live after the attempt to copy).

2) If you see “MySQL Has Gone Away” during an interactive session on an SSH tunnelled connection, the only way to recover is to disconnect and reconnect. And this applies to at last two completely different servers. It looks to me as if SQLYog is not monitoring the SSH input correctly for this message and so doesn't either reconnect within SSH, or destroy the SSH connection and start again.

My comments about earlier versions are designed to show that I'm not making this up, that I AM an experienced user (you just don't seem to get that), and that you really should be less offhand with your established clients: all I can describe are the symptoms I'm seeing, and the _diagnostic_ fact that it wasn't present in earlier versions: for instance, most of version 5 was fine, though I recall problems with 5.25 in this area. Demanding specific information about WHICH versions it used to work in is just unreasonable and looks like an attempt to make me give up complaining by bombarding me with ever more detailed requests for information (I'm well aware of that technique, having been in IT for nearly 30 years).

I've installed version 6 now: you want me to go back and find install builds for previous versions and test them painstakingly in each one? Perhaps I should packet sniff for you as well? If I do, are you going to pay my consulting rate if it's a bug in your software?

Chris

[peterlaursen]

Thanks.

We will check the dump file and discuss what else points you expressed here

But we cannot possibly relate to anything else that what exact information is written. We have 100.000's of user and can't know the skills of everyone.

[peterlaursen]

We have released 6.06 beta2. We believe this one fixes the issue with 'copy to other …' using two SSH connections. Please verify this.

The announcement:

http://www.webyog.com/forums//index.php?showtopic=3441

Your dump also tells us the position where the crash has occured with fast data entry as you dscribed it. It is clipboard related, as you suggested – that much we can confirm. But we still have not been able to reproduce a crash or find a bug in the code yet.

[c64audio]

peterlaursen wrote on Aug 20 2007, 04:17 PM:

We have released 6.06 beta2. We believe this one fixes the issue with 'copy to other …' using two SSH connections. Please verify this.

The announcement:

http://www.webyog.com/forums//index.php?showtopic=3441

Your dump also tells us the position where the crash has occured with fast data entry as you dscribed it. It is clipboard related, as you suggested – that much we can confirm. But we still have not been able to reproduce a crash or find a bug in the code yet.

Thank you, I will test that build.

For the fast data entry thing, the impression I got was that it was a problem when a row is updated while the previous row is still updating (maybe a simultaneous connection problem, or a buffer overrun?). When I press “down arrow”, there's a non-zero (noticeable) period of time when the program is busy (presumably updating MySql). Test the data entry out on a system 120ms away by ping-time, accessed by SSH and you'll be replicating the circumstances of this bug.

Chris

[c64audio]

OK, that fixed the “copy database” bug, thanks.

Chris

[peterlaursen]

now two issues left:

1) the crash that is clearly reproducable for you but not for us.

2) enable reconnect in structure sync

[c64audio]

The new beta ignores my previous connections I set up: I find an sqlyog.bak.ini in that directory which now has that information in it, but SQLYog doesn't read it any more.

I'm sure the data entry crash bug is to do with the speed at which I'm entering the data and the slight pause while the data is updated meaning something's getting triggered wrong.

Chris

[peterlaursen]

1) Please refer to the beta1 release notes: From 6.06 beta 1 the .ini file is no longer read from installation folder but from user's 'application data' folder.

2K,XP,2003: /documents and settings/user/application data/sqlyog (i think, but currently I only have Vista available!)

Vista: /users/user/AppData/Roaming/SQLyog

(note that folder names may be localised/non-english)

First time the program is opened after install of 6.06 the .ini, .err and .log files are copied to the new position (and a backup left in original position). Did that copy process fail for you? We have tested it VERY MUCH and have no other reports of such failure!

2) I think we should try to reproduce with a so-called 'slow connection'- it might be a buffer that runs over if user is faster than the connection!

Is it a SSH-connection that you use when reproducing or any kind of conenction?

[c64audio]

peterlaursen wrote on Aug 20 2007, 09:34 PM:

1) Please refer to the beta1 release notes: From 6.06 beta 1 the .ini file is no longer read from installation folder but from user's 'application data' folder.

2K,XP,2003: /documents and settings/user/application data/sqlyog (i think, but currently I only have Vista available!)

Vista: /users/user/AppData/Roaming/SQLyog

(note that folder names may be localised/non-english)

First time the program is opened after install of 6.06 the .ini, .err and .log files are copied to the new position (and a backup left in original position). Did that copy process fail for you? We have tested it VERY MUCH and have no other reports of such failure!

2) I think we should try to reproduce with a so-called 'slow connection'- it might be a buffer that runs over if user is faster than the connection!

Is it a SSH-connection that you use when reproducing or any kind of conenction?

1) There's an ini file there (now), but it was either new or missing when I first booted 6.06, since the contents of the original file just didn't make it over to the new place. The XP account concerned has admin permissions, and is pretty much the only account used on the machine.

2) I've seen the crash on SSH and non-SSH connections.

Chris

[peterlaursen]

We will try again to reproduce the fast data entry crash. Could you attache 1 or 2 dumps more (as

they may give a hint).

[c64audio]

peterlaursen wrote on Sep 3 2007, 11:32 AM:

We will try again to reproduce the fast data entry crash. Could you attache 1 or 2 dumps more (as

they may give a hint).

The last one wasn't even a fast data entry crash: it was just a CTRL-V crash. It always happens during a CTRL-V operation.

[attachment=738:dumps.zip]

[peterlaursen]

“It always happens during a CTRL-V operation.”

I would like to ask you if you have an option to test with another system?

There might be something wrong with your system!

Anyway we will of course check this dump tomorrow (Tuesday)

[c64audio]

peterlaursen wrote on Sep 3 2007, 09:01 PM:

“It always happens during a CTRL-V operation.”

I would like to ask you if you have an option to test with another system?

There might be something wrong with your system!

Anyway we will of course check this dump tomorrow (Tuesday)

It's 5 dumps. Could have been 6, since it just did it again.

Points to note:

1) Of course, it doesn't happen EVERY time I press CTRL-V.

2) I'm using keyboard control only during the time this happens.

Another system? I'll try tomorrow.

Chris

[peterlaursen]

This CTRL-V crahs is absolutely not reproducable for me (and the rest of us are sleeping!). However I am also pretty sure that we would have heard about it before if it was a general problem.

Do you have any software installed that enhances or changes clipboard functionality?

[c64audio]

I have Microsoft Office XP installed, but I haven't noticed Office Clipboard being installed, so I'd say no.

Incidentally, I just installed SQLYog 6.06 stable enterprise onto a machine that previously had SQLYog 5.03RC1, and it lost the ini settings again: and I checked the steps that it displays while installing, and it didn't mention anything about migrating settings, copying ini files, or anything else.

So that's two machines it's happened on, and I did nothing special to install: download (didn't save to a dir first, just selected “run”), then install, follow prompts automatically, then start SqlYog automatically.

I'm testing the machine now, which is on the same LAN as the MySql server, and is running Windows 2003 server.

Chris

[c64audio]

I'll add this, too: before it happens (after pasting the last successful cell, there's an odd pause of about 1/2 second. Then, though I can move about the grid, I know the next CTRL-V will result in a crash. That indicates that the clipboard is getting corrupted after being pasted that final time, so I guess the clipboard is pointing somewhere nasty at that point.

Interestingly after the crash I can still navigate round the software, click the menus and even right click, but the next action that requires any actual work, it exits.

Chris

[c64audio]

And I just replicated the problem on said Windows 2003 server, which is running pretty much nothing. This time, that installation wasn't even polite enough to create a dump: it just quit straight out. It only took about 10 pastes to get it to happen.

As a programmer (which I am), my next step would to think about possible ways in which the clipboard would get corrupted by the paste function rather than fixating on the fact that you can't replicate it: it's obvious here that I'm doing something different to you, and triggering a different code path. Somewhere, your program is corrupting memory.

As for people not complaining: (a) you'd be surprised what people put up with (after all, I've only just started complaining about it, but I've been putting up with it for months), and (:cool: probably not many people use SqlYog to do what I'm doing (mass data entry using keys and copy/paste in the results pane on the result of a query). So I wouldn't put much stock in that. I've had quite nasty bugs myself which have taken months for people to report.

Chris

[peterlaursen]

Quote:

Somewhere, your program is corrupting memory.

There is no program that you have installed on both systems that may do this (corrupt memory) and interact with SQLyog .. a driver for instance? Do you use the same Firewal/AV software on those systems for instance?

Of course not everyone would report. But still we tried on quite a lot of systems and spent at least 10 hours trying to 'catch' this crash. And of course we have been reviewing the code too.

But let's see if your latest dumps will give more hints.

[c64audio]

There is no application software common to both systems, except SQLYog itself and MySql server: not even Microsoft Office is installed in the 2003 Server machine.

Chris

[peterlaursen]

Sorry for continuing asking questions like this!

Are you connecting to the same server and/or the same data all the time?

Is it reproducable even if you create a small silly table with 3-5 columns on 'localhost'?

[c64audio]

peterlaursen wrote on Sep 4 2007, 09:24 PM:

Sorry for continuing asking questions like this!

Are you connecting to the same server and/or the same data all the time?

Is it reproducable even if you create a small silly table with 3-5 columns on 'localhost'?

I've seen it attached to different servers on different continents, both with direct access and SSH tunnelling.

I never tried the localhost thing though. One of my DBs on the Windows 2003 server is local.

Chris

[peterlaursen]

I only asked this question because a developer asked if the table was very 'wide' (having hundreds of columns)

[c64audio]

No, consistently happens in a table with less than 10 columns: one common thing is that the tables tend to have text fields in them: although the text field is not necessarily showing in the results pane at the time of the problem (I'm usually editing a query output, not a table).

Chris

[peterlaursen]

We have fixed an(other ?) issue reported by another customer where the program enters an infinite loop when executing SET CHARSET after a reconnect.

This bug was introduced in 6.06 when we re-enabled reconnect in Structure Sync (that was accidentially removed in 6.0).

You may try if it makes any difference for your issues:

http://www.webyog.com/downloads/betas/not_…QLyog607Ent.exe

[Author]

Posts