Confusing Message From Sqlyog Migration

[Keith Macdonald]

Just tried using SQLYog to migrate one table from SQL Server.

The source table ForumTopic_tbl has 315358 rows.

When I run the migration wizard, I see these messages.

DBMS Information: MICROSOFT SQL SERVER

Importing table schema: ForumTopic_tbl… Successful…

Importing table foreign keys: ForumTopic_tbl… Successful…

Importing table data: ForumTopic_tbl…

130438 rows transferred!

Which suggests the wizard has finished/stopped the transfer after 130438 rows, but not copied the whole table.

To make things more confusing, the “Terminate” button is enabled, but the “Back” and “Next” buttons are disabled, which suggests something is still running.

Am I doing something wrong? Any ideas?

[Keith Macdonald]

Sorry folks, this might be the answer, which appeared c.30 minutes afterwards

ERROR: [Microsoft][SQL Server Native Client 10.0]TCP Provider: The specified network name is no longer available.

Sounds like a network error, I'll try again.

[Keith Macdonald]

Strange, same error at the same row

SQLyog Job Agent Version 8.3 Copyright(c) Webyog Softworks Pvt. Ltd. All Rights Reserved.

Job started at Tue Mar 23 12:37:43 2010

DBMS Information: MICROSOFT SQL SERVER

Importing table schema: ForumTopic_tbl… Successful…

Importing table foreign keys: ForumTopic_tbl… Successful…

Importing table data: ForumTopic_tbl…

130438 rows transferred!

I suspect there is some invalid characters in that row (or the one after) it which is corrupting the transfer. But the message is still confusing.

[peterlaursen]

If this is data specific we need a test case with data.  But if the ODBC driver does not return a reasonable error message or error number, I cannot guarantee anything.

Could you try to find more information? Like locate that row (and maybe even try to delete it temporarily)?  Also tell the exact driver version?

[Keith Macdonald]

Thanks Peter

I suspect it is the data as well. I've been cleaning-up and filtering the data before trying to use the Migration Wizard. e.g. replacing NULL with '' or 0.

But I'm sure that some of the VARCHAR or TEXT columns will contain characters like

Single-quote '

Double-quote “

as well as Tabs, HTML mark-up, and anything else users have pasted in.

So – I'm wondering if the Wizard is using any special delimiter around VARCHAR or TEXT columns? I would need to remove or replace those in the source data as well.

Thanks

Keith

[Keith Macdonald]

'Keith wrote on '23:

Thanks Peter

I suspect it is the data as well. I've been cleaning-up and filtering the data before trying to use the Migration Wizard. e.g. replacing NULL with '' or 0.

But I'm sure that some of the VARCHAR or TEXT columns will contain characters like

Single-quote '

Double-quote “

as well as Tabs, HTML mark-up, and anything else users have pasted in.

So – I'm wondering if the Wizard is using any special delimiter around VARCHAR or TEXT columns? I would need to remove or replace those in the source data as well.

Thanks

Keith

[Keith Macdonald]

Just thought of another possibility, the MySQL insert buffer size. Would that matter if the source table has (say) 100,000 or 1,000,000 rows?

[Keith Macdonald]

Sorry Peter

I realise know that I have been misunderstanding how the Migration Wizard shows rows transferred.

For example, another table (progress so far):

DBMS Information: MICROSOFT SQL SERVER

Importing table schema: ForumVote_tbl… Successful…

Importing table data: ForumVote_tbl…

376394 rows transferred!

750944 rows transferred!

So the number of rows transferred is increasing, but only shown at strangely-large intervals.

The actual source table contains 1652995 rows, so maybe these numbers 376394 and 750944 are fractions of the total? But it's a strange way to show progress.

As a positive offering, I've raised a Feature Request for a proper progress bar, with the suggestion that the Wizard first does a count of rows in the source table, then shows percentage progress.

Thanks

Keith

[navyashree.r]

Hi Keith,

Issue is added in our issue tracker,

http://code.google.com/p/sqlyog/issues/detail?id=1253

Thank you. We will discuss with other team members and come up with better GUI and set the priority too and update.

Regards,

Navya

[Author]

Posts