[vygi]

peterlaursen wrote on Dec 30 2005, 03:26 PM:

Will I need that 'proces explorer' program to reproduce?  Task manager will do as well I guess? You are sure that it is not that 'proces explorer' program that smashes Windows Menory management?

[post=”8314″]<{POST_SNAPBACK}>[/post]

No need for Process Explorer, it's clearly visible also using Windows Task manager.

Start it, and start to move/resize SQLyog. You'll see…

BTW, Process Explorer is nothing that runs permanently, so it's impossible that it “smashes Windows memory management”.

It can replace Task manager and be called using Ctrl-Shift-Esc if you choose that. I like it and use it because it delivers much better overview about things going in Windows. Just try it – it's free!

[vygi]

To sum up:

– amount of used memory grows just slowly if you resize/move window but there are no query results in the grid, or you switch eg. to “Message” tab, but it grows very rapidly (up to many MB/s) if a big result is being displayed.

– I think, repeated F5 only increases memory use because the result grid must be updated (like while window switching/moving/resizing).

[vygi]

Ritesh wrote on Dec 23 2005, 04:26 PM:

This is very strange. Can you provide me with steps to reproduce the error?

Any hints where I can start?

[post=”8268″]<{POST_SNAPBACK}>[/post]

NOW I HAVE IT!! 😎

I was just searching for some information in the databases and realized that SQLyog has reserved more than 100MB RAM having just two open connections and 4 query editor tabs with few result lines in each. I have closed all connections but memory use was still above 90 MB (“Private Bytes” in Process Explorer by sysinternals.com).

I have saved all my queries, restarded SQLyog and tried to reproduce this issue… without any results at the beginning. Then I saw that with every run of a query (every press of F5) SQLyog takes a bit more memory.

1. Fresh restart, one DB connection: 5,352 KB

2. Load a file with some queries: 7,536 KB

strange: it needs more than TWO MEGAbytes just to load an ONE-KILObyte text file with 4 queries inside, without executing anything?

3. Close connection: 6,348 KB

4. Re-open connection and re-load same file: 7,560 KB

5. Run a query once (it takes about 50 ms and returns 78 short rows): 7,688 KB

6. Run same query one more time (just press F5): 7,752 KB

7. Press F5 10 times: 8,308 KB

8. Close connection: 7,168 KB

9. Re-open connection: 8,360 KB

10. Select 1,000 rows from a big table (SELECT * FROM table LIMIT 1000): 10,680

NOW, THINGS START TO GO CRAZY:

11. Change approximately 10 times with Alt-Tab between SQLyog and Process Explorer: 21,408 KB

Note: this is without doing anything with SQLyog!!!

At this point, I thought I must stop this switching between SQLyog and Process Explorer, so I did following:

12. Maximize Process Explorer window, switch to SQLyog, restore (“un-maximize”) SQLyog window and change its height with the mouse… WOW! memory usage grows permanently! After ca. 30 s of changing window size, it has occupied more than 200 GB. The growing speed of “Private Bytes” is approximately 10MB/s when I change the SQLyog window size or move window with the mouse, or aprox. 1.1 MB with each switching with Alt-Tab to some other program and then back.

Huh… I think that you will not need any data examples because it works with any MySQL table: just select some data, and then try to move SQLyog window around and/or change window size and/or switch to other applications and then back. It needs more memory with every re-painting of its own window.

Happy Fixing (and Happy New Year indeed),

Vygi

[vygi]

20 MB?.. Tables larger than 4 GB are usual here! 😛

And they work very well!

Most of our tables consist of so-called CDRs (Call Data Records): every telephone call generates one CDR on one telecommunication switch, mostly 2-3 CDRs pro call, sometimes up to 6-8 as several devices are affected. We (a small telecom company) have more than 0.5 mio calls every day, that means far more than 1,000,000 new data rows daily, recently more than 5 GB every month. The biggest table at the moment contains 44 mio. rows, data file size is 18.5 GB, index size 1.3 GB. An it is still fast enough for our purposes: response time for simple insert and update queries is always below 5ms while sequential processing of data. Our main OLAP database (still under construction) which is based on star schema has almost 150 mio rows in a merged MyISAM table. Total data size is 15 GB, index size 12 GB. Some simple queries take just several milliseconds, larger ones can take up to few minutes, which was the reason to introduce aggredated summary tables.

BTW I can't reproduce this memory leak, SQLyoug works very well.

[vygi]

Ritesh wrote on Dec 23 2005, 04:26 PM:

This is very strange. Can you provide me with steps to reproduce the error?

Right now I have again 321.524K (1/3 G:cool: “Private Bytes” reserved by SQLyog with no open connections. I have run several queries which return few rows (or even no rows at all) from a table with 12+ GB of data. I will try to reproduce it… stay tuned! 😉

[vygi]

Happy holidays averybody! 🙂

Any news re data export to Excel?…..

[vygi]

Ritesh wrote on Dec 21 2005, 04:21 PM:

Are you sure the query is proper i.e. indexes are correctly used? It might be that the MySQL client library needs to create lot of data at the client side to create the correct resultset for your query.

[post=”8247″]<{POST_SNAPBACK}>[/post]

Isn't SERVER always creating the final result set and sending it to the (dumb) client?

I always thought that clients don't need to make any operations with the data they get from the server.

[vygi]

carltond wrote on Dec 21 2005, 03:45 PM:

After a few minutes I check the Windows' Task Manager and it suggests that SQLYog is using 800,000K worth of memory.

[post=”8245″]<{POST_SNAPBACK}>[/post]

Recently I've got same problems!

After running of several queries, SQLyog has suddenly occupied almost one gigabyte of RAM on a XP machine which has 512 MB RAM. I've tried to close all (actually both) DB connections but memory usage remained that high: about 960MB without any opened connections! I had to closed and restart SQLyog to free this memory. 2-3 hours later, memory usage was again 447MB.

Same problems (“out of virtual memory”) were reported by one of my workmates.

That's really strange because I don't run any queries who return big amount of data. All result sets are usually small, mostly just 3-4 rows, in rare cases more than 100.

I also did not have such problems before so it can be something related to one of the newest versions.

[vygi]

peterlaursen wrote on Dec 8 2005, 11:54 AM:

Thanks for the enlightment!

Well, yes that could be useful too.

However you could also use the DATA SYNC tool.  Import the .sql to a 'dummy' database and sync the 'dummy' with the 'real' DB.  It gives you more options, I think (row filtering, column filtering).

[post=”8151″]<{POST_SNAPBACK}>[/post]

I'm not really sure but I think that Data Synchronization will fail if tables have different field order.

See this thread: http://www.webyog.com/forums/index.php?showtopic=1841

[vygi]

Ritesh wrote on Dec 6 2005, 12:14 PM:

This is very strange. This happens only when you close a connection window using Ctrl+F4.

Is this a Windows issue  😮

[post=”8130″]<{POST_SNAPBACK}>[/post]

Thanks….

so should I forward this bug report to Mr. Gates?.. 😕

[vygi]

Ritesh wrote on Dec 6 2005, 07:12 AM:

Strangely, we have not be able to reproduce this one. Can you provide me with steps to reproduce the error?

[post=”8125″]<{POST_SNAPBACK}>[/post]

To reproduce what please?

If the issue with the file upload? I am quite sure that is proxy-related that it is just my problem; your website works fine. I am also other strange issues here at the office, eg. all phpMyAdmin installations cannot add and cennot edit any entries: all data gets lost after clicking on “Submit”! I also don't have any problems at home. So don't worry about it, all fine.

If the issue with the drawing outside the application window: yes that often hapens when SQLyou gets broken and I try to change wondow size and then maximize + restore + execute query.

Vygi

[vygi]

Ritesh wrote on Dec 2 2005, 02:15 PM:

@vygi: Can you send me some sample data to reproduce the problem?

[post=”8073″]<{POST_SNAPBACK}>[/post]

This is not a bug of SQLyog, this is a general problem with Excel, and to improve it could be not easy, I guess… So please release 5.01 final or public beta soon, and this Excel problem can wait.

From all DB tools I know only urSQL is working quite perfectly. And MySQL Query Browser is able to create MS Excel XP files as XML.

Maybe this feature is not needed by most of the users but, unfurtunately, it is heavily used in our office.

To repoduce this issue, create a simple table, eg.

CREATE TABLE xtest (

s varchar(255),

f float(14,2)

)

and put this data in the table:

abcabc 88.99

000123 10.09

Then execute SELECT * FROM xtest and copy all rows to clipboard (wit excel friendly option or without).

Now open Excel and paste values. I've got:

abcabc 88.99

123 10. Sep

String '000123' has been converted to number 123 and number 10.09 to 10th of September (German date format: dd.mm[.yy]).

That's it 🙂

Let me know if you need any additional information.

Regards,

Vygi

[vygi]

Just FYI: another colleague at work came to me and said that “this your new database tool just looks nice but works shitty because it's impossible to put data into Excel”. This time it was my superior, and now I'm sure that we will get no licenses…

[vygi]

confirmed!

I was always wondering why there is this additional comma in the ALTER statement and why MySQL doesn't complaint about it.

[vygi]

Now I've got it again 🙂

I had 3 connections and it worked fine several days in a row but today SQLyou suddenly got crazy while I was switching to another database inside same server.

SQLyog paints now even ottside his own window!

BTW I was unable to attached a screenshot to this message. Tried with Opera 8 and IE 6 with no success: always got just completely blank window after “Add this attachment” :huh:

But it is uploaded HERE

Thumbnail:

[Author]

Posts