Processlist Stops Working With Tunnel To Mysql Server Was No Created S

[JeffR]

I keep 2 browsers (IE 8.0.6001.18702) open, one on the process list viewing 1 MySQL 5.0.86 server, and the other browser on the monitors/replication tab viewing 5 MySQL 5.0.86 servers.

After a couple of days, the browser on the processlist view stops working, with an error message in a red font saying:

Tunnel to MySQL server was not created successfully..

I can switch tabs and which servers to view, but if I go back to the original server in the processlist view, the error remains.

It takes restarting the MONyog service or host to resolve the error. And since I don't have admin access to the resource, I have to get a network admin involved.

I am on MONyog: 3.15

Is there a fix for this?

[JeffR]

partial log (could not get attachments to work)

Last 8KB

[3.15] [2009-11-20 09:13:23] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:13:23] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/DB1.pid' in '0' access mode: sftp server : Permission denied

[3.15] [2009-11-20 09:13:23] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:13:46] .srcymysql.cpp(259) ErrCode:2003 ErrMsg:Can't connect to MySQL server on '10.140.250.22' (10060)

[3.15] [2009-11-20 09:13:46] .populatemysql.cpp(487) ErrCode:-1 ErrMsg:RealConnect

[3.15] [2009-11-20 09:13:46] .populatemysql.cpp(82) ErrCode:-1 ErrMsg:ConnectToMySQL

[3.15] [2009-11-20 09:13:46] .srcymysql.cpp(392) ErrCode:2006 ErrMsg:MySQL server has gone away

[3.15] [2009-11-20 09:13:48] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:13:48] .srcytunnel.cpp(207) ErrCode:-1 ErrMsg:SSH2 Connect and Authorize failed: Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:13:48] .srcymysql.cpp(313) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:13:48] .srcymysql.cpp(259) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:13:48] .populatemysql.cpp(487) ErrCode:-1 ErrMsg:RealConnect

[3.15] [2009-11-20 09:13:48] .populatemysql.cpp(82) ErrCode:-1 ErrMsg:ConnectToMySQL

[3.15] [2009-11-20 09:13:48] .srcymysql.cpp(392) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:13:50] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:13:50] .populatesystem.cpp(122) ErrCode:-1 ErrMsg:ConnectToSsh

[3.15] [2009-11-20 09:13:50] .srcysftp.cpp(82) ErrCode:-1 ErrMsg:SFTP not valid

[3.15] [2009-11-20 09:13:50] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:13:51] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to db3.kaneva-dc.net:22

[3.15] [2009-11-20 09:13:51] .populatesystem.cpp(122) ErrCode:-1 ErrMsg:ConnectToSsh

[3.15] [2009-11-20 09:13:51] .srcysftp.cpp(82) ErrCode:-1 ErrMsg:SFTP not valid

[3.15] [2009-11-20 09:13:51] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:13:51] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.140.250.50:22

[3.15] [2009-11-20 09:13:51] .populatesystem.cpp(122) ErrCode:-1 ErrMsg:ConnectToSsh

[3.15] [2009-11-20 09:13:51] .srcysftp.cpp(82) ErrCode:-1 ErrMsg:SFTP not valid

[3.15] [2009-11-20 09:13:52] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:14:18] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:14:18] .srcytunnel.cpp(207) ErrCode:-1 ErrMsg:SSH2 Connect and Authorize failed: Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:14:18] .srcymysql.cpp(313) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:14:18] .srcymysql.cpp(259) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:14:18] .populatemysql.cpp(487) ErrCode:-1 ErrMsg:RealConnect

[3.15] [2009-11-20 09:14:18] .populatemysql.cpp(553) ErrCode:-1 ErrMsg:ExecuteMySQLQuery

[3.15] [2009-11-20 09:14:18] .historymgr.cpp(176) ErrCode:-1 ErrMsg:PopulatingStart

[3.15] [2009-11-20 09:14:21] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:14:21] .populatesystem.cpp(122) ErrCode:-1 ErrMsg:ConnectToSsh

[3.15] [2009-11-20 09:14:21] .srcysftp.cpp(82) ErrCode:-1 ErrMsg:SFTP not valid

[3.15] [2009-11-20 09:14:21] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:15:23] .srcymysql.cpp(392) ErrCode:2006 ErrMsg:MySQL server has gone away

[3.15] [2009-11-20 09:15:23] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/search-master.kaneva-dc.net.pid' in '0' access mode: sftp server : No such file

[3.15] [2009-11-20 09:15:23] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:15:24] .srcymysql.cpp(259) ErrCode:2003 ErrMsg:Can't connect to MySQL server on '10.140.250.12' (10061)

[3.15] [2009-11-20 09:15:24] .populatemysql.cpp(487) ErrCode:-1 ErrMsg:RealConnect

[3.15] [2009-11-20 09:15:24] .populatemysql.cpp(553) ErrCode:-1 ErrMsg:ExecuteMySQLQuery

[3.15] [2009-11-20 09:15:24] .historymgr.cpp(176) ErrCode:-1 ErrMsg:PopulatingStart

[3.15] [2009-11-20 09:15:24] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/preview-db1.pid' in '0' access mode: sftp server : Permission denied

[3.15] [2009-11-20 09:15:24] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:15:24] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/DB1.pid' in '0' access mode: sftp server : Permission denied

[3.15] [2009-11-20 09:15:24] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:16:19] .srcymysql.cpp(392) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:16:49] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:16:49] .srcytunnel.cpp(207) ErrCode:-1 ErrMsg:SSH2 Connect and Authorize failed: Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:16:49] .srcymysql.cpp(313) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:16:49] .srcymysql.cpp(259) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[3.15] [2009-11-20 09:16:49] .populatemysql.cpp(487) ErrCode:-1 ErrMsg:RealConnect

[3.15] [2009-11-20 09:16:49] .populatemysql.cpp(553) ErrCode:-1 ErrMsg:ExecuteMySQLQuery

[3.15] [2009-11-20 09:16:49] .historymgr.cpp(176) ErrCode:-1 ErrMsg:PopulatingStart

[3.15] [2009-11-20 09:16:51] .srcysshsession.cpp(96) ErrCode:2 ErrMsg:Error while connecting to ssh server: Timeout while connecting to 10.201.1.66:22

[3.15] [2009-11-20 09:16:51] .populatesystem.cpp(122) ErrCode:-1 ErrMsg:ConnectToSsh

[3.15] [2009-11-20 09:16:51] .srcysftp.cpp(82) ErrCode:-1 ErrMsg:SFTP not valid

[3.15] [2009-11-20 09:16:51] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:17:24] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/search-master.kaneva-dc.net.pid' in '0' access mode: sftp server : No such file

[3.15] [2009-11-20 09:17:24] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:17:24] .srcymysql.cpp(392) ErrCode:2006 ErrMsg:MySQL server has gone away

[3.15] [2009-11-20 09:17:25] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/preview-db1.pid' in '0' access mode: sftp server : Permission denied

[3.15] [2009-11-20 09:17:25] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:17:25] .srcysftp.cpp(153) ErrCode:-1 ErrMsg:Could not open file '/var/lib/mysql/DB1.pid' in '0' access mode: sftp server : Permission denied

[3.15] [2009-11-20 09:17:25] .populatesystem.cpp(179) ErrCode:-1 ErrMsg:GetMysqlPid

[3.15] [2009-11-20 09:17:25] .srcymysql.cpp(259) ErrCode:2003 ErrMsg:Can't connect to MySQL server on '10.140.250.12' (10061)

[3.15] [2009-11-20 09:17:25] .populatemysql.cpp(487) ErrCode:-1 ErrMsg:RealConnect

[3.15] [2009-11-20 09:17:25] .populatemysql.cpp(553) ErrCode:-1 ErrMsg:ExecuteMySQLQuery

[3.15] [2009-11-20 09:17:25] .historymgr.cpp(176) ErrCode:-1 ErrMsg:PopulatingStart

[3.15] [2009-11-20 09:18:49] .srcymysql.cpp(392) ErrCode:5001 ErrMsg:Tunnel to MySQL server was not created successfully.

[peterlaursen]

Please complete the sentence here “Processlist Stops Working With Tunnel To Mysql Server Was No Created S”.  It was truncated as it exceeded max. header length and I am not getting the meaning.

[JeffR]

'peterlaursen' wrote on '20:

Please complete the sentence here “Processlist Stops Working With Tunnel To Mysql Server Was No Created S”.  It was truncated as it exceeded max. header length and I am not getting the meaning.

Processlist Stops Working With this replacing the processlist output:

Tunnel To Mysql Server Was Not Created Successfully

[Mahesh]

Quote:

I keep 2 browsers (IE 8.0.6001.18702) open, one on the process list viewing 1 MySQL 5.0.86 server, and the other browser on the monitors/replication tab viewing 5 MySQL 5.0.86 servers.

After a couple of days, the browser on the processlist view stops working, with an error message in a red font saying:

Tunnel to MySQL server was not created successfully..

I can switch tabs and which servers to view, but if I go back to the original server in the processlist view, the error remains.

It takes restarting the MONyog service or host to resolve the error. And since I don't have admin access to the resource, I have to get a network admin involved.

I am on MONyog: 3.15

Is there a fix for this?

Please tell,

1) Is processlist page open for couple of days ?

2) You have mentioned other tab viewing five 5.0.86 server, You mean to say you have registered same MySQL server details five times and viewing all in Monitors/Advisors ?

3) After you got error message , Edit Server — What does “Test Connection” says?

4) Are you able to connect to SSH Server through putty or some other program when MONyog shows the error?

[JeffR]

'Mahesh' wrote on '23:

Please tell,

1) Is processlist page open for couple of days ?

2) You have mentioned other tab viewing five 5.0.86 server, You mean to say you have registered same MySQL server details five times and viewing all in Monitors/Advisors ?

3) After you got error message , Edit Server — What does “Test Connection” says?

4) Are you able to connect to SSH Server through putty or some other program when MONyog shows the error?

1) Yes

2) No, my production environment is 1 master with 6 slaves, so I have one browser open on the Processlist view watching the master server and the second browser open on the monitor/advisors tab, replication view, watching 5 of the 6 slaves. The Processlist will stop working after a few days, the monitors/advisors tab remains good.

3) I will try that when the error condition returns.

4) Yes, everything can connect to the server except MONyog, and restarting MONyog immediately resolves the error condition.

[Mahesh]

We are still trying to reproduce this issue at our end.

Can you please tell,

1. What is the OS of the system where MONyog is running?

2. If it is a *nix system, please give us the output of the following commands:

a. uname -a

b. cat /etc/issue

3. What is the OS where the SSH server is running? It it is *nix please give the output of above commands.

4. What is the SSH server make and version?

5. Are you collecting OS metrics?

6. How much is the Data collection Interval time?

7. Is Processlist based sniffer enabled?

[Sabyasachi Ruj]

Additionally please answer these too:

8. When the error occurs, is the problematic server's SSH reachable from the system where MONyog is running? You can test this by connecting from a SSH client. I guess the problematic server is 10.201.1.66, right? I guess you have to involve your network admin.

9. You have told restarting MONyog service or the host solves the problem. Was there any case when restarting MONyog service did not help? So that, you had to restart the host? It is possible due to some reason the SSH server of 10.201.1.66 was not reachable from that host.

10. Are you using SSH tunneling to connect to replication slaves?

11. When processlist tab was showing the error, what was the “monitors and advisors” page showing for that server? Was it available?

[JeffR]

'Mahesh' wrote on '26:

We are still trying to reproduce this issue at our end.

Can you please tell,

1. What is the OS of the system where MONyog is running?

2. If it is a *nix system, please give us the output of the following commands:

a. uname -a

b. cat /etc/issue

3. What is the OS where the SSH server is running? It it is *nix please give the output of above commands.

4. What is the SSH server make and version?

5. Are you collecting OS metrics?

6. How much is the Data collection Interval time?

7. Is Processlist based sniffer enabled?

1. Microsoft Windows Server 2003 R2 Standard Edition Service Pack 2

2. N/A

3. Linux CentOS 4

4. OpenSSH_3.9p1, OpenSSL 0.9.7a Feb 19 2003

5. In SSH Server Details, the “Do you want to use SSH Connection?” is set to Yes.

In Data Collection Options, “Collect data from the server?” is set to Active.

6. 2 Minutes

7. Yes

[JeffR]

'Sabyasachi wrote on '26:

Additionally please answer these too:

8. When the error occurs, is the problematic server's SSH reachable from the system where MONyog is running? You can test this by connecting from a SSH client. I guess the problematic server is 10.201.1.66, right? I guess you have to involve your network admin.

9. You have told restarting MONyog service or the host solves the problem. Was there any case when restarting MONyog service did not help? So that, you had to restart the host? It is possible due to some reason the SSH server of 10.201.1.66 was not reachable from that host.

10. Are you using SSH tunneling to connect to replication slaves?

11. When processlist tab was showing the error, what was the “monitors and advisors” page showing for that server? Was it available?

8. Not sure. I have been informed by my system admin that MONyog has been crashing the box, so this error has not reproduced recently.

The problematic server is 10.140.250.6. The current IP of the MONyog server is 10.6.1.16.

9. Restarting the MONyog server has always resolved the error (temporarily).

10. For some yes, others no. The problem is only with the master server, not a slave of any other server.

11. Not sure.

[Sabyasachi Ruj]

Hi Jeff,

1. Can you upgrade to our latest MONyog version (3.61)?

2. Can you explain “MONyog has been crashing the box”? What do you mean by “crashing” here? What is the effect?

3. Is it still crashing after upgrading to 3.61?

[Author]

Posts