ODBC Import Buffer Overrun

[ronald]

I am attempting an import of a SQL Server table with many fields. If i have 61 or less fields checked to be imported it works — 62 or more fields cause an error dialog “Buffer Overrun Detected! Program: sja.exe A buffer overrun has been detected which has corrupted the programs internal state. The program cannot savely continue and must be terminated.”

Importing the table schema is successful, the crash occurs on the data import stage.

This is with the latest 4.1 Beta 2

[peterlaursen]

It is not easy to tell whether this is a SQLyog issue or an OS-issue!

I think you better give information about about OS-version and SP-level!

You are sure that you have not exceeded the swap-file settings of your system (watch task manager!).

Some VERY BIG BLOB's in dataset? If yes, how are they defined ? And as what MySQL datatype are they imported ?

Quote:

the crash occurs on the data import stage.

any idea of how far the data writing has proceeded? (# of rows of total #of rows)

[Ritesh]

ronald wrote on Jul 12 2005, 09:28 PM:

I am attempting an import of a SQL Server table with many fields.  If i have 61 or less fields checked to be imported it works — 62 or more fields cause an error dialog “Buffer Overrun Detected! Program: sja.exe  A buffer overrun has been detected which has corrupted the programs internal state. The program cannot savely continue and must be terminated.”

Importing the table schema is successful, the crash occurs on the data import stage.

This is with the latest 4.1 Beta 2

If the data is not confidential then can you send me your table structure and sample data to reproduce the error? Send it to [email protected],

[Ritesh]

We have been working on your issue. We can successfully import tables having 100 columns and 1000 rows. While working on it we came across this issue at http://bugs.mysql.com/bug.php?id=10035 that looks similar to yours.

Though in our case, SJA displayed the error and the application exited gracefully.

Can you tell us the table structure with a rough idea of what kind of data it contains?

[ronald]

Ritesh wrote on Jul 13 2005, 08:27 AM:

We have been working on your issue. We can successfully import tables having 100 columns and 1000 rows. While working on it we came across this issue at http://bugs.mysql.com/bug.php?id=10035 that looks similar to yours.

Though in our case, SJA displayed the error and the application exited gracefully.

Can you tell us the table structure with a rough idea of what kind of data it contains?

The number of rows doesn't seem to matter — it can be reproduced with the one-row case below. The client machine is a Pentium 4 3.4ghz with 512 megs of ram. The server is running mysql 4.1.10a.

I had a look at that MySQL bug report, and apparently it is an InnoDB-only bug. So, I tried choosing “MyISAM” as the table type in the Import Wizard's “Target Table Type”, and got the same crash.

Interestingly, if I choose only the first 62 fields of the following table to be imported, I get the Buffer Overflow error message. If I choose 63 or more, no error message pops up, but Sqlyog hangs indefinately on “Importing table data: Company2…”

Here is the sql to create and populate the table in sql server:

CREATE TABLE [dbo].[Company2] (

[ID] [int] IDENTITY (1, 1) NOT NULL ,

[NAFILL] [int] NULL ,

[TicklerID] [int] NULL ,

[MenuID] [int] NULL ,

[MinimumLunch] [int] NULL ,

[MinimumDinner] [int] NULL ,

[ExtraRestaurantFee] [int] NULL ,

[Tip] [int] NULL ,

[TipThreshold] [int] NULL ,

[FreeDeliveryThreshold] [int] NULL ,

[CashSurcharge] [int] NULL ,

[CheckSurcharge] [int] NULL ,

[CardSurcharge] [int] NULL ,

[HouseSurcharge] [int] NULL ,

[ICVerifyCompany] [int] NULL ,

[CandidateAddressID] [int] NULL ,

[Authorization1] [int] NULL ,

[Authorization2] [int] NULL ,

[CheckAuthorizationType] [int] NULL ,

[CardAuthorization] [int] NULL ,

[SalesTaxOnDeliveryFee] [int] NULL ,

[SalesTaxOnCompanyTip] [int] NULL ,

[SalesTaxOnMiscFee] [int] NULL ,

[Active] [int] NULL ,

[PrintAllOrders] [int] NULL ,

[OnLine] [int] NULL ,

[CardRequired] [int] NULL ,

[Description] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[OrderMessage] [varchar] (750) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[RestaurantMessage] [varchar] (750) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[AccountMessage] [varchar] (750) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[ZoneMessage] [varchar] (750) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Phone] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[CandidateDescription] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[CandidatePhone] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[AcceptedCards] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[StateCodeDefault] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[CandidateAddress1] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[CandidateAddress2] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[CandidateAddress3] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Address1] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Address2] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Address3] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UseMembership] [int] NULL ,

[MemberDiscount] [int] NULL ,

[MemberLimit] [int] NULL ,

[MemberFreeDelivery] [int] NULL ,

[Overhead] [int] NULL ,

[FreezeConvFee] [int] NULL ,

[ShowCommissionRate] [int] NULL ,

[QB_Restaurants] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_Checking] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_DueRestaurant] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_SalesTax] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_RestaurantCharges] [varchar] (750) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_FoodCosts] [varchar] (750) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_CompanyFile] [varchar] (250) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[QB_Days_Restaurant] [int] NULL ,

[QB_Integrate_Restaurant] [int] NULL ,

[DelFee_Minimum] [int] NULL ,

[DelFee_Maximum] [int] NULL ,

[DelFee_Percent] [int] NULL ,

[UserList1] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UserList2] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UserList3] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UserList4] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UserList5] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UserList6] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[MinimumDinnerList] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[MinimumLunchList] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[MinimumTipList] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[MinimumMessageList] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[MinimumTitleList] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[UserListRequired] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[BusinessListRequired] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[LunchBegins] [datetime] NULL ,

[DinnerBegins] [datetime] NULL ,

[Text_DeliveryFee] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Text_ConvFee] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Text_DriverTip] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[RestrictHouseOnCheckOut] [int] NULL ,

[RequireApprovalToCheckOut] [int] NULL ,

[CateringMenu] [int] NULL ,

[CateringFee] [int] NULL ,

[RequireEmail] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[PayDriversByDelivery] [int] NULL ,

[ReimburseDrivers] [int] NULL ,

[TemplateID] [int] NULL ,

[TipImpoundCategoryID] [int] NULL ,

[AccountingPhone] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[MaxInternetLevel] [int] NULL ,

[AllowAdjustmentChangeDate] [int] NULL ,

[AuthorizeExtra] [int] NULL ,

[MailingListOptOut] [int] NULL ,

[Reservations_Use] [int] NULL ,

[Reservations_AutoCancel] [int] NULL ,

[Website] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[EmailAddress] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[TipCalculation] [int] NULL ,

[DefaultHouseRestriction] [int] NULL ,

[WebAuthMerchant] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[ReturnDriversToRestaurant] [int] NULL ,

[TodayNotAdvanced] [int] NULL ,

[UseRestaurantTaxRates] [int] NULL ,

[UseZoneTaxRates] [int] NULL ,

[UseCustomerTipRate] [int] NULL ,

[WelcomeMessage] [int] NULL ,

[UseClassification] [int] NULL ,

[NoMultipleOrders] [int] NULL ,

[NegativeBalanceAdjustmentID] [int] NULL ,

[RestaurantBillAdjustmentID] [int] NULL ,

[SettlementPeriodEnds] [int] NULL ,

[CustomCateringOnWeb] [int] NULL ,

[AuthValue] [int] NULL ,

[WEB_ShowUtensils] [int] NULL ,

[UseRadios] [int] NULL ,

[Nextel_PickupTime] [int] NULL ,

[Nextel_DeliveryTime] [int] NULL ,

[AllowCheck_Individual] [int] NULL ,

[AllowCheck_Business] [int] NULL ,

[AllowCheck_Hotel] [int] NULL ,

[ConvFeeCalc] [int] NULL ,

[AboutUsID] [int] NULL ,

[ContactUsID] [int] NULL ,

[AllowCourier] [int] NULL ,

[CanadaTax] [int] NULL ,

[PayCCToRestaurant] [int] NULL ,

[CAAMediaAccountNumber] [int] NULL ,

[SalesTaxOnOperatorTip] [int] NULL ,

[Message_21_ID] [int] NULL ,

[Message_21_AutoSend] [int] NULL ,

[Message_22_ID] [int] NULL ,

[Message_22_AutoSend] [int] NULL ,

[Message_23_ID] [int] NULL ,

[Message_23_AutoSend] [int] NULL ,

[Message_24_ID] [int] NULL ,

[Message_24_AutoSend] [int] NULL ,

[Message_25_ID] [int] NULL ,

[Message_25_AutoSend] [int] NULL ,

[HoursOfOperation] [varchar] (112) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[HideRestaurantAddress] [int] NULL ,

[Template_Print_Auto] [int] NULL ,

[Template_Print_Manual] [int] NULL ,

[Template_Fax_Restaurant] [int] NULL ,

[Template_Fax_Customer] [int] NULL ,

[Template_Email] [int] NULL ,

[Template_View] [int] NULL ,

[Internet_ShowAllRestaurants] [int] NULL ,

[UsePostalCodes] [int] NULL ,

[Internet_ForceStreetMap] [int] NULL ,

[ClosedForVacation] [int] NULL ,

[Authorization3] [int] NULL ,

[InternalWebsite] [varchar] (50) COLLATE SQL_Latin1_General_CP1_CI_AS NULL ,

[Template_TakeOut] [int] NULL ,

[RequireTaxIDNumber] [int] NULL ,

[Group_Minutes] [int] NULL ,

[Integration_ReadySetFood_Account] [int] NULL ,

[Integration_IamCity_Account] [int] NULL ,

[ShowFullCCNumber] [int] NULL ,

[StripLeading] [int] NULL ,

[StripTrailing] [int] NULL ,

[RestrictAuthLength] [int] NULL ,

[MerchantType] [int] NULL ,

[UpdateETA] [int] NULL

) ON [PRIMARY]

GO

INSERT INTO dbo.Company2

(NAFILL,TicklerID,MenuID,MinimumLunch,MinimumDinner,ExtraRestaurantFee,Tip,TipTh

eshold,FreeDeliveryThreshold,CashSurcharge,CheckSurcharge,CardSurcharge,HouseSur

harge,ICVerifyCompany,CandidateAddressID,Authorization1,Authorization2,CheckAuth

rizationType,CardAuthorization,SalesTaxOnDeliveryFee,SalesTaxOnCompanyTip,SalesT

xOnMiscFee,Active,PrintAllOrders,OnLine,CardRequired,Description,OrderMessage,Re

taurantMessage,AccountMessage,ZoneMessage,Phone,CandidateDescription,CandidatePh

ne,AcceptedCards,StateCodeDefault,CandidateAddress1,CandidateAddress2,CandidateA

dress3,Address1,Address2,Address3,UseMembership,MemberDiscount,MemberLimit,Membe

FreeDelivery,Overhead,FreezeConvFee,ShowCommissionRate,QB_Restaurants,QB_Checkin

,QB_DueRestaurant,QB_SalesTax,QB_RestaurantCharges,QB_FoodCosts,QB_CompanyFile,Q

_Days_Restaurant,QB_Integrate_Restaurant,DelFee_Minimum,DelFee_Maximum,DelFee_Pe

cent,UserList1,UserList2,UserList3,UserList4,UserList5,UserList6,MinimumDinnerLi

t,MinimumLunchList,MinimumTipList,MinimumMessageList,MinimumTitleList,UserListRe

uired,BusinessListRequired,LunchBegins,DinnerBegins,Text_DeliveryFee,Text_ConvFe

,Text_DriverTip,RestrictHouseOnCheckOut,RequireApprovalToCheckOut,CateringMenu,C

teringFee,RequireEmail,PayDriversByDelivery,ReimburseDrivers,TemplateID,TipImpou

dCategoryID,AccountingPhone,MaxInternetLevel,AllowAdjustmentChangeDate,Authorize

xtra,MailingListOptOut,Reservations_Use,Reservations_AutoCancel,Website,EmailAdd

ess,TipCalculation,DefaultHouseRestriction,WebAuthMerchant,ReturnDriversToRestau

ant,TodayNotAdvanced,UseRestaurantTaxRates,UseZoneTaxRates,UseCustomerTipRate,We

comeMessage,UseClassification,NoMultipleOrders,NegativeBalanceAdjustmentID,Resta

rantBillAdjustmentID,SettlementPeriodEnds,CustomCateringOnWeb,AuthValue,WEB_Show

tensils,UseRadios,Nextel_PickupTime,Nextel_DeliveryTime,AllowCheck_Individual,Al

owCheck_Business,AllowCheck_Hotel,ConvFeeCalc,AboutUsID,ContactUsID,AllowCourier

CanadaTax,PayCCToRestaurant,CAAMediaAccountNumber,SalesTaxOnOperatorTip,Message_

1_ID,Message_21_AutoSend,Message_22_ID,Message_22_AutoSend,Message_23_ID,Message

23_AutoSend,Message_24_ID,Message_24_AutoSend,Message_25_ID,Message_25_AutoSend,

oursOfOperation,HideRestaurantAddress,Template_Print_Auto,Template_Print_Manual,

emplate_Fax_Restaurant,Template_Fax_Customer,Template_Email,Template_View,Intern

t_ShowAllRestaurants,UsePostalCodes,Internet_ForceStreetMap,ClosedForVacation,Au

horization3,InternalWebsite,Template_TakeOut,RequireTaxIDNumber,Group_Minutes,In

egration_ReadySetFood_Account,Integration_IamCity_Account,ShowFullCCNumber,Strip

eading,StripTrailing,RestrictAuthLength,MerchantType,UpdateETA)

VALUES (NULL,NULL,1,NULL,NULL,450,NULL,5000,50000,0,0,0,20000,0,NULL,273728576,20144716

,0,-1,0,0,0,-1,0,-1,-1,'Sample Company','We appreciate your patronage, and all feedback you provide to help us improve our services to you! ***Delivery Rewards … Every 10 points receive One Free Delivery !! ***','Thank You from The Staff at Our Company','We appreciate your patronage and all feedback you provide to help us improve our services to you!','','(555) 555-5555','','','NYYYNN','0','','','','555 Main Street','Suite A','Yourtown US 55555',0,495,0,NULL,400000,0,0,'-1','Commerce Bank','','','','','',NULL,NULL,0,0,0,'','','','','','','','','','','0006800007710006690003800006810003140000000000000','NNNNNNNNNY','NNNNNNNNNN','1899-12-30 11:00:00','1899-12-30 14:30:00','','','',0,0,0,1995,'YNYNN',0,0,2,1,'2013212345',1,-1,0,-1,0,20,'www.samplecompany.com','[email protected]',1,1,'',0,0,-1,0,0,1,0,0,2,2,6,0,NULL,0,1,-1,-1,2,2,-1,0,23,NULL,0,0,0,0,0,1,-1,2,-1,3,-1,4,-1,5,-1,'1100110011001100110000000000143014301430143014300000000016301630163016301630

63016002100210021002100211521151945',0,2,2,2,3,3,2,-1,0,NULL,NULL,167912345,'www.samplecompany.com',NULL,0,90,NULL,NULL,0,NULL,NULL,NULL,NULL,NULL)

GO

[Ritesh]

Thanks for the info.

I have forwarded it to my development team and they are working on it.

BTW, which version of MS SQL Server are you using?

[ronald]

Ritesh wrote on Jul 13 2005, 01:47 PM:

Thanks for the info.

I have forwarded it to my development team and they are working on it.

BTW, which version of MS SQL Server are you using?

Cool, thanks for looking into it —

I am using Sql Server Developer Edition 8.00.194

[Author]

Posts