Unsupported Screen Size: The viewport size is too small for the theme to render properly.

Import HUGE table (~1G) via query

forums › forums › SQLyog › Sync tools, Migration, Scheduled Backup and Notifications › Import HUGE table (~1G) via query

  • This topic is empty.
Viewing 4 reply threads
  • Author
    Posts
    • April 23, 2004 at 2:29 am #15715
      Ritesh
      Member

      I suspect this is an issue with the efficiency of the ODBC driver. Have you tried accessing the data thru any other ODBC client like Excel, Access?

    • April 24, 2004 at 2:49 am #15716
      fhlostonparadise
      Member

      Here is what I have found by playing around with the NonStop SQL ODBC driver. When I switch the cursor mode from read_only_streaming to read_only, the high memory usage no longer happens. However, the data transfer is significantly affected. I'm down to 120 records/sec. That will take me 2 months to import 560M records!

      Looks like I'll have to find some other ways to get round this… Any suggestions?

    • April 25, 2004 at 5:28 pm #15717
      Shadow
      Member

      Can you export the data as csv file from your db?

    • April 29, 2004 at 3:13 pm #15718
      fhlostonparadise
      Member

      Since ODBC is the only way for me to communicate w/ the server, it doesn't matter what format of the data I request the performance issue will be there.

    • April 30, 2004 at 12:39 pm #15719
      Shadow
      Member

      Then this problem is beyond our capabilities…

  • Author
    Posts
Viewing 4 reply threads
  • You must be logged in to reply to this topic.