Q

How to speed up loading production data into test database

How can I speed up the loading of production data into my test db? We want to load the test database once a week

(in the weekend) with fresh data from our production database. We have about 40 Gb of data (roughly 20 Gb tables and 20 Gb indexes) in three SCHEMAS. We don't want to recreate the testdb. We do table exports and a full export without data on the proddb every night. Import into the testdb takes about 13-14 hours. Is there a way to create the indexes after the tables import completed? Is there a way to exp/imp so that indexes are created 'NOLOGGING'? Can I find a script that can generate 'create indexes'? Is there any other method of loading? Can I use SQLLoader? Both the prod and test environments are Solaris 2.6 and Oracle8i (8.1.7).

Well, that's more than one question! Best wishes. Thank you,
Urban Svanberg


Urban,

Mass loading of data is one thing that has always plagued DBAs who wish the whole process would go faster. Each version of Oracle has brought forth a few new features that make the data loading faster. Since you are on Oracle 8.1.7, you can try the following suggestions:

  1. Import with INDEXES=N option. This will not create any indexes on import. Then import with the INDEXFILE information to get a script to create your indexes. This will not actually import any data; it just creates the script. Then run the script to create your indexes after all the data has been loaded.
  2. Check out the Transportable Tablespace option! If you have your table and indexes separated into their own tablespace, then you can use the Transportable Tablespace option to plug these tablespaces into your new database. The operation that takes the longest is to FTP the files from one server to another!
  3. You can use SQL*Loader and the DIRECT path method to load. Unfortunately, you have to use SQL to get the data out of your source database first.

Consider the other two options first.

For More Information


This was first published in May 2001

Dig deeper on Oracle database design and architecture

Pro+

Features

Enjoy the benefits of Pro+ membership, learn more and join.

Have a question for an expert?

Please add a title for your question

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

0 comments

Oldest 

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to:

SearchDataManagement

SearchBusinessAnalytics

SearchSAP

SearchSQLServer

TheServerSide

SearchDataCenter

SearchContentManagement

SearchFinancialApplications

Close