Home > Ask the Oracle Experts > Data Warehousing, ETL, and business intelligence Questions & Answers > Method other than DB link for large data transfer
Ask The Oracle Expert: Questions & Answers
EMAIL THIS

Method other than DB link for large data transfer

Ian Abramson EXPERT RESPONSE FROM: Ian Abramson

Pose a Question
Other Oracle Categories
Meet all Oracle Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 30 May 2006
We are working on the development of a datamart (in 9i) which takes data from two source systems (one 9i and one 8i). We need to do a full load of data. Since this is a transaction system, there is a lot of data. Currently we are doing incremental loads using a spool file and external tables. But due to so much data to be taken care of in full loads, the spool file size is huge and it will take a long time to do spooling, as well as taking a lot of space on the server. Copy is not allowed, nor is a DB link as it is deprecated in 9i. Are there any other ways we can do this large data transfer? This activity is supposed to be carried on every week. Let me know your views.

>
EXPERT RESPONSE

The challenge of transmitting large volumes of data to a warehouse is always one that must be carefully considered. Your options are limited in some ways since you feel that creating flat files is not an option, and based on your description, this is probably a good idea. You also mention a DB Link -- this is another nice option, but again not an option for you. So what else do we have? My suggestion would be transportable tablespaces (TT). The concept behind TT is that you can do a VERY quick export of the metadata and then you can copy the export file and the data files from your source system and then attach them to your database. Another option would be to export and import data; you could pipe the export and improve your performance. You could also create a standby database, but you would still have to transmit data to the warehouse.

I hope this gives you some food for thought.


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


RELATED CONTENT
Data Warehousing, ETL, and business intelligence
Analyzing an index after rebuild
Speed of low-cost query
Data warehouse based on operational data model
Data migration with ETL
Using PL/SQL for ETL
Basic steps for implementing a DBMS
Importing 8i dump file to 9i
Using export/import process to clone to data warehouse
Areas of impact while migrating database from 8i to 9i/10g
External tables explained

Oracle data warehousing
IOUG chief discusses OpenWorld, DBA pay and security
Oracle enters the appliance market with Exadata
Tip: Exposing logical attributes with virtual columns
Oracle users prepare for MDM
Data modeling tools no substitute for hard work
eHarmony spurns Microsoft, finds match with Oracle 10g
Separate database for each client in Oracle 10g
Help with data warehouse disaster recovery planning
ORA-600 error and slow server response after upgrade
Extracting data from a specific period

Oracle metadata
Data warehouse based on operational data model
RFID: Metadata in motion
New Oracle BI tool adds color to compliance efforts
Learning Guide: Data warehousing and business intelligence
Getting BI with a little help from your friends
Legal auditing firm retains customers with Oracle BI
Application vendors to dig into data mining
Peering into Bill Inmon's data warehousing crystal ball
Queries to retrieve table metadata
A simple way to reorganize a table and release the unused space
Oracle metadata Research

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
multidimensional database  (SearchOracle.com)
operational data store  (SearchOracle.com)
repository  (SearchOracle.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice

HomeNewsTopicsTipsAsk the ExpertsMultimediaWhite PapersProductsBlogs
About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides enterprise IT professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective IT purchase decisions and managing their organizations' IT projects - with its network of technology-specific Web sites, events and magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Reprints  |  Site Map




All Rights Reserved, Copyright 2003 - 2008, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts