Ask the Expert

Eliminating duplicate records from a flat file

How to eliminate duplicate records from a flat file?

    Requires Free Membership to View

I would use two choices here. One, write a Perl program to perform this activity. Two, load the data into an Oracle database with SQL*Loader. Then remove the duplicate records with a DELETE statement. Finally, dump the records back to a flat file.

This was first published in January 2007

There are Comments. Add yours.

 
TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: