Ask the Expert

Generating multiple flat files from a single flat file source

I have a single flat file source containing 1 million (changeable) rows. I want to generate multiple flat files, each containing 30,000 rows. The naming convention for the destination file could be anything as of now. The number of files to generate is not known at design time. Only the number of rows in each file is known. How do I divide my single file into multiple files, each containing 30,000 rows?

    Requires Free Membership to View

It's times like this that I miss some of my favorite Unix utilities. Unix supported the split command, which did exactly what you are looking for! You may want to consider creating a DTS package with the Custom Active Script task, in which you use the Scripting Runtime library's FileSystemObject to split a large text file into multiple small files.

This was first published in May 2006

There are Comments. Add yours.

 
TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: