Using an UNIX pipe Effectively
September 1st, 2008 8:20 pm
Is it possible to use something like a UNIX pipe to pump the data from the generation program into a database load program? If the data in the database is partitioned and the data generator used generates the data randomly across partitions rather than randomly within partitions, the database load program will need to filter the data as it loads. This will slow down the data load considerably.
