View Single Post
Old 06-27-2009, 10:07 PM   #81 (permalink)
kengreenwood
Platinum Lifetime Member
 
kengreenwood's Avatar
 
Name: That shouldn't be too hard to figure out...
Last Online: 10-29-2009 08:46 AM
iTrader: (2)
Join Date: May 2006
Posts: 377
DNF$: 4,437
Location: Tampa
Country:


--- Moved the sort into the initial file clean up on the Unix side of things. Had to split the zone file into 5 different files of around 20 million records a piece 'cause I was exceeding disk quota in my tmp directory due to the sort... then I merge them all back together, resorting the entire file and bulkload it into the database. Thus removing the need for the ORDER BY in the query code. That was the culprit for the lengthy queries... Even crazy wide open queries are coming back in a reasonable amount of time... So I bumped up the max return records to 250,000. That's mainly due to the limitation of the Flex Datagrid.
__________________
KJG
OneWorldMedia, ZFBot
kengreenwood is offline   Reply With Quote
Sponsored Ads