[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Scrubbing Data



PureBytes Links

Trading Reference Links


At Mon, 13 Mar 2000 18:30:25 EST, Sunkist1448@xxxxxxx wrote:

> How is data scrubbed?

This is a labor intensive process requiring a lot of elbow grease.  The 
data must first be spread out in a large tub.  Then the tub should be filled 
with very hot water.    Sometimes it is best to let the hard numbers soak 
for a while...  but if this is fundamental data then don't soak too long 
or the numbers will come out like a prune.


>What tools are necessary?

I like to use a stiff-bristled scrub brush mainly, but some steel wool (00 
grade) is required for those particularly persistent bad ticks.


>Are there data filters?

Yes, but these really aren't necessary.  Most of the bad data gets through 
anyhow....  the filters just take out the rocks and gravel...