Journal:

Sat, 22 Dec 2007

SVMOP:VSTP: First run with full data set 12/22/2007 23:27

I've downloaded the entire GTS data set to my server at home, and, after adding some more exception handling to the fields2xml.py program, ran the entire data set: once with tab delimited formating to a single file, and then to separate xml files for each file in the data set. That is 83 files. Each file took about 20 seconds to run. The single tab delimited file resulted in 487565 records!

I need some place on the CCOM servers to put this stuff. If it gets down to the crunch before I leave, I'll just make a CD of it.

[/VSTP] permanent link