After several days of
fighting with the peculiarities of the
computer system at
LHO (
LIGO Hanford Observatory), my analysis program is good to go—and it is awesome indeed. All I need to do is type "
make submit" and my program finds the data to be analysed, constructs a tree containing thousands of processing jobs that will perform the analysis, and then submits these jobs to the computing cluster at LHO. Working late at night on a Sunday when nobody else is using the cluster, I have all of the computing resources to myself: 276 processors, each running at several gigahertz, each one with a gigabyte of RAM, with a collective total of
twenty seven terabytes of hard disk space, and access to a robotic magnetic tape system containing who knows how many terabytes more. Amazingly all of this sits in one room in a remote, desert corner of Washington State. Amusingly the data processing program consists of only 216 lines of Matlab, 100 lines of
Python, 26 lines of
Makefile, with a pinch of
sed and dash of other unix goodness thrown in for good measure. Programs that write programs: that's what makes CS fun. As I said: type "
make submit", wait, then
results.mat will be sitting there, ready for ingestion by Matlab and consumption by the analysis phase.
Kent and I joked that a proper scientific analysis program should start with the raw data and ultimately
typeset and mail the resulting publication. I wasn't really kidding. Read paragraph three of
Background: Kepler. This time I might have it: type "
make analysis" and that
results.mat file will be picked up and churned through the analysis. Hypothesis testing is done. Figures are generated, in PNG and EPS. The LaTeX typesetter is run, producing both postscript and PDF. If I were properly awesome, the proper concluding text will be subbed in given the results of the hypothesis testing. Ultimately: Type "
make all." Robots in Washington State awaken, transcribe signals from magnetic tape to disk. An army of machines grinds through the data. A program in New York State performs model fitting, hypothesis testing. LaTeX turns this into a beautiful manuscript, which the Laserjet 2300dn fuses to the page.
Pull the page out of the printer and read what you have discovered.
![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
