Path: utzoo!attcan!utgpu!watmath!att!dptg!rutgers!cs.utexas.edu!uunet!mcvax!ukc!harrier.ukc.ac.uk!jbww
From: jbww@ukc.ac.uk (J.B.W.Webber)
Newsgroups: comp.sys.atari.st
Subject: Re: Faster loading
Keywords: parallel, loading, transputer
Message-ID: <2001@harrier.ukc.ac.uk>
Date: 8 Aug 89 11:46:36 GMT
References: <259@marvin.moncam.co.uk>
Reply-To: jbww@ukc.ac.uk (J.B.W.Webber)
Organization: Physics Lab, University of Kent at Canterbury, UK.
Lines: 51

In article <259@marvin.moncam.co.uk> emmo@moncam.co.uk (Dave Emmerson) writes:
>
>Continuing the discussion prompted by jbww@ukc.ac.uk (J.B.W.Webber)
>
>>	thus the user is up and running, without having to wait for 
>>	the whole network to boot, ramdisks/caches to be filled.
>>
>>	by the time the data pops out of the first part of the pipeline,
>>	the program can be in place for the next.
>
>...  you'll have to store executables on one drive, data (sources) on another.

>Maybe someone'll do it one day.
>
>Dave E.

Yes, sure, if your problem is I/O limited, more disks will help;

our main problem (molecular dynamics simulations of liquids) is not :

a few numbers in, a few numbers out (except for any tempory files, to 
allow for recovery from power outs, etc) - on a Vax 750, nearly single user,
it was about one new point on the graph per week.

for moderate amounts of data, the problem can be managed; consider :

We usually boot a 2Mbyte MWC ramdisk into a Mega4's memory, at power on;
this gives us the Helios OS, resources, libraries, etc on ramdisk.
The transputer network boots from this; any parts or the network that
need to be booted/rebooted later can come up fast from this.

The rest of this ramdisk (and the ST4's menory) can be used for data,
and each processor has at least 1M of memory, some of which can be used to 
squirrel data away on (preferably where it will be needed). If there are
multiple STs, these drives can be used. The local drive is assumed, unless
otherwise specified. Yes, sure, it is possible to get confused as to what
is where (ever done a recursive directory listing on a network of Suns?), but,
as always, placing the data where it is needed is the best strategy. Oh, and
yes, the fastest way of processing a small amount of data is to give each of
the processors that is to work on it, its own copy. We actually use something
called a systollic loop - there are two copies of the data, and one circulates
round and round a `race-track' of processors, getting modified as it goes.

P.S. anyone up to writing an eternal ramdisk bigger than 2M.
	(preferably that can be resized without rebooting)
	Ah, well, one can always hope !

I should be on holiday, I am writing too much.

cheers,
 	 beau webber	ukc.ac.uk