Opened 4 years ago

Last modified 4 years ago

#1721 confirmed enhancement

Simfactory's test mechanism should use softlinks instead of rsync

Reported by: Erik Schnetter Owned by:
Priority: minor Milestone:
Component: SimFactory Version: development version
Keywords: Cc:


Simfactory's test mechanism copies all test cases from the source tree into the simulation directory. This takes a long time and a lot of space. This should rarely be necessary, since these test usually run soon after being submitted, so that there is little chance of the source tree becoming outdated.

Attachments (0)

Change History (2)

comment:1 Changed 4 years ago by Ian Hinder

The main reason I added support for running the tests using simfactory was so that I could run them on Kraken, where the compute nodes didn't have access to the home filesystem, so the copying was essential. I am also a little nervous about the assumption that the source tree stays around. The tests may sit in the queue for a while, or you may change branch in the source directory. I agree it would be good to reduce the time taken to copy the data, but I seem to remember that a design goal of simfactory was to be correct, and avoid people making mistakes, at the potential expense of efficiency.

Maybe we could have a "cache" of the required files on the scratch filesystem, and use rsync's link-dest option, to make hard links to that cache. It wouldn't help the first time, but subsequent jobs would benefit.

comment:2 Changed 4 years ago by Ian Hinder

Status: newconfirmed

Modify Ticket

Change Properties
Set your email in Preferences
as confirmed The ticket will remain with no owner.
Next status will be 'review'.
as The resolution will be set.
to The owner will be changed from (none) to the specified user.
The owner will be changed from (none) to anonymous.

Add Comment

E-mail address and name can be saved in the Preferences.

Note: See TracTickets for help on using tickets.