Home directories are stored on a dedicated file server with limited fast disk. To ensure this resources is always available please do not store data in your home directory. If you notice the home directories filling up and it appears it is going unnoticed, please contact the sys admins asap - even on a weekend. The home directories filling up is a bad thing.
Please attempt to limit your home directory to less than 1GB.
Regular checks will be made of home directory sizes, and users with more than 1GB will be sent a reminder to clean their files.
The following disks are available for personal analysis data storage.
Please make a directory on one of these disks, using your user-name. Inside this directory, make sub-directories which will contain your data. Use a name which has meaning for these sub-directories. Users should not have a directory on more than one of the above disks. If this is not the case then contact the sys admin if help is needed in consolidating to one disk.
These disks are intended for active, in progress analysis. They are not intended for long term storage of data. However, data can be put directly into long term storage if it is documented. A script will be regularly run to check the last use of the directories (and to check users don't have multiple directories). Once a directory is inactive for 3 months, the data should be moved to long term storage. If directories are found to be inactive for longer than 3 months, the sys admins will assist in relocating the data, or archive to tape.
On the above disks, data inactive for longer than 3 months must be removed.
Be aware of other users and do not fill up these disks.
If possible put data directly into long term storage (MUST be documented)
For long term storage, data should be put in the following directory structure.
/data/[exp|sim]/experiment-name/[year|general]/some-name-that-makes-sense
where
Example
/data/exp/AMANDA/2002/mu-mon
is the AMANDA muon DAQ monitoring data from the South Pole.
Data on these disks MUST be documented! See the Data Documentation page on how to do this.
A web tool is available to help produce and save the data documentation.
The data will be distributed over the following disks by symbolic links. The data should NOT be accessed via path names such as /data/disk5/exp/AMANDA/2002/mu-mon. Scripts that use such paths will break if the data is moved. The sys admins must be able to move the data to ensure adequate space is available on all disks at all times.
The total capacity of these disks is presently 7TB. If the disk a user is presently using has inadequate free space for up coming work, contact the sys admins who will make the arrangements need to free up space.