The Petabyte Data Store is a scalable storage solution based on Sun’s SAM-QFS (Storage and Archive Manager File System & Quick File System) software, and consists of a 70TB of disk cache and a second 100TB file system. The SAM-QFS software automates the migration and retrieval of files across multiple tiers of storage, from the online disk cache, to near-line tape storage, to offline tape archival. This system allows researchers to see their complete directory hierarchy and have seamless access to their files within a single file system. Each file that is placed on the system has a copy written to two separate tapes.
iVEC currently has 70TB of online disk storage (cache) and a second 100TB file system, backed by LTO4 tape technology which features a native capacity of 800GB. The Tape Library is a StorageTek SL8500 and is currently licensed for 2PB (Petabyte) under managment, which provides 1PB of usable space.
Currently iVEC does not create a tertiary offsite copy of all data; in the event of a catastrophic failure destroying both onsite copies, iVEC is unable to recover the data. A tertiary copy can be created for smaller amounts of non-recreatable data upon request; this would be at an alternate facility or to an alternate tape for offsite storage but this service will be evaluated on a case by case basis and may have a cost associated with it.
iVEC is also funded by the Research Data Storage Initiative (RDSI) to be part of a national collaborative data storage initiative which will provide significant resources during 2013. More detail about iVEC’s role in the RDSI Project is available here.
iVEC also supports data access initiatives such as the deployment of MyTARDIS (created at Monash University). MyTARDIS was developed for Protein Crystallographers to store and disseminate of public datasets containing raw crystallography data (known as ‘diffraction images’), along with rich metadata for search and persistent handles for citation in publications. More information about the MyTARDIS deployment at iVEC is available from here.