Data Stores @ iVEC
iVEC has multiple data storage options available to the research community, known as Data Stores @ iVEC. Access to Data Stores @ iVEC is governed by a Data Storage and Management Policy (DSMP), which was approved by the iVEC Board. The DSMP is available to all researchers from here. iVEC_Storage_Policy_Ver2.01
Access to Data Stores @ iVEC
Data storage allocations now require researchers to complete the application form provided below.
What storage is available?
Data Stores @ iVEC includes data storage from Research Data Storage Infrastructure (RDSI) which is a national collaborative initiative providing significant resources across Australia to the research community. More detail about iVEC’s role in the RDSI Project is available here.
Data Stores @ iVEC also includes the Petabyte Data Store (PB Store) which is a scalable storage solution based on Sun’s SAM-QFS (Storage and Archive Manager File System & Quick File System) software, and consists of a 70TB of disk cache and a second 100TB file system. The SAM-QFS software automates the migration and retrieval of files across multiple tiers of storage from the online disk cache, to near-line tape storage, to offline tape archival. This system allows researchers to see their complete directory hierarchy and have seamless access to their files within a single file system. Each file that is placed on the system has a copy written to two separate tapes. The system is presently backed by LTO4 tape technology which features a native capacity of 800GB. The Tape Library is a StorageTek SL8500 and is currently licensed for 2PB (Petabyte) under management, which provides 1PB of usable space.
Data Stores @ iVEC will also expand to include resources provided by the Pawsey Project. Details of additional storage for researchers will be provided soon.
Currently iVEC does not create a tertiary offsite copy of all data; in the event of a catastrophic failure destroying both onsite copies, iVEC is unable to recover the data. Is is possible to create a tertiary copy for smaller amounts of non-recreatable data upon request. This service is evaluated on a case by case basis with a cost associated.
Need more help?
Why don’t you come along to a Data Clinic? There is help available at a ‘drop-in’ Data Clinics near you. At a Clinic you can find out:
- what data storage is available and how to access this
- how to complete the application process
- about data ingest procedures, tools and practices (e.g. what tools to use and why)
- how eResearch staff can help you identify bottlenecks in present workflow
- how best to share data (especially for researchers with collaborators elsewhere)
- how best to make data discoverable by others.
Other data projects
iVEC also supports data access initiatives such as the deployment of MyTARDIS (created at Monash University). MyTARDIS was developed for Protein Crystallographers to store and disseminate of public datasets containing raw crystallography data (known as ‘diffraction images’), along with rich metadata for search and persistent handles for citation in publications. More information about the MyTARDIS deployment at iVEC is available from here.