Current state-of-the-art sequencing platforms like the Illumina NovaSeq X Plus are capable of generating large amounts of data quickly, and for historically low prices. As a result, transferring and storing these data presents a unique challenge. In order to make data transfer as painless as possible, we try to support a number of different options including local share folders, cloud resources, and platforms such as DNAnexus.
Data Storage Policies
Historically, the MBCF has tried to maintain local storage of all the data we generate "forever". Moore's Law made this possible through our history running Sanger sequencing, Microarray, and even Illumina MiSeq and NextSeq. However, the NovaSeq 6000 and X plus have made storing data "forever" cost prohibitive.
Current Policy
Raw data will be stored for no more than 5 years.
Within 3 months after initial transfer, data will be archived.
Retrieval will take time (1-2 weeks) and incur additional fees.
Download and Store your FASTQ files.
DFCI Internal Data Transfer
RCSM Share Folders: This is the fastest and most efficient way to transfer internal DFCI data. The shares requires an RCSM storage space. This is the future of DFCI storage, if not set up yet, open a ticket with research computing today!
Legacy rc-stor Share Folders: A fast and efficient way to transfer internal DFCI data, but space is limited. Please consider migrating to the RCSM store system (see above) or utilizing DNAnexus (see below).
DNAnexus: A cloud based storage and analysis system.