Logo image
GOBii, a scalable genomics data management system with rapid data extract times and integration with downstream genomic selection analysis pipelines
Acte de colloque   Open Access

GOBii, a scalable genomics data management system with rapid data extract times and integration with downstream genomic selection analysis pipelines

Yaw Nti-Addae, Victor Jun Ulat, Dave Matthews, Guilhem Sempere, Valentin Guignon, Pierre Larmande, Jon Renner, Adrien Petel, Elizabeth Jones et Kelly Robbins
Plant and Animal Genome Conference (PAG) (San Diego, United States, 12/01/2019–16/01/2019)
2019

Résumé

Interoperability Web tool VCF INDELs SNP markers NoSQL database
The Genomic Open-Source Breeding informatics initiative (GOBii) has built a genomics data management system that is highly scalable and has focused on data extract performance for large genomics data files. We have benchmarked several SQL and noSQL open-source data management systems with a view to managing large scale genomics data, and have determined that the HDF5 file system outperformed other data management systems both in loading and extract times. In order to also accommodate metadata management, we have designed and developed a hybrid system based on Postgres for sample and marker metadata management and HDF5 for the large genomics files. The HDF5 genomics files are stored in two different orientations to enable rapid extract in either sample or marker-fast formats. The system is flexible enough to be used across different crops and with diverse marker and sequence-based platforms. We are now working to integrate the genomics data extracts with downstream genomic selection applications in Galaxy.

Fichiers et liens (1)

url
Find in HALAfficher

Indicateurs

1 Consultations de la notice

Détails

Logo image