alterlab-tiledbvcf

Featured

Store and query genomic variant data at scale with TileDB-VCF — ingest VCF/BCF into compressed TileDB arrays, add samples incrementally, run fast parallel region/sample queries, and export back to VCF. Use when managing population-genomics variant datasets that are too large for flat VCF, building joint variant stores, or querying thousands of samples by region. Part of the AlterLab Academic Skills suite.

AI & Automation 68 stars 13 forks Updated 3 days ago MIT

Install

View on GitHub

Quality Score: 91/100

Stars 20%
61
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# TileDB-VCF ## Overview TileDB-VCF is a high-performance C++ library with Python and CLI interfaces for efficient storage and retrieval of genomic variant-call data. Built on TileDB's sparse array technology, it enables scalable ingestion of VCF/BCF files, incremental sample addition without expensive merging operations, and efficient parallel queries of variant data stored locally or in the cloud. ## When to Use This Skill This skill should be used when: - Building a queryable, compressed variant store from many single-sample VCF/BCF files (cohort/population datasets too large for flat VCF) - Incrementally adding new samples to an existing store without re-merging - Querying specific genomic regions across many samples (region/sample-partitioned reads) - Exporting region/sample subsets back to VCF/BCF for downstream tools - Working with variant data on cloud storage (S3, Azure, GCS) or TileDB Cloud - Prototyping or teaching scalable genomics-variant workflows ### Does NOT Trigger | Scenario | Use Instead | |----------|-------------| | Reading, filtering, or iterating a handful of VCF/BAM files in Python (pysam/htslib) | `alterlab-pysam` | | Producing the VCFs in the first place (FASTQ -> alignment -> variant calling) | `alterlab-nf-core-sarek` | | Clinical interpretation or population frequency of a specific variant | `alterlab-clinvar` / `alterlab-gnomad` | | General chunked array storage for non-variant data (images, tensors, matrices) | `alterlab-zarr` | | Out-of-c...

Details

Author
AlterLab-IEU
Repository
AlterLab-IEU/AlterLab-Academic-Skills
Created
6 months ago
Last Updated
3 days ago
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

alterlab-nf-core-sarek

Runs FASTQ-to-VCF germline and somatic variant calling via the Nextflow nf-core/sarek pipeline pinned to -r 3.10.0 — builds the samplesheet.csv (patient, sex, status, sample, lane, fastq_1, fastq_2), runs bwa-mem/bwa-mem2/dragmap alignment plus GATK4 MarkDuplicates and BQSR against the GATK GRCh38 resource bundle (dbSNP, Mills/1000G indels), and selects callers — explicitly correcting that sarek defaults to Strelka when --tools is unset (pass haplotypecaller for GATK best practice or deepvariant for CNN accuracy), with a non-Nextflow manual GATK4 fallback. Use when the user wants a variant-calling pipeline, FASTQ to VCF, germline or somatic SNV/indel calling, nf-core/sarek, GATK best-practices alignment-to-VCF, or BQSR/HaplotypeCaller/Mutect2/DeepVariant; annotate hits with alterlab-clinvar/alterlab-gnomad/alterlab-cosmic, parse VCFs with alterlab-pysam, store at scale with alterlab-tiledbvcf. Part of the AlterLab Academic Skills suite.

68 Updated 3 days ago
AlterLab-IEU
AI & Automation Featured

alterlab-scvi-tools

Train deep generative models for single-cell omics with scvi-tools — probabilistic batch correction and integration (scVI), reference-mapping transfer learning (scArches), differential expression with uncertainty, and multimodal models (totalVI for CITE-seq, MultiVI for multiome). Use when correcting batch effects, integrating multimodal data, or doing advanced probabilistic single-cell modeling — for standard analysis pipelines use scanpy. Part of the AlterLab Academic Skills suite.

68 Updated 3 days ago
AlterLab-IEU
AI & Automation Featured

alterlab-scikit-bio

Analyze biological data with scikit-bio — sequence analysis and alignments, phylogenetic trees, alpha/beta diversity metrics (including UniFrac), ordination (PCoA), PERMANOVA statistics, and FASTA/Newick I/O. Use for microbiome and community-ecology analysis — computing diversity, distance matrices, and ordination from feature tables. Part of the AlterLab Academic Skills suite.

68 Updated 3 days ago
AlterLab-IEU