Cover image for Genomics in the Cloud

Genomics in the Cloud

Author Brian D. O'Connor , Geraldine A. Van der Auwera
Release Date: 2020/05/01
ISBN: 9781491975183
Topic:
0%
6
Chapters
0-1
Hours read
0k
Total Words
    Start Reading Now    
       Add to Wishlist       
View table of contents

Book Description

Data in the genomics field is booming. In just a few years, organizations such as the National Institutes of Health (NIH) will host 50+ petabytes—or 52.4 million gigabytes—of genomic data, and they’re turning to cloud infrastructure to make that data available to the research community. How do you adapt analysis tools and protocols to access and analyze that data in the cloud?

With this practical book, researchers will learn how to work with genomics algorithms using open source tools including the Genome Analysis Toolkit (GATK), Docker, WDL, and Terra. Brian O’Connor of the UC Santa Cruz Genomics Institute and Geraldine Van der Auwera, longtime custodian of the GATK user community, guide you through the process. You’ll learn by working with real data and genomics algorithms from the field.

This book takes you through:

  • Essential genomics and computing technology background
  • Basic cloud computing operations
  • Getting started with GATK
  • Three major GATK best practices for variant discovery pipelines
  • Automating analysis with scripted workflows using WDL and Cromwell
  • Scaling up workflow execution in the cloud, including parallelization and cost optimization
  • Interactive analysis in the cloud using Jupyter notebooks
  • Secure collaboration and computational reproducibility using Terra

Table of Contents

  1. 1. First steps on the Cloud
    1. Setting up your Google Cloud account and first Project
      1. Create a Project
      2. Check your billing account and activate free credits
      3. Running basic commands in Google Cloud Shell
      4. Log into the Cloud Shell VM
      5. Use gsutil to access and manage files
      6. Pull a Docker image and spin up the container
      7. Mounting a volume to access the filesystem from within the container
      8. Setting up your own custom VM
      9. Create and configure your VM instance
      10. Set up the GATK container image
      11. Configure the Integrated Genome Viewer to read data from GCS buckets
    2. Wrap up and next steps
  2. 2. First steps with GATK
    1. Getting started with GATK
      1. Operating requirements
    2. Command-line syntax
      1. Multithreading with Spark
      2. Running GATK in practice
      3. Generate an output BAM to troubleshoot a surprising call
      4. Understanding variant context annotations
      5. Plotting variant context annotation data
      6. Applying hard filters to germline SNPs and indels
    3. Best Practices workflows covered in the book
      1. Other supported use cases
    4. Wrap up and next steps
18.119.126.80