In the near future, we will update a number of the libraries and packages that are preloaded on notebook clusters on both FireCloud and Terra (beta). The updates are listed below. We expect all of these updates to be backwards compatible, with the exception of the upgrade from Hail 0.1 to 0.2 which is a breaking change. However it is possible that even the minor version updates could break dependencies in some of your notebooks, so we have developed a rollout plan to minimize disruption as follows.

  • For FireCloud, we are taking a conservative approach and soliciting feedback from all users before scheduling the update. Please comment below if you think any of the updates listed below will be disruptive for your work. These updates only affect the creation of new clusters; existing clusters that are paused will not be affected by this change.
  • For Terra (new beta UI for FireCloud), the updates listed below will be released next week (planned for Dec 4). Because these updates will affect all clusters on Terra, we recommend you save a version of your current notebook and results before that date. After the release, re-run your analysis results using the using the old vs new packages and compare results against your saved version. Let us know if you find any problematic discrepancies that you need help with.
  • In the future, we plan to make it possible to enable access to prior versions of the notebook kernels to ensure long-term reproducibility and avoid this becoming a recurring issue when we roll out kernel upgrades.

The updates Version changes for libraries and packages:

  • hail 0.1 -> 0.2
  • python 3.4 -> 3.6
  • R 3.4 -> 3.5
  • pandas 0.22.0 -> 0.23.4
  • numpy 1.15.0 -> 1.15.2
  • google-api-core 1.3.0 -> 1.5.0
  • google-cloud-bigquery 1.4.0 -> 1.6.0
  • bokeh 1.0.0 -> 1.0.1

Hail 0.2 has a new file format and cannot read Hail 0.1. You can learn more about Hail 0.1 -> 0.2 changes here.

If you have any concerns, please comment below as soon as possible. Our goal is to equip you with the tools you need to get your work done, so the more we know, the better we can serve you.

Thank you for your patience as we work to improve the platform!



Comment on this article


- Recent posts



- Follow us on Twitter

FireCloud

@BroadFireCloud

The analysis described in this paper is available in reproducible form in FireCloud; see https://t.co/uSChRZIoZg fo… https://t.co/j1zeh2TGRg
30 Nov 18
@xDBio_Inc @geoffjentry @WDL_dev @gatk_dev It’s pretty new, glad you like it! Think we should add the name itself a… https://t.co/65jwJEbyQu
23 Oct 18
We’re excited to deliver our #ASHG18 Invited Workshop on reproducible research tomorrow morning! Looking forward to… https://t.co/6vmB5qaA1H
17 Oct 18
RT @NCI_NCIP: Does @BroadFireCloud sound familiar? It should! @AllofUsResearch uses the same researcher workbench as this @NIH initiative.…
16 Oct 18
RT @broadinstitute: .@BroadGenomics put together a comprehensive list of @broadinstitute activities at #ASHG18. Find out about sessions, po…
16 Oct 18

- Our favorite tweets from others

The question is, how will @Microsoft and @Docker team up to solve collaborative challenges in the area of Bioinform… https://t.co/IKzElembVl
4 Dec 18
@geoffjentry Who doesn't love a Warp Pig? @WDL_dev and @gatk_dev are on the ball getting stickers out. Was happy to… https://t.co/91OODRpFOC
22 Oct 18
Does @BroadFireCloud sound familiar? It should! @AllofUsResearch uses the same researcher workbench as this @NIH in… https://t.co/8ZyoMBSG4x
12 Oct 18
Today at #GATK course, pipelining with WDL, Cromwell and Firecloud! @ClinicalBioinfo @FProgresoysalud @gatk_dev https://t.co/V4bLinpoPh
20 Sep 18
@dgmacarthur If anybody wants to sequence my genome to find the rare variant that is preventing me from going into… https://t.co/xGPGDZn9rQ
11 Jul 18

See more of our favorite tweets...