So far, you could run workflows with Cromwell natively on Google Cloud Platform (GCP), Amazon Web Services (AWS) and Alibaba Cloud -- in addition to running jobs locally and on most HPC clusters, of course. We can now add the big name previously missing from that list: Microsoft Azure. I’m excited to report that we recently received a contribution from a Microsoft group that supports running WDL workflows natively on Azure, as announced on the Microsoft team's blog. This means Cromwell now has at least beta support or better for running workflows natively on all 3 major cloud providers in North America and the largest in Asia.


This development unlocks a big step forward for portability and interoperability of workflow execution across compute environments. For example this is great news for researchers in the GATK community who will now be able to run the Best Practices workflows more easily regardless of which cloud platform(s) they are operating in. More generally, this means you will be able to take advantage of Cromwell's capabilities out of the box on any data stored in Azure.

What's especially cool with this particular Cromwell integration is that it's based on the GA4GH Task Execution Service (TES) API, which aims to standardize how task execution is defined across platforms. This is important because TES is a standard that helps ensure research tools are portable and can be run on different platforms (such as the public clouds mentioned above and various HPCs).

To take it out for a spin, check out the Cromwell on Azure Github repository for details and instructions on how to get started. Please keep in mind that this is new functionality; it is still in a beta phase and testing has been highly focused on running an optimized version of the GATK Best Practices against public data on Azure. Next, the project will seek to add support for popular features like call caching, support for preemptible VMs (low cost machines), and the addition of more scientific pipelines optimized for Azure.


Return to top

Tue 15 Oct 2019
Comment on this article


- Recent posts


- Upcoming events

See Events calendar for full list and dates


- Recent events

See Events calendar for full list and dates



- Follow us on Twitter

WDL Dev Team

@WDL_dev

RT @TristanNaumann: Very cool to see Cromwell on Azure 1.0.0 released on GitHub! https://t.co/ZdQ9glQSZs
6 Nov 19
RT @hcaskey: Earlier this month, we released Cromwell on Azure, an open-source project on GitHub from Microsoft Genomics that provides scie…
6 Nov 19
@dbernick @fdmts java -Dconfig.file=google.conf -jar cromwell-47.jar run hello.wdl -i hello.inputs
26 Oct 19
Featuring WDL and Cromwell on @Azure thanks to @Microsoft @Health_IT -- see also our blog at… https://t.co/gCUAQrcgC1
16 Oct 19
Blue skies ahead for Cromwell on Azure! https://t.co/35jHw7yIqt https://t.co/2OD9w8EyZ9
15 Oct 19

- Our favorite tweets from others

To all the workflow developers out there, we’ve added support for @WDL_dev 1.0. Check out our getting started doc h… https://t.co/eYhN1c84QD
28 Oct 19
@tangming2005 @geoffjentry @dnanexus I was surprised at the cost too, most user group meetings in biotech are free/… https://t.co/GP0Os3t64r
9 Sep 19
Nice overview of bioinformatics workflows definition and execution including discussion of @commonwl @galaxyprojecthttps://t.co/3WfecaEEJH
3 Sep 19
Workflow systems turn raw data into scientific knowledge https://t.co/t5jUjl39RW
2 Sep 19
@DNAstack @DTSupercluster Ok, so now I'm expecting this many more @WDL_dev PRs :P
2 Aug 19

See more of our favorite tweets...