Dynamic On-Demand Analysis Software

Instantiate on-demand customizable infrastructures for data analysis

What is it?

Dynamic On-Demand Analysis Software (DODAS) enables the execution of user analysis code both in batch mode and interactively via the Jupyter interface. DODAS is highly customizable and offers several building blocks that can be combined together in order to create the best service composition for a given use case. The currently available blocks allow to combine Jupyter and HTCondor as well as Jupyter and Spark or simply a jupyter interface. In addition, they allow the management of data via caches to optimize the processing of remote data. This can be done either via XCache or MinIO S3 object storage capabilities. DODAS is based on docker containers and the related orchestration relies on Kubernetes that enables the possibility to compose the building blocks via a web-based user interface thanks to Kubeapps.

In order to deploy it services over various backend, DODAS relies on Infrastructure Manager and INDIGO PaaS

Tip

If you want to give it a try and deploy your cluster in the EGI Federation: DODAS.

Note

For detailed information about DODAS please see its documentation. It was also presented in one of the EGI Webinars, more details are available on the indico page and the video recording is available on YouTube.

Last modified March 10, 2023 by Gianni Dalla Torre : General guidelines, SSH setup options, tips, and examples for setting up the OpenStack environment. (#544)