TUDLife blog posts from the Delft University of Technology IT department

Using Jupyter to study Earth

How TU Delft’s ICT-Innovation department is providing hands-on help to researchers in order to understand their IT requirements better.

How did it come about?

Earlier this year I was reading through the ‘TU Delft Strategic Framework 2018-2024’ and buried deep within its pages I found this hidden gem:

We strengthen the social cohesion and interaction within the organisation, by:

  • Supporting mobility across the campus. For example through interfaculty micro-sabbaticals.
  • Stimulating joint activities and knowledge exchange across the various faculties and service departments.
  • Strengthening relations between academic staff members and support staff.

Hidden Gem

This seemed especially relevant to our ICT-Innovation department. We are continually on the look-out for ways to support the primary processes of the university, research and education, by applying IT solutions. I decided to find myself a suitable micro-sabbatical.

Since October 2018 I’ve been spending one day a week in the group of Prof.dr.ir. Nick van de Giesen and Dr.ir. Rolf Hut, working with their bright, new Ph.D. student, Jerom Aerts, on the eWaterCycle II project.

What’s it about?

eWaterCylce II aims to understand water movement on a global scale in order to predict floods, droughts and the effect of land use on water. You can read more about it here https://www.ewatercycle.org/ or here https://www.esciencecenter.nl/project/ewatercycle-ii.

Sacramento River Delta

Hydrologists are encouraged to use their own local models within a global hydrological model.

In order to test whether their model is working properly, the project team is developing a Python Jupyter notebook that makes it easy for hydrologists to produce the graphs and statistics that they are familiar with.

During my micro-sabbatical, I am contributing to the development of this Jupyter notebook.

What did I learn?

  • Wi-Fi is an essential service for researchers and needs to be reliable
  • Standard TU Delft laptops are not adequate for research
  • Data for this project is hosted in Poland due to the collaboration with many partners and funding from EOSC
  • The team initially hosted their forecasting site on AWS, because AWS is quick to set up and it works in all the countries involved. For the minimum viable product of the global hydrology model they moved to the SURFsara HPC Cloud
  • If data is not open, then researchers are hesitant to use it. Their work can’t be reproduced easily, leading to fewer quality checks and less publicity
  • In the face of bureaucracy, cramped conditions and an ever growing number of extra required activities, our researchers’ determination and passion for their field of expertise is truly magnificent

TU Delft light bulb

I shall be using these insights to guide my work within the ICT-Innovation department and to feed our conversations with the Shared Service Center.

What next?

From 1st April 2019 I’ll be moving on to my next micro-sabbatical at the Chemical Engineering department of the Applied Sciences faculty. There I shall be installing molecular simulation software on a computer cluster and getting it up and running.

My ambition is to cover all 8 faculties of the TU Delft within 4 years. In October 2019 I shall be available for the next micro-sabbatical. If you have any suggestions, please do not hesitate to get in touch.

About the Author

Susan Branchett is Expert Research Data Innovation in the ICT-Innovation department of the TU Delft. She has a Ph.D. in physics and many years’ experience in software development and IT. Find her at TU Delft or LinkedIn or Twitter or github.

This blog expresses the views of the author.

Acknowledgements

The image of Jupiter is from here. Image credit: NASA/JPL-Caltech/SwRI/MSSS/Kevin M. Gill. License.

The hidden gem image is from here and is reproduced by kind permission of Macintyres.

The Sacramento River Delta image is from here and is reproduced under a CC-BY-2.0 license.

Except where otherwise noted this blog is available under a CC-BY-4.0 international license.