Project Information

docker, hadoop, jupyterhub, kubernetes, machine-learning, programming-best-practices, python, r, software-installation, spark, tensorflow, tuning
Project Status: Complete
Project Region: CAREERS
Submitted By: Anita Schwartz
Project Email: tina.callahan@udel.edu
Project Institution: University of Delaware
Anchor Institution: CR-University of Delaware
Project Address: Newark, Delaware. 19716

Mentors: Christina Callahan, Matt Shatley
Students: Rainier Delarosa

Project Description

NSF EPSCoR-funded Project WiCCED aims to assess threats and develop solutions to mitigate the human, agricultural, and natural pressures threatening water security in Delaware’s changing coastal environment. The WiCCED Data Core team provides an important platform for storage and dissemination of data produced from diverse resources and develops advanced data analysis techniques and data-backed decision-support systems.

The student working on this project will interface with faculty, staff, and students to … enable access/retrieval of data from a big data system(GeoMesa/Accumulo based) for machine learning projects. This student will review, test, and create code to access data via Python and R, documenting their process for others to follow. They will also assist in retrieving/converting data to researchers desired file format. Time permitting, the student will also assist with data ingest.
Software utilized:
Python
R
Geomesa
Accumulo
Hadoop/MapReduce
Spark/PySpark
Jupyter(notebook)
Kubernetes

Additional Resources

Launch Presentation: