Augmented Flumen - Space Apps Challenge

Augmented Flumen| A Flood of Ideas

A Flood of Ideas

Your challenge is to develop a new methodology or algorithm that leverages Earth observation and critical infrastructure datasets to estimate damages to infrastructure caused by flooding. Make a measurable impact on the resilience of nations by helping the Earth observations community contribute to the United Nations’ primary effort to reduce disaster risk!

Augmented Flumen-An augmented reality based app upgraded to Extended Reality:Taking it to next level

Summary

To estimate damages of critical infrastructure affected by floods, we have developed a project called "Augmented Flumen", a mobile application that can detect damaged infrastructure by GPS and also gives real-time data sets from NASA, JAXA, CSA, UNISDR, EASA etc. Not only that by the integration of AI & AR it can also create a 3D model of critical infrastructure helping the United Nations & Researchers to avoid the flood.

How We Addressed This Challenge

We have developed a mobile application named Augmented Flumen which deals with a modern technology Augmented Reality. Our Innovators have taken it to next level; making it integrated with Artificial Intelligence we call it Extended Reality. Our application generally takes real time data sets from JAXA (LONGITUDE & LATITUDE), then warns the user about the flood affected infrastructure nearby with the help of GPS. For a particular location globally and locally our app is capable to give data on the basis of 7 recognized targets by UNISDR to estimate damages. We are indicating those data in a map where flood affected regions are identified automatically by our app.

Moreover by using those global data given by NASA, CSA, JAXA our app is able to create a 3D model as a solution for that critical infrastructure by using Extended Reality. We have to go through the app; press the AR mode button, we have to allow the permissions to access GPS and Camera. The app will go through our online database & render GPS whether it is flood affected or not and scan the environment. Then it will check for available solutions and create an Augmented Reality model for that specific infrastructure. Our app is mainly a global platform for United Nations & fellow Researchers working on flood.

They can get any data they want regarding infrastructure designing and create their own 3D design home and abroad by sending it to our app database. Our Innovators will make sure it turns into Extended Reality. We have different solutions for variant Infrastructure; To mitigate the problem we have to submit some data and 3D design of the solution in our submit solution section. We hope one day it will become the global platform for visualizing 3D models for any disaster.

How We Developed This Project

Flood is one of the most criticized global natural disaster. If we observe our past experiences in last 10 years number of affected per year were 72 million people whereas in following years it drastically increased to 147 million. If we look at the monetary damages past 10 years average dictates 174 Billion $ where as in the following year it rocketed to 712 Billion $.According to the report of World Resource Institute 221 million people will be affected by flood by 2050.The numbers will be catastrophic in future. This type of situation Inspired us to choose this challenge. However ,there was always been a problem to estimate damages, mortality rate, number of affected people, direct economic loss etc. not only locally but also reporting those in global level. Our approach is to create a global platform and local platform as well for reporting damage estimation at local level. The tools that we used are given below:

Unity engine. (App Development & AR Development)
Solid works. (3-D Modelling)
Laravel for back-end. (Web Development)
Vuejs for front-end. (Web Development)
Adobe Illustrator. (Graphics Designing)
C#. (Coding)
Matlab. (Mathematical Calculations and Graph Plotting)
Filmora. (Video Editing)
Meshlab. (3-D Modelling)
Microsoft Excel. (Data Collection)
Google Map API. (For Mapping)

Our major achievement is all of our team member are well skilled and could made a prototype easily within a short period of time using maximum amount of data from NASA and their partner agencies. One of the major problem that we faced is our application is not applicable for all devices and API levels. the link of the list of supported devices are given below as our app supports only AR core devices.

https://developers.google.com/ar/discover/supported-devices?fbclid=IwAR1RvQDLlrbZab4GPs0hDS2IWBfHwi5kQRKzFb0LeoT-Y9xB1MvhW5PmhCQ

How We Used Space Agency Data in This Project

From UNISDR we have taken mathematical formulae for 7 different targets which are given below:

Technical Note on Data and Methodology to Estimate Global Disaster Mortality to Measure the Achievement of Target A of the Sendai Framework for Disaster Risk Reduction.

Technical Note on Data and Methodology to Estimate the Number of Affected People to Measure the achievement of Target B of the Sendai Framework for Disaster Risk Reduction.
Technical Note on Data and Methodology to Estimate Direct Economic Loss to Measure the Achievement of Target C of the Sendai Framework for Disaster Risk Reduction.
Technical note on Data and Methodology to Estimate Damages to Infrastructure and Disruptions to Basic Services to Measure the Achievement of Target D of the Sendai Framework for Disaster Risk Reduction.
Technical Note on Data and Methodology to Estimate the Global Progress in the Number of Countries with National and Local DRR Strategies to Measure the Achievement of Target E of the Sendai Framework for Disaster Risk Reduction.
Technical Note on Data and Methodology to Estimate the Enhancement of International Cooperation to Developing Countries to Complement National Actions to Measure the Achievement of Target F of the Sendai Framework for Disaster Risk Reduction.
Technical Note on Data and Methodology to Estimate the Availability of and Access to Multi-Hazard Early Warning Systems and Disaster Risk Information and Assessments to Measure the Achievement of Target G of the Sendai Framework for Disaster Risk Reduction.

From NASAGroup of Earth Observation (GEO) we have taken different Data Sets& different satellite images of river Brahmaputra and Padma from Global Flood Risk Monitoring(GFRM)

From JAXA we have taken the data range of Latitude and Longitude for GPS monitoring and to provide alert to the users by indicating critical infrastructures damaged by flood.

From CSA(International Charter Space & Major Disaster) we have taken different data from year 2000-2020 of Bangladesh for National Monitoring. The type of Data Sets are given below:

Mortality Rate.
Infrastructure Damage.
Affected People.
Location.
Date & Time of Flood.

Project Demo

YouTube: This is our 30-second video demonstrating the Solution as a whole and briefly demonstrating the Project.

https://youtu.be/4tQsY6NWTxo

App: This is the link for the APK File of the prototype that we created as our solution of the project.

https://drive.google.com/file/d/1Hmz_wuzjNVHs_64T0_yJnwoYkNyalI4P/view?fbclid=IwAR1K5ceiidV86NGTX3R-dzafgzHJoQMjIz_GZnnU1StDd4UGs9czRmzuaSo

Screenshots of the App:

We took Screenshots of the App while using it. This shows the Demo Model Building on a floor that is detected by the App as a plane. It also shows the Location of the user in Real-time.