Drone Survey

Drone tools have been instrumental as a first step in the assessment of cliff floras. We can now map the distribution and abundance of critically endangered endemic cliff species and expedite their conservation. Field surveys have been conducted in Hawaii, the Republic of Palau, and Madeira (Portugal) with extremely positive results.

As technology has improved and progressed, this survey methodology has become accessible to a range of conservation practitioners.

Drone are effective tools for assessment of cliff habitats, and will be critical to species conservation in these areas.

Education tools

Amphibians are more threatened and are declining more rapidly than either birds or mammals. Amphibian populations are decreasing due to multiple factors, such as climate change, the chytrid fungus, and other anthropogenic factors such as species trafficking. However, the level of threat to amphibians is undoubtedly underestimated because 1294 species (22.5%) are too poorly known to assess, as compared with only 78 birds (0.8%) (Stuart et al., 2004). 

This knowledge deficit underscores the vital importance of educational tools like Ribbit in democratizing scientific research. By lowering barriers to ecological monitoring, apps like Ribbit transform passive observers into active conservation participants. Educational technologies enable citizen scientists to directly contribute to understanding and protecting vulnerable ecosystems, addressing critical research limitations through expanded data collection in under-researched regions.

These innovative platforms increase public awareness about biodiversity challenges while providing accessible pathways for scientific engagement. Unlike bird-focused apps with well-established research infrastructures, anuran conservation has lacked comprehensive citizen science platforms. Ribbit fills this critical gap by empowering individuals to become crucial contributors to amphibian research, turning the tide on data deficiency and supporting global conservation efforts through collaborative, technology-enabled environmental stewardship.

  • Subject matter expertise: one of our team members (Juliana Gómez Consuegra) worked closely with other experts who were researching the chytrid fungus. 
  • Creating accessible web app: intuitive design of web app allows less-experienced observers to participate and learn.

While the goal is to educate nature enthusiasts, we want to avoid the increase of species trafficking. For this reason, we decided not to allow users to have access to each other's data. That way, an endangered species' location won't be visible to traffickers, on the app. Users only have access to their own data. Once data is shared with GBIF, the data is obscured, so that neither the frog's nor the user's precise location will be disclosed to the general public. 

Mitigate biodiversity loss

Conserving ecosystems is key to curbing climate change, and maintaining ecosystem services, which are closely linked to over 50% of the world’s GDP. Over 1 million species face the threat of extinction this century: however, selecting which areas to conserve is challenging with the existing data gap, which is biased towards observations in the global north. Increasing the amount of biodiversity data in the Global South is critical in the conservation of endangered species, found at high density in biodiversity hotspots in the Global South. Amphibians are ideal for acoustic identification due to their diverse vocalizations and are crucial ecosystem indicators (Estes-Zumpf et al., 2022), with over 40% of species at risk of extinction (Cañas et al., 2023). Increasing labeled data for the more than 7,000 amphibian species worldwide would enhance conservation efforts and reduce knowledge gaps in vulnerable ecosystems. By using a citizen science platform to aide in the mitigation of biodiversity loss, we help establish local environmental stewardship of these critical habitats.

Other citizen apps have shown the potential that citizen science has on mitigating biodiversity loss. eBird, the largest citizen science project related to biodiversity, has 100 million bird observations from users around the world. These observations help to "document the distribution, abundance, habitat use and bird trends through collected species list, within a simple scientific framework." (Sánchez-Clavijo et. al., 2024).  

iNaturalist, another citizen science app, that uses computer vision algorithms for species identification, has also proven successful in mitigating biodiversity loss. To date, the app has over 200,000,000 observations, with 6 million observations per month, globally. On iNaturalist, research-grade observations are shared with GBIF, which in turn uses that knowledge for policy decisions, research, and community building (GBIF, 2023). 

Currently, our app identifies 71 species of frogs and toads, worldwide. Though many of them are identified as least concern (LC) under the IUCN, we do have one IUCN endangered species, the Southern Bell Frog (Ranoidea raniformis). This lack of threatened species included, underscores the need for diverse practitioners to participate in bioacoustic ecological monitoring. Increasing data points on vulnerable species can serve to inform policy decisions using data-driven insights. 

  • Closing data gaps: get more data from citizen scientists.
  • Enabling environmental stewardship: accessibility to a diverse set of users.

We initially set a goal to decrease data gaps in the Global South. However, getting access to enough calls for rare, cryptic, and endangered species in the Global South to train our model proved to be challenging. Therefore, to improve model performance, we turned our attention to as many species as we could tackle, worldwide. Getting users engaged worldwide will lead to more recordings in data-poor regions like the Global South, allowing us to retrain our model in the future with increased data on endangered, rare, and cryptic species. 

Citizen science and community engagement

Citizen science apps have been shown to aid in biodiversity monitoring while engaging nature enthusiasts (Callaghan et al., 2019). For instance,  FrogID, an app by the Australian Museum, allows users to record frog calls whose identity is verified by human validators. To date, FrogID has published papers related to monitoring invasive species (Rowley and Callaghan, 2023), informing IUCN red list assessments (Gallagher et al., 2024), assessing fire impacts (Mitchell et. al., 2023), understanding urbanization impacts (Callaghan et al., 2020) and studying frog call behavior (Liu et al., 2022). Our goal is to achieve similar results with Ribbit, with anuran species around the world, and in a shorter time frame. To date, the FrogID team has a backlog of over 18,000 calls, which could be greatly reduced with our app, since the processing time is greatly reduced with the implementation of machine learning algorithms. 

During the first round of beta testing of our app, 50 users submitted recordings for identification. Their feedback has been positive: subject matter experts have pointed out that the species they recorded matched the one predicted by Ribbit, and nature enthusiasts have enjoyed the "Frog of the Day" feature introducing them to a new anuran species or allowing them to re-acquaint with familiar anurans through name and most common vocalization of the species. 

  • Ease of use: through analyzed feedback from users, we iterated to enhance user experience and accessibility.
  • Familiarity of established citizen ecological science apps: with FrogID, Merlin, eBird and iNaturalist used as references, we mimicked key app features for quick initiation for new users.
  • It is hard to strike a balance between different types of users. While scientists advocated for using scientific names, nature enthusiasts did not connect to these names and preferred common names. However, obtaining common names for all our species in all four languages proved to be challenging. This is another opportunity for development: crowdsourcing common names around the world. 
Democratization of data

Ribbit's approach to data democratization represents a carefully curated process of citizen-driven scientific contribution. By leveraging existing public datasets from iNaturalist sounds and Anuraset, the application establishes a robust foundation for acoustic biodiversity monitoring. These initial datasets provide a comprehensive baseline for machine learning training, ensuring high-quality initial models for anuran identification.

The application's innovative data collection strategy goes beyond gathering information, implementing a rigorous quality control process for user-contributed data. Each citizen-submitted recording will undergo careful verification before potential contribution to the Global Biodiversity Information Facility (GBIF). This approach transforms passive data collection into an active, collaborative scientific process where citizens can meaningfully contribute to conservation research.

Critically, Ribbit maintains stringent data privacy and protection protocols. Recognizing the sensitive nature of ecological data, particularly regarding rare species and precise location information, the application implements strict user consent mechanisms. No user data will be shared or distributed without explicit, informed approval from the contributor, protecting both ecological subjects and citizen scientists' privacy.

 

  • Accessible technology: web app runs on desktop and mobile devices, and users may upload their data when no Internet is available. 
  • Robust quality control mechanisms: advanced evaluation of scientific quality recordings.
  • Ethical data governance: prioritization of user privacy and ecological sensitivity.

When starting this project, we were aware of the anuran biodiversity data gap in the global south. However, we were surprised that as we attempted increase accessibility of our application and add qualitative data, there was a gap in language representation. Currently, our project is available in four languages (English, Spanish, Portuguese, Arabic),  increasing accessibility. We used the Wikipedia API to obtain general information about our species in these four languages, and noticed that while there was an abundance of data in English and Arabic, the information available was sparse in Spanish and even more sparse in Portuguese. Therefore, we envision a  future challenge will involve engaging diverse scientists, such as Spanish and Portuguese speaking scientists, to decrease the "Wikipedia data gap". Addressing this gap will be a crucial act in further democratizing and increasing accessibility of our solution.

Establishing a satellite-based IoT communication system

Relevant ecological processes and incidents that are of interest in environmental change research typically occur in remote areas beyond the reach of terrestrial communication infrastructures. Data generated in the field using animal tags in these regions can often only be transmitted with a delay of days or even weeks. To overcome this delay and ensure no delay in the early-warning system, GAIA develops a satellite communication module for the tags as well as a nanosatellite operating in low earth orbit (LEO): In order to be able to transmit collected data and information directly from the transmitting node to the LEO satellite (Low Earth Orbit), a high-performance satellite IoT radio module will be integrated into the new tags. This guarantees immediate, secure and energy-efficient transmission of the extracted data. The communication system is based on the terrestrial mioty® technology and will be adapted to satellite-typical frequency bands such as L- and S-band for the project. Typical communication protocols, which are sometimes used in the IoT sector, are usually designed for small packet sizes. Further development of the mioty® system will therefore also aim to increase the data rate and message size to enable application scenarios such as image transmissions.

A significant share of the GAIA research and development was funded by the German Space Agency (DLR). This provided not only budgets for the development of the mioty® communication modules in the tags and first modules and concepts of the nanosatellites, but also access to an ecosystem of space-tech stakeholders. The start-up Rapidcubes became a key partner in the Initiative for the satellite development and plans for subsequent project phases include collaboration with existing DLR infrastructure such as the Heinrich Hertz satellite. 

The adaptation of the terrestrial mioty® protocols for satellite communication were successful. With the Ariane 6, an experimental nanosatellite was launched into a low earth orbit in July 2024. Since then, communication protocols are tested and refined for future application for the GAIA early-warning system.

Developing a new generation of animal tags and concepts for a digital swarm intelligence in networks of devices

To meet the goal of the GAIA Initiative to develop and put into practice a high-tech early-warning system for environmental changes, a new generation of animal tags is a key component. GAIA teams are working on the hardware and software development of miniaturized animal tags with lowest-power sensor technology with camera and image processing. The tags will be energy-autonomous, optimally adapted to the anatomy of vultures and are the basis for further technological features under development such as on-board artificial intelligences for behaviour detection and image recognition as well as a satellite-based IoT communication system.

Additionally, GAIA is developing concepts of distributed artificial intelligence and networks of micro-processors – animal tags that act just like a swarm. Analogous to natural swarm intelligence, the GAIA initiative is mapping digital swarm intelligence in an ad hoc network of microprocessors. These spontaneously forming networks are the foundation for distributed and sensor-based analysis of large amounts of data. Following this path will make it possible for vulture tags, for example, that are present at the same location during feeding events, to link and share tasks such as artificial intelligence analyses and data transmission.

A key factor for the success of this building block is the interdisciplinary and cross-sectoral cooperation of the GAIA partners: The Leibniz-IZW provided biological and veterinary knowledge about vultures and provided goals for the technical design of the new tags. The Fraunhofer IIS provided expertise in energy-efficient hardware, electronics and mechanics as well as in software for the miniature units. The Zoo Berlin provided environment and access to animals to aid the design and test the prototypes at various stages. Partner organisations in Africa such as Uganda Conservation Foundation provided an environment for in-depth field tests of the tag prototypes.

After several years of design and development, prototypes of the new tag system were tested in the wild in Uganda in November 2024. Wild white-backed vultures were equipped with prototypes called “data collection tag” (DCT) that featured many (albeit not all) innovations of the GAIA tag. The tags were released after 14 days from the vultures and collected using GPS and VHF signals, allowing for thorough examination of hardware and software performance as well as evaluation of collected data. These analyses will greatly help further developing the system.

Artificial intelligence(s) for behaviour recognition, carcass detection and image recognition

For ecological research as well as for GAIA use cases, it is necessary to reliably and accurately recognise the behaviour of different animal species over a long period of time in remote wilderness regions. To do this, GAIA scientists have developed and trained an artificial intelligence (AI) that can perform behavioural classification from GPS and acceleration data and tell us exactly what, for example, white-backed vultures fitted with animal tags are doing at any given time and place. This AI will eventually run directly on the GAIA animal tags and generate behavioural information from sensor data. In a second step, the scientists combined the behaviour thus classified with the GPS data from the tags. Using algorithms for spatial clustering, they identified locations where certain behaviours occurred more frequently. In this way, they obtained spatially and temporally finely resolved locations where vultures fed. Last but not least, GAIA is developing an AI for image recognition that will analyse photos taken by the integrated camera of the new tag system. All those algorithms will run directly on the tag and can perform efficient embedded data processing. This also places very special demands on image recognition AI, which must operate particularly sparingly and with small amounts of data. To this end, GAIA teams are developing appropriate strategies and models for sparse AI.

This building block stands on the shoulders of two major enabling factors. First, the combination of expertise in wildlife biology and data analysis/artificial intelligence development in one staff member. It proved absolutely essential to have great experience in wildlife ecology and vulture behaviour in particular as well as the development of code and the training of algorithms of the AI. Second, the acquisition of a large set of training data – one of the key factors for a successful AI development – was only possible through the cooperation of a wildlife research institute and a zoological organisation. With vultures in captivity in a large aviary, both data collection with a tag and video recordings of relevant behaviour could be conducted. Only this allowed for synced pairs of reference data and a training of the AI algorithms.

In this building block, GAIA achieved various tangible outcomes: First, the development of two integrated AI algorithms for vulture behaviour classification based on sensor data and for feeding cluster and carcass detection was completed and published in a peer-reviewed scientific journal (https://doi.org/10.1111/1365-2664.14810). The AI analysis pipeline has been running effectively for several years on sensor data from commercially available tags and provided many hundreds of potential carcass sites with a GPS location – an essential source of information for ranger patrols on the ground. Second, a similar AI pipeline has been developed for ravens. It is similarly efficient and can be utilized for mortality monitoring in North America or Europe, for example. Third, GAIA demonstrated that an extremely sparse image recognition AI can be trained to detect species from photos from the new tag camera. An fourth, a GAIA concept study showed that tags present at the same locality could form ad-hoc networks (digital swarms) within which AI calculations and other tasks such as joint backhauling can be shared.

Advancing animal-borne remote sensing, GPS tracking and monitoring

Satellites and aircrafts play a crucial role in gathering environmental data from the distance, helping us to better understand our climate and ecosystems. Remote sensing, often conducted from aircraft, balloons, or satellites, allows us to monitor large areas and remote regions over extended periods. These “eyes in the sky” are invaluable complements to land-based observations, helping us understand ocean and air currents, land cover changes, and climate change. However, animals also possess extraordinary senses and a unique ability to detect changes in their habitats. By combining animal capabilities with remote sensing technologies, GAIA aims at enhancing our ability to monitor and understand our planet. Animals have superior sensory abilities and behavioural strategies that enable them to sense subtle and dramatic changes in their ecosystems, as well as to detect critical incidents. Vultures, for example, act as “sentinel species” and can elevate the concept of remote sensing to new heights. They regularly patrol vast areas in search of food, operating without emissions, additional resources, or repairs. Furthermore, their patrols are guided by their exceptional vision and the mission to find carcasses. The way they patrol, what they search for, and the incidents they lead us to may be linked to specific environmental changes and ecological events.

To fully exploit the potential of vulture-borne remote sensing, GAIA focuses on two essential aspects. Firstly, powerful tracking devices are attached to vultures to monitor their movements and behaviour on detailed temporal and spatial scales. Secondly, new technological solutions are being developed to better understand what the animals observe and do. This includes a newly developed camera tag featuring an integrated camera, artificial intelligence algorithms for behaviour detection and image recognition, and satellite uplink for real-time coverage in remote regions. With these tools, animals can capture imagery and provide data of their surroundings faster, with higher resolution and specificity than satellite imagery. This innovative approach allows us to see nature through the eyes of animals.

GAIA was able to deploy around 130 commercially available tags to vultures all across southern and East Africa. This relatively high number provided opportunity to study in great depth (both spatially and temporally) how the data from tagged sentinel species such as scavenging white-backed vultures can support ecosystem monitoring. Second, this building block is enabled by collaboration with, for example, Endangered Wildlife Trust, Kenya Bird of Prey Trust or Uganda Conservation Foundation. 

The GAIA studies have proven that the sensory capabilities and intelligence of sentinel species are indeed a great asset in ecosystem monitoring. Investigating vultures and ravens and analysing data from tags carried by these “eyes in the sky” have demonstrated they are highly superior to man and machine in localising carcasses in vast landscapes and can help monitoring mortality in ecosystems. And second, the GAIA studies confirmed that high-tech approaches are a means to connect to this valuable knowledge and utilize it for monitoring, research and conservation. Modern humans have notably disconnected from nature, failing to “read” and “listen to” nature. By means of innovative AI-powered tracking technology, not only animal-borne remote sensing for research and conservation is elevated, but also a connection to nature re-established.

Understanding scavengers, their communities, ecosystems and conservation challenges

Vultures are a highly intelligent group of birds that provide important ecosystem services. Yet, populations of old-world vultures decreased dramatically in the last decades owing to anthropogenic factors. Efficient conservation strategies that address critical threats such as indiscriminate poisoning or depleted food sources need to be developed. At the same time, their behaviour including social interactions is still poorly understood. Building on high-tech tracking equipment and AI-based analytical tools, GAIA aims at better understanding how vultures communicate, interact and cooperate, forage, breed and rear their young. Additionally, the GAIA scientists research the social foraging strategies of white-backed vultures and the information transfer within carnivore-scavenger-communities. In the animal kingdom it is common across taxa that the search for food is undertaken not only as individuals but in a group. Animals forage together or rely on knowledge from other individuals to find food. This so-called social foraging presumably yields benefits, for example concerning the amount of food that is found, the size of prey that can be hunted or the time required to access food. GAIA investigates species-specific mechanisms in behaviour and communication as well as the incentives, benefits and possible disadvantages for individuals.

This building block is enabled by experience, funding and access: GAIA had the resources to hire excellent scientists with years of experience in investigating animal behaviour, spatial ecology, carnivore-scavenger interaction, intraspecific communication and human-wildlife conflicts. Additionally, GAIA stands on the shoulders of several decades of integration into science and stakeholder communities in wildlife management and conservation in southern Africa. This allowed access to protected/restricted areas with research permits to tag birds and collar carnivores for example. 

Newly published research results from the project (https://doi.org/10.1016/j.ecolmodel.2024.110941) confirm the benefits of cooperation and social information for foraging success. The results highlight social foraging strategies such as “chains of vultures” or “local enhancement” as overall more advantageous than the non-social strategy. The “chains of vultures” strategy outperformed “local enhancement” only in terms of searching efficiency under high vulture densities. Furthermore, the findings suggest that vultures in our study area likely adopt diverse foraging strategies influenced by variations in vulture and carcass density. The model developed in this study is potentially applicable beyond the specific study site, rendering it a versatile tool for investigating diverse species and environments.