Plant Propagation: increased efficiency with improved collecting techniques

Once plants have been collected, they are transferred to our conservation nursery for propagation, or to our seed lab for viability testing and storage. We are seeing increased effectiveness of these methods with freshly collected seeds and cuttings making it quickly to our staff. As many of these individual plants were not previously known, these actions boost the genetic diversity of ex-situ collections, providing a safe place in the face of environmental degradation.

Previously, botanists would need to scale the remote cliff environments where these species occur, making conservation collections difficult and time-consuming to collect and transfer back to nursery staff for propagation. With the Mamba mechanism, collections are quickly collected and transferred to the nursery. 

Fresh cuttings and seeds have a higher success rate in propagation.

 

Drone Collection: Using a drone-based robotic arm to collect inaccessible plants

The Mamba tool allows us to collect plant material via seeds or cuttings from endangered species that we have identified and mapped in the previous building block. This tool has an effective range well over 1000m, making even the most inaccessible areas available for management actions. 

The development of this tool by experienced robotics engineers, expedited the conservation of many species by field staff at the National Tropical Botanical Garden and partners at the Plant Extinction Prevention Program. The Mamba has an interchangeable head system that provides customizable collecting depending on the target species and the type of material necessary for conservation. Many of the components of this mechanism are 3D-printed, which is cost-effective and flexible for speedy development processes. The Mamba is built with readily available drone components which also reduces the cost and building time. The development of this tool was undertaken by P.h.D students, and integrates state of the art hardware and software solutions specifically designed for this application.

When undertaking a project of this type, it is critical to have the proper pairing of experienced field staff with professional robotics engineers, as both parties provide crucial information to guide both development and effective conservation considerations. It is worth noting that the development process was iterative, leaving space for testing and revising the design, and ultimately allowing for deployment of a well-functioning and highly useful tool. 

Drone Survey: location, mapping, and inventory of remote plant populations

Drone tools have been instrumental as a first step in the assessment of cliff floras. Using drones to get unique viewpoints of these environments, we can now map the distribution and abundance of critically endangered endemic cliff species and expedite their conservation. Field surveys have been conducted in Hawaii, the Republic of Palau, and Madeira (Portugal) with extremely positive results.

As drone technology has improved and progressed, this survey methodology has become accessible to a range of conservation practitioners. High-resolution camera sensors allow the identification of a range of plants, from large trees to small herbaceous organisms. Drone pilots can now expect to conduct up to 45 minutes of survey time in a single flight due to increased battery capacity. Usability improvements from software refinements make drones safe and effecient for beginners to use, increasing the uptake of this technology by conservation practitioners.  Most importantly, as drones have become more widely available, the associated costs have been reduced, making them an amazing tool for a range of applications  

Drone are effective tools for the location and inventory of critically endangered species, especially in difficult-to-access environments like cliffs or tree canopies.  Assessment of cliff habitats will be critical to species conservation in these areas, as baseline knowledge of where species occur can guide conservation actions, and help prioritize landscape protection.

Education tools

Amphibians are more threatened and are declining more rapidly than either birds or mammals. Amphibian populations are decreasing due to multiple factors, such as climate change, the chytrid fungus, and other anthropogenic factors such as species trafficking. However, the level of threat to amphibians is undoubtedly underestimated because 1294 species (22.5%) are too poorly known to assess, as compared with only 78 birds (0.8%) (Stuart et al., 2004). 

This knowledge deficit underscores the vital importance of educational tools like Ribbit in democratizing scientific research. By lowering barriers to ecological monitoring, apps like Ribbit transform passive observers into active conservation participants. Educational technologies enable citizen scientists to directly contribute to understanding and protecting vulnerable ecosystems, addressing critical research limitations through expanded data collection in under-researched regions.

These innovative platforms increase public awareness about biodiversity challenges while providing accessible pathways for scientific engagement. Unlike bird-focused apps with well-established research infrastructures, anuran conservation has lacked comprehensive citizen science platforms. Ribbit fills this critical gap by empowering individuals to become crucial contributors to amphibian research, turning the tide on data deficiency and supporting global conservation efforts through collaborative, technology-enabled environmental stewardship. It is the first application to include information about over 800 amphibian species, in four languages, including call type, photo, CITES information (whether species are trafficked or used for commercial purposes, addressing GBF targets 5 and 9), IUCN status (whether species are endangered, addressing GBF target 4) and general information on animal behavior and reproduction. 

  • Subject matter expertise: one of our team members (Juliana Gómez Consuegra) worked closely with other experts who were researching the chytrid fungus. 
  • Creating accessible web app: intuitive design of web app allows less-experienced observers to participate and learn.

While the goal is to educate nature enthusiasts, we want to avoid the increase of species trafficking. For this reason, we decided not to allow users to have access to each other's data. That way, an endangered species' location won't be visible to traffickers, on the app. Users only have access to their own data. Once data is shared with GBIF, the data is obscured, so that neither the frog's nor the user's precise location will be disclosed to the general public. This way, we are ensuring that our application is environmentally responsible. 

Mitigate biodiversity loss

Conserving ecosystems is key to curbing climate change, and maintaining ecosystem services (GBF target 11), which are closely linked to over 50% of the world’s GDP. Over 1 million species face the threat of extinction this century; however, selecting which areas to conserve is challenging with the existing data gap, which is biased towards observations in the global north. Increasing the amount of biodiversity data in the Global South is critical in the conservation of endangered species, found at high density in biodiversity hotspots in the Global South. Amphibians are ideal for acoustic identification due to their diverse vocalizations and are crucial ecosystem indicators (Estes-Zumpf et al., 2022), with over 40% of species at risk of extinction (Cañas et al., 2023). Increasing labeled data for the more than 7,000 amphibian species worldwide would enhance conservation efforts and reduce knowledge gaps in vulnerable ecosystems. By using a citizen science platform to aid in the mitigation of biodiversity loss, we help establish local environmental stewardship of these critical habitats (GBF Target 20).

Other citizen apps have shown the potential that citizen science has on mitigating biodiversity loss. eBird, the largest citizen science project related to biodiversity, has 100 million bird observations from users around the world. These observations help to "document the distribution, abundance, habitat use and bird trends through collected species list, within a simple scientific framework." (Sánchez-Clavijo et. al., 2024).  

iNaturalist, another citizen science app, that uses computer vision algorithms for species identification, has also proven successful in mitigating biodiversity loss. To date, the app has over 200,000,000 observations, with 6 million observations per month, globally. On iNaturalist, research-grade observations are shared with GBIF, which in turn uses that knowledge for policy decisions, research, and community building (GBIF, 2023). 

Currently, our app identifies 71 species of frogs and toads, worldwide. Though many of them are identified as least concern (LC) under the IUCN, we do have one IUCN endangered species, the Southern Bell Frog (Ranoidea raniformis). This lack of threatened species included, underscores the need for diverse practitioners to participate in bioacoustic ecological monitoring. Increasing data points on vulnerable species can serve to inform policy decisions using data-driven insights. Local communities and Indigenous Peoples will be a key asset in increasing the number of species included in the app, as their local knowledge allows us to track species in remote regions. 

  • Closing data gaps: get more data from citizen scientists, especially from local communities and Indigenous Peoples.
  • Enabling environmental stewardship: accessibility to a diverse set of users.

We initially set a goal to decrease data gaps in the Global South. However, getting access to enough calls for rare, cryptic, and endangered species in the Global South to train our model proved to be challenging. Therefore, to improve model performance, we turned our attention to as many species as we could tackle, worldwide. Getting users engaged worldwide will lead to more recordings in data-poor regions like the Global South, allowing us to retrain our model in the future with increased data on endangered, rare, and cryptic species. 

This user engagement perfectly aligns with multiple targets, the most evident one being GBF target 20: Strengthen Capacity-Building, Technology Transfer, and Scientific and Technical Cooperation for Biodiversity. But other targets are key in this building block: by increasing the data points, we will be able to identify invasive alien species, addressing GBF Target 6, as well as protecting wild species from illegal trade, by obscuring their location from users. This is aligned with GBF Target 5, which seeks to "Ensure Sustainable, Safe and Legal Harvesting and Trade of Wild Species."

Citizen science and community engagement

Citizen science apps have been shown to aid in biodiversity monitoring while engaging nature enthusiasts (Callaghan et al., 2019). For instance,  FrogID, an app by the Australian Museum, allows users to record frog calls whose identity is verified by human validators. To date, FrogID has published papers related to monitoring invasive species (Rowley and Callaghan, 2023), informing IUCN red list assessments (Gallagher et al., 2024), assessing fire impacts (Mitchell et. al., 2023), understanding urbanization impacts (Callaghan et al., 2020) and studying frog call behavior (Liu et al., 2022). Our goal is to achieve similar results with Ribbit, with anuran species around the world, and in a shorter time frame. To date, the FrogID team has a backlog of over 18,000 calls, which could be greatly reduced with our app, since the processing time is greatly reduced with the implementation of machine learning algorithms. 

During the first round of beta testing of our app, 50 users submitted recordings for identification. Their feedback has been positive: subject matter experts have pointed out that the species they recorded matched the one predicted by Ribbit, and nature enthusiasts have enjoyed the "Frog of the Day" feature introducing them to a new anuran species or allowing them to re-acquaint with familiar anurans through name and most common vocalization of the species (GBF target 11). 

  • Ease of use: through analyzing feedback from users, we iterated to enhance user experience and accessibility.
  • Familiarity of established citizen ecological science apps: with FrogID, Merlin, eBird and iNaturalist used as references, we mimicked key app features for quick initiation for new users.
  • For those users who had never had any experience with citizen science applications, we focused on making the app as user-friendly as possible. Additionally, our FAQ section includes tips on "how to frog", including where and when to find calling species. 
  • It is hard to strike a balance between different types of users. While scientists advocated for using scientific names, nature enthusiasts did not connect to these names and preferred common names. However, obtaining common names for all our species in all four languages proved to be challenging. This is another opportunity for development: crowdsourcing common names around the world. 
  • In the future, we also want to create more visual content, in order to guide users who want to use the app but are not sure how to do so; this content includes what to include in the optional observations section of the app, how to validate whether the frog suggested by the app is the one the user is seeing, among others.  

     

Democratization of data

Ribbit's approach to data democratization represents a carefully curated process of citizen-driven scientific contribution. By leveraging existing public datasets from iNaturalist sounds and Anuraset, the application establishes a robust foundation for acoustic biodiversity monitoring. These initial datasets provide a comprehensive baseline for machine learning training, ensuring high-quality initial models for anuran identification.

The application's innovative data collection strategy goes beyond gathering information, implementing a rigorous quality control process for user-contributed data. Each citizen-submitted recording will undergo careful verification before potential contribution to the Global Biodiversity Information Facility (GBIF). This approach transforms passive data collection into an active, collaborative scientific process where citizens can meaningfully contribute to conservation research, addressing GBF Target 14, to "Integrate Biodiversity in Decision-Making at Every Level".

Critically, Ribbit maintains stringent data privacy and protection protocols. Recognizing the sensitive nature of ecological data, particularly regarding rare species and precise location information, the application implements strict user consent mechanisms. No user data will be shared or distributed without explicit, informed approval from the contributor, protecting both ecological subjects and citizen scientists' privacy.

 

  • Accessible technology: web app runs on desktop and mobile devices, and users may upload their data when no Internet is available. 
  • Robust quality control mechanisms: advanced evaluation of scientific quality recordings.
  • Ethical data governance: prioritization of user privacy and ecological sensitivity.
  • Periodical re-training of the model: the model is updated every six months, with training done on new species that are incorporated into the app and validated by annotators. 

When starting this project, we were aware of the anuran biodiversity data gap in the global south. However, we were surprised that as we attempted increase accessibility of our application and add qualitative data, there was a gap in language representation. Currently, our project is available in four languages (English, Spanish, Portuguese, Arabic),  increasing accessibility. We used the Wikipedia API to obtain general information about our species in these four languages, and noticed that while there was an abundance of data in English and Arabic, the information available was sparse in Spanish and even more sparse in Portuguese. Therefore, we envision a  future challenge will involve engaging diverse scientists, such as Spanish and Portuguese speaking scientists, to decrease the "Wikipedia data gap". Addressing this gap will be a crucial act in further democratizing and increasing accessibility of our solution.

Establishing a satellite-based IoT communication system

Relevant ecological processes and incidents that are of interest in environmental change research typically occur in remote areas beyond the reach of terrestrial communication infrastructures. Data generated in the field using animal tags in these regions can often only be transmitted with a delay of days or even weeks. To overcome this delay and ensure no delay in the early-warning system, GAIA develops a satellite communication module for the tags as well as a nanosatellite operating in low earth orbit (LEO): In order to be able to transmit collected data and information directly from the transmitting node to the LEO satellite (Low Earth Orbit), a high-performance satellite IoT radio module will be integrated into the new tags. This guarantees immediate, secure and energy-efficient transmission of the extracted data. The communication system is based on the terrestrial mioty® technology and will be adapted to satellite-typical frequency bands such as L- and S-band for the project. Typical communication protocols, which are sometimes used in the IoT sector, are usually designed for small packet sizes. Further development of the mioty® system will therefore also aim to increase the data rate and message size to enable application scenarios such as image transmissions.

The satellite IoT system will be key for a no-delay communication and thus for an early-warning system. It greatly contributes to the GAIA system in achieving GBF target 4 "Halt Extinction, Protect Genetic Diversity and Manage Human-Wildlife Conflicts". 

A significant share of the GAIA research and development was funded by the German Space Agency (DLR). This provided not only budgets for the development of the mioty® communication modules in the tags and first modules and concepts of the nanosatellites, but also access to an ecosystem of space-tech stakeholders. The start-up Rapidcubes became a key partner in the Initiative for the satellite development and plans for subsequent project phases include collaboration with existing DLR infrastructure such as the Heinrich Hertz satellite. 

The adaptation of the terrestrial mioty® protocols for satellite communication were successful. With the Ariane 6, an experimental nanosatellite was launched into a low earth orbit in July 2024. Since then, communication protocols are tested and refined for future application for the GAIA early-warning system.

Developing a new generation of animal tags and concepts for a digital swarm intelligence in networks of devices

To meet the goal of the GAIA Initiative to develop and put into practice a high-tech early-warning system for environmental changes, a new generation of animal tags is a key component. GAIA teams are working on the hardware and software development of miniaturized animal tags with lowest-power sensor technology with camera and image processing. The tags will be energy-autonomous, optimally adapted to the anatomy of vultures and are the basis for further technological features under development such as on-board artificial intelligences for behaviour detection and image recognition as well as a satellite-based IoT communication system.

Additionally, GAIA is developing concepts of distributed artificial intelligence and networks of micro-processors – animal tags that act just like a swarm. Analogous to natural swarm intelligence, the GAIA initiative is mapping digital swarm intelligence in an ad hoc network of microprocessors. These spontaneously forming networks are the foundation for distributed and sensor-based analysis of large amounts of data. Following this path will make it possible for vulture tags, for example, that are present at the same location during feeding events, to link and share tasks such as artificial intelligence analyses and data transmission.

A key factor for the success of this building block is the interdisciplinary and cross-sectoral cooperation of the GAIA partners: The Leibniz-IZW provided biological and veterinary knowledge about vultures and provided goals for the technical design of the new tags. The Fraunhofer IIS provided expertise in energy-efficient hardware, electronics and mechanics as well as in software for the miniature units. The Zoo Berlin provided environment and access to animals to aid the design and test the prototypes at various stages. Partner organisations in Africa such as Uganda Conservation Foundation provided an environment for in-depth field tests of the tag prototypes.

After several years of design and development, prototypes of the new tag system were tested in the wild in Uganda in November 2024. Wild white-backed vultures were equipped with prototypes called “data collection tag” (DCT) that featured many (albeit not all) innovations of the GAIA tag. The tags were released after 14 days from the vultures and collected using GPS and VHF signals, allowing for thorough examination of hardware and software performance as well as evaluation of collected data. These analyses will greatly help further developing the system.

Artificial intelligence(s) for behaviour recognition, carcass detection and image recognition

For ecological research as well as for GAIA use cases, it is necessary to reliably and accurately recognise the behaviour of different animal species over a long period of time in remote wilderness regions. To do this, GAIA scientists have developed and trained an artificial intelligence (AI) that can perform behavioural classification from GPS and acceleration data and tell us exactly what, for example, white-backed vultures fitted with animal tags are doing at any given time and place. This AI will eventually run directly on the GAIA animal tags and generate behavioural information from sensor data. In a second step, the scientists combined the behaviour thus classified with the GPS data from the tags. Using algorithms for spatial clustering, they identified locations where certain behaviours occurred more frequently. In this way, they obtained spatially and temporally finely resolved locations where vultures fed. Last but not least, GAIA is developing an AI for image recognition that will analyse photos taken by the integrated camera of the new tag system. All those algorithms will run directly on the tag and can perform efficient embedded data processing. This also places very special demands on image recognition AI, which must operate particularly sparingly and with small amounts of data. To this end, GAIA teams are developing appropriate strategies and models for sparse AI.

This novel carcass detection pipeline is a key asset in halting species extinction and managing human-wildlife conflicts and therefore aligns with GBF target 4. The pipeline allows for the swift detection of either vultures' death or the death of the animal that the vultures are feeding on. Both scenarious are relevant to halting species extinction: Poisoning at carcasses contributes significantly to the decline in populations of many vulture species. As vultures use social strategies in their search for food, one poisoned carcass can kill hundreds of birds. Scientists from the GAIA Initiative have shown that tagging vultures allows for an early detection of deaths and the carcass to be removed. Tagging vultures and using the AI pipelines described here can substantially reduce further mortalities. Secondly, early detection of poaching incidents of threatened species can put a local full stop to poaching and contribute significantly to combating extinction.

This building block stands on the shoulders of two major enabling factors. First, the combination of expertise in wildlife biology and data analysis/artificial intelligence development in one staff member. It proved absolutely essential to have great experience in wildlife ecology and vulture behaviour in particular as well as the development of code and the training of algorithms of the AI. Second, the acquisition of a large set of training data – one of the key factors for a successful AI development – was only possible through the cooperation of a wildlife research institute and a zoological organisation. With vultures in captivity in a large aviary, both data collection with a tag and video recordings of relevant behaviour could be conducted. Only this allowed for synced pairs of reference data and a training of the AI algorithms.

In this building block, GAIA achieved various tangible outcomes: First, the development of two integrated AI algorithms for vulture behaviour classification based on sensor data and for feeding cluster and carcass detection was completed and published in a peer-reviewed scientific journal (https://doi.org/10.1111/1365-2664.14810). The AI analysis pipeline has been running effectively for several years on sensor data from commercially available tags and provided many hundreds of potential carcass sites with a GPS location – an essential source of information for ranger patrols on the ground. Second, a similar AI pipeline has been developed for ravens. It is similarly efficient and can be utilized for mortality monitoring in North America or Europe, for example. Third, GAIA demonstrated that an extremely sparse image recognition AI can be trained to detect species from photos from the new tag camera. An fourth, a GAIA concept study showed that tags present at the same locality could form ad-hoc networks (digital swarms) within which AI calculations and other tasks such as joint backhauling can be shared.