SNAPSHOT
A team of NASA personnel and contractors has prototyped a new set of algorithms that will enable instruments in space to process data more efficiently. Using these algorithms, space-based remote sensors will be able to provide the most important data to scientists on the ground more quickly and may also be able to autonomously determine which Earth phenomena are the most important to observe.
The International Space Station, where Steve Chien and his team prototyped a new set of AI algorithms that will reduce data latency and improve dynamic targeting capabilities for satellites. (Credit: NASA/ISS)
Earth-observing instruments can gather a world’s worth of information each day. But transforming that raw data into actionable knowledge is a challenging task, especially when instruments have to decide for themselves which data points are most important.
“There are volcanic eruptions, wildfires, flooding, harmful algal blooms, dramatic snowfalls, and if we could automatically react to them, we could observe them better and help make the world safer for humans,” said Steve Chien, a JPL Fellow and Head of Artificial Intelligence at NASA’s Jet Propulsion Laboratory.
Engineers and researchers from JPL and the companies Qualcomm and Ubotica are developing a set of AI algorithms that could help future space missions process raw data more efficiently. These AI algorithms allow instruments to identify, process, and downlink prioritized information automatically, reducing the amount of time it would take to get information about events like a volcanic eruption from space-based instruments to scientists on the ground.
These AI algorithms could help space-based remote sensors make independent decisions about which Earth phenomena are most important to observe, such as wildfires.
“It’s very difficult to direct a spacecraft when we’re not in contact with it, which is the vast majority of the time. We want these instruments to respond to interesting features automatically,” said Chien
Chien prototyped the algorithms using commercially available advanced computers onboard the International Space Station (ISS). During several different experiments, Chien and his team investigated how well the algorithms ran on Hewlett Packard Enterprise’s Spaceborne Computer-2 (SBC-2), a traditional rack server computer, as well as on embedded computers.
These embedded computers include the Snapdragon 855 processor, previously used in cell phones and cars, and the Myriad X processor, which has been used in terrestrial drones and low Earth orbit satellites.
Including ground tests using PPC-750 and Sabertooth processors – which are traditional spacecraft processors – these experiments validated more than 50 image processing, image analysis, and response scheduling AI software modules.
The experiments showed these embedded commercial processors are very suitable for space-based remote sensing, which will make it much easier for other scientists and engineers to integrate the processors and AI algorithms into new missions.
The full results of these experiments were published in a series of three papers at the 2022 IEEE Geoscience and Remote Sensing Symposium, which can be accessed through the links below.
