Welcome to the IBM Spark @ SETI Project
IBM jStart team has joined with the SETI Institute to develop a Spark application to analyze the 198 million radio events detected by the Allen Telescope Array over the past decade. The complex nature of the data demands sophisticated mathematical models to tease out faint signals, and machine learning algorithms to separate terrestrial interference from true signals of interest. These requirements are well suited to the scalable in-memory capabilities offered by IBM Apache Spark Services. You can learn more by visiting the project web page, or by reading blogs from the project team
jStart - IBM Emerging Technology
The jStart mission within IBM is to leverage emerging technologies to address real and current business needs of IBM clients. One area of focus for the jStart team is the rapid adoption of Apache Spark as a key platform for complex analytics of large data sets. IBM announced its strategic commitment to Spark in June 2015, and jStart activities are a core component how we apply IBM Spark Services for customer success. You can learn more about IBM jStart and our project portfolio at the jStart webpage.
The SETI Institute
The SETI Institute’s mission is to explore, understand and explain the origin and nature of life in the universe. A central element of the Institute’s operations is the Allen Telescope Array (ATA) located in the Hat Creek Radio Observatory in California. This phased array observatory combines over 40 radio dishes to look for faint signals which may betray the presence of intelligent extraterrestrial life. Making sense of the data produced by this installation demands advanced analytics, which must scale to handle the ATA data stream of over 60 gigabits of data per second. You can learn more about by visiting the SETI Institute website.
Contact
For more information on this project and this github repository, please contact the IBM jStart team, or connect with Graham Mackintosh (@mackintg).