From insideHPC: “Supercomputing Dark Energy Survey Data through 2021”

From insideHPC

January 9, 2019

Comet Lovejoy (Photo courtesy: Dark Energy Survey Collaboration)

Scientists’ effort to map a portion of the sky in unprecedented detail is coming to an end, but their work to learn more about the expansion of the universe has just begun.

After scanning in depth about a quarter of the southern skies for six years and cataloging hundreds of millions of distant galaxies, the Dark Energy Survey (DES) will finish taking data on January 9, 2019.

Dark Energy Survey

Dark Energy Camera [DECam], built at FNAL

NOAO/CTIO Victor M Blanco 4m Telescope which houses the DECam at Cerro Tololo, Chile, housing DECam at an altitude of 7200 feet

The National Center for Supercomputing Applications (NCSA) at the University of Illinois will continue refining and serving this data for use by scientists into 2021.

NCSA National Center for Supercomputing Applications

The survey is an international collaboration that began mapping a 5,000-square-degree area of the sky on August 18, 2013, to search for evidence of dark energy, the mysterious force that is accelerating the expansion of the universe. Using the Dark Energy Camera, a 520-megapixel digital camera mounted on the Blanco 4-meter telescope at the Cerro Tololo Inter-American Observatory in Chile, scientists on DES took data for 758 nights over six years.

Over those nights, the survey generated 50 terabytes (that’s 50 trillion bytes) of data over its six observation seasons. That data is stored and analyzed at NCSA. Compute power for the project comes from NCSA’s NSF-funded Blue Waters Supercomputer, the University of Illinois Campus Cluster, and Fermilab.

U Illinois Urbana-Champaign Blue Waters Cray Linux XE/XK hybrid machine supercomputer

DES recorded data from nearly a billion galaxies that are billions of light-years from Earth. More than 400 scientists from over 25 institutions around the world have been involved in the project. This collaboration has already produced about 200 academic papers, with more to come.

The first step in that process, according to Fermilab’s Josh Frieman, former director of DES, is to find the signal in all the noise. “We’re trying to extract this signal of cosmology in a background of all sorts of non-cosmological stuff that gets imprinted on the data,” Frieman said. “It’s a massive ongoing effort from many different people around the world.”

In this video, Daniel Gruen discusses the DES Y1 Cosmology Results at the APS Division of Particles & Fields meeting at Fermilab.
44 minutes

According to DES Director Rich Kron, a Fermilab and University of Chicago scientist, those results and the scientists who made them possible are where much of the real accomplishment of DES lies.

“First generations of students and post-doctoral researchers on DES are now becoming faculty at research institutions and are involved in upcoming sky surveys,” Kron said. “The number of publications and people involved are a true testament to this experiment. Helping to launch so many careers has always been part of the plan, and it’s been very successful.”

DES scientists also spotted the first visible counterpart of gravitational waves ever detected, a collision of neutron stars that occurred 130 million years ago. DES was one of several sky surveys that detected this gravitational wave source, opening the door to a new kind of astronomy.

DES remains one of the most sensitive and comprehensive surveys of distant galaxies ever performed. The Dark Energy Camera is capable of seeing light from galaxies billions of light-years away and capturing it in unprecedented quality. The Dark Energy Camera will remain mounted to the telescope at Cerro Tololo and will continue to be a useful instrument for scientific collaborations around the world. With one era at an end, the next era of the Dark Energy Survey is just beginning.

The DES collaboration continues to release scientific results from their storehouse of data. Highlights from the previous years include:

The most precise measurement of dark matter structure in the universe, and comparing it with cosmic microwave background results to see the evolution of the cosmos
The discovery of many more dwarf satellite galaxies orbiting our Milky Way than originally thought
The creation of the most accurate dark matter map of the universe
The spotting of the most distant supernova ever detected.
The public release of the survey’s first three years of data, enabling astronomers around the world to make similar discoveries

See the full article here .


Please help promote STEM in your local schools.

Stem Education Coalition

Founded on December 28, 2006, insideHPC is a blog that distills news and events in the world of HPC and presents them in bite-sized nuggets of helpfulness as a resource for supercomputing professionals. As one reader said, we’re sifting through all the news so you don’t have to!

If you would like to contact me with suggestions, comments, corrections, errors or new company announcements, please send me an email at Or you can send me mail at:

2825 NW Upshur
Suite G
Portland, OR 97239

Phone: (503) 877-5048