Tagged: FNAL- Fermi National Accelerator Laboratory Toggle Comment Threads | Keyboard Shortcuts

  • richardmitnick 8:18 am on August 1, 2019 Permalink | Reply
    Tags: "In photos: LBNF rebuilds portal for rock transportation system", , FNAL- Fermi National Accelerator Laboratory,   

    From FNAL for SURF: “In photos: LBNF rebuilds portal for rock transportation system” 

    FNAL Art Image
    FNAL Art Image by Angela Gonzales

    From Fermi National Accelerator Lab , an enduring source of strength for the US contribution to scientific research world wide.

    July 29, 2019
    Kurt Riesselmann

    The pre-excavation work for the South Dakota portion of the Long-Baseline Neutrino Facility reached another milestone.

    FNAL LBNF/DUNE from FNAL to SURF, Lead, South Dakota, USA

    In June, construction workers finished securing the portal of the old tramway tunnel. The tunnel will house the conveyor system that will move about 800,000 tons of rock — excavated a mile underground to create the caverns for the Fermilab-hosted Deep Underground Neutrino Experiment — to its final resting place in the Open Cut, a former open pit mining area. The photo gallery below highlights various stages of this work.

    The Homestake mining company had stopped using the tramway tunnel when it ceased mining operations in Lead, South Dakota, in 2002. Today the tunnel is part of the Sanford Underground Research Facility. The LBNF team is now in the process of rehabilitating the tunnel to get it ready for the installation of a conveyor system that will run from the Ross Shaft, exit through the rebuilt portal and extend to the Open Cut (see graphic). When the work is complete, the tunnel will house about 2,300 feet of the 4,250-foot-long conveyor system.

    SURF logo
    Sanford Underground levels

    Sanford Underground Research Facility

    Construction workers are currently rehabilitating the tramway tunnel at Sanford Lab. The goal is to prepare it for the installation of a 2,300-foot-long section of a conveyor system that will move rock from the mile-deep Ross Shaft to the Open Cut for the LBNF construction. Credit: Fermilab

    This photo shows the construction site from above the old portal. When complete in 2020, the conveyor system will extend down the hill and begin moving rock to the Open Cut. Credit: Fermilab

    In June, construction workers applied shotcrete on the rock surrounding the portal. Credit: Fermilab

    Done: the rebuilt portal of the tramway tunnel. A new concrete enclosure will extend the tunnel approximately 80 feet beyond this point, which will allow for the restoration of a roadway above the tunnel. When complete, the conveyor system will exit the tramway tunnel at the end of the new enclosure and move rock from the Ross Shaft to the Open Cut. Credit: Fermilab

    For the LBNF project, about 800,000 tons of rock will be transported to this former open pit mining area in Lead, South Dakota, known as the Open Cut. The excavated rock will fill less than one percent of the Open Cut. Credit: Fermilab

    This graphic illustrates how the conveyor system will transport rock from the Ross Shaft through the tramway tunnel to the Open Cut. Credit: Fermilab

    See the full here.


    Please help promote STEM in your local schools.

    Stem Education Coalition

    FNAL Icon

    Fermi National Accelerator Laboratory (Fermilab), located just outside Batavia, Illinois, near Chicago, is a US Department of Energy national laboratory specializing in high-energy particle physics. Fermilab is America’s premier laboratory for particle physics and accelerator research, funded by the U.S. Department of Energy. Thousands of scientists from universities and laboratories around the world
    collaborate at Fermilab on experiments at the frontiers of discovery.

  • richardmitnick 5:39 pm on February 15, 2019 Permalink | Reply
    Tags: An innovative way for different types of quantum technology to “talk” to each other using sound, ANL Advanced Photon Source, , “Spins”—a property of an electron that can be up or down or both, “The object is to couple the sound waves with the spins of electrons in the material”, FNAL- Fermi National Accelerator Laboratory, , Sound waves let quantum systems ‘talk’ to one another,   

    From University of Chicago: “Sound waves let quantum systems ‘talk’ to one another” 

    U Chicago bloc

    From University of Chicago

    Feb 15, 2019
    Louise Lerner

    An X-ray image of sound waves. Image courtesy of Kevin Satzinger and Samuel Whiteley

    Researchers at the University of Chicago and Argonne National Laboratory have invented an innovative way for different types of quantum technology to “talk” to each other using sound. The study, published Feb. 11 in Nature Physics, is an important step in bringing quantum technology closer to reality.

    Researchers are eyeing quantum systems, which tap the quirky behavior of the smallest particles as the key to a fundamentally new generation of atomic-scale electronics for computation and communication. But a persistent challenge has been transferring information between different types of technology, such as quantum memories and quantum processors.

    “We approached this question by asking: Can we manipulate and connect quantum states of matter with sound waves?” said senior study author David Awschalom, the Liew Family Professor with the Institute for Molecular Engineering and senior scientist at Argonne National Laboratory.

    One way to run a quantum computing operation is to use “spins”—a property of an electron that can be up, down or both. Scientists can use these like zeroes and ones in today’s binary computer programming language. But getting this information elsewhere requires a translator, and scientists thought sound waves could help.

    “The object is to couple the sound waves with the spins of electrons in the material,” said graduate student Samuel Whiteley, the co-first author on the paper. “But the first challenge is to get the spins to pay attention.” So they built a system with curved electrodes to concentrate the sound waves, like using a magnifying lens to focus a point of light.

    The results were promising, but they needed more data. To get a better look at what was happening, they worked with scientists at the Center for Nanoscale Materials at Argonne to observe the system in real time. Essentially, they used extremely bright, powerful X-rays from the lab’s giant synchrotron, the Advanced Photon Source, as a microscope to peer at the atoms inside the material as the sound waves moved through it at nearly 7,000 kilometers per second.

    ANL Advanced Photon Source

    “This new method allows us to observe the atomic dynamics and structure in quantum materials at extremely small length scales,” said Awschalom. “This is one of only a few locations worldwide with the instrumentation to directly watch atoms move in a lattice as sound waves passes through them.”

    Argonne nanoscientist Martin Holt took X-ray images of the acoustic waves with the Hard X-ray Nanoprobe at the Center for Nanoscale Materials and Advanced Photon Source, both at Argonne. Image courtesy of Argonne National Laboratory.

    One of the many surprising results, the researchers said, was that the quantum effects of sound waves were more complicated than they’d first imagined. To build a comprehensive theory behind what they were observing at the subatomic level, they turned to Prof. Giulia Galli, the Liew Family Professor at the IME and a senior scientist at Argonne. Modeling the system involves marshalling the interactions of every single particle in the system, which grows exponentially, Awschalom said, “but Professor Galli is a world expert in taking this kind of challenging problem and interpreting the underlying physics, which allowed us to further improve the system.”

    It’s normally difficult to send quantum information for more than a few microns, said Whiteley—that’s the width of a single strand of spider silk. This technique could extend control across an entire chip or wafer.

    “The results gave us new ways to control our systems, and opens venues of research and technological applications such as quantum sensing,” said postdoctoral researcher Gary Wolfowicz, the other co-first author of the study.

    The discovery is another from the University of Chicago’s world-leading program in quantum information science and engineering; Awschalom is currently leading a project to build a quantum “teleportation” network between Argonne and Fermi National Accelerator Laboratory to test principles for a potentially unhackable communications system.

    The scientists pointed to the confluence of expertise, resources and facilities at the University of Chicago, Institute for Molecular Engineering and Argonne as key to fully exploring the technology.

    An acoustic chip is used to generate and control sound waves. Photo courtesy of Kevin Satzinger

    “No one group has the ability to explore these complex quantum systems and solve this class of problems; it takes state-of-the-art facilities, theorists and experimentalists working in close collaboration,” Awschalom said. “The strong connection between Argonne and the University of Chicago enables our students to address some of the most challenging questions in this rapidly moving area of science and technology.”

    Other coauthors on the paper are Assoc. Prof. David Schuster, and Prof. Andrew Cleland; Argonne scientists Joseph Heremans and Martin Holt; graduate students Christopher Anderson, Alexandre Bourassa, He Ma and Kevin Satzinger; and postdoctoral researcher Meng Ye.

    The devices were fabricated in the Pritzker Nanofabrication Facility at the William Eckhardt Research Center. Materials characterization was performed at the UChicago Materials Research Science and Engineering Center.

    Funding: Air Force Office of Scientific Research, U.S. Department of Energy Office of Basic Energy Sciences, National Science Foundation, Department of Defense

    See the full article here .


    Please help promote STEM in your local schools.

    Stem Education Coalition

    U Chicago Campus

    An intellectual destination

    One of the world’s premier academic and research institutions, the University of Chicago has driven new ways of thinking since our 1890 founding. Today, UChicago is an intellectual destination that draws inspired scholars to our Hyde Park and international campuses, keeping UChicago at the nexus of ideas that challenge and change the world.

    University of Chicago

    An intellectual destination

    One of the world’s premier academic and research institutions, the University of Chicago has driven new ways of thinking since our 1890 founding. Today, UChicago is an intellectual destination that draws inspired scholars to our Hyde Park and international campuses, keeping UChicago at the nexus of ideas that challenge and change the world.

    The University of Chicago is an urban research university that has driven new ways of thinking since 1890. Our commitment to free and open inquiry draws inspired scholars to our global campuses, where ideas are born that challenge and change the world.

    We empower individuals to challenge conventional thinking in pursuit of original ideas. Students in the College develop critical, analytic, and writing skills in our rigorous, interdisciplinary core curriculum. Through graduate programs, students test their ideas with UChicago scholars, and become the next generation of leaders in academia, industry, nonprofits, and government.

    UChicago research has led to such breakthroughs as discovering the link between cancer and genetics, establishing revolutionary theories of economics, and developing tools to produce reliably excellent urban schooling. We generate new insights for the benefit of present and future generations with our national and affiliated laboratories: Argonne National Laboratory, Fermi National Accelerator Laboratory, and the Marine Biological Laboratory in Woods Hole, Massachusetts.

    The University of Chicago is enriched by the city we call home. In partnership with our neighbors, we invest in Chicago’s mid-South Side across such areas as health, education, economic growth, and the arts. Together with our medical center, we are the largest private employer on the South Side.

    In all we do, we are driven to dig deeper, push further, and ask bigger questions—and to leverage our knowledge to enrich all human life. Our diverse and creative students and alumni drive innovation, lead international conversations, and make masterpieces. Alumni and faculty, lecturers and postdocs go on to become Nobel laureates, CEOs, university presidents, attorneys general, literary giants, and astronauts.

  • richardmitnick 8:47 pm on September 24, 2018 Permalink | Reply
    Tags: Department of Energy awards Fermilab more than $10 million for quantum science, FNAL- Fermi National Accelerator Laboratory, See all of the listed areas   

    From Fermi National Accelerator Lab: “Department of Energy awards Fermilab more than $10 million for quantum science” 

    FNAL II photo

    FNAL Art Image
    FNAL Art Image by Angela Gonzales

    From Fermi National Accelerator Lab , an enduring source of strength for the US contribution to scientific research world wide.

    September 24, 2018

    Andre Salles,
    Fermilab Office of Communication

    Joe Lykken, Fermilab

    The Department of Energy’s QuantISED grants will support a number of initiatives by Fermilab scientists and their collaborators focusing on quantum computing, sensors and communication. Photo: Reidar Hahn

    The U.S. Department of Energy announced today that it has awarded scientists at its Fermi National Accelerator Laboratory more than $10 million to spur research that could revolutionize not only our understanding of nature, but also the very way we investigate it.

    Quantum science is a cutting-edge field of research made possible through the unique effects of quantum physics. The best known examples are quantum computing, quantum sensors and quantum teleportation, all of which Fermilab researchers will be working on in the coming years. This work – and the technology that enables it – is beyond complex, but Fermilab’s scientists and engineers, in partnership with other institutions and industry, have discovered new ways to make use of quantum effects to understand the universe.

    “Scientists have understood the practical potential of quantum physics for decades, but only recently has the technology advanced to the point that we could tap into it,” said Fermilab Chief Research Officer and Deputy Director Joe Lykken. “Quantum physics has been Fermilab’s bread and butter for a half-century. With that accumulation of expertise and the technological innovation that comes with it, there’s hardly a place better positioned to explore — as a focused, dedicated program — the ways we can take full advantage of nature’s quantum behavior.”

    As part of a number of grants to national laboratories and universities through its Quantum Information Science-Enabled Discovery (QuantISED) program, DOE’s funding to Fermilab scientists cover five initiatives (listed below) and will be distributed over two years. It also funds Fermilab’s participation in three further initiatives led by other institutions.

    “One of the most exciting aspects of these initiatives is the way that quantum science and particle physics will advance each other. We’re pushing at the bounds of both fields,” said University of Washington graduate student Natalie Klco, who is participating in one of the funded programs. “It’s exciting to be working at a new frontier in particle physics.”

    The quantum science funding announcement follows on the heels of a first-of-its-kind quantum workshop held earlier this month at Fermilab. With participants from academia and industry, it featured Google’s first quantum software tutorial in a public setting. The hands-on nature of the workshop and the face-to-face interaction among researchers from tech companies, national laboratories and universities made it an incubator for new ideas, discussions and problem-solving in quantum computing.

    Fermilab is also preparing to participate in the Chicago Quantum Exchange Summit, to be held at the University of Chicago on Nov. 8 and 9. Fermilab, the U.S. Department of Energy’s Argonne National Laboratory and the University of Chicago form the core of CQE, a partnership that will facilitate the exploration of quantum information and the development of new applications with the potential to dramatically improve technology for communication, computing and sensing.

    The summit will include representatives from the technical and academic sector. It will also serve as a testament to both academia’s and industry’s serious, burgeoning interest in quantum science.

    “As we refer to it now, quantum science is a young field. But Fermilab is building on a 50-year foundation of world-leading quantum physics research and high-performance computing,” said Fermilab Scientific Computing Division Head Panagiotis Spentzouris. “These awards give us a way to maximize all the potential we have here. Not just for our field, but for research everywhere.”


    The Fermilab-led initiatives funded through DOE’s QuantISED grants are:

    1. A breakthrough technology to spot potential dark matter particles called axions
    Lead principal investigator: Aaron Chou

    Scientists have so far come up empty in the search for dark matter, the mysterious and as-of-yet undetectable substance that makes up a quarter of our universe. One theory suggests that dark matter might be made of exotic particles called axions. Fermilab researchers are part of a team using superconducting qubits – basic circuit elements of quantum computers that are able to detect a single photon of light – that will enable further experiments searching for axion particles.

    Partner institutions: National Institute of Standards and Technology, University of Chicago, University of Colorado, Yale University

    2. Particle accelerator technology to enhance qubit performance and to search for dark photons
    Lead principal investigator: Alexander Romanenko

    Fermilab scientists are using ultraefficient superconducting radio-frequency resonators – one of the core technologies for advancing particle accelerators – to significantly increase a quantity known as coherence time. Coherence time is how long a superposition of quantum states survives before it collapses into a single state. The longer the coherence time, the more is available for a quantum system to perform operations. Researchers are working to increase the resonators’ ability to retain energy — characterized by its quality factor — and thus the achievable coherence times. One of the main goals of this program is to demonstrate qubits with ultrahigh quality factors and long coherence times, ultimately putting a number of them together into a multiqubit, “quantum computer”-type system. The same technology will be used for experiments aimed at searching for dark photons, a particular kind of dark matter particle.

    Partner institutions: National Institute of Standards and Technology, University of Wisconsin – Madison

    3. Using quantum information science to aid particle physics theory work
    Lead principal investigator: Marcela Carena

    Researchers are using simulated quantum computers to enable computations for particle physics theory, integrating them into existing computing infrastructure to make complex and difficult calculations easier and faster. These simulations are opening avenues for physicists to address a whole new class of physics problems that were previously out of reach with classical computers.

    Partner institutions: Caltech, University of Chicago, University of Washington

    4. Quantum computers for machine learning and optimization
    Lead principal investigator: Gabriel Perdue

    Machine learning is the science of teaching computers to solve problems and fill in blanks on their own. Quantum computers are the next step in machine learning and can help make connections between pieces of information and learn how strong those connections should be. Classical computers have made great strides in this field, but quantum computers will allow scientists to build more sophisticated and powerful models of physical reality.

    Partner institutions: Oak Ridge National Laboratory

    5. A new single-photon sensor for quantum imaging
    Lead principal investigator: Juan Estrada

    Scientists have developed a next-generation version of the charge-coupled device, or CCD, that’s in your home camera. This sensitive new technology, the skipper CCD, has the potential to exploit the quantum nature of light to capture images of objects with exceptional resolution. Thanks to the technology’s heightened sensitivity, the skipper CCD could image objects one photon at a time, increasing the clarity of the signal in quantum imaging experiments. Scientists are designing a skipper CCD optimized for such an application. They’re also exploring the quantum entanglement of photons as a tool to look for dark photons, a hypothetical particle related to dark matter.

    Partner institutions: Lawrence Berkeley National Laboratory, Caltech


    Fermilab has also been funded to participate in three initiatives led by other institutions:

    1. Quantum communication channels for fundamental physics – led by Caltech
    Lead principal investigator: Maria Spiropulu

    Researchers have devised a way to use a phenomenon called quantum entanglement to send information over long distances. The first step toward that goal is called the Fermilab Quantum NETwork (FQNET) Teleportation Experiment, which will use a quantum network using commercial optical fibers to “teleport” information across several kilometers. This program also explores the connection of quantum teleportation protocols with deep mysteries of space-time physics that include black holes and wormholes.

    Other participating institution: Harvard University

    2. Quantum machine learning and quantum computation frameworks for high-energy physics – led by Caltech
    Lead principal investigator: Maria Spiropulu

    Machine learning algorithms have had a huge impact on the areas of pattern matching and classification. Applications at Fermilab including classifying different types of neutrino interactions in detectors, determining a particle’s path from a string of hits in a tracking chamber, and separating stars from galaxies in astrophysics sky surveys. With increased data volumes, scientists will require better data access methods, so researchers are also exploring the use of quantum computers for very fast data indexing and recall.

    Other participating institutions: Massachusetts Institute of Technology, University of Southern California

    3. Quantum computing for neutrino-nucleus dynamics – led by Los Alamos National Laboratory
    Lead principal investigator: Rajan Gupta

    Neutrinos are fleeting, elusive subatomic particles that may hold the key to the mystery of why we live in a matter-dominated universe. Scientists study neutrino interactions to get a better understanding of what trace the mysterious particles will leave in neutrino experiments like the Deep Underground Neutrino Experiment (DUNE), hosted by Fermilab. Quantum computers may be ideal for simulating the detailed outcomes of neutrino with complex, heavy nuclei, which are themselves quantum systems.

    See the full article here .


    Please help promote STEM in your local schools.

    Stem Education Coalition

    FNAL Icon

    Fermi National Accelerator Laboratory (Fermilab), located just outside Batavia, Illinois, near Chicago, is a US Department of Energy national laboratory specializing in high-energy particle physics. Fermilab is America’s premier laboratory for particle physics and accelerator research, funded by the U.S. Department of Energy. Thousands of scientists from universities and laboratories around the world
    collaborate at Fermilab on experiments at the frontiers of discovery.



    FNAL Muon g-2 studio

    FNAL Short-Baseline Near Detector under construction

    FNAL Mu2e solenoid

    Dark Energy Camera [DECam], built at FNAL

    FNAL DUNE Argon tank at SURF


    FNAL Don Lincoln


    FNAL Cryomodule Testing Facility

    FNAL Minos Far Detector

    FNAL LBNF/DUNE from FNAL to SURF, Lead, South Dakota, USA

    FNAL/NOvA experiment map

    FNAL NOvA Near Detector


    FNAL Holometer

  • richardmitnick 12:48 pm on November 2, 2017 Permalink | Reply
    Tags: Apache Spark open-source software, , , FNAL- Fermi National Accelerator Laboratory,   

    From ASCRDiscovery: “A Spark in the dark” 

    Advancing Science Through Computing

    October 2017

    The cosmological search in the dark is no walk in the park. With help from Berkeley Lab’s NERSC, Fermilab [FNAL] aims open-source software at data from high-energy physics.

    NERSC Cray Cori II supercomputer

    LBL NERSC Cray XC30 Edison supercomputer

    The Genepool system is a cluster dedicated to the DOE Joint Genome Institute’s computing needs. Denovo is a smaller test system for Genepool that is primarily used by NERSC staff to test new system configurations and software.


    PDSF is a networked distributed computing cluster designed primarily to meet the detector simulation and data analysis requirements of physics, astrophysics and nuclear science collaborations.

    Proposed filaments of dark matter surrounding Jupiter could be part of the mysterious 95 percent of the universe’s mass-energy. Image courtesy of NASA/JPL-Caltech.

    Most of the universe is dark, with dark matter and dark energy comprising more than 95 percent of its mass-energy. Yet we know little about dark matter and energy. To find answers, scientists run huge high-energy physics experiments. Analyzing the results demands high-performance computing – sometimes balanced with industrial trends.

    After four years of running computing for the Large Hadron Collider CMS experiment at CERN near Geneva, Switzerland – part of the work that revealed the Higgs boson – Oliver Gutsche, a scientist at Department of Energy’s (DOE) Fermi National Accelerator Laboratory, turned to the search for dark matter.

    CERN CMS Higgs Event

    CERN/CMS Detector

    “The Higgs boson had been predicted, and we knew approximately where to look,” he says. “With dark matter, we don’t know what we’re looking for.”

    To learn about dark matter, Gutsche needs more data. Once that information is available, physicists must mine it. They are exploring computational tools for the job, including Apache Spark open-source software.

    In searching for dark matter, physicists study results from colliding particles. “This is trivial to parallelize,” breaking the job into pieces to get answers faster, Gutsche explains. “Two PCs can each process a collision,” meaning researchers can employ a computer grid to analyze data.

    Much of the work in high-energy physics, though, depends on software the scientists develop. “If our graduate students and postdocs only know our proprietary tools, then they’ll have trouble if they go to industry,” where such software is unavailable, Gutsche notes. “So I started to look into Spark.”

    To search for dark matter, scientists collect and analyze results from colliding particles, an extremely computationally intense process. Image courtesy of CMS CERN.

    Spark is a data-reduction tool made for unstructured text files. That creates a challenge – accessing the high-energy physics data, which are in an object-oriented format. Fermilab computer science researchers Saba Sehrish and Jim Kowalkowski are tackling the task.

    Spark offered promise from the beginning, with some particularly interesting features, Sehrish says. “One was in-memory, large-scale distributed processing” through high-level interfaces, which makes it easy to use. “You don’t want scientists to worry about how to distribute data and write parallel code,” she says. Spark takes care of that.

    Another attractive feature: Spark is a supported research platform at the National Energy Research Scientific Computing Center (NERSC), a DOE Office of Science user facility at the DOE’s Lawrence Berkeley National Laboratory.

    “This gives us a support team that can tune it,” Kowalkowski says. Computer scientists like Sehrish and Kowalkowski can add capabilities, but making the underlying code work as efficiently as possible requires Spark specialists, some of whom work at NERSC.

    Kowalkowski summarizes Spark’s desirable features as “automated scaling, automated parallelism and a reasonable programming model.”

    In short, he and Sehrish want to build a system allowing researchers to run an analysis that performs extremely well on large-scale machines without complications and through an easy user interface.

    Just being easy to use, though, is not enough when dealing with data from high-energy physics. Spark appears to satisfy both ease-of-use and performance goals to some degree. Researchers are still investigating some aspects of its performance for high-energy physics applications, but computer scientists can’t have everything. “There is a compromise,” Sehrish states. “When you’re looking for more performance, you don’t get ease of use.”

    The Fermilab scientists selected Spark as an initial choice for exploring big-data science, and dark matter is just the first application under testing. “We need several real-use cases to understand the feasibility of using Spark for an analysis task,” Sehrish says. With scientists like Gutsche at Fermilab, dark matter was a good place to start. Sehrish and Kowalkowski want to simplify the lives of scientists running the analysis. “We work with scientists to understand their data and work with their analysis,” Sehrish says. “Then we can help them better organize data sets, better organize analysis tasks.”

    As a first step in that process, Sehrish and Kowalkowski must get data from high-energy physics experiments into Spark. Notes Kowalkowski, “You have petabytes of data in specific experimental formats that you have to turn into something useful for another platform.”

    The starting data for the dark-matter implementation are formatted for high-throughput computing platforms, but Spark doesn’t handle that configuration. So software must read the original data format and convert it to something that works well with Spark.

    In doing this, Sehrish explains, “you have to consider every decision at every step, because how you structure the data, how you read it into memory and design and implement operations for high performance is all linked.”

    Each of those data-handling steps affects Spark’s performance. Although it’s too early to tell how much performance can be pulled from Spark when analyzing dark-matter data, Sehrish and Kowalkowski see that Spark can provide user-friendly code that allows high-energy physics researchers to launch a job on hundreds of thousands of cores. “Spark is good in that respect,” Sehrish says. “We’ve also seen good scaling – not wasting computing resources as we increase the dataset size and the number of nodes.”

    No one knows if this will be a viable approach until determining Spark’s peak performance for these applications. “The main key,” Kowalkowski says, “is that we are not convinced yet that this is the technology to go forward.”

    In fact, Spark itself changes. Its extensive open-source use creates a constant and rapid development cycle. So Sehrish and Kowalkowski must keep their code up with Spark’s new capabilities.

    “The constant cycle of growth with Spark is the cost of working with high-end technology and something with a lot of development interests,” Sehrish says.

    It could be a few years before Sehrish and Kowalkowski make a decision on Spark. Converting software created for high-throughput computing into good high-performance computing tools that are easy to use requires fine tuning and team work between experimental and computational scientists. Or, you might say, it takes more than a shot in the dark.

    A DOE Office of Science laboratory, Fermilab [FNAL] is located near Chicago, Illinois, and operated under contract by the Fermi Research Alliance LLC. The DOE Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit http://science.energy.gov.

    See the full article here.

    Please help promote STEM in your local schools.

    STEM Icon

    Stem Education Coalition

    ASCRDiscovery is a publication of The U.S. Department of Energy

Compose new post
Next post/Next comment
Previous post/Previous comment
Show/Hide comments
Go to top
Go to login
Show/Hide help
shift + esc
%d bloggers like this: