Rutgers New Supercomputer Celebrated at December 15 Event

NEW BRUNSWICK, N.J. – Rutgers Senior Vice President Christopher Molloy, the founder of the Rutgers Discovery Informatics Institute (RDI2) and researchers from universities statewide are among those expected to participate in a celebration of Caliburn, Rutgers’ new supercomputer, today (December 15) on the university’s Busch Campus in Piscataway.

Caliburn is the most powerful such system in New Jersey. It was built with a $10 million award from the New Jersey Higher Education Leasing Fund. The lead contractor was HighPoint Solutions of Sparta, N.J., which was chosen after a competitive bidding process. The system manufacturer and integrator is Super Micro Computer Inc. of San Jose, California.

“This new system will give Rutgers the high-performance computing capacity that our world-class faculty needs and deserves, particularly as the use of computation and big data have become key enablers in nearly every field of research,” Christopher J. Molloy, senior vice president for research and economic development, said. “We are extremely appreciative of the state’s support for this initiative, which is a great investment in the university and ultimately the future of New Jersey.”

Manish Parashar, distinguished professor of computer science at Rutgers and founding director of the Rutgers Discovery Informatics Institute (RDI2), led the effort to build the system. Parashar and Ivan Rodero, RDI2’s associate director of technical operations, designed the system with a unique architecture and capabilities. It is based on a new network interconnect developed by Intel (Omni-Path) and among the first clusters to use the Intel Omni-Path fabric and the latest Intel processors.

“This system provides state-of-the-art advanced cyber infrastructure that will dramatically increase the computation power, provide greater speeds and offer expanded storage capacity to faculty, researchers and students across Rutgers and the state,” Parashar said, “This system will significantly elevate the competitiveness of Rutgers researchers in computational and data-enabled science, engineering and medicine, as well as those in social science and humanities disciplines.”

Along with users at Rutgers, the system will be accessible to researchers at other New Jersey universities and industry users. RDI2 will work with the New Jersey Big Data Alliance, which was founded by Rutgers and seven other universities in the state, to build an industry users program. The capabilities of this new system will establish New Jersey's reputation in advanced computing and benefit a broad spectrum of industry sectors and academic disciplines.

The updated Top 500 ranking of world’s most powerful supercomputers issued last month ranks Rutgers’ new supercomputer #242 among all of the world’s supercomputers. The Top 500 project provides a reliable basis for tracking and detecting trends in high-performance computing. Twice annually it assembles and releases a list of the 500 most powerful computer systems in the world.

The project was built in three phases. Phase I went live in January and provides approximately 150 teraflops of computational and data analytics capabilities and one petabyte of storage to faculty and staff researchers throughout the university. To date there have been more than 100 users from 17 departments universitywide. The system has delivered over 12 million computing hours and 100 terabytes (TB) of storage to the Rutgers community over the past few months. Among the heaviest users have been researchers in the Waksman Institute of Microbiology, the Departments of Physics at New Brunswick and Camden, Department of Chemistry at Newark, and the Center for Integrative Proteomics Research.

Phase II included a new self-contained modular data center at Rutgers University–New Brunswick. Phase III encompasses the installation of the Caliburn supercomputer and final elements of the network, which provides high-speed access to users. The Supermicro solution is based on a FatTwin SuperServer system. It has 560 nodes, each with two Intel Xeon E5-2695 v4 (Broadwell) processors, 256 gigabytes (GB) of RAM, and a 400 GB Intel NVMe drive. Overall, the system has 20,160 cores, 140 TB of memory and 218 TB of non-volatile memory. The performance is 603 TFLOPS with a peak performance of 677 TFLOPS.

“As the leading provider of high-performance computing (HPC) solutions, Supermicro is very pleased to help enable this state-of-the-art HPC solution at Rutgers based on our multi-node FatTwin architecture,” said Tau Leng, vice president and GM of HPC at Super Micro Computer, Inc. “Key features of these FatTwin SuperServers include support for E5-2600 v4 processors, NVMe, 100 Gbps Omni-Path fabric, and an innovative cooling architecture to deliver maximum performance while reducing the TCO for the Caliburn supercomputer which will supply high-performance computational and data analytics capabilities to researchers for years to come.”

About RDI² – Rutgers Discovery Informatics Institute (RDI2) is a Rutgers-wide multidisciplinary institute for Advanced Computation and Data Sciences, with the overarching goal of establishing a comprehensive and internationally competitive Computational and Data-Enabled Science and Engineering program at Rutgers that can nurture the fundamental integration of research, education, and infrastructure. RDI² aims to bridge more traditional research boundaries and catalyze socio-technical changes in research across all fields of science and engineering, stimulating new thinking and new practices essential to address grand challenges in science, engineering, and industry. RDI² is strategically positioned to engage leading researchers in innovative, interdisciplinary collaborations, and has established successful research collaborations with computational groups across Rutgers and beyond, including industry. The institute has a strong research program with more than 50 grants totaling over $40 million. RDI² was instrumental in establishing the universitywide ACI strategy that resulted in the formation of the Rutgers Office of Advanced Research Computing, is playing a leadership role in New Jersey’s cyberinfrastructure and Big Data efforts and the formation of the statewide Big Data Alliance, and is spearheading the Discovery Science spoke of the NSF-funded Northeast Regional BigData Innovation Hub. It has architected and deployed the largest research-computing platform in Rutgers history. RDI² also has designed, deployed and operates a production data cyberinfrastructure for the National Science Foundation’s Ocean Observatories Initiative (OOI).