Super Computing 2010

Industry

About Mellanox: Mellanox Technologies is a leading supplier of end-to-end connectivity solutions for servers and storage that optimize data center performance. Mellanox products deliver market-leading bandwidth, performance, scalability, power conservation and cost-effectiveness while converging multiple legacy network technologies into one future-proof solution. For the best in performance and scalability, Mellanox is the choice for Fortune 500 data centers and the world’s most powerful supercomputers. Founded in 1999, Mellanox Technologies is headquartered in

Research Organizations

About Caltech: With an outstanding faculty, including five Nobel laureates, and such off-campus facilities as the Jet Propulsion Laboratory, Palomar Observatory, and the W. M. Keck Observatory, the California Institute of Technology is one of the world’s major research centers. The Institute also conducts instruction in science and engineering for a student body of approximately 900 undergraduates and 1,300 graduate students who maintain a high level of scholarship and intellectual achievement. Caltech’s

Team

Harvey NewmanIosif Legrand Artur BarczykAzher MughalSandor Gyula RozsaRamiro VoicuMichael ThomasDorian KciraPhillipe GalvezDave AdamczykMichael Ojeda (Brookhaven)Shawn McKee (Michigan)James Grace (FIU)Joe Dilasco (FIU)Daniel Engh (Vanderbilt)Rogerio Iope (USP)

Show Floor

SCInet WAN Connections This year 11 10GE connections from SCInet were ordered, each providing connectivity from Booth to SCInet NOC with details below: 4 x 10GE connections to Internet2 100GE LONI – StarLight Path1 x NLR PacketNet1 x NLR WaveNet to LA Cenic1 x NLR FrameNet East1 x Internet2 ION1 x Internet2 IP1 x ESnet SDN1 x CiscoWave East Network InterConnect Nexus 7010 and Force10 ExaScale E600i switch fully populated

Booth Layout

Caltech Booth# 2713 had 30 x 30 feet dimension and was distributed in four main sections: 1. Display & Storage2. Equipment Racks3. Kiosks4. Workstations 

Equipment

Servers Servers rack comprised of a set of 5 2U Twin Motherboard Supermicro servers. 2U Twin Servers  Qty 12 (48 motherboards)   Specification Per Motherboard  Processor  Dual Processor Xeon E5630 Quad-Core  RAM  24GB  Hard Disks   3 x 2TB SATA-II  NIC  Myricom/Mellanox 10GE SFP+ Storage Servers NexSan SataBeasts Disk arrays each equipped with 228 1TB disks were connected with the SuperMicro servers through QLogic FC-8 cards. Each SataBeast controller delivered roughly

Moving towards Terabit/sec Scientific Dataset Transfers: the LHC Challenge

This year different demonstration will take place, making use of Hadoop storage systems in New Orleans and at partner institutes in Michigan, Florida, UCSD, CERN,  FermiLab, Brookhaven and locations in Brazil, Korea and Tallinn. Our networking partners include National Lambda Rail, Internet2, the Energy Sciences Network, USLHCNet, and national research and education networks in Europe (SURFNet and GEANT3), Asia (JGN2, KREONet) and Latin America (RNP, ANSP).

Abstract

Physicists at the LHC will break new ground at the high energy frontier when the accelerator and the experiments CMS and ATLAS resume operation in Nov 2009, searching for the Higgs particles thought to be responsible for mass in the universe, for supersymmetry, and for other fundamentally new phenomena bearing on the nature of matter and spacetime. In order to fully exploit the potential wealth for scientific discoveries, a global-scale

40GE Network Demonstration

Caltech HEP team started testing the 40GE NICs from Mellanox before SC10, a detailed presentation on the 40GE network testing with results is available for download. Force10 Networks released their first 40GE 1U top of the rack switch just before SC2010, Caltech received the pre-alpha switch which had few bugs but most of the time switch worked. As shown in the network diagram below, 4 10GE links were placed over the

SuperComputing 2010

The SuperComputing Conference 2010 was held in New Orleans, Louisiana (USA) this year. Caltech Booth showed different network centric and data intensive transfer demonstrations to the visiting researchers. An international team of physicists, computer scientists, and network engineers led by the California Institute of Technology (Caltech) and partners from the University of Michigan, Fermilab, Brookhaven National Laboratory, CERN, San Diego (UCSD), Florida (UF and FIU), Brazil (Rio de Janeiro State University, UERJ,