Super Computing 2011

100GE Network Demonstration

100GE Network DemonstrationShowfloor to Univ of Victoria   Caltech HEP team started testing the 40GE ConnextX-2 NICs from Mellanox before SC10 last year, however due to PCIe Gen2 limitations the NICs could only perform up to 24Gbps in each direction. Detailed presentation on the 40GE network testing with results is available for download. This year Sandy Bridge based Server motherboards with PCIe Gen3 became available from several vendors including SuperMicro and

Industry

About Ciena: Ciena Corporation (NASDAQ: CIEN) is a United States-based global supplier of telecommunications networking equipment, software and services that support the delivery and transport of voice, video and data services. Its products are used in telecommunications networks operated by telecommunications service providers, cable operators, governments and enterprises.[1] The company was founded in 1992 and is headquartered in Linthicum, Maryland. For more information, visit Ciena atwww.ciena.com About Mellanox: Mellanox Technologies is a

Research Organizations

About Caltech: With an outstanding faculty, including five Nobel laureates, and such off-campus facilities as the Jet Propulsion Laboratory, Palomar Observatory, and the W. M. Keck Observatory, the California Institute of Technology is one of the world’s major research centers. The Institute also conducts instruction in science and engineering for a student body of approximately 900 undergraduates and 1,300 graduate students who maintain a high level of scholarship and intellectual achievement. Caltech’s

Team

Harvey NewmanIosif LegrandArtur BarczykAzher MughalSandor Gyula RozsaRamiro VoicuSteven LoDorian KciraPhillipe GalvezDave AdamczykShawn McKee (Michigan)Ian Gable (Victoria)Rogerio Iope (USP)

Show Floor

SCInet WAN Connections This year focus was on utilising the 100GE connection from the ShowFloor to Univ of Victoria and 40GE connection to Univ of Michigan. We did ordered couple of 10GE connections to connect to other destinations via the SCinet. 1 x 100GE connection to Univ of Victoria1 x 40GE connection to Univ of Michigan over the ESnet/Internet2 100GE1 x 10GE IP connection to Internet21 x NLR PacketNet/FrameNet1 x

Booth layout

Caltech Booth# 1223 had 20 x 40 feet dimension and was distributed in four main sections: 1. Display & Storage2. Equipment Racks3. Kiosks4. Workstations 

Equipment

Servers are divided in fiour categories: A) PCIe Generation3 40GE Servers 2U Servers  Qty 5   Specification  Processor  Dual Intel Processor Xeon E2560 Eight Core  RAM  64GB  Hard Disks   16 x 120GB OCZ Vertex3 SSD Disks or 7 x SAS Disks  NIC  Mellanox 40GE Gen3 B) PCIe Generation2 40GE Servers 1U / 2U Servers  Qty 3   Specification  Processor  Dual Processor Xeon X5670 Hex-Core  RAM  24GB  Hard Disks   16 x OCZ

SuperComputing 2011

 Caltech Press Release  Longer version of Press Release SuperComputing Conference 2011 was held in Seattle Convention Center, Washington State. Caltech Booth showed different network centric and data intensive transfer demonstrations to the visiting researchers. 100GE Network Demonstration Caltech HEP team along with University of Victoria, demonstrated how Peta Bytes of data can be effectively transferred using highly tuned servers and transfer applications like FDT. We crossed several challenges where the newly obtained

MonALISA

MonALISA, stands for Monitoring Agents using a Large Integrated Services Architecture, has been developed by Caltech and its partners with the support of the U.S. CMS software and computing program. The framework is based on Dynamic Distributed Service Architecture and is able to provide complete monitoring, control and global optimization services for complex systems. The MonALISA system is designed as an ensemble of autonomous multi-threaded, self-describing agent-based subsystems which are registered

FDT

FDT – One of the key advances in this demonstration was Fast Data Transport (FDT; http://monalisa.cern.ch/FDT), a Java application developed by the Caltech team in close collaboration with the Polytehnica Bucharest team. FDT runs on all major platforms and uses the NIO libraries to achieve stable disk reads and writes coordinated with smooth data flow across long-range networks. The FDT application streams a large set of files across an open TCP socket,