Super Computing 2012

Industry

About Ciena: Ciena Corporation (NASDAQ: CIEN) is a United States-based global supplier of telecommunications networking equipment, software and services that support the delivery and transport of voice, video and data services. Its products are used in telecommunications networks operated by telecommunications service providers, cable operators, governments and enterprises.[1] The company was founded in 1992 and is headquartered in Linthicum, Maryland. For more information, visit Ciena atwww.ciena.com About Mellanox: Mellanox Technologies is a

Research Organizations

About Caltech: With an outstanding faculty that has been honored with 32 Nobel prizes and 66 National Medals of Science and Technology, and such off-campus facilities as the Jet Propulsion Laboratory, Palomar Observatory and the W. M. Keck Observatory, the California Institute of Technology is one of the world’s major research centers and a premier institution of learning. The Institute conducts instruction in science and engineering for a student body of

RDMA based FTP Service

 RFTP is a novel data transfer tool for high performance networks. It uses IB verbs through the InfiniBand, RoCE, and iWARP provided by InfiniBand Verbs library (libibverbs) and RDMA communication manager (librdmacm). RFTP is availble in RHEL/CentOS now. For more information visit: ftp100.cewit.stonybrook.edu/rftp/.

Team

California Institute of Technology Harvey Newman Iosif Legrand Artur Barczyk Azher Mughal Sandor Gyula Rozsa Ramiro Voicu Michael Bredel Steven Lo Dorian Kcira Phillipe Galvez Dan Moraru (LIGO) University of Michigan Shawn McKee Ben Meekhof Roy Hockett University of Victoria Ian Gable (Victoria) Yvan Savard (Victoria) University of São Paulo  Rogerio Iope (USP) Padtec  Sergio Timoteo (Padtec)

Show Floor

This year’s focus was on utilizing the 100GE connections from the ShowFloor to the Univ of Victoria, Univ of Michigan and Caltech. Also ordered were DarkFiber Inter Booth connections and one 10GE IP connection. 1 x 100GE connection to the Univ of Victoria 1 x 100GE connection to the Univ of Michigan 1 x 100GE connection to Caltech 1 x DF connection for 100GE Inter-Booth connection to the VanderBilt Booth1 x DF connection

Booth Layout

Caltech Booth# 809 had 30 x 30 feet dimension and was distributed in four main sections: 1. Display & Storage2. Equipment Racks3. Kiosks4. Workstations 

Planning

Servers are divided in fiour categories: A) PCIe Generation3 40GE Servers 2U Servers  Qty 8   Specification  Processor  Dual Intel Processor Xeon E5 – 2670 Eight Core  RAM  64GB  Hard Disks   Mix of OCZ Vertex4, Vertex3 SSD Disks and OCZ PCIe SSD Cards  NIC  Mellanox 40GE Gen3 VPI NICs B) PCIe Generation2 10GE Servers 1U Servers  Qty 2   Specification  Processor  Dual Processor Xeon L5640 Hex-Core  RAM  24GB  Hard Disks   4 x

OpenFlow Network with MPTCP Demonstration

While full use of 100 Gbps links was being shown on dedicated links, the Caltech team at SC12 also used software defined networks and multipath protocols to overcome the limitations faced by most data intensive science projects, who use shared network infrastructures or dedicated links of 10 Gbps or lower speeds.  Researchers from iCAIR, SARA, SURFnet, and Caltech demonstrated the utilization of MultiPath TCP (MPTCP) and OpenFlow to address these

Multiple 100GE Network Demonstrations

With three 100 gigabit/sec (100 Gbps) wide area network circuits set up by the SCinet, Internet2, CENIC, CANARIE and BCnet, Starlight and US LHCNet network teams, and servers at each of the sites with 40 gigabit Ethernet (40GE) interfaces, the team reached a record transfer rate of 339 Gbps between Caltech, the University of Victoria Computing Center in British Columbia, the University of Michigan, and the Salt Palace Convention Center

SuperComputing 2012

SALT LAKE CITY, Utah – During the SuperComputing 2012 (SC12) conference November 12-16, an International team of high energy physicists, computer scientists, and network engineers led by the California Institute of Technology (Caltech), the University of Victoria, and the University of Michigan, together with Brookhaven National Lab, Vanderbilt and other partners, smashed their previous records for data transfers using the latest generation of wide area network circuits.  Multiple 100GE Network Demonstrations With three