{"id":233,"date":"2020-08-27T17:00:32","date_gmt":"2020-08-27T17:00:32","guid":{"rendered":"http:\/\/131.215.207.17\/?p=233"},"modified":"2020-08-27T17:00:47","modified_gmt":"2020-08-27T17:00:47","slug":"planning-2","status":"publish","type":"post","link":"https:\/\/supercomputing.caltech.edu\/index.php\/2020\/08\/27\/planning-2\/","title":{"rendered":"Planning"},"content":{"rendered":"\n

1. Equipment<\/strong><\/p>\n\n\n\n

Servers rack was comprised of a set of 1U Twin Motherboard Supermicro servers.<\/p>\n\n\n\n

1U Servers<\/strong><\/td> Qty 32<\/td><\/tr>
 <\/td> 2 x Supermicro  6015TC-10GB server<\/td><\/tr>
 Processor<\/td> 2 x Dual Intel  L5420,  2.5 GHz quad-core<\/td><\/tr>
 RAM<\/td> 2 x 16GB<\/td><\/tr>
 Hard Disks<\/td> 4 x 1TB SATA-II<\/td><\/tr>
 NIC<\/td> 2 x 10GbE CX4<\/td><\/tr>
 HBA
 <\/td>		 1 x QLogic 2560 FC-8
 (in 16 sevrers only)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
 Cisco 6509-E<\/strong><\/td> Qty 2<\/td><\/tr>
 Supervisor<\/td> SUP VSS 720 with PFC3B<\/td><\/tr>
 LR Ports<\/td> 19<\/td><\/tr>
 SR Ports<\/td> 39<\/td><\/tr>
 CX4 Ports<\/td> 27<\/td><\/tr>
 Cisco 3560-E<\/strong><\/td> Qty2<\/td><\/tr>
 Cisco 3550<\/strong><\/td> Qty2<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
 Force10 s2410<\/strong><\/td> Qty 2 (Total 48 ports)<\/td><\/tr>
 FO Ports<\/td> 2 x 4 MM SR<\/td><\/tr>
 CX4 Ports<\/td> 2 x 20 CX4<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
 GlimmerGlass<\/strong><\/td> System 100 48×48 ports<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
 XKL DXM10<\/strong><\/td> Qty 2  – 10 Port DWDM<\/td><\/tr>
 MM SR Ports<\/td> 6<\/td><\/tr>
 SM LR Ports<\/td> 4<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
 Storage System<\/strong><\/td> 2 x Data Direct Networks S2A9900,
 8 port FiberChannel storage system,
 using 80 SAS disks in 5 trays<\/td><\/tr>
 HBA<\/strong><\/td> 16 x QLogic 2560, Single port 8Gb Fiber Channel<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
 Miscellaneous<\/strong><\/td> <\/td><\/tr>
 <\/td> <\/td><\/tr>
 Rack<\/td> 2 x 42U<\/td><\/tr>
 FO PatchPanel<\/td> 1<\/td><\/tr>
 KVM<\/td> 1 x 16 port<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

2. Server Configuration<\/strong><\/p>\n\n\n\n

Each system ran the same custom Linux UltraLight 2.6.24 kernel, with patches for FAST TCP and other TCP performance tunings built in.<\/p>\n\n\n\n

Based on the different hardware combination, systems were grouped into four main categories:<\/p>\n\n\n\n

A) 1U Servers with Fiber Channel Storage System + onboard Intel CX4 10GE NIC<\/strong><\/p>\n\n\n\n

8 of  the 1U<\/strong> twin systems<\/strong> were outfitted with QLogic<\/strong>  fiberchannel HBAs connected to Data Direct Networks<\/strong> storage system. Maximum read\/write speeds between ??.<\/strong><\/p>\n\n\n\n

B) 1U Servers with Local Storage + Myricom10 GbE NIC (dCache Head Nodes)<\/strong><\/p>\n\n\n\n

4 of the 1U<\/strong> systems were outfitted with Intel Oplin<\/strong> single port 10GbE NIC and local storage with RAID-0 was used to source\/sink data.
Maximum read\/write speeds at 200MB\/s<\/strong>.<\/p>\n\n\n\n

C) 1U Servers with Local Storage with on board 10GE CX4 NIC (dCache pool nodes \/ individual systems)<\/strong><\/p>\n\n\n\n

20 of 1the U <\/strong>systems were configured with Myricom<\/strong> 10GbE NIC while the 4 hard drives were placed in RAID-0 configuration. Maximum read\/write speeds at 200MB\/s<\/strong>.<\/p>\n\n\n\n

D) Sun Thumpers with Local Storage + Myricom 10 GbE NIC (disk servers)<\/strong><\/p>\n\n\n\n

The 4 x 2U servers were whitebox systems with Myricom <\/strong>10GbE NIC and each system having 12<\/strong> hard disks connected through Areca<\/strong> 1231ML<\/strong> RAID Controller and placed in RAID-0. Maximum read\/write speeds at 500MB\/s<\/strong>.<\/p>\n","protected":false},"excerpt":{"rendered":"

1. Equipment Servers rack was comprised of a set of 1U Twin Motherboard Supermicro servers. 1U Servers  Qty 32    2 x Supermicro  6015TC-10GB server  Processor  2 x Dual Intel  L5420,  2.5 GHz quad-core  RAM  2 x 16GB  Hard Disks  4 x 1TB SATA-II  NIC  2 x 10GbE CX4  HBA   1 x QLogic 2560 FC-8 (in 16 sevrers only)  Cisco 6509-E  Qty 2  Supervisor  SUP VSS 720 with PFC3B  LR Ports<\/p>\n

Read More<\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28],"tags":[],"class_list":["post-233","post","type-post","status-publish","format-standard","hentry","category-super-computing-2008"],"_links":{"self":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts\/233","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/comments?post=233"}],"version-history":[{"count":1,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts\/233\/revisions"}],"predecessor-version":[{"id":234,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts\/233\/revisions\/234"}],"wp:attachment":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/media?parent=233"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/categories?post=233"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/tags?post=233"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}