{"id":174,"date":"2020-08-25T19:27:11","date_gmt":"2020-08-25T19:27:11","guid":{"rendered":"http:\/\/131.215.207.17\/?p=174"},"modified":"2020-08-25T19:27:11","modified_gmt":"2020-08-25T19:27:11","slug":"planning","status":"publish","type":"post","link":"https:\/\/supercomputing.caltech.edu\/index.php\/2020\/08\/25\/planning\/","title":{"rendered":"Planning"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><strong>1. Equipment<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The single rack of systems was comprised of a set of low-cost 1U and 2U Supermicro servers.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>1U Servers<\/strong><\/td><td>&nbsp;Qty 32<\/td><\/tr><tr><td>&nbsp;<\/td><td>&nbsp;Supermicro 6015URB server<\/td><\/tr><tr><td>&nbsp;Processor<\/td><td>&nbsp;Dual Intel E5345 2.33 GHz quad-core<\/td><\/tr><tr><td>&nbsp;RAM<\/td><td>&nbsp;8GB<\/td><\/tr><tr><td>&nbsp;Hard Disks<\/td><td>&nbsp;4 x 750GB Western Digital SATA-II<\/td><\/tr><tr><td>&nbsp;NIC<\/td><td>&nbsp;1 x 10GbE<\/td><\/tr><tr><td>&nbsp;HBA<br>&nbsp;<\/td><td>&nbsp;1 x QLogic 2462<br>&nbsp;(in 8 sevrers only)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>&nbsp;2U Servers<\/strong><\/td><td>&nbsp;Qty 4<\/td><\/tr><tr><td>&nbsp;<\/td><td>&nbsp;Supermicro X7DBE+ motherboard<\/td><\/tr><tr><td>&nbsp;Processor<\/td><td>&nbsp;Intel E5345 2.33 GHz quad-core<\/td><\/tr><tr><td>&nbsp;RAM<\/td><td>&nbsp;8GB<\/td><\/tr><tr><td>&nbsp;Hard Disks<\/td><td>&nbsp;12 x 750GB Western Digital SATA<\/td><\/tr><tr><td>&nbsp;NIC<\/td><td>&nbsp;1 x 10GbE<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>&nbsp;Cisco 6509-E<\/strong><\/td><td>&nbsp;Qty 1<\/td><\/tr><tr><td>&nbsp;Supervisor<\/td><td>&nbsp;SUP 720 with PFC3B<\/td><\/tr><tr><td>&nbsp;LR Xenpak<\/td><td>&nbsp;5<\/td><\/tr><tr><td>&nbsp;LR X2<\/td><td>&nbsp;3<\/td><\/tr><tr><td>&nbsp;SR Xenpak<\/td><td>&nbsp;15<\/td><\/tr><tr><td>&nbsp;SR X2<\/td><td>&nbsp;21<\/td><\/tr><tr><td>&nbsp;<strong>Cisco 3560-E<\/strong><\/td><td>&nbsp;Qty1<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>&nbsp;<strong>Storage System<\/strong><\/td><td>&nbsp;Data Direct Networks S2A9550,<br>&nbsp;8 port FiberChannel storage system,<br>&nbsp;using 80 SATA-II disks in 5 trays<\/td><\/tr><tr><td>&nbsp;<strong>HBA<\/strong><\/td><td>&nbsp;8 x QLogic 2462, Dual port 4Gb Fiber Channel<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>&nbsp;Miscellaneous<\/strong><\/td><td>&nbsp;<\/td><\/tr><tr><td>&nbsp;<\/td><td>&nbsp;<\/td><\/tr><tr><td>&nbsp;Rack<\/td><td>&nbsp;1x 42U, 1 x 44U<\/td><\/tr><tr><td>&nbsp;FO PatchPanel<\/td><td>&nbsp;1<\/td><\/tr><tr><td>&nbsp;KVM<\/td><td>&nbsp;1 x 16 port<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>2. Server Configuration<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Each system ran the same custom Linux 2.6.20 kernel, with patches for FAST TCP and other TCP performance tunings built in.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Based on the different hardware combination, systems were grouped into four main categories:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>A) 1U Servers with Fiber Channel Storage System + Intel Oplin 10 GbE NIC<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>8 of&nbsp; the 1U<\/strong>&nbsp;systems were outfitted with&nbsp;<strong>Intel Oplin<\/strong>&nbsp;single port 10GbE NIC and a&nbsp;<strong>QLogic<\/strong>&nbsp; fiberchannel HBAs connected to&nbsp;<strong>Data Direct Networks<\/strong>&nbsp;storage system. Maximum read\/write speeds between&nbsp;<strong>350-400MB\/s.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>B) 1U Servers with Local Storage + Intel Oplin 10 GbE NIC<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>4 of&nbsp;the 1U<\/strong>&nbsp;systems were outfitted with&nbsp;<strong>Intel Oplin<\/strong>&nbsp;single port 10GbE NIC and local storage with RAID-0 was used to source\/sink data.<br>Maximum read\/write speeds at&nbsp;<strong>200MB\/s<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>C) 1U Servers with Local Storage + Myricom 10 GbE NIC<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>20 of 1the U&nbsp;<\/strong>systems were configured with&nbsp;<strong>Myricom<\/strong>&nbsp;10GbE NIC while the 4 hard drives were placed in RAID-0 configuration. Maximum read\/write speeds at&nbsp;<strong>200MB\/s<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>D) 2U Servers with Local Storage + Myricom 10 GbE NIC<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The 4 x 2U servers were whitebox systems&nbsp;<strong>with Myricom&nbsp;<\/strong>10GbE NIC and each system having&nbsp;<strong>12<\/strong>&nbsp;hard disks connected through&nbsp;<strong>Areca<\/strong>&nbsp;<strong>1231ML<\/strong>&nbsp;RAID Controller and placed in RAID-0. Maximum read\/write speeds at&nbsp;<strong>500MB\/s<\/strong>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>1. Equipment The single rack of systems was comprised of a set of low-cost 1U and 2U Supermicro servers. 1U Servers &nbsp;Qty 32 &nbsp; &nbsp;Supermicro 6015URB server &nbsp;Processor &nbsp;Dual Intel E5345 2.33 GHz quad-core &nbsp;RAM &nbsp;8GB &nbsp;Hard Disks &nbsp;4 x 750GB Western Digital SATA-II &nbsp;NIC &nbsp;1 x 10GbE &nbsp;HBA&nbsp; &nbsp;1 x QLogic 2462&nbsp;(in 8 sevrers only) &nbsp;2U Servers &nbsp;Qty 4 &nbsp; &nbsp;Supermicro X7DBE+ motherboard &nbsp;Processor &nbsp;Intel E5345 2.33 GHz quad-core<\/p>\n<div class=\"belowpost\"><a class=\"btnmore\" href=\"https:\/\/supercomputing.caltech.edu\/index.php\/2020\/08\/25\/planning\/\">Read More<\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29],"tags":[],"class_list":["post-174","post","type-post","status-publish","format-standard","hentry","category-super-computing-2007"],"_links":{"self":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts\/174","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/comments?post=174"}],"version-history":[{"count":1,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts\/174\/revisions"}],"predecessor-version":[{"id":175,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/posts\/174\/revisions\/175"}],"wp:attachment":[{"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/media?parent=174"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/categories?post=174"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/supercomputing.caltech.edu\/index.php\/wp-json\/wp\/v2\/tags?post=174"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}