想在服务器上安装虚拟机运行hadoop，再实际使用中会干扰别的机器访问服务器吗？ Hadoop的搭建一般至少要多少台机器
hadoop\u914d\u7f6e\u4f2a\u5206\u5e03\u5f0f\u540elocalhost50030\u65e0\u6cd5\u770b\uff0c\u4f46\u662f50070\u53ef\u4ee5\uff0c\u8fd9\u662f\u600e\u4e48\u56de\u4e8b\uff1f\u6c42\u89e3\u7b54\u3002hadoop2.0\u7684web\u9875\u9762\u7aef\u53e3\u4e0d\u662f50030\u4e86\uff0c\u8bd5\u8bd58088\u3002
Hadoop\u662f\u4e00\u4e2a\u7531Apache\u57fa\u91d1\u4f1a\u6240\u5f00\u53d1\u7684\u5206\u5e03\u5f0f\u7cfb\u7edf\u57fa\u7840\u67b6\u6784\u3002
\u7528\u6237\u53ef\u4ee5\u5728\u4e0d\u4e86\u89e3\u5206\u5e03\u5f0f\u5e95\u5c42\u7ec6\u8282\u7684\u60c5\u51b5\u4e0b\uff0c\u5f00\u53d1\u5206\u5e03\u5f0f\u7a0b\u5e8f\u3002\u5145\u5206\u5229\u7528\u96c6\u7fa4\u7684\u5a01\u529b\u8fdb\u884c\u9ad8\u901f\u8fd0\u7b97\u548c\u5b58\u50a8\u3002
[1] Hadoop\u5b9e\u73b0\u4e86\u4e00\u4e2a\u5206\u5e03\u5f0f\u6587\u4ef6\u7cfb\u7edf\uff08Hadoop Distributed File System\uff09\uff0c\u7b80\u79f0HDFS\u3002HDFS\u6709\u9ad8\u5bb9\u9519\u6027\u7684\u7279\u70b9\uff0c\u5e76\u4e14\u8bbe\u8ba1\u7528\u6765\u90e8\u7f72\u5728\u4f4e\u5ec9\u7684\uff08low-cost\uff09\u786c\u4ef6\u4e0a\uff1b\u800c\u4e14\u5b83\u63d0\u4f9b\u9ad8\u541e\u5410\u91cf\uff08high throughput\uff09\u6765\u8bbf\u95ee\u5e94\u7528\u7a0b\u5e8f\u7684\u6570\u636e\uff0c\u9002\u5408\u90a3\u4e9b\u6709\u7740\u8d85\u5927\u6570\u636e\u96c6\uff08large data set\uff09\u7684\u5e94\u7528\u7a0b\u5e8f\u3002HDFS\u653e\u5bbd\u4e86\uff08relax\uff09POSIX\u7684\u8981\u6c42\uff0c\u53ef\u4ee5\u4ee5\u6d41\u7684\u5f62\u5f0f\u8bbf\u95ee\uff08streaming access\uff09\u6587\u4ef6\u7cfb\u7edf\u4e2d\u7684\u6570\u636e\u3002
Hadoop\u7684\u6846\u67b6\u6700\u6838\u5fc3\u7684\u8bbe\u8ba1\u5c31\u662f\uff1aHDFS\u548cMapReduce\u3002HDFS\u4e3a\u6d77\u91cf\u7684\u6570\u636e\u63d0\u4f9b\u4e86\u5b58\u50a8\uff0c\u5219MapReduce\u4e3a\u6d77\u91cf\u7684\u6570\u636e\u63d0\u4f9b\u4e86\u8ba1\u7b97\u3002
Hadoop\u539f\u672c\u6765\u81ea\u4e8e\u8c37\u6b4c\u4e00\u6b3e\u540d\u4e3aMapReduce\u7684\u7f16\u7a0b\u6a21\u578b\u5305\u3002\u8c37\u6b4c\u7684MapReduce\u6846\u67b6\u53ef\u4ee5\u628a\u4e00\u4e2a\u5e94\u7528\u7a0b\u5e8f\u5206\u89e3\u4e3a\u8bb8\u591a\u5e76\u884c\u8ba1\u7b97\u6307\u4ee4\uff0c\u8de8\u5927\u91cf\u7684\u8ba1\u7b97\u8282\u70b9\u8fd0\u884c\u975e\u5e38\u5de8\u5927\u7684\u6570\u636e\u96c6\u3002\u4f7f\u7528\u8be5\u6846\u67b6\u7684\u4e00\u4e2a\u5178\u578b\u4f8b\u5b50\u5c31\u662f\u5728\u7f51\u7edc\u6570\u636e\u4e0a\u8fd0\u884c\u7684\u641c\u7d22\u7b97\u6cd5\u3002Hadoop[3] \u6700\u521d\u53ea\u4e0e\u7f51\u9875\u7d22\u5f15\u6709\u5173\uff0c\u8fc5\u901f\u53d1\u5c55\u6210\u4e3a\u5206\u6790\u5927\u6570\u636e\u7684\u9886\u5148\u5e73\u53f0\u3002
\u76ee\u524d\u6709\u5f88\u591a\u516c\u53f8\u5f00\u59cb\u63d0\u4f9b\u57fa\u4e8eHadoop\u7684\u5546\u4e1a\u8f6f\u4ef6\u3001\u652f\u6301\u3001\u670d\u52a1\u4ee5\u53ca\u57f9\u8bad\u3002Cloudera\u662f\u4e00\u5bb6\u7f8e\u56fd\u7684\u4f01\u4e1a\u8f6f\u4ef6\u516c\u53f8\uff0c\u8be5\u516c\u53f8\u57282008\u5e74\u5f00\u59cb\u63d0\u4f9b\u57fa\u4e8eHadoop\u7684\u8f6f\u4ef6\u548c\u670d\u52a1\u3002GoGrid\u662f\u4e00\u5bb6\u4e91\u8ba1\u7b97\u57fa\u7840\u8bbe\u65bd\u516c\u53f8\uff0c\u57282012\u5e74\uff0c\u8be5\u516c\u53f8\u4e0eCloudera\u5408\u4f5c\u52a0\u901f\u4e86\u4f01\u4e1a\u91c7\u7eb3\u57fa\u4e8eHadoop\u5e94\u7528\u7684\u6b65\u4f10\u3002Dataguise\u516c\u53f8\u662f\u4e00\u5bb6\u6570\u636e\u5b89\u5168\u516c\u53f8\uff0c\u540c\u6837\u57282012\u5e74\u8be5\u516c\u53f8\u63a8\u51fa\u4e86\u4e00\u6b3e\u9488\u5bf9Hadoop\u7684\u6570\u636e\u4fdd\u62a4\u548c\u98ce\u9669\u8bc4\u4f30\u3002
\u8fd9\u4e2a\u8981\u770b\u4f60\u7684\u9700\u6c42\uff0c\u6bd4\u5982\u662f\u751f\u4ea7\u73af\u5883\u8fd8\u662f\u6d4b\u8bd5\u7528
\u5982\u679c\u662f\u751f\u4ea7\uff0c\u8981\u770b\u4f60\u7684\u6570\u636e\u91cf\uff0c\u9700\u8981\u7684\u5904\u7406\u80fd\u529b\u7b49
\u5982\u679c\u4f60\u53ea\u662f\u5b66\u4e60\u7528\uff0c\u6761\u4ef6\u597d\u70b9\u7684\uff0c\u5f043\u53f0\u4ee5\u4e0a\u7684\u673a\uff0c\u4e00\u4e2anamenode\uff0c\u4e24\u4e2adatanode
\u5982\u679c\u5b9e\u5728\u6ca1\u6709\u6761\u4ef6\uff0c\u5c31\u4e24\u53f0\u673a\uff0c\u4e00\u4e2anamenode\u4e00\u4e2adatanode
\u5b9e\u5728\u6ca1\u6709\u6761\u4ef6\uff0c\u5c31\u7528\u4e00\u53f0\u673a\uff0c\u88c5\u51e0\u4e2a\u865a\u62df\u673a
虽然你是建虚机, 但对性能的影响是显然的..
看你们server的配置吧..
绛旓細铏氭嫙鏈虹殑鏂囦欢鏄瓨鏀惧湪瀛樺偍閲屻HA鐨勫姛鑳芥槸鎶婅櫄鎷熸満鏂囦欢浠庢晠闅滀富鏈轰笂鍗歌浇锛屽悗鎸傝浇鍒拌繍琛屾甯哥殑涓绘満涓婏紝鍐嶅紑鍚銆傚鏋滀紒涓氳冭檻鍒版垚鏈棶棰橈紝寤鸿涓ゅ彴鏈嶅姟鍣ㄥ畨瑁呰櫄鎷熷寲杞欢鍚庝簰涓哄浠姐
绛旓細绠鍗曚竴鐐圭殑鏄:鐢ㄤ袱鍙鏈嶅姟鍣鍒嗗埆瀹夎ESX, 铏氭嫙鏈鏀惧埌鍙︿竴涓鐩橀樀鍒椾笂,鐢╒sphere 鐩存帴鏈HA鍔熻兘, 寰楀厛璁剧疆濂紻NS,鍙湁涓鍙扮數鑴戣繖涓繕鍙粈涔堥珮鍙敤, 鐢佃剳閮芥寕浜,鐢ㄤ粈涔?
绛旓細鍙互閫氳繃瀹夎铏氭嫙鏈哄疄鐜帮紝鍒╃敤vmware鍏徃鐨別sxi杩欐浜у搧瀹炵幇銆傞厤缃柟娉曪細esxi閲岄潰鑷甫鏈夐泦缇よ繖涓椤瑰姛鑳斤紝鍙皢澶氬彴鏈嶅姟鍣ㄦ坊鍔犲埌闆嗙兢涓潵锛岄泦缇ゅ缓濂藉悗杩樺彲浠ュ埄鐢ㄩ噷闈㈢殑ha(楂樺彲鐢ㄦ)銆乨rs(鍒嗗竷寮忓瓨鍌ㄨ皟璇)锛宔vc(澶氱‖浠跺吋瀹)绛夊绉嶇壒鎬у皢澶氬彴鏈嶅姟鍣ㄧ殑纭欢璧勬簮鍔犲叆鍒颁竴涓祫婧愭睜閲岋紝鍙纭欢鐨勮祫婧愬仛鍒嗛厤銆備互鐧...
绛旓細涓瀹夎KVM铏氭嫙鏈锛岃櫄鎷熶富鏈洪渶瑕杩愯libvirt鏈嶅姟銆傚彲浠ヤ娇鐢ㄥ涓嬪懡浠よ繍琛宭ibvirt鏈嶅姟锛歴ystemctl start libvirtd; systemctl enable libvirtd銆傚紑鍚畨瑁呮湁涓ょ鏂瑰紡锛屽彲浠ヤ娇鐢ㄨ櫄鎷熸満绠＄悊鍣ㄥ浘褰㈠伐鍏锋垨鑰卾irt-install鍛戒护琛屻傚鏋滆兘澶熶娇鐢ㄥ浘褰㈢幆澧冿紝閭ｄ箞virt-manager宸ュ叿灏嗛潪甯告湁鐢紝浣犱篃鍙互浣跨敤鑴氭湰鍒涘缓铏氭嫙鏈恒傝鍛戒护鎸...
绛旓細鑷充簬浣犺冭檻鍒扮殑锛鐗╃悊鏈嶅姟鍣ㄥ綋鏈轰細褰卞搷鍒版湇鍔★紝鍏跺疄铏氭嫙鍖栭噷闈㈠彲浠ョ粨鍚圚A鎶鏈潵瑙ｅ喅杩欎竴娼滃湪椋庨櫓銆備富娴佺殑铏氭嫙鍖栫鐞嗗钩鍙伴兘鍙互鎻愪緵铏氭嫙鏈篐A鎶鏈紝褰撲竴鍙拌櫄鎷熸満鎴栬呮暣涓墿鐞嗘湇鍔″櫒褰撴満涔嬪悗锛岀鐞嗙灏嗕細鑷姩鍦ㄥ彟澶栦竴鍙扮墿鐞嗘湇鍔″櫒涓婂惎鍔ㄨ繖涓铏氭嫙鏈猴紝褰撶劧濡傛灉浣犲彧鏈変竴鍙扮墿鐞嗘湇鍔″櫒閭ｅ氨娌″姙娉曚簡锛
绛旓細瑙ｅ喅鍔炴硶寰堢畝鍗曪細1銆佷慨鏀 VMware ESXi 鐨勮缃紱2銆佷慨鏀瑰搴铏氭嫙鏈鐨勮缃傜櫥闄 VMware ESXi 鎺у埗鍙版墦寮 VMware ESXi 5.0 鐨 SSH 鏈嶅姟锛堥粯璁 SSH 鏈嶅姟鏄叧闂殑锛夛紝鐒跺悗鐢 ssh 鐧婚檰 VMware ESXi 鍚庡湪 config 鏂囦欢涓渶鍚庡姞鍏 vhv.allow = 鈥淭RUE鈥 涓琛岋細vi /etc/vmware/config libdir = "/usr/...
绛旓細VMware鐨HA鍜屽井杞殑MSCS(Win2008浠ュ悗鏀圭ОFailover Clustering)绫讳技锛岄兘鏄皢澶氬彴涓绘満缁勫缓鎴愪竴涓晠闅滆浆绉婚泦缇(Cluster)锛杩愯鍦ㄩ泦缇や笂鐨鏈嶅姟(鎴朧M)涓嶄細鍥犱负鍗曞彴涓绘満鐨勬晠闅滆屽仠姝傜敤涓涓浘鏉ョ畝鍗曡鏄嶩A鐨勫伐浣滃師鐞嗭細鍥句腑姗欒壊鐨勪富鏈篍SXi01瀹曟満浜嗭紝鍏朵笂鐨2鍙铏氭嫙鏈VM1鍜孷M2灏辨牴鎹瓾A鐨勮皟搴﹁ESXi-02鍜孍SXi...
绛旓細渚嬪锛屽鏋铏氭嫙鏈鸿繍琛鍦‵C鎴朣AS瀛樺偍涓婏紝鍒欏彲浠ュ皢澶囦唤浣嶇疆閫夋嫨鍙︿竴瀛樺偍銆傚綋娌℃湁澶氫綑鐨勫瓨鍌ㄦ椂锛屽彲浠ュ皢鏁版嵁澶囦唤鍦ㄦ煇鍙鏈嶅姟鍣鐨勬湰鍦扮‖鐩樼┖闂淬傚湪鎴戜滑瀹炴柦铏氭嫙鍖栭」鐩椂锛岄兘浼氳喘缃柊鐨勫瓨鍌ㄣ傚湪瀹炴柦铏氭嫙鍖栭」鐩悗锛屽彲浠ヤ娇鐢ㄧ殑鏁版嵁涓績鍘熸潵鐨勫瓨鍌ㄥ仛澶囦唤浣跨敤銆傚鏋滄暟鎹腑蹇冩病鏈夊浣欏瓨鍌紝鍙互鐢ㄨ妭鐪佷笅鏉ョ殑鏈嶅姟鍣ㄥ仛缃戠粶...
绛旓細浣跨敤vSphere HA锛屽彲璁╄櫄鎷熸湇鍔″櫒鍋滄锛岀郴缁熻嚜鍔ㄥ皢鍏跺垏鎹㈠埌鏂鏈嶅姟鍣ㄤ笂鐨勭浜屼釜鐩稿悓鐨铏氭嫙鏈涓婏紝骞朵笖涓嶄細涓㈠け蹇冭烦銆傞鍏堬紝閰嶇疆VMware闆嗙兢鑺傜偣锛屽苟鍦ㄩ氱敤鏍囧噯涓杩愯璧锋潵銆備綘闇瑕佸鎵鏈夎妭鐐瑰悗鎵ц鐩稿悓鐨勬洿鏂帮紝璇ユ渚嬩腑鏄袱鍙版湇鍔″櫒锛屽苟鎷ユ湁涓涓叡浜殑瀛樺偍绌洪棿锛屼綘鐨勭涓夊彴瀛樺偍鏈嶅姟鍣ㄦ彁渚涚粰鑺傜偣浣跨敤銆傛墍鏈夎櫄鎷...
绛旓細绗竴浣犵殑C鐩樻病鏈夎婵娲伙紝绗簩浣犵殑Ghost鍏夌洏闀滃儚绯荤粺鏈夐棶棰樸傚缓璁敤绾噣鐗堢殑闀滃儚绯荤粺瀹夎锛岀櫨鍒嗕箣鐧炬垚鍔熴
