Spark¼¯Èº´î½¨Óë²âÊÔ - ͼÎÄ

×¢2£º×¢£ºÓеÄÅóÓÑϲ»¶Ê¹ÓÃstart-all.sh£¬ÆäʵÖÊÊÇÖ´ÐÐÁËstart-dfs.shºÍstart-yarn.sh,ÈçÏÂͼ¿É¼û£¬ÔÚÌáʾÖÐÒ²¿É¼û£¬ÍƼö·Ö¿ªÊ¹ÓÃstart-dfs.shºÍstart-yarn.sh¶ø²»ÊÇÖ±½ÓʹÓÃstart-all.sh:

c. Æô¶¯yarn: start-yarn.sh

ʹÓÃjpsÑéÖ¤yarnÊÇ·ñÆô¶¯³É¹¦£º

ͨ¹ýwebui¼ì²éyarnÊÇ·ñÆô¶¯³É¹¦: http://master:8088/

http://worker1:8042/

d. Æô¶¯JobHistory Server£ºmr-jobhistory-daemon.sh start historyserver

ʹÓÃjpsÑéÖ¤JobHistory ServerÊÇ·ñÆô¶¯³É¹¦£º

ͨ¹ýwebui¼ì²éJobHistory ServerÊÇ·ñÆô¶¯³É¹¦:

http://master:19888

e. ÑéÖ¤hadoop¼¯Èº ´´½¨Îļþ¼Ð£º

hdfsdfs -mkdir -p /data/wordcount hdfsdfs -mkdir -p /output ÉÏ´«Îļþ£º

hdfsdfs -put /usr/local/hadoop/hadoop-2.6.0/etc/hadoop/*.xml /data/wordcount ²é¿´ÉÏ´«ÎļþÊÇ·ñ³É¹¦£º hdfsdfs -ls /data/wordcount

ÁªÏµ¿Í·þ£º779662525#qq.com(#Ìæ»»Îª@)