ScalaºÍJavaÀàËÆ£¬Ö»ÔÊÐí¼Ì³ÐÒ»¸ö¸¸Àà¡£²»Í¬µÄÊÇ£¬JavaÖ»Äܼ̳и¸ÀàÖзÇ˽ÓеÄÊôÐԺͷ½·¨¡£¶øScala¿ÉÒԼ̳и¸ÀàÖеÄËùÓÐÊôÐԺͷ½·¨£¬×ÓÀàÓµÓи¸ÀàµÄËùÓÐÌØÕ÷¡£µ«ÊÇScalaÔÚ×ÓÀà¼Ì³Ð¸¸ÀàµÄʱºò£¬ÓÐÒÔϼ¸µãÐèҪעÒ⣺ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-30 |ÀÖÓãµç¾º |scala×ÓÀà¼Ì³Ð¸¸Àà,scala¼Ì³Ð
HDFS²ÉÓÃÖ÷´Ó¼Ü¹¹(Master/Slave¼Ü¹¹)¡£HDFS¼¯Èº·Ö±ðÊÇÓÉÒ»¸öNameNodeºÍ¶à¸öµÄ DataNode×é³É¡£ÆäÖУ¬NameNodeÊÇHDFS¼¯ÈºµÄÖ÷½Úµã£¬¸ºÔð¹ÜÀíÎļþϵͳµÄÃüÃû¿Õ¼äÒÔ¼°¿Í»§¶Ë¶ÔÎļþµÄ·ÃÎÊ;DataNodeÊǼ¯ÈºµÄ´Ó½Úµã£¬¸ºÔð¹ÜÀíËüËùÔÚ½ÚµãÉϵÄÊý¾Ý´æ´¢¡£HDFS·Ö²¼Ê½ÎļþϵͳÖеÄNameNodeºÍDataNodeÁ½ÖÖ½ÇÉ«¸÷˾ÆäÖ°£¬¹²Í¬Ðµ÷Íê³É·Ö²¼Ê½µÄÎļþ´æ´¢·þÎñ¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-30 |ÀÖÓãµç¾º |HDFS,NameNode·Ö²¼Ê½Îļþϵͳ,´¢´æ¼Ü¹¹
HadoopÊÇApache»ù½ð»áÃæÏòÈ«Çò¿ªÔ´µÄ²úÆ·Ö®Ò»£¬ÈκÎÓû§¶¼¿ÉÒÔ´ÓApache Hadoop ¹ÙÍøÏÂÔØÊ¹ÓøòúÆ·¡£±¾Ê齫ÒÔ±àдʱ½ÏΪÎȶ¨µÄHadoop2.7.4°æ±¾ÎªÀý£¬Ïêϸ½²½âHadoopµÄ°²×°²½Öè¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-29 |ÀÖÓãµç¾º |Hadoop°²×°²½Öè,Hadoop°²×°Ä¿Â¼µÄ×÷ÓÃÊÇʲô
DAG(Directed Acyclic Graph)½Ð×öÓÐÏòÎÞ»·Í¼,DAGÊÇÒ»Öַdz£ÖØÒªµÄͼÂÛÊý¾Ý½á¹¹¡£Èç¹ûÒ»¸öÓÐÏòͼÎÞ·¨´ÓÈÎÒâ¶¥µã³ö·¢¾¹ýÈô¸ÉÌõ±ß»Øµ½¸Ãµã£¬ÔòÕâ¸öͼ¾ÍÊÇÓÐÏòÎÞ»·Í¼£¬½ÓÏÂÀ´Í¨¹ý¼¸¸öÀý×Ó£¬ÎÒÃÇÀ´ÏêϸÁ˽âÏÂDAGÓÐÎÞ»·Ïòͼ¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-29 |ÀÖÓãµç¾º |DAG,ÓÐÎÞ»·Ïòͼ,ʲôÊÇDAG
Spark StreamingÖ§³Ö´Ó¶àÖÖÊý¾ÝÔ´»ñÈ¡Êý¾Ý£¬°üÀ¨Kafka¡¢Flume¡¢Twitter¡¢ZeroMQ¡¢Kinesis ÒÔ¼°TCP SocketsÊý¾ÝÔ´¡£µ±Spark Streaming´ÓÊý¾ÝÔ´»ñÈ¡Êý¾ÝÖ®ºó£¬Ôò¿ÉÒÔʹÓÃÖîÈçmap¡¢reduce¡¢joinºÍwindowµÈ¸ß¼¶º¯Êý½øÐи´ÔӵļÆËã´¦Àí£¬×îºó½«´¦ÀíµÄ½á¹û´æ´¢µ½·Ö²¼Ê½Îļþϵͳ¡¢Êý¾Ý¿âÖÐΪÁË¿ÉÒÔÉîÈëµÄÀí½âSpark Streaming£¬½ÓÏÂÀ´£¬ÎÒÃǶԶÔSpark StreamingµÄÄÚ²¿¹¤×÷ÔÀí½øÐÐÏêϸ½²½â¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-28 |ÀÖÓãµç¾º |Spark Streaming£¬Spark Streaming¹¤×÷ÔÀí
´Ó0¿ªÊ¼Ñ§Ï°´óÊý¾Ý¿Î³Ì£¬ÏëÁ˽âlinux¡¢kettle¡¢BI¡¢mysql¡¢´Ó»ù´¡µ½Êµ¼ù£¬Í¨¹ý֪ʶµã + °¸Àý½Ìѧ·¨°ïÖúÄãÏëÄãÏëѸËÙÕÆÎÕ´óÊý¾Ý¡£ÌáÈ¡Â룺ir0t ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-23 |ÀÖÓãµç¾º |´óÊý¾ÝÈëÃÅÊÓÆµ½Ì³Ì
RDD( Resilient Distributed Dataset£¬µ¯ÐÔ·Ö²¼Ê½Êý¾Ý¼¯)£¬ÊÇÒ»¸öÈÝ´íµÄ¡¢²¢ÐеÄÊý¾Ý½á¹¹£¬¿ÉÒÔÈÃÓû§ÏÔʽµØ½«Êý¾Ý´æ´¢µ½´ÅÅ̺ÍÄÚ´æÖУ¬²¢ÇÒ»¹ÄÜ¿ØÖÆÊý¾ÝµÄ·ÖÇø¡£¶ÔÓÚµü´úʽ¼ÆËãºÍ½»»¥Ê½Êý¾ÝÍÚ¾ò£¬RDD¿ÉÒÔ½«ÖÐ¼ä¼ÆËãµÄÊý¾Ý½á¹û±£´æÔÚÄÚ´æÖУ¬ÈôÊǺóÃæÐèÒªÖмä½á¹û²ÎÓë¼ÆËãʱ£¬Ôò¿ÉÒÔÖ±½Ó´ÓÄÚ´æÖжÁÈ¡£¬´Ó¶ø¿ÉÒÔ¼«´óµØÌá¸ß¼ÆËãËÙ¶È¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-22 |ÀÖÓãµç¾º |RDDÌØÕ÷
ScalaÓïÑÔ¿ÉÒÔÔÚWindows¡¢Linux¡¢Mac OSµÈϵͳÉϱàÒëÔËÐС£ÓÉÓÚScalaÊÇÔËJVMƽ̨Éϵģ¬ËùÒÔ°²×°Scala֮ǰ±ØÐëÅäÖúÃJDK»·¾³(JDK°æ±¾ÒªÇó²»µÍÓÚ1.5)¡£ ²é¿´È«ÎÄ>>
´óÊý¾Ý¼¼ÊõÎÄÕÂ2020-12-22 |ºÚÂí³ÌÐòÔ± |win10ÏÂÔØ°²×°Scala,Scala»·¾³±äÁ¿ÅäÖÃ
±±¾©Ð£Çø