Ŀ¼
KettleÖÐÔªËØ½éÉÜ ............................................................................................................................ 2
±äÁ¿........................................................................................................................................... 4 ת»»........................................................................................................................................... 5
ת»»Á¬½ÓÑÕÉ« ................................................................................................................... 6 ²½Ö裨ÓÒ¼üÊôÐÔ£© ................................................................................................................... 6 Îı¾ÎļþÊäÈë ........................................................................................................................... 7 ±íÊäÈë....................................................................................................................................... 8 »ñȡϵͳÐÅÏ¢ ........................................................................................................................... 8 Éú³É¼Ç¼ ................................................................................................................................... 9 CubeÊäÈë ............................................................................................................................... 10 XbaseÊäÈë .............................................................................................................................. 10 ExcelÊäÈë ............................................................................................................................... 10 XMLÊäÈë ................................................................................................................................ 10 »ñÈ¡ÎļþÃû ............................................................................................................................. 10 »ñÈ¡ÎļþÐÐÊý ......................................................................................................................... 10 Îı¾ÎļþÊä³ö ......................................................................................................................... 11 ±íÊä³ö..................................................................................................................................... 11 ²åÈë/¸üР............................................................................................................................... 12 ¸üÐÂ(¿ÉÒÔÓòåÈë/¸üÐÂÌæ´ú) ................................................................................................. 12 ɾ³ý......................................................................................................................................... 12 ÐòÁл¯µ½Îļþ(ÒÔǰÊÇCube output) ..................................................................................... 12 XMLÊä³ö ................................................................................................................................ 12 ExcelÊä³ö ............................................................................................................................... 13 AccessÊä³ö ............................................................................................................................. 13 Êý¾Ý¿â²éѯ(Database lookup) ............................................................................................... 13 Á÷²éѯ..................................................................................................................................... 13 µ÷ÓÃÊý¾Ý¿â´æ´¢¹ý³Ì ............................................................................................................. 14 HTTP¿Í»§¶Ë ........................................................................................................................... 14 ×Ö¶ÎÑ¡Ôñ ................................................................................................................................. 14 ¹ýÂ˼Ǽ ................................................................................................................................. 15 ÅÅÐò¼Ç¼ ................................................................................................................................. 15 Ìí¼ÓÐòÁÐ ................................................................................................................................. 15 ¿Õ²Ù×÷(ʲôҲ²»×ö) .............................................................................................................. 15 ÐÐתÁÐ(Row Normaliser) ........................................................................................................ 16 ²ð·Ö×Ö¶Î ................................................................................................................................. 17 È¥³ýÖØ¸´¼Ç¼ ......................................................................................................................... 17 ·Ö×é(Statistics) ........................................................................................................................ 17 ÉèÖÃΪ¿ÕÖµ£¨Null if£© ........................................................................................................... 18 ¼ÆËãÆ÷..................................................................................................................................... 18 Ôö¼ÓXML(Add XML) ............................................................................................................... 18 Ôö¼Ó³£Á¿ ................................................................................................................................. 18
1 / 42
ÐÐתÁÐ(Row Denormaliser) .................................................................................................... 19 ÐÐ±âÆ½»¯ ................................................................................................................................. 19 ÖµÓ³Éä..................................................................................................................................... 20 ±»¶³½áµÄ²½Öè(Blocking Step) ................................................................................................. 20 ¼Ç¼¹ØÁª£¨µÑ¿¨¶ûÊä³ö£© ..................................................................................................... 21 Êý¾Ý¿âÁ¬½Ó ............................................................................................................................. 21 ºÏ²¢¼Ç¼ ................................................................................................................................. 21 ÅÅÐòºÏ²¢(Sorted Merge) ........................................................................................................ 22 Merge Join£¨ºÏ²¢Á¬½Ó£© ....................................................................................................... 22 Java ScriptÖµ(Modified Java Script Value) .............................................................................. 23 Ö´ÐÐSQLÓï¾ä ........................................................................................................................ 23 Execute row SQL script ............................................................................................................ 24 ά¶È¸üÐÂ/²éѯ ....................................................................................................................... 25 ÁªºÏ¸üвéѯ ......................................................................................................................... 25 Ó³É䣨×Óת»»£© ..................................................................................................................... 26 ´Ó½á¹û»ñÈ¡¼Ç¼ ..................................................................................................................... 27 ¸´ÖƼǼµ½½á¹û£¨×Ö·û´®£© ................................................................................................. 27 Set Variables(ÉèÖñäÁ¿) ......................................................................................................... 27 Get Variables(»ñÈ¡±äÁ¿) ......................................................................................................... 28 Get files from result(´ÓÒÔǰµÄ½á¹û»ñÈ¡Îļþ) ...................................................................... 28 Set files in result ...................................................................................................................... 28 Injector(¼Ç¼עÉäÆ÷) .............................................................................................................. 29 Socket reader(Ì×½Ó×Ö¶ÁÈëÆ÷) ................................................................................................ 29 Ì×½Ó×ÖÊäдÆ÷(Socket writer) ................................................................................................. 30 ¾ÛºÏ¼Ç¼ ................................................................................................................................. 30 Á÷XMLÊäÈë(Êôsax½âÎö£¬ºÍGet data from xml¹¦ÄÜÏàͬ) ............................................... 30 Abort(ÖÐÖ¹) ............................................................................................................................. 31 Oracle Bulk Loader(Oracle ÅúÁ¿×°ÔØ) ................................................................................... 31 ÈÎÎñÉèÖã¨Job Settings£©Î´ÕÒµ½ ......................................................................................... 33 ÈÎÎñÌõÄ¿£¨Job Entries£©Î´ÕÒµ½ ........................................................................................... 33 Start ......................................................................................................................................... 33 ¸½Â¼1 £º ............................................................................................................................. 36 JSº¯Êý .................................................................................................................................... 36
×ÊÔ´¿â£º×ª»»ºÍjobµÄ±£´æµØµã
1¡¢kettle ÓÐÁ½ÖÖ·½Ê½Á¬½Ó×ÊÔ´¿â£¬Ò»ÖÖÊÇ´¿Êý¾Ý¿âʽ£¬ËùÓеÄת»»È«²¿¶¼±£´æÔÚÒ»¸öÊý¾Ý¿âÖУ»ÁíÍâÒ»ÖÖÁ¬½Ó·½Ê½ÊÇʹÓÃÎı¾Îļþ£¬Ò²¾ÍÊÇxml Îļþ£¬ÔÚ×öÍêÈκÎת»»Ö®ºó£¬ÎÒÃǶ¼¿ÉÒÔ°Ñת»»»òÕßJob ±ä³Éxml ÎļþÊä³ö¡£
KettleÖÐÔªËØ½éÉÜ
2 / 42
===========================
Transformation======================
? ÊäÈ룺
1¡¢Access Input 2¡¢Cube Input 3¡¢Excel ÊäÈë
4¡¢Generate random value 5¡¢Get File Names
6¡¢Get Files Rows Count 7¡¢Get SubFolder names 8¡¢Get data from XML 9¡¢Mondrian Input
10¡¢ Propperty Input 11¡¢ XBaseÊäÈë 12¡¢ Îı¾ÎļþÊäÈë 13¡¢ ±íÊäÈë
14¡¢ »ñȡϵͳÐÅÏ¢ 15¡¢ CSV file input ? Êä³ö£º
1¡¢Access Output 2¡¢CubeÊä³ö 3¡¢Excel Output 4¡¢Property Output 5¡¢SQL File Output 6¡¢XMLÊä³ö 7¡¢É¾³ý
8¡¢Îı¾ÎļþÊä³ö (CSVÎļþÊä³ö£¬½«·Ö¸ô·û¸ÄΪ¡°,¡±) 9¡¢±íÊä³ö
? ת»»£º
1¡¢Ôö¼Ó³£Á¿ ÓÃÀ´¸ø²éѯÔö¼Ó³£Á¿ÁÐ 2¡¢Ôö¼ÓÐòÁÐ ÓÃÀ´¸ø²éѯÔö¼ÓÐòÁÐÁÐ 3¡¢×Ö¶ÎÑ¡Ôñ ÓÃÀ´Ñ¡ÔñÊä³ö×Ö¶Î
4¡¢²ð·Ö×Ö¶Î ½«Ä³×ֶΰ´ÕÕij¸ö·Ö¸ô·û·Ö¸îΪ¶à¸ö×Ö¶Î 5¡¢ÅÅÐò¼Ç¼ °´ÕÕijЩ×ֶζԼǼ½øÐÐÅÅÐò 6¡¢Number range ²»Í¬·¶Î§Êä³ö²»Í¬µÄÖµ 7¡¢Add a checksum md5¼ÓÃܵÈ
8¡¢Replace in string Ìæ»»×Ö¶ÎֵΪÆäËûÖµ
9¡¢È¥³ýÖØ¸´¼Ç¼ ʹÓÃ֮ǰËùÓмǼ±ØÐëÒÑÓÐÐò 10¡¢ÖµÓ³Éä
11¡¢Unique rows(HashSet) 12¡¢¼ÆËãÆ÷ ¶Ô×Ö¶ÎÖµ½øÐÐ+¡¢-¡¢*¡¢/¡¢Æ½·½¡¢¿ª·Å¡¢ËÄÉáÎåÈëµÈÊý
3 / 42
ѧ¼ÆËãÒÔ¼°Ê±¼ä¼ÆËã¡£ ? Flow£º
1¡¢¹ýÂ˼Ǽ 2¡¢Switch/Case ? ²éѯ£º
1¡¢Êý¾Ý¿â²éѯ£¨¶à±í¹ØÁªÊ±Ê¹Óã¬ÎÞ¹ØÁªÊ±Ö»Ê¹ÓñíÊäÈë¼´¿É£©
? Á¬½Ó
1¡¢¼Ç¼¹ØÁª£¨µÑ¿¨¶ûÊä³ö£© ½«¶à¸ö±í¼Ç¼¹ØÁªÆðÀ´(µÑ¿¨¶û»ý£¬²»ÊDZíÁ¬
½Ó)
? ½Å±¾
1¡¢Modified Java Script Value
Ãû´Ê½âÊÍ£º
1¡¢hops£º½ÚµãÁ¬½Ó£¬Ò»¸öÁ¬½ÓÁ¬½ÓÁ½¸ö²½Öè¡£³ýÁËÖ¸¶¨Ö´ÐÐ˳Ðò£¬Ò²¿ÉÒÔÖ¸¶¨ÏÂÒ»
¸öÈÎÎñ½«»á±»Ö´ÐеÄÌõ¼þ¡£
2¡¢
³£ÓõŤ¾ß
1¡¢SQL Editor £ºÊý¾Ý¿âÁ¬½Ó¡ªÓÒ¼üSql Editor 2¡¢Explore £ºÊý¾Ý¿âÁ¬½Ó¡ªÓÒ¼üexplore 3¡¢ËÑË÷ÔªÊý¾Ý £ºCTRL + F 4¡¢ÉèÖû·¾³±äÁ¿£ºctrl+alt+j
±äÁ¿
1. »·¾³±äÁ¿£ºÊ¹Óû·¾³±äÁ¿Î¨Ò»µÄÎÊÌâÊÇ£º²»Äܶ¯Ì¬µÄʹÓñäÁ¿
2. Kettle±äÁ¿£ºÒòΪ»·¾³±äÁ¿µÄ·¶Î§·Ç³£¹ã·º£¬ËùÒÔÎÒÃÇÒýÈëKettle ±äÁ¿£¬ËüÃǶÔÓÚÉè
ÖñäÁ¿µÄÈÎÎñÀ´ËµÊǾֲ¿µÄ
3. ÄÚ²¿±äÁ¿£º
3.1 ÓÀÔ¶±»¶¨Ò壨ȫ¾Ö±äÁ¿£©
±äÁ¿Ãû³Æ 4 / 42
ʾÀýÖµ