Google½Ķ¤£©È´c§@¼@ §O·Q¿n«D¦¨¬O

2017-05-04 393

Google¥xÆW¸³¨ÆÁ`¸g²z²¥ß®p»¡¡AGoogle½Ķ¤ñ¥H«e¦n¥Î¤Ó¦h¤F¡I´Nºâ¦³¤H´c§@¼@¡A¨è·N¦b´£¥X­×§ï«ØijÄæ¦ì¼g¤U¿ùªºÂ½Ä¶¡A¤]¤£·|¼vÅT¨t²Îªº¹B§@¡C

¤¤¥¡ªÀ³ø¾É¡AGoogle¥xÆW¸³¨ÆÁ`¸g²z²¥ß®p»¡¡AGoogle½Ķ¤ñ¥H«e¦n¥Î¤Ó¦h¤F¡I´Nºâ¦³¤H´c§@¼@¡A¨è·N¦b¡u´£¥X­×§ï«Øij¡vÄæ¦ì¼g¤U¿ùªºÂ½Ä¶¡A¤]¤£·|¼vÅT¨t²Îªº¹B§@¡C

²¥ß®p¸ÑÄÀ¡AGoogle½Ķ¦³¾Ç²ß¤Î¸ê®Æ®wªº¥\¯à¡A¤£Â_²Ö¿n¸gÅç¡A¿ù»~¤]¬O¤@ºØ¸gÅç¡A°£«D´X¥G©Òªº¤H³£¦b¡u­×§ï«Øij¡vÄæ¼g¤U¤@¼Ò¤@¼Ëªº¿ù»~¡A¤~·|¿n«D¦¨¬O¡A¦ý¨Æ¹ê¤W³oºØ±¡ªp¨Ã¤£¥i¯àµo¥Í¡C

¥L»{¬°¡AÁöµM²Å餤¤å¡BÁcÅ餤¤å¦³¨Ç¬Û¦Pªº¦rµü¦³µÛ¤£¦Pªº·N¸q¡A©Î¬Û¦Pªº¦r¤w­l¥Í¥X·sªº·N¸q¡A¦ý¦]²Åé¡BÁcÅ餤¤å»yªk¬Û¦P¡A¦b¾÷¾¹Â½Ä¶¤W¤´±Ä¥Î¤@®M¨t²Î¡A¥iµø¬°±M¦³¦Wµü¡A³z¹L¾Ç²ß«Ø¥ß¸ê®Æ®w¨Ó®Õ¥¿¡C

¨ä¹ê¤£¥u²Å餤¤å¡BÁcÅ餤¤åªº»yªk¬Û¦P¡A¥L³zÅS¡A¤é¤å¡BÁú¤å¦b¾÷¾¹Â½Ä¶¤W¤]¥iºâ¬O»yªk¬Û¦P¡A¥Î¦P¤@®M¨t²Î¡C

¥L«ü¥X¡A¾÷¾¹¾Ç²ß¬O«Ü­«­nªºÄ³ÃD¡A¤j®a¦b°Q½×Google½Ķªº¾Ç²ß¥\¯à¤§»Ú¡A¤]·|Áp·Q¨ì¤H¤u¹q¸£AlphaGo¥´±Ñ¯u¤H¥@¬É´Ñ¤ý¡C²{¦b¤]¦³¤H´£¥XÅýAlphaGo¥´AlphaGo¡A¾Ç²ß¯à¤O¥i¥H§ó§Öªº»¡ªk¡A´N¹³¬Oª÷±e¤p»¡¡uµØ¤s½×¼C¡v¸Ì¥þ¯u¬£ªº©P§B³q¡A¥Î¦Û¤vªº¥ª¤â©M¥k¤â¹ï¥´¡A¨Ï¥Xªº¡u¥ª¥k¤¬·i¡v¡C

Google½Ķªºµo®i¶iµ{§Ö³t¡A10¦~«e¡AGoogle±À¥X½ĶªA°È¡A¨Ã¥H¤ù»y¦¡¾÷¾¹Â½Ä¶¡]Phrase-Based Machine Translation¡^§@¬°¥D­n¹Bºâ¤è¦¡¡C±q¹L¥h¶È¤ä´©´XºØ»y¨¥¡A¨ì²{¦b¥i¤ä´©103ºØ»y¨¥¡A¥B¨C¤Ñ½Ķ¶W¹L1400»õ­Ó³æµü¡AGoogle½Ķªº«~½è¦³¤F«Ü¤jªº¶i®i¡C

¼Æ¦~«e¡AGoogle±Ä¥Î»¼Âk¯«¸gºôµ¸¡]Recurrent Neural Networks¡^±N¥y¤lµø¬°¤@­Ó³æ¦ì¶i¦æ½Ķ¡A¤§«áªº¤ù»y¦¡¾÷¾¹Â½Ä¶¤è¦¡¡]PBMT¡^¡A«h¬O±N¥y¤l¤Á³Î¦¨³æ¿Wªº¦r©Mµü²Õ°µ¿W¥ß½Ķ¡C

¹L¥h¡A¬°Â½Ä¶¥ô·N¨âºØ»y¨¥¡AGoogle»Ý­n«Øºc¦h­Ó¤£¦PªºÂ½Ä¶¨t²Î¡A¹Bºâ¦¨¥»¬Û·í¥iÆ[¡C¬Û¸û©ó¹L¥hªº¤ù»y¾÷¾¹¾Ç²ß¡]PBMT¡^¡A¯«¸g¾÷¾¹Â½Ä¶¡]NMT¡^¶È»Ý­n¸û¤Öªº¨t²Î¬[ºc³]­p¡C­è¶}©l±À¥X¯«¸g¾÷¾¹Â½Ä¶®É¡A³o¨âºØ½Ķ¤è¦¡ªººë·Ç«×¤£¬Û¤W¤U¡C

¬°§ïµ½NMT½Ķ«~½è¡A¬ã¨s¤H­û´£¥X³\¦h§Þ³N¨Ó¸Ñ¨M¡A³o·í¤¤¥]¬A³z¹L¼ÒÀÀ½Õ®Õ¼Ò«¬(external alignment model) ³B²z¨u¨£¦rµü¡B¨Ï¥Î¡uª`·N¡v(attention)¨Ó¹ï·Ç¿é¤Jµü©M¿é¥Xµü¡A¥H¤Î±Nµü©î¸Ñ¦¨§ó¤pªº³æ¤¸¥HÀ³¹ï¨u¨£¦rµüµ¥¡C

Google¯«¸g¾÷¾¹Â½Ä¶(GNMT)±N¤¤¤å¥y¤l½Ķ¦¨­^¤å¥y¤lªº¹Lµ{¡A³z¹L½s½X¾¹ (Encoder)¡A­º¥ý¡AGNMT±N¤¤¤å¥y¤lªº¨C¤@­Ó³æµü¶i¦æ¦V¶q(vector)½s½X¡A¦Ó¨C­Ó¦V¶q±NÅã¥Ü¥X¥Ø«e¬°¤î³æµü³QŪ¨ú¨ìªº©Ò¦³·N¸q¡C

¦bŪ¨ú§¹¾ã¥y¤l«á¡A¸Ñ½X¾¹(Decoder)´N·|¶}©l¹B§@¡A¤@¦¸²£¥Í¤@­Ó­^»y¥y¤l¤¤ªº¤@­Óµü¡C

ª`·N (Attention)¥\¯à¬O¬°¤F¨C¤@¨B³£²£¥X¥¿½Tªºµü¡A¸Ñ½X¾¹±N°w¹ï½s½X¤¤¤å¦V¶q¸Ì³Ì¬ÛÃöªº­^¤å³æµüÅv­«¤À¥¬(weighted distribution)¶i¦æ¸Ñ½X¡C
¡i¹Ï¤ù¨Ó·½¡G¤¤¥¡ªÀ¡j

ment,'script','//www.google-analytics.com/analytics.js','ga'); ga('create', 'UA-35937129-1', 'auto'); ga('send', 'pageview');