dropout是什么意思 如何理解dropout
\u5982\u4f55\u7406\u89e3dropoutdropout voltage \u56de\u52a8\u7535\u538b;
\u7535\u6e90\u7535\u538b\u5373\u7535\u52a8\u52bf\uff0c\u8def\u7aef\u7535\u538b\u5373\u7535\u52a8\u52bf\u51cf\u53bb\u7535\u6e90\u7684\u5185\u538b\uff0c\u5373\u5916\u7535\u8def\u7684\u7535\u538b\u3002
\u7535\u6e90\u7535\u538b\u4e00\u822c\u4e0d\u53d8\uff0c\u8def\u7aef\u7535\u538b\u6839\u636e\u7535\u6e90\u7684\u5185\u963b\u6765\u5b9a\u3002
\u6240\u8bf4\u7684\u7535\u6e90\u7535\u538b\u5176\u5b9e\u5c31\u662f\u8def\u7aef\u7535\u538b\u4e86\uff0c\u4e0d\u77e5\u9053\u4f60\u95ee\u7684\u662f\u4e0d\u662f\u7535\u52a8\u52bf\u4e0e\u8def\u7aef\u7535\u538b\u7684\u95ee\u9898\uff0c\u56e0\u4e3a\u5728\u9ad8\u4e8c\u9636\u6bb5\u8fd9\u4e24\u4e2a\u6982\u5ff5\u4f1a\u5f88\u5bb9\u6613\u6df7
\u7535\u52a8\u52bf\u5c31\u662f\u521a\u624d\u8bf4\u7684\u90a3\u4e2a\u7eaf\u7535\u6e90\u7684\u7535\u538b\uff08\u53ea\u662f\u7406\u89e3\u6210\u8fd9\u6837\uff0c\u4e0d\u662f\u6982\u5ff5\uff09
\u5185\u90e8\u7684\u7535\u963b\u8ddf\u5916\u90e8\u7535\u8def\u4e00\u5b9a\u662f\u4e32\u8054\u5173\u7cfb\uff0c\u4e32\u8054\u5206\u538b\uff0c\u65bd\u52a0\u5728\u5916\u90e8\u7535\u8def\u7684\u7535\u538b\u5c31\u662f\u8def\u7aef\u7535\u538b\uff0c\u6216\u8005\u8bf4\u7535\u6e90\u7535\u538b
\u81f3\u4e8e\u95ed\u5408\u7535\u8def\u7535\u6d41\uff0c\u7531\u5185\u963br\uff0c\u5916\u90e8\u7535\u963bR\u548c\u7535\u52a8\u52bfE\u51b3\u5b9a\uff0c\u5373I=E/(r+R),\u518d\u7531U=IR\u5f97\u5230\u8def\u7aef\u7535\u538b\uff08\u95ed\u5408\u7535\u8def\u6b27\u59c6\u5b9a\u5f8b\uff09
\u5f00\u7bc7\u660e\u4e49\uff0cdropout\u662f\u6307\u5728\u6df1\u5ea6\u5b66\u4e60\u7f51\u7edc\u7684\u8bad\u7ec3\u8fc7\u7a0b\u4e2d\uff0c\u5bf9\u4e8e\u795e\u7ecf\u7f51\u7edc\u5355\u5143\uff0c\u6309\u7167\u4e00\u5b9a\u7684\u6982\u7387\u5c06\u5176\u6682\u65f6\u4ece\u7f51\u7edc\u4e2d\u4e22\u5f03\u3002\u6ce8\u610f\u662f\u6682\u65f6\uff0c\u5bf9\u4e8e\u968f\u673a\u68af\u5ea6\u4e0b\u964d\u6765\u8bf4\uff0c\u7531\u4e8e\u662f\u968f\u673a\u4e22\u5f03\uff0c\u6545\u800c\u6bcf\u4e00\u4e2amini-batch\u90fd\u5728\u8bad\u7ec3\u4e0d\u540c\u7684\u7f51\u7edc\u3002
dropout\u662fCNN\u4e2d\u9632\u6b62\u8fc7\u62df\u5408\u63d0\u9ad8\u6548\u679c\u7684\u4e00\u4e2a\u5927\u6740\u5668\uff0c\u4f46\u5bf9\u4e8e\u5176\u4e3a\u4f55\u6709\u6548\uff0c\u5374\u4f17\u8bf4\u7eb7\u7ead\u3002\u5728\u4e0b\u8bfb\u5230\u4e24\u7bc7\u4ee3\u8868\u6027\u7684\u8bba\u6587\uff0c\u4ee3\u8868\u4e24\u79cd\u4e0d\u540c\u7684\u89c2\u70b9\uff0c\u7279\u6b64\u5206\u4eab\u7ed9\u5927\u5bb6\u3002
\u7ec4\u5408\u6d3e
\u53c2\u8003\u6587\u732e\u4e2d\u7b2c\u4e00\u7bc7\u4e2d\u7684\u89c2\u70b9\uff0cHinton\u8001\u5927\u7237\u63d0\u51fa\u6765\u7684\uff0c\u5173\u4e8eHinton\u5728\u6df1\u5ea6\u5b66\u4e60\u754c\u7684\u5730\u4f4d\u6211\u5c31\u4e0d\u518d\u8d58\u8ff0\u4e86\uff0c\u5149\u662f\u8fd9\u5730\u4f4d\uff0c\u4f30\u8ba1\u8fd9\u4e00\u6d3e\u7684\u89c2\u70b9\u5c31\u662f\u201c\u6b66\u5f53\u5c11\u6797\u201d\u4e86\u3002\u6ce8\u610f\uff0c\u6d3e\u540d\u662f\u6211\u81ea\u5df1\u8d77\u7684\uff0c\u5404\u4f4d\u52ff\u7b11\u3002
\u89c2\u70b9
\u8be5\u8bba\u6587\u4ece\u795e\u7ecf\u7f51\u7edc\u7684\u96be\u9898\u51fa\u53d1\uff0c\u4e00\u6b65\u4e00\u6b65\u5f15\u51fadropout\u4e3a\u4f55\u6709\u6548\u7684\u89e3\u91ca\u3002\u5927\u89c4\u6a21\u7684\u795e\u7ecf\u7f51\u7edc\u6709\u4e24\u4e2a\u7f3a\u70b9\uff1a
\u8d39\u65f6
\u5bb9\u6613\u8fc7\u62df\u5408
\u8fd9\u4e24\u4e2a\u7f3a\u70b9\u771f\u662f\u62b1\u5728\u6df1\u5ea6\u5b66\u4e60\u5927\u817f\u4e0a\u7684\u4e24\u4e2a\u5927\u5305\u88b1\uff0c\u4e00\u5de6\u4e00\u53f3\uff0c\u76f8\u5f97\u76ca\u5f70\uff0c\u989d\u4e0d\uff0c\u81ed\u6c14\u76f8\u6295\u3002\u8fc7\u62df\u5408\u662f\u5f88\u591a\u673a\u5668\u5b66\u4e60\u7684\u901a\u75c5\uff0c\u8fc7\u62df\u5408\u4e86\uff0c\u5f97\u5230\u7684\u6a21\u578b\u57fa\u672c\u5c31\u5e9f\u4e86\u3002\u800c\u4e3a\u4e86\u89e3\u51b3\u8fc7\u62df\u5408\u95ee\u9898\uff0c\u4e00\u822c\u4f1a\u91c7\u7528ensemble\u65b9\u6cd5\uff0c\u5373\u8bad\u7ec3\u591a\u4e2a\u6a21\u578b\u505a\u7ec4\u5408\uff0c\u6b64\u65f6\uff0c\u8d39\u65f6\u5c31\u6210\u4e3a\u4e00\u4e2a\u5927\u95ee\u9898\uff0c\u4e0d\u4ec5\u8bad\u7ec3\u8d77\u6765\u8d39\u65f6\uff0c\u6d4b\u8bd5\u8d77\u6765\u591a\u4e2a\u6a21\u578b\u4e5f\u5f88\u8d39\u65f6\u3002\u603b\u4e4b\uff0c\u51e0\u4e4e\u5f62\u6210\u4e86\u4e00\u4e2a\u6b7b\u9501\u3002
Dropout\u7684\u51fa\u73b0\u5f88\u597d\u7684\u53ef\u4ee5\u89e3\u51b3\u8fd9\u4e2a\u95ee\u9898\uff0c\u6bcf\u6b21\u505a\u5b8cdropout\uff0c\u76f8\u5f53\u4e8e\u4ece\u539f\u59cb\u7684\u7f51\u7edc\u4e2d\u627e\u5230\u4e00\u4e2a\u66f4\u7626\u7684\u7f51\u7edc\uff0c\u5982\u4e0b\u56fe\u6240\u793a\uff1a
\u56e0\u800c\uff0c\u5bf9\u4e8e\u4e00\u4e2a\u6709N\u4e2a\u8282\u70b9\u7684\u795e\u7ecf\u7f51\u7edc\uff0c\u6709\u4e86dropout\u540e\uff0c\u5c31\u53ef\u4ee5\u770b\u505a\u662f2n\u4e2a\u6a21\u578b\u7684\u96c6\u5408\u4e86\uff0c\u4f46\u6b64\u65f6\u8981\u8bad\u7ec3\u7684\u53c2\u6570\u6570\u76ee\u5374\u662f\u4e0d\u53d8\u7684\uff0c\u8fd9\u5c31\u89e3\u8131\u4e86\u8d39\u65f6\u7684\u95ee\u9898\u3002
\u52a8\u673a\u8bba
英 ['drɒpaʊt]
美 ['drɑpaʊt]
n. 中途退学；
辍学学生
绛旓細dropoff鍑忓急锛屽噺灏dropout閫鍑猴紝绂婚槦dropby/in椤轰究鏉ヨdroplitter鎵斿瀮鍦綿ropon璁枼锛屾儵缃氫富瑕佽瘝姹囷細drop鑻盵dr?p]缇嶽dr蓱?p]vt.钀戒笅锛涜穼鍊掞紱涓嬮檷锛涙斁寮冿紱婕忔帀锛涙柇缁濆叧绯伙紱n.婊达紱寰噺锛涘噺灏戯紱婊寸姸鐗╄繃鍘诲紡:dropped杩囧幓鍒嗚瘝:dropped璇嶈鐢ㄦ硶v.(鍔ㄨ瘝)drop鐨勫熀鏈鎰忔鏄滆惤涓嬧濃滄姇涓嬧,琛ㄧず鏌愮墿浣撲互鍨傜洿...
绛旓細闄ゆ涔嬪锛屽湪闊╄涓紝DK杩樻湁鈥滆钂欏湪榧撻噷鈥濈殑鎰忔銆傚畠鍙互鐢ㄦ潵鎻忚堪鏌愪汉琚楠椼佽闅愮瀿鐪熺浉鐨勬儏鍐点備緥濡傦紝鈥滀粬涓鐩碊K浠栧コ鍙嬬殑鐪熷疄缁忓巻鈥濄傚彟澶栵紝鍦ㄩ煩鍥界殑涓浜涢珮鏍￠噷锛孌K涔熻鐢ㄤ綔鈥滅己甯濈殑鎰忔濄傝繖鍙兘鏄洜涓篋K涓"Dropout"锛堥瀛︼級鐨勯瀛楁瘝鐩稿悓鎵瀵艰嚧鐨勩傚湪杩欑鎯呭喌涓嬶紝瀛︾敓鍙兘鍥犱负鏌愮鍘熷洜娌¤兘鍙婃椂鍒...
绛旓細鎺夊悜鎸囪皟杞柟鍚戣浆寮皟鍚戯紝杩峰け鏂瑰悜銆傛帀鍚戣嫳璇炕璇憈o adjust one's direction锛宼o lose one's bearings锛宼o turn銆傛帀鍚戣繎涔夎瘝锛1銆佹帀鍖咃細鏆椾腑鐢ㄥ亣鐨勬崲鐪熺殑鎴栫敤鍧忕殑鎹㈠ソ鐨勶細锝炶銆備粬鐨勪笢瑗垮彨浜烘帀浜嗗寘銆備篃浣滆皟鍖呫2銆佹帀绉わ細鎶橈紙sh茅锛夌Г銆3銆佹帀闃燂細[dropout;fallbehind]钀藉湪闃熶紞鐨勫悗闈傛瘮鍠昏窡涓嶄笂...
绛旓細Low Dropout Voltage Regulator鏄粈涔堟剰鎬 棣栭〉 闂 鍏ㄩ儴闂 缁忔祹閲戣瀺 浼佷笟绠＄悊 娉曞緥娉曡 绀句細姘戠敓 绉戝鏁欒偛 鍋ュ悍鐢熸椿 浣撹偛杩愬姩 鏂囧寲鑹烘湳 鐢靛瓙鏁扮爜 鐢佃剳缃戠粶 濞变箰浼戦棽 琛屾斂鍦板尯 蹇冪悊鍒嗘瀽 鍖荤枟鍗敓 绮鹃 鐭ラ亾涓撴爮 鐭ラ亾鏃ユ姤 鐭ラ亾澶ф暟鎹 鐭ラ亾闈為仐 鐢ㄦ埛 鐭ラ亾鍚堜紮浜 鑺濋夯鍥 鑺濋夯灏 ...
绛旓細internet dropout 鎸囦簰鑱旂綉杩炴帴涓柇 internet dropouts 鍒欐槸鐗规畩鍚嶈瘝锛屾寚鍘熷厛浣跨敤缃戠粶锛屼絾鐜板湪鍑轰簬鍚勭鍘熷洜涓嶅啀浣跨敤銆傛鍚嶈瘝鍑鸿嚜銆婂墤妗ュ浗闄呰嫳璇暀绋嬨2绾 P46
绛旓細鎺塤鐨勫叿浣撹В閲鏄粈涔鍛紝鎴戜滑閫氳繃浠ヤ笅鍑犱釜鏂归潰涓烘偍浠嬬粛锛氫竴銆佸浗璇瘝鍏搞愮偣姝ゆ煡鐪嬭鍒掕缁嗗唴瀹广戣惤鍦ㄩ槦浼嶅悗闈紝璺熶笉涓婇槦浼嶃傚锛氥屽姞蹇剼姝ワ紝鎵嶄笉浼氭帀闃熴傘嶈瘝璇炕璇戣嫳璇璽ofallbehind,todropout娉曡tomberenarri猫re,selaisserdistancer浜屻佺綉缁滆В閲婃帀闃焄dropout;fallbehind]钀藉湪闃熶紞鐨勫悗闈傛瘮鍠昏窡涓嶄笂鏃朵唬鎴...
绛旓細(1)钀藉湪闃熶紞鐨勫悗闈傛瘮鍠昏窡涓嶄笂鏃朵唬鎴栬揪涓嶅埌瑕佹眰鐨勬按骞炽傛帀闃熺殑璇嶈瑙ｉ噴鏄細鎺夐槦di脿odu矛銆(1)钀藉湪闃熶紞鐨勫悗闈傛瘮鍠昏窡涓嶄笂鏃朵唬鎴栬揪涓嶅埌瑕佹眰鐨勬按骞炽傜粨鏋勬槸锛氭帀(宸﹀彸缁撴瀯)闃(宸﹀彸缁撴瀯)銆傛嫾闊虫槸锛歞i脿odu矛銆傝瘝鎬ф槸锛氬姩璇嶃傛敞闊虫槸锛氥剦涓銊燺銊夈劏銊焈銆傛帀闃熺殑鍏蜂綋瑙ｉ噴鏄粈涔鍛紝鎴戜滑閫氳繃浠ヤ笅鍑犱釜鏂归潰...
绛旓細浣庢紡澶辩數鍘媀dropout锛 缁存寔绋冲帇鍣ㄦ甯稿伐浣滅殑鎯呭喌涓嬶紝鏈灏忕殑杈撳叆鐢靛帇 鍑忓幓 杈撳嚭鐢垫簮鐨 宸笺 绠绉癡DO.鐩墠鍋氬埌鏈浣庣殑鏄 璐熻浇1mA鏃讹紝V杈撳叆-V杈撳嚭 < 0.4mV锛 褰撹礋杞300mA, V杈撳叆-V杈撳嚭< 120mV. 姣斿锛歨t71xx ,璐熻浇1mA鏃讹紝V杈撳叆-V杈撳嚭 < 60mV 鑰屽父鐢 LM1117 鑺墖 锛屽畼鏂规暟鎹槸 璐熻浇1A...
绛旓細璁烘枃涓殑鍥惧涓嬶紙瀹冭〃杈剧殑鎰忔灏辨槸鍙互鎷熷悎浠绘剰鍑稿嚱鏁帮紝褰撶劧涔熷寘鎷簡ReLU浜嗭級锛2銆丮axout涓嶥ropout Dropout鏄涓绉嶇綉缁滆鍒欏寲鎶宸э紝鍏跺疄瀹冨氨鏄浉褰撲簬鍦ㄨ缁冨緢澶氫釜涓嶅悓鐨勭綉缁滅粨鏋勶紝灏界濡傛锛屾帹鐞嗛樁娈垫墍鏈変笉鍚岀粨鏋勭殑鍙傛暟渚濈劧鏄叡浜殑锛屽洜涓哄疄闄呬笂鍙湁涓涓綉缁滃瓨鍦ㄣ傚湪鏈哄櫒瀛︿範绠楁硶涓紝鏈変竴涓蹇靛彨鍋歜agging锛...
绛旓細2. 椋熺⒈灞炰簬鏃犳満鐗╋紝鏈韩娌℃湁浠涔钀ュ吇鎴愬垎锛屼絾鍦ㄩ鍝佺児璋冧腑鐨勪綔鐢ㄥ嵈涓嶅彲浣庝及锛岄纰辩殑姘存憾娑叉槸鐢佃В璐紝鍙娇椋熷搧鍘熸枡(濡傞笨楸)涓殑铔嬬櫧璐ㄥ垎瀛愬惛姘磋兘鍔涘寮猴紝鍔犲揩鍘熸枡鐨勬定鍙戦熷害锛屼絾瑕佹敞鎰忔帉鎻″ソ鐢ㄧ⒈鏁伴噺銆佹柟娉曞拰鏃堕棿锛屼互闃查鐗╁師鏂欏彂寰楄繃閫忋佽繃鐑傜敋鑷冲彉璐ㄣ
