{"id":3326,"date":"2022-02-27T15:02:26","date_gmt":"2022-02-27T07:02:26","guid":{"rendered":"https:\/\/egonlin.com\/?p=3326"},"modified":"2022-02-27T15:02:26","modified_gmt":"2022-02-27T07:02:26","slug":"%e7%ac%ac%e4%ba%8c%e7%af%87%ef%bc%9a-%e6%a2%af%e5%ba%a6%e4%b8%8b%e9%99%8d%e6%b3%95","status":"publish","type":"post","link":"https:\/\/egonlin.com\/?p=3326","title":{"rendered":"\u7b2c\u4e8c\u7bc7\uff1a \u68af\u5ea6\u4e0b\u964d\u6cd5"},"content":{"rendered":"<h1>\u68af\u5ea6\u4e0b\u964d\u6cd5<\/h1>\n<p>&emsp;&emsp;\u5728\u6c42\u89e3\u673a\u5668\u5b66\u4e60\u7b97\u6cd5\u6a21\u578b\u53c2\u6570\u7684\u65f6\u5019\uff0c\u68af\u5ea6\u4e0b\u964d\u6cd5\uff08gradient descent\uff09\u548c\u6700\u5c0f\u4e8c\u4e58\u6cd5\uff08least squares\uff09\u662f\u6700\u7ecf\u5e38\u4f7f\u7528\u7684\u65b9\u6cd5\uff0c\u7531\u4e8e\u68af\u5ea6\u4e0b\u964d\u6cd5\u884d\u751f\u51fa\u7684\u5206\u652f\u8f83\u591a\uff0c\u6240\u4ee5\u5728\u8fd9\u91cc\u5bf9\u68af\u5ea6\u4e0b\u964d\u6cd5\u5355\u72ec\u505a\u4e00\u4e2a\u603b\u7ed3\u3002<\/p>\n<h1>\u68af\u5ea6\u4e0b\u964d\u6cd5\u8be6\u89e3<\/h1>\n<h2>\u68af\u5ea6<\/h2>\n<p>&emsp;&emsp;\u68af\u5ea6\u662f\u5728\u5fae\u79ef\u5206\u4e2d\u5bf9\u591a\u5143\u51fd\u6570\u7684\u5404\u4e2a\u53c2\u6570\u6c42\u504f\u5bfc\u6570\uff0c\u5e76\u4e14\u628a\u6c42\u5f97\u7684\u5404\u4e2a\u53c2\u6570\u7684\u504f\u5bfc\u6570\u7528\u5411\u91cf\u7684\u5f62\u5f0f\u8868\u8fbe\u51fa\u6765\u3002<\/p>\n<p>&emsp;&emsp;\u4f8b\u5982\u51fd\u6570$L(\\omega,b)$\uff0c\u5206\u522b\u5bf9$\\omega$\u548c$b$\u6c42\u504f\u5bfc\u6570\uff0c\u68af\u5ea6\u5411\u91cf\u5c31\u662f$({\\frac{\\partial{L}}{\\partial{\\omega}}},{\\frac{\\partial{L}}{\\partial{b}}})^T$\uff0c\u7b80\u79f0$grad{L(\\omega,b)}$\u6216\u8005$\\nabla{L(\\omega,b)}$\u3002\u5bf9\u4e8e\u67d0\u4e2a\u5177\u4f53\u7684\u70b9$(\\omega_i,b_i)$\u7684\u5177\u4f53\u68af\u5ea6\u5411\u91cf\u5c31\u662f$({\\frac{\\partial{L}}{\\partial{\\omega_i}}},{\\frac{\\partial{L}}{\\partial{b_i}}})^T$\u6216\u8005$\\nabla{L(\\omega_i,b_i)}$\uff0c\u5982\u679c\u662f\u591a\u53c2\u6570\u7684\u51fd\u6570\u5219\u662f$({\\frac{\\partial{L}}{\\partial{x}}},{\\frac{\\partial{L}}{\\partial{y}}},{\\frac{\\partial{L}}{\\partial{z}}})^T$\u3002<\/p>\n<h2>\u68af\u5ea6\u4e0b\u964d\u6cd5\u548c\u68af\u5ea6\u4e0a\u5347\u6cd5<\/h2>\n<p>&emsp;&emsp;\u5728\u673a\u5668\u5b66\u4e60\u7b97\u6cd5\u4e2d\uff0c\u5982\u679c\u9700\u8981\u6700\u5c0f\u5316\u76ee\u6807\u51fd\u6570\u65f6\uff0c\u5219\u53ef\u4ee5\u901a\u8fc7\u68af\u5ea6\u4e0b\u964d\u6cd5\u4e00\u6b65\u4e00\u6b65\u7684\u8fed\u4ee3\u6c42\u89e3\uff0c\u5f97\u5230\u6700\u5c0f\u5316\u7684\u76ee\u6807\u51fd\u6570\u548c\u6a21\u578b\u53c2\u6570\u503c\uff1b\u5982\u679c\u8981\u6700\u5927\u5316\u76ee\u6807\u51fd\u6570\u65f6\uff0c\u5219\u53ef\u4ee5\u901a\u8fc7\u68af\u5ea6\u4e0a\u5347\u6cd5\u8fed\u4ee3\u6c42\u89e3\u3002<\/p>\n<p>&emsp;&emsp;\u68af\u5ea6\u4e0b\u964d\u7b97\u6cd5\u548c\u68af\u5ea6\u4e0a\u5347\u6cd5\u4e4b\u95f4\u4e5f\u53ef\u4ee5\u4e92\u76f8\u8f6c\u5316\uff0c\u53ef\u4ee5\u901a\u8fc7\u68af\u5ea6\u4e0b\u964d\u8fed\u4ee3\u6700\u5c0f\u5316\u76ee\u6807\u51fd\u6570\uff0c\u540c\u65f6\u4e5f\u53ef\u4ee5\u53cd\u5411\u68af\u5ea6\u4e0a\u5347\u8fed\u4ee3\u6700\u5c0f\u5316\u76ee\u6807\u51fd\u6570\uff1b\u540c\u7406\u4e5f\u53ef\u4ee5\u53cd\u5411\u68af\u5ea6\u4e0b\u964d\u8fed\u4ee3\u6700\u5927\u5316\u76ee\u6807\u51fd\u6570\u3002<\/p>\n<h2>\u68af\u5ea6\u4e0b\u964d<\/h2>\n<p>&emsp;&emsp;\u5047\u8bbe\u6211\u4eec\u5904\u5728\u67d0\u5ea7\u4e0d\u77e5\u540d\u7684\u5927\u5c71\u4e0a\u7684\u67d0\u5904\u4f4d\u7f6e\uff0c\u7531\u4e8e\u6211\u4eec\u4e0d\u77e5\u9053\u8be5\u600e\u4e48\u4e0b\u5c71\uff0c\u4e8e\u662f\u51b3\u5b9a\u8d70\u4e00\u6b65\u7b97\u4e00\u6b65\uff0c\u5373\u6bcf\u8d70\u5230\u4e00\u4e2a\u4f4d\u7f6e\u7684\u65f6\u5019\u4fbf\u6c42\u89e3\u5f53\u524d\u4f4d\u7f6e\u7684\u68af\u5ea6\uff0c\u6cbf\u7740\u68af\u5ea6\u7684\u8d1f\u65b9\u5411\u5373\u5f53\u524d\u6700\u9661\u5ced\u7684\u4f4d\u7f6e\u5411\u4e0b\u8d70\u4e00\u6b65\uff0c\u7136\u540e\u7ee7\u7eed\u6c42\u89e3\u5f53\u524d\u4f4d\u7f6e\u7684\u68af\u5ea6\u2026\u2026\u76f4\u5230\u6211\u4eec\u8ba4\u4e3a\u6211\u4eec\u5df2\u7ecf\u5230\u4e86\u5c71\u811a\u624d\u505c\u4e0b\u6765\u3002\u4ece\u4e0b\u56fe\u53ef\u4ee5\u770b\u51fa\uff0c\u901a\u8fc7\u8be5\u65b9\u6cd5\u6211\u4eec\u6709\u53ef\u80fd\u8d70\u5230\u4e86\u8fd9\u5ea7\u5927\u5c71\u7684\u67d0\u4e00\u4e2a\u5c40\u90e8\u7684\u6700\u4f4e\u5904(\u5c71\u8170\u5904)\uff0c\u800c\u6ca1\u6709\u8d70\u5230\u771f\u6b63\u7684\u5c71\u811a\u3002<\/p>\n<p><div class='fancybox-wrapper lazyload-container-unload' data-fancybox='post-images' href='https:\/\/egonlin.com\/wp-content\/uploads\/2022\/02\/\u68af\u5ea6\u4e0b\u964d\u6cd5-\u4e0b\u5c71\u5b9e\u4f8b\u89e3\u91ca\u68af\u5ea6\u4e0b\u964d.jpg'><img class=\"lazyload lazyload-style-2\" src=\"data:image\/svg+xml;base64,PCEtLUFyZ29uTG9hZGluZy0tPgo8c3ZnIHdpZHRoPSIxIiBoZWlnaHQ9IjEiIHhtbG5zPSJodHRwOi8vd3d3LnczLm9yZy8yMDAwL3N2ZyIgc3Ryb2tlPSIjZmZmZmZmMDAiPjxnPjwvZz4KPC9zdmc+\"  data-original=\"https:\/\/egonlin.com\/wp-content\/uploads\/2022\/02\/\u68af\u5ea6\u4e0b\u964d\u6cd5-\u4e0b\u5c71\u5b9e\u4f8b\u89e3\u91ca\u68af\u5ea6\u4e0b\u964d.jpg\" src=\"data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAJcEhZcwAADsQAAA7EAZUrDhsAAAANSURBVBhXYzh8+PB\/AAffA0nNPuCLAAAAAElFTkSuQmCC\" alt=\"\" \/><\/div><\/p>\n<p>&emsp;&emsp;\u4ece\u4e0b\u5c71\u8fd9\u4e2a\u5b9e\u4f8b\u4e2d\u53ef\u4ee5\u5f97\u51fa\uff1a\u68af\u5ea6\u4e0b\u964d\u4e0d\u4e00\u5b9a\u80fd\u591f\u627e\u5230\u5168\u5c40\u7684\u6700\u4f18\u89e3\uff0c\u6709\u53ef\u80fd\u4f1a\u627e\u5230\u5c40\u90e8\u6700\u4f18\u89e3\u3002<\/p>\n<p>&emsp;&emsp;\u4f46\u662f\u5982\u679c\u4ee3\u4ef7\u51fd\u6570\u4e3a\u51f8\u51fd\u6570\u7684\u65f6\u5019\u68af\u5ea6\u4e0b\u964d\u5f97\u5230\u7684\u5219\u4e00\u5b9a\u662f\u5168\u5c40\u6700\u4f18\u89e3\u3002<\/p>\n<h2>\u76f8\u5173\u6982\u5ff5<\/h2>\n<h3>\u6b65\u957f<\/h3>\n<p>&emsp;&emsp;\u6b65\u957f\u51b3\u5b9a\u4e86\u68af\u5ea6\u4e0b\u964d\u8fed\u4ee3\u7684\u65f6\u5019\u6bcf\u4e00\u6b65\u6cbf\u68af\u5ea6\u8d1f\u65b9\u5411\u524d\u8fdb\u7684\u957f\u5ea6\uff0c\u4e0b\u5c71\u5b9e\u4f8b\u4e2d\u5219\u8868\u793a\u6bcf\u4e00\u6b65\u7684\u957f\u5ea6\u3002<\/p>\n<p>&emsp;&emsp;\u5982\u679c\u6b65\u957f\u8fc7\u957f\uff0c\u5219\u53ef\u80fd\u4f1a\u9519\u8fc7\u6700\u4f18\u89e3\uff1b\u5982\u679c\u6b65\u957f\u8fc7\u5c0f\uff0c\u8fed\u4ee3\u901f\u5ea6\u4f1a\u53d8\u6162\uff0c\u5f88\u957f\u65f6\u95f4\u7b97\u6cd5\u90fd\u4e0d\u4f1a\u7ed3\u675f\u3002\u56e0\u6b64\u53ef\u4ee5\u4ece\u5927\u5230\u5c0f\u7684\u5c1d\u8bd5\u6b65\u957f\u7684\u5927\u5c0f\uff0c\u5982\u679c\u76ee\u6807\u51fd\u6570\u503c\u5728\u53d8\u5c0f\uff0c\u8bf4\u660e\u53d6\u503c\u6709\u6548\uff0c\u5426\u5219\u9700\u8981\u589e\u5927\u6b65\u957f\u3002<\/p>\n<h3>\u5047\u8bbe\u51fd\u6570<\/h3>\n<p><\/p><div id=\"rml_readmorelogin_placeholder\" style=\"position:relative;\"><div id=\"rml_fade_content\" style=\"position: absolute;\r\ntop:-10em;\r\nwidth:100%;\r\nheight:10em;\r\nbackground: -webkit-linear-gradient(rgba(255, 255, 255, 0) 0%,#ffffff 100%);\r\nbackground-image: -moz-linear-gradient(rgba(255, 255, 255, 0) 0%,#ffffff 100%);\r\nbackground-image: -o-linear-gradient(rgba(255, 255, 255, 0) 0%,#ffffff 100%);\r\nbackground-image: linear-gradient(rgba(255, 255, 255, 0) 0%,#ffffff 100%);\r\nbackground-image: -ms-linear-gradient(rgba(255, 255, 255, 0) 0%,#ffffff 100%);\"><\/div><div class=\"wpf-controller aru_rml_from_in_post\" style=\"background-color:#eeeeee;border:5px solid #cce6ff;\" id=\"ARU_ReadMoreLogin_ReadMoreLoginController\"><h2 id=\"Header\">\u67e5\u770b\u66f4\u591a<\/h2><div id=\"Message\"><p>\u8054\u7cfb\u7ba1\u7406\u5458\u5fae\u4fe1tutu19192010\uff0c\u6ce8\u518c\u8d26\u53f7<\/p>\n<\/div><div id=\"StatusBarHeader\"><\/div><form id=\"ARU_ReadMoreLogin_ReadMoreLoginController\"><input name=\"post_id\" value=\"3326\" type=\"hidden\"\/><input name=\"_init_callback\" value=\"InitLogin\" type=\"hidden\"\/><input name=\"post_id\" value=\"3326\" type=\"hidden\"\/><input name=\"rt_ype\" value=\"1\" type=\"hidden\"\/><input name=\"nonce\" value=\"78bc8eda5e\" type=\"hidden\"\/><input name=\"_wpnonce\" value=\"f48666364f\" type=\"hidden\"\/><input name=\"_controller\" value=\"ARU_ReadMoreLogin\\ReadMoreLoginController\" type=\"hidden\"\/><input name=\"_proxy_controller\" value=\"ARU_ReadMoreLogin\\ReadMoreLoginController\" type=\"hidden\"\/><input name=\"_view\" value=\"ARU_ReadMoreLogin\\ReadMoreLoginView\" type=\"hidden\"\/><table class=\"wpf-table-placeholder\"><tbody class=\"wpf-table-placeholder\"><tr class=\"wpf-table-placeholder\"><td class=\"wpf-table-placeholder-input\" width=\"400px\"><table class=\"wpf-table-placeholder\"><tbody class=\"wpf-table-placeholder\"><tr class=\"wpf-table-placeholder\"><th class=\"wpf-table-placeholder-input\"><label class=\"wpf-label\">Username:<\/label><\/th><\/tr><tr class=\"wpf-table-placeholder\"><td class=\"wpf-table-placeholder-input\"><input class=\"regular-text text_input\" name=\"username\" value=\"\" type=\"text\"\/><\/td><\/tr><tr class=\"wpf-table-placeholder\"><th class=\"wpf-table-placeholder-input\"><label class=\"wpf-label\">Password:<\/label><\/th><\/tr><tr class=\"wpf-table-placeholder\"><td class=\"wpf-table-placeholder-input\"><input class=\"regular-text text_input\" name=\"password\" value=\"\" type=\"password\"\/><\/td><\/tr><\/tbody><\/table><p class=\"wpf-table-placeholder submit\"><button class=\"wp_plugin_framework_ajax_button\" type=\"button\" style=\"background-color:#4D90FE;;color:#ffffff;;border:1px solid #3079ed;\" name=\"_event\" value=\"ButtonLogin\">Log in<\/button><\/p><\/td><td class=\"wpf-table-placeholder-input\"><\/td><\/tr><\/tbody><\/table><\/form><div id=\"ButtonStartRegister\"><a href=\"https:\/\/egonlin.com\/wp-login.php?action=register\">Register<\/a><\/div><div id=\"Link1\"><a href=\"https:\/\/egonlin.com\/wp-login.php?action=lostpassword\">Forgotten username or password?<\/a><\/div><div id=\"StatusBarFooter\"><\/div><\/div><\/div><div id=aru_remaining_content><\/div>","protected":false},"excerpt":{"rendered":"<p>\u68af\u5ea6\u4e0b\u964d\u6cd5 &emsp;&emsp;\u5728\u6c42\u89e3\u673a\u5668\u5b66\u4e60\u7b97\u6cd5\u6a21\u578b\u53c2\u6570\u7684\u65f6\u5019\uff0c\u68af\u5ea6\u4e0b\u964d\u6cd5\uff08gradient desce [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[276,303,304],"tags":[],"_links":{"self":[{"href":"https:\/\/egonlin.com\/index.php?rest_route=\/wp\/v2\/posts\/3326"}],"collection":[{"href":"https:\/\/egonlin.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/egonlin.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/egonlin.com\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/egonlin.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3326"}],"version-history":[{"count":0,"href":"https:\/\/egonlin.com\/index.php?rest_route=\/wp\/v2\/posts\/3326\/revisions"}],"wp:attachment":[{"href":"https:\/\/egonlin.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3326"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/egonlin.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3326"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/egonlin.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3326"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}