{"id":272,"date":"2017-04-10T22:47:31","date_gmt":"2017-04-10T15:47:31","guid":{"rendered":"http:\/\/vannamit.com\/?p=272"},"modified":"2017-04-10T22:47:31","modified_gmt":"2017-04-10T15:47:31","slug":"robots-txt-robots-txt-la-gi","status":"publish","type":"post","link":"https:\/\/khowordpress.com\/vannamit\/robots-txt-robots-txt-la-gi\/","title":{"rendered":"Robots.txt \u2013 robots.txt l\u00e0 g\u00ec?"},"content":{"rendered":"<p><strong>1.Robots.txt l\u00e0 g\u00ec ?<br \/>\n<\/strong>Robots.txt l\u00e0 m\u1ed9t d\u1ea1ng text \u0111\u1eb7c bi\u1ec7t kh\u00f4ng ph\u1ea3i l\u00e0 HTML hay m\u1ed9t lo\u1ea1i n\u00e0o kh\u00e1c. N\u00f3 gi\u00fap cho c\u00e1c webmaster linh ho\u1ea1t h\u01a1n trong vi\u1ec7c cho hay kh\u00f4ng cho bot c\u1ee7a c\u00e1c c\u00f4ng c\u1ee5 t\u00ecm ki\u1ebfm(SE) \u0111\u00e1nh ch\u1ec9 m\u1ee5c(index) m\u1ed9t khu v\u1ef1c n\u00e0o \u0111\u00f3 trong website c\u1ee7a b\u1ea1n.<\/p>\n<p><strong>V\u00ed d\u1ee5:<\/strong><\/p>\n<p>User-agent: *<\/p>\n<p>Disallow: \/wp-admin\/<\/p>\n<p>Disallow: \/wp-includes\/<\/p>\n<p><strong>ch\u00fa gi\u1ea3i :<\/strong><\/p>\n<ul>\n<li>User-agent: * : cho ph\u00e9p t\u1ea5t c\u1ea3 c\u00e1c lo\u1ea1i bot<\/li>\n<li>Disallow: \/wp-admin\/\u00a0 : ch\u1eb7n th\u01b0 m\u1ee5c wp-admin v\u00e0 t\u1ea5t c\u1ea3 nh\u1eefng g\u00ec n\u1eb1m trong th\u01b0 m\u1ee5c wp-admin<\/li>\n<\/ul>\n<p><strong>2.H\u01b0\u1edbng d\u1eabn s\u1eed d\u1ee5ng Robots.txt<\/strong><\/p>\n<p><strong>a.Kh\u00f3a to\u00e0n b\u1ed9 website kh\u00f4ng cho bot \u0111\u00e1nh ch\u1ec9 m\u1ee5c<\/strong><\/p>\n<p>User-agent: *<br \/>\nDisallow: \/<\/p>\n<p><strong>==&gt; c\u00f3 ngh\u0129a l\u00e0 c\u1ea5m t\u1ea5t c\u1ea3 c\u00e1c lo\u1ea1i bot truy c\u1eadp v\u00e0o t\u1ea5t c\u1ea3 t\u00e0i nguy\u00ean c\u00f3 tr\u00ean website c\u1ee7a b\u1ea1n, nh\u01b0 v\u1eady c\u00f3 ngh\u0129a l\u00e0 website b\u1ea1n ch\u1ea3 th\u00e8m ch\u01a1i v\u1edbi c\u00e1c SE<\/strong><\/p>\n<p><strong>b.Kh\u00f4ng cho ph\u00e9p bot truy c\u1eadp v\u00e0o th\u01b0 m\u1ee5c n\u00e0o m\u00e0 m\u00ecnh kh\u00f4ng mu\u1ed1n<\/strong><\/p>\n<p>L\u1ea5y l\u1ea1i v\u00ed d\u1ee5 tr\u00ean :<\/p>\n<p>User-agent: *<\/p>\n<p>Disallow: \/wp-admin\/<\/p>\n<p>Disallow: \/wp-includes\/<\/p>\n<p><strong>==&gt; Di\u1ec1u n\u00e0y c\u00f3 ngh\u0129a l\u00e0 cho ph\u00e9p t\u1ea5t c\u1ea3 c\u00e1c lo\u1ea1i bot thu th\u1eadp ch\u1ec9 tr\u1eeb 2 th\u01b0 m\u1ee5c wp-admin v\u00e0 wp-includes<\/strong><\/p>\n<p><strong>c.Ch\u1eb7n\u00a01 trang<\/strong><\/p>\n<p><strong>Disallow:<\/strong> \/lien-he.html<\/p>\n<p><strong>d.Lo\u1ea1i b\u1ecf 1 h\u00ecnh t\u1eeb \u00a0Google Images<\/strong><\/p>\n<p><strong>User-agent:<\/strong> Googlebot-Image<br \/>\n<strong>Disallow:<\/strong> \/images\/hinh.png<\/p>\n<p><strong>e.Ch\u1eb7n m\u1ed9t bot n\u00e0o \u0111\u00f3<\/strong><\/p>\n<p>User-agent: SpamBot<br \/>\nDisallow: \/<\/p>\n<p>User-agent: *<br \/>\nDisallow: \/wp-admin\/<\/p>\n<p>Disallow: \/wp-includes\/<\/p>\n<p><strong>==&gt; \u0110\u1ec3 b\u1eaft \u0111\u1ea7u ch\u1ec9 \u0111\u1ecbnh m\u1edbi th\u00ec b\u1ea1n h\u00e3y \u0111\u1eb7t m\u1ed9t d\u00f2ng tr\u1eafng. V\u00e0 bot SpamBot b\u1ecb c\u1ea5m truy c\u1eadp t\u1ea5t c\u1ea3 t\u00e0i nguy\u00ean. Trong khi c\u00e1c bot kh\u00e1c\u00a0 \u0111\u01b0\u1ee3c truy c\u1eadp t\u1ea5t c\u1ea3 tr\u1eeb th\u01b0 m\u1ee5c \u201cwp-admin \u201d v\u00e0 &#8220;wp-includes&#8221;<\/strong><\/p>\n<p>User-agent: SpamBot<br \/>\nDisallow: \/admin\/<br \/>\nDisallow: \/includes\/<br \/>\nDisallow: \/config\/config.php<\/p>\n<p>User-agent: *<br \/>\nDisallow: \/admin\/<br \/>\nDisallow: \/includes\/<\/p>\n<p><strong>==&gt; Kh\u00f4ng cho ph\u00e9p SpamBot truy c\u1eadp c\u00e1c th\u01b0 m\u1ee5c \u0111\u01b0\u1ee3c li\u1ec7t k\u00ea nh\u01b0: th\u01b0 m\u1ee5c \u201cadmin\u201d, \u201cincludes\u201d v\u00e0 v\u00e0 file \u201cconfig.php\u201d . C\u00f2n c\u00e1c bot kh\u00e1c \u0111\u01b0\u1ee3c truy c\u1eadp m\u1ecdi th\u1ee9 tr\u1eeb hai th\u01b0 m\u1ee5c \u201cadmin\u201d v\u00e0 \u201cincludes\u201d.<\/strong><\/p>\n<p><strong>f.s\u1eed d\u1ee5ng \u0111\u1ed3ng th\u1eddi \u201cAllow\u201d v\u00e0 \u201cDisallow\u201d c\u00f9ng nhau<\/strong><\/p>\n<p>User-agent: Googlebot<\/p>\n<p>Disallow: \/vidu\/<\/p>\n<p>Allow: \/vidu\/demo-thoi-nha.html<\/p>\n<p><strong>== &gt; c\u00f3 ngh\u0129a l\u00e0 ch\u1eb7n Googlebot truy c\u1eadp v\u00e0o t\u00e0i nguy\u00ean c\u00f3 trong th\u01b0 m\u1ee5c &#8220;vidu&#8221;\u00a0 .Nh\u01b0ng ch\u1ec9 c\u00f3 th\u1ec3 truy c\u1eadp \u0111\u01b0\u1ee3c file &#8220;demo-thoi-nha.html&#8221;<\/strong><\/p>\n<p>User-agent: Googlebot<\/p>\n<p>Disallow: \/<\/p>\n<p>User-agent: Googlebot-Mobile<\/p>\n<p>Allow: \/<\/p>\n<p><strong>== &gt; Ch\u1eb7n kh\u00f4ng cho Googlebot truy c\u1eadp v\u00e0o t\u00e0i nguy\u00ean tr\u00ean website, nh\u01b0ng l\u1ea1i cho ph\u00e9p Googlebot-Mobile truy c\u1eadp v\u00e0o t\u00e0i nguy\u00ean tr\u00ean website b\u1ea1n<\/strong><\/p>\n<p><strong>3.N\u00ean tr\u00e1nh nh\u1eefng sai s\u00f3t sau<\/strong><\/p>\n<p>khi c\u00e1c b\u1ea1n s\u1eed d\u1ee5ng l\u1ea1i m\u1ed9t robots.txt c\u1ee7a ai \u0111\u00f3 ho\u1eb7c t\u1ef1 m\u00ecnh t\u1ea1o ra m\u1ed9t robots.txt ri\u00eang cho website m\u00ecnh th\u00ec c\u0169ng kh\u00f4ng tr\u00e1nh kh\u1ecfi nh\u1eefng sai s\u00f3t<\/p>\n<p>&#8211; Ph\u00e2n bi\u1ec7t ch\u1eef hoa ch\u1eef th\u01b0\u1eddng.<\/p>\n<p>&#8211; Kh\u00f4ng \u0111\u01b0\u1ee3c vi\u1ebft d\u01b0, thi\u1ebfu kho\u1ea3ng tr\u1eafng.<\/p>\n<p>&#8211; Kh\u00f4ng n\u00ean ch\u00e8n th\u00eam b\u1ea5t k\u1ef3 k\u00fd t\u1ef1 n\u00e0o kh\u00e1c ngo\u00e0i c\u00e1c c\u00fa ph\u00e1p l\u1ec7nh.<\/p>\n<p>&#8211; M\u1ed7i m\u1ed9t c\u00e2u l\u1ec7nh n\u00ean vi\u1ebft tr\u00ean 1 d\u00f2ng.<\/p>\n<p>\u0110\u00f3 l\u00e0 t\u1ea5t c\u1ea3 nh\u1eefng g\u00ec m\u00e0 ki\u1ebfn th\u1ee9c c\u1ee7a t\u00f4i bi\u1ebft v\u1ec1 robots.txt , r\u1ea5t mong nh\u1eadn \u0111\u01b0\u1ee3c s\u1ef1 \u0111\u00f3ng g\u00f3p c\u1ee7a c\u00e1c b\u1ea1n.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>1.Robots.txt l\u00e0 g\u00ec ? Robots.txt l\u00e0 m\u1ed9t d\u1ea1ng text \u0111\u1eb7c bi\u1ec7t kh\u00f4ng ph\u1ea3i l\u00e0 HTML hay m\u1ed9t lo\u1ea1i n\u00e0o kh\u00e1c. N\u00f3 gi\u00fap cho c\u00e1c webmaster&#8230;<\/p>\n","protected":false},"author":1,"featured_media":273,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-272","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-thu-thuat-seo"],"_links":{"self":[{"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/posts\/272","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/comments?post=272"}],"version-history":[{"count":0,"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/posts\/272\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/media\/273"}],"wp:attachment":[{"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/media?parent=272"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/categories?post=272"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/khowordpress.com\/vannamit\/wp-json\/wp\/v2\/tags?post=272"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}