Whole website no-index, no-follow
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
add a comment |
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
1
add this in layout<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
Mar 27 at 7:42
Thanks Rakesh Donga
– Asim Ali
Mar 27 at 8:05
add a comment |
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
magento2
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
asked Mar 27 at 7:40
Asim AliAsim Ali
7710
7710
1
add this in layout<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
Mar 27 at 7:42
Thanks Rakesh Donga
– Asim Ali
Mar 27 at 8:05
add a comment |
1
add this in layout<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
Mar 27 at 7:42
Thanks Rakesh Donga
– Asim Ali
Mar 27 at 8:05
1
1
add this in layout
<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>– Rakesh Donga
Mar 27 at 7:42
add this in layout
<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>– Rakesh Donga
Mar 27 at 7:42
Thanks Rakesh Donga
– Asim Ali
Mar 27 at 8:05
Thanks Rakesh Donga
– Asim Ali
Mar 27 at 8:05
add a comment |
2 Answers
2
active
oldest
votes
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt in root and pub/ directory. File content would be:
User-Agent: *
Disallow: /
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots you find the option
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
working or not ?
– Ronak Rathod
Mar 27 at 8:07
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
add a comment |
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "479"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmagento.stackexchange.com%2fquestions%2f267581%2fwhole-website-no-index-no-follow%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt in root and pub/ directory. File content would be:
User-Agent: *
Disallow: /
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
add a comment |
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt in root and pub/ directory. File content would be:
User-Agent: *
Disallow: /
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
add a comment |
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt in root and pub/ directory. File content would be:
User-Agent: *
Disallow: /
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt in root and pub/ directory. File content would be:
User-Agent: *
Disallow: /
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
answered Mar 27 at 7:46
Shoaib MunirShoaib Munir
2,3172829
2,3172829
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
add a comment |
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
Thanks Shoaib Munir
– Asim Ali
Mar 27 at 8:05
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots you find the option
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
working or not ?
– Ronak Rathod
Mar 27 at 8:07
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots you find the option
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
working or not ?
– Ronak Rathod
Mar 27 at 8:07
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots you find the option
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots you find the option
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
answered Mar 27 at 7:43
Ronak RathodRonak Rathod
869112
869112
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
working or not ?
– Ronak Rathod
Mar 27 at 8:07
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
add a comment |
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
working or not ?
– Ronak Rathod
Mar 27 at 8:07
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
Thanks Rathod..
– Asim Ali
Mar 27 at 8:05
working or not ?
– Ronak Rathod
Mar 27 at 8:07
working or not ?
– Ronak Rathod
Mar 27 at 8:07
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
Mar 27 at 8:24
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
Good answer though. +1
– Shoaib Munir
Mar 28 at 9:54
add a comment |
Thanks for contributing an answer to Magento Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmagento.stackexchange.com%2fquestions%2f267581%2fwhole-website-no-index-no-follow%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
add this in layout
<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>– Rakesh Donga
Mar 27 at 7:42
Thanks Rakesh Donga
– Asim Ali
Mar 27 at 8:05