Remove Web Service (ASMX) From Search Engine (Google) Results

Question

0.00/5 (No votes)

See more:

I have a web service at www.mysite.com/SomePath/SomeService.asmx. When I search on google for "inurl:mysite.com", I get that web service as one of the results. I would like that web service to not show up in the search results.

I have tried adding a robots.txt file to exclude /SomePath/ from search results, but that hasn't seemed to work yet (though it's only been a day or two, so maybe it'll take more time). Also, I can't remove the "link" to this web service from all other crawled pages, because I'm pretty sure ASP.NET is including the link on any page that references the web service. I'm using this syntax to reference the web service:

ASP.NET

<asp:ServiceReference Path="~/SomePath/SomeService.asmx" InlineScript="true" />

I suspect setting InlineScript to true is causing the path to the web service to be output to the HTML, so my next step will be to try setting that property to false. However, I am not sure that will work and I would rather not set it to false, so if you have any other recommendations I would appreciate it.

Posted 18-Sep-11 10:02am

AspDotNetDev

Add a Solution

2 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Prasanth S · Answer 1 · 2011-09-18T20:49:00

Solution 1

Use a robot.txt file to your website and specify url which should not be listed by search engines using this block

VB

User-agent: *
Disallow: /SomePath/SomeService.asmx

For more details see the page

http://www.robotstxt.org/robotstxt.html[^]

Posted 18-Sep-11 20:49pm

Prasanth S

Comments

AspDotNetDev 19-Sep-11 12:58pm

Did you see the part of my question where I said "I have tried adding a robots.txt file to exclude /SomePath/ from search results"?

Kishore Jangid · Answer 2 · 2011-09-18T21:50:00

Solution 2

Use AjaxToolkit Control NoBot control

Posted 18-Sep-11 21:50pm

Kishore Jangid

Comments

AspDotNetDev 19-Sep-11 12:57pm

Uh... that prevents bots from posting garbage on your website, not web crawlers from indexing your web service.