Datafeedr Support Forums  

Go Back   Datafeedr Support Forums > Current Version (V3) Forum > Questions
Home Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Important - The support forums are now in "read-only" mode as we transition to an alternative help desk solution. Feel free to contact us here with any of your questions or search the forums for an existing solution.
 
 
Thread Tools Search this Thread Display Modes
Prev Previous Post   Next Post Next
  #1  
Old January 13th, 2014, 03:40 PM
proneone proneone is offline
 
Join Date: Jan 2014
Posts: 33
Default blocking robots from crawling buy links?

i was told that it was relatively easy to block search engines from crawling my affiliate links with datafeedr, given the semi-static link structure it uses.

does anyone have an example robots.txt file i can implement to accomplish this?

our buy now link structure looks like:

http://domain.com/store/product/buy/...24671/product/

thanks!
 


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
blocking items chunkyjewellery Questions 6 August 24th, 2011 11:01 AM
Blocking products macfink Feature Requests 0 August 13th, 2011 12:54 PM


All times are GMT -5. The time now is 01:16 PM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.