Datafeedr Support Forums  

Go Back   Datafeedr Support Forums > Current Version (V3) Forum > Problems
Home Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Important - The support forums are now in "read-only" mode as we transition to an alternative help desk solution. Feel free to contact us here with any of your questions or search the forums for an existing solution.
 
 
Thread Tools Search this Thread Display Modes
  #1  
Old October 29th, 2014, 06:16 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default Problem with site map

Hi,

Do you know why i have a problem with my sitemap?

http://www.freakfish.co.uk/shop/sitemap
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #2  
Old October 29th, 2014, 08:47 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

I believe your server is timing out while generating the large sitemap.

I suggest breaking up your sitemap into multiple maps. Here's how: http://www.datafeedr.com/docs/item/259

However this might still be your issue: http://www.datafeedr.com/forums/show...9884#post49884

Eric
  #3  
Old October 29th, 2014, 09:17 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

I have tried the fixes. Disabled plugins and it still shows the error

I'm in serious trouble with this as my traffic has been hit hard. I'm bringing in 15 visits a day down from 480 average. I'm at a loss what do do?

If i give you my login details could you have a look please?
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #4  
Old October 29th, 2014, 09:28 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

You still have to set the number of items to appear in a sitemap. You can do that here: The Factory > Your Store > Store menu > Sitemap Settings > Sitemap Siz

I suggest you enter 5000 into that field.

Eric
  #5  
Old October 29th, 2014, 09:41 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

Hi Eric,

Its still showing the error? What next?
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #6  
Old October 29th, 2014, 09:44 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

Try deleting your W3TC cache.

Eric
  #7  
Old October 29th, 2014, 09:59 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

If that still doesn't work, you will need to make the change we made to your site in June.

1. Open this file: ~/wp-content/plugins/datafeedr/datafeedr.php

2. Find this line (line #2520):

PHP Code:
sprintf("Content-Length: %s"strlen($str)), 
3. Change that line to this:

PHP Code:
//sprintf("Content-Length: %s", strlen($str)), 
4. Save the file.

That should fix the issue.

Eric
  #8  
Old October 29th, 2014, 10:41 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

Im afraid its still showing the error.
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #9  
Old October 29th, 2014, 10:52 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

If you tried deleting your cache and making the file changes as mentioned above and it still doesn't work, I can only suggest that there is something wrong with one of your plugins or theme which is causing a few line breaks before any content on your site is rendered.

I say that because if you look at the source code of both your homepage and a sitemap page, you will see 2 empty lines at the top of the file. Here a few screenshots of what I'm talking about:

Sitemap



Homepage



Once you find and fix the plugin or theme file responsible for adding the 2 extra blank lines to the top of every page on your site, then the sitemap issue will also be fixed.

As it is, I imported your store into my test site and the sitemap pages loaded fine and there were no blank lines at the top of source code.

Eric
  #10  
Old October 29th, 2014, 10:58 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

Hi Eric,

This is out of my depth. Is there any chance you can have a quick look, as you know what you are looking for?

It would be much appreciated.

Adam
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #11  
Old October 29th, 2014, 11:06 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi
Quote:
Originally Posted by macfink View Post
This is out of my depth. Is there any chance you can have a quick look, as you know what you are looking for?
That's the problem... I don't know where to look. It could be in any of your plugin files or in any of your theme files.

To figure it out, you'd have to disable plugins and/or your theme 1 by 1, check the source code and see if the lines are gone.

More precisely:

1. Turn off ALL caching plugins

2. Disable a plugin

3. View the source of your homepage. If the 2 lines are gone, you've found the culprit.

4. If the 2 lines are still there, reactivate the plugin.

5. Go to your next plugin and repeat steps #2 ~ #5.

If after turning off ALL caching plugins and checking your source code after disabling each plugin the problem still exists, you might need to try the default WordPress theme to see if that makes the issue go away.

The most important thing in your testing is that you have deleted all cached files and deactivated all caching plugins. Otherwise, you will never know if your changes actually made any difference at all.

Eric
  #12  
Old October 29th, 2014, 11:24 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

Where do i delete cached files? In FTP? If so what would the directory be? I haven't got W3 installed. However, i see there are files within FTP
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #13  
Old October 29th, 2014, 11:35 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

I just activated a different theme and the two line disappeared as you can see in the screen shot. It looks like my theme. What do i do now?
Attached Thumbnails
Click image for larger version

Name:	screen.png
Views:	132
Size:	177.9 KB
ID:	825  
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #14  
Old October 29th, 2014, 11:54 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

I would contact the theme developer and ask them for a fix.

Eric
  #15  
Old November 7th, 2014, 09:12 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

Hi Eric,

I think i have fixed it. There was blank lines in my index php file in the theme.

Can you check that the everything looks ok to you. As i have updated the site map to google but im still bringing in only 22 visits a day.

Also webmater tools is suggesting these URLS are throwing up a 505. They have the brand filter in the URL. How do i stop this?

Priority URL Response Code Detected

1
sanuk-anthem-womens-shoes-cream-3346800196665929
500
11/1/14

2
mens-oneill-pm-originals-ricca-board-shorts-blue-aop-177200121305600?brand=Webber
503
10/9/14

3
mens-oneill-ignite-beanie-haute-red-177202118169858?brand=Carhart
500
11/1/14

4
womens-hurley-skinny-leggings-moonstone-177200039259325?description=06
500
11/1/14

5
oneill-skin-turtleneck-womens-rash-vest-black-177202109581740?brand=Protest
500
11/1/14

6
womens-puma-move-sweat-jacket-athletic-gray-heather-177200117605088?description=Large+Short
503
10/9/14

7
womens-billabong-safari-jammin-tropic-bikini-bottom-limeade-177200122200833?brand=Natural+Rhythm
500
11/1/14

8
womens-roxy-activated-short-sleeve-rash-vest-white-177200118929409?brand=Globe
503
10/9/14

9
womens-roxy-activated-short-sleeve-rash-vest-white-177200118929409?brand=The+North+Face
503
10/9/14

10
oneill-hyperfreak-0-5mm-l-s-neoprene-top-14-grpred-2110202097136494?brand=Barts
500
11/1/14

11
womens-animal-ivorie-bikini-blueberry-177200124647749?brand=Globe
503
10/9/14

12
womens-animal-ivorie-bikini-blueberry-177200124647749?brand=Ignite
503
10/9/14

13
oneill-womens-pyrotech-5-4-fsw-wetsuit-2015-deep-2110202097241082?brand=GoPro
500
11/1/14

14
womens-g-star-3301-bootleg-jeans-comfort-bloom-denim-177200156699395?brand=Hurley
503
10/9/14

15
womens-french-connection-gina-knit-with-pom-pom-scarf-black-midnight-eclipse-177202113216795?brand=Berghaus+
503
10/9/14

16
womens-roxy-around-you-scarf-cloudy-177202112281376?brand=Billabong+
503
10/9/14

17
oneill-epic-bz-3-2-gbs-wetsuit-2014-blk-lime-2110202097130945?brand=Havaianas
500
11/1/14

18
oakley-backhand-womens-sunglasses-cherry-red-black-grey-gradient-3346800196743184?brand=Breo
503
10/9/14

19
oakley-backhand-womens-sunglasses-cherry-red-black-grey-gradient-3346800196743184?brand=Converse
503
10/9/14

20
oneill-psychofreak-fz-5-4-ssw-wetsuit-2015-black-2110202097206154?brand=Bench+
500
11/1/14

21
oneill-glitch-hybrid-tee-stone-blue-2110201581856980?brand=Dakine
500
11/1/14

22
womens-people-tree-pippa-stripe-dress-red-177200085757314?brand=Famous
503
10/9/14

23
womens-esprit-lace-cardi-knitwear-black-177200080869018?brand=Element
503
10/9/14

24
rash-vests-quiksilver-all-time-ls-3047900916137719?description=16
503
10/9/14

25
womens-billabong-cacy-19-board-shorts-black-stripe-177200122199744?brand=Gola
500
11/1/14

26
womens-billabong-cacy-19-board-shorts-black-stripe-177200122199744?brand=Globe
500
11/1/14

27
womens-billabong-cacy-19-board-shorts-black-stripe-177200122199744?brand=Hurley
500
11/1/14

28
womens-wolf-york-ortega-skirt-casablanca-177200123602499?description=12
500
11/1/14

29
mens-oneill-thermo-x-short-sleeve-crew-thermal-rashvest-black-177200120007580?brand=Roxy
500
11/1/14

30
mens-afends-rain-down-jacket-tropical-print-177200086804997?brand=Gola
500
11/1/14

31
womens-55dsl-dimpoi-dress-sky-blue-177200128166340?brand=Santa+Cruz
503
10/9/14

32
womens-hurley-mango-tie-dye-bikini-top-multi-177200128417900?brand=Carhart
500
11/1/14

33
womens-louche-aurora-flower-dress-blue-177200125933851?brand=Westbeach
500
11/1/14

34
boys-quiksilver-little-molokai-mw-logo-flip-flops-black-green-blue-177200121340586?price=10-20
500
11/1/14

35
womens-dakine-garden-20l-backpack-salima-177202118177321?brand=Ipanema
500
11/1/14

36
womens-volcom-way-to-go-sandals-mix-177200122306492?description=34
500
11/1/14

37
womens-splendid-loose-knit-stripe-knitwear-black-and-white-177200117778468?description=04
500
11/1/14

38
womens-oneill-santa-monica-s-slv-t-shirt-creole-pink-177200124854854?brand=Hot+Buttered
503
10/9/14

39
mens-sanuk-m-vagabond-madras-shoes-blue-white-177200121015860?brand=Havaianas
500
11/1/14

40
fcs-comp-leash-5-5mm-5ft-purple-2110200815455492?price=5-10
500
11/1/14

41
mens-lowlife-armor-belt-slate-gunmetal-177200078465367?brand=Enjoi
500
11/1/14

42
mens-ringspun-memphis-hoody-grey-marl-177200003756861?description=Small
503
10/9/14

43
mens-rusty-riff-raff-board-shorts-grey-marle-177200160326620?description=04
500
11/1/14

44
womens-nica-lizzy-medium-grab-hand-bag-black-177202119181511?description=05
500
11/1/14

45
mens-moods-of-norway-simen-loen-knitwear-burgundy-177200161407963?description=Medium
500
11/1/14

46
mens-money-money-company-chain-stitch-sweatshirt-grey-melange-177200118746492?brand=Dickies
503
10/9/14

47
mens-animal-bishopsgate-board-shorts-black-177200122446942?brand=Xcel
500
11/1/14

48
mens-afends-depths-board-shorts-floral-177200127162247?brand=Rusty
500
11/1/14

49
girls-name-it-jalinen-kids-slim-t-shirt-crystal-rose-177200156658932?description=36
500
11/1/14

50
mens-dc-big-star-beanie-black-177202112204321?description=04
500
11/1/14

51
3-4-scoop-raglan-a-3-4-sleeve-t-shirt-for-women-roxy-3048000002234015?description=10
500
11/1/14

52
mens-180s-down-headphone-ear-muffs-black-177202113249496?description=05-6
500
11/1/14

53
mens-patagonia-fitz-roy-down-parka-jacket-black-177200161340613?brand=Bic+Surfboards
503
10/9/14

54
mens-animal-lisk-t-shirt-frenchnavy-177200083352964?brand=Ocean+Kayak
500
11/1/14

55
womens-vero-moda-karma-short-parka-jacket-fig-177200157955904?description=Large
500
11/1/14

56
womens-wolf-york-cleveleys-dress-charcoal-177200156768958?brand=Famous
500
11/1/14

57
yutika-long-sleeve-heather-dress-for-girls-roxy-3048000009170973?brand=Santa+Cruz
500
11/1/14

58
mens-planks-bobble-fleece-lined-beanie-orange-black-peacock-177202114434591?brand=Globe
503
10/9/14

59
mens-humor-prust-long-sleeve-t-shirt-bright-white-177200126077566?brand=Oxbow
500
11/1/14

60
womens-seafolly-goddess-bandeau-bikini-top-red-hot-177200089179152?brand=Dakine
500
11/1/14

61
mens-endura-pakajak-ultra-packable-jacket-green-177200079614297?description=07-8
503
10/9/14

62
mens-quiksilver-chill-out-towel-black-177202116774621?price=100-150
500
11/1/14

63
womens-billabong-regular-short-sleeve-rash-vest-fiji-blue-177200048963496?brand=Nike+ACG
500
11/1/14

64
patagonia-skateboard-tee-tobago-blue-2110200631823376?description=Large+Short
500
11/1/14

65
womens-ilse-jacobsen-rain-coat-marine-177200127271249?description=03
503
10/9/14

66
tunic-sheer-green-a-screen-print-t-shirt-for-women-roxy-3048000492386437?description=Large
503
10/9/14

67
boys-tiger-joe-sargeant-shark-retro-board-shorts-fuel-177200157780469?description=11
500
11/1/14

68
womens-charcoal-rose-broome-top-light-grey-heather-177200156769051?brand=Nike+6.0
500
11/1/14

69
womens-sugarhill-boutique-zigzag-dress-dress-multicolour-177200156662165?brand=Santa+Cruz
500
11/1/14

70
rusty-fiver-adjustable-cap-mineral-blue-2110201483784659?description=05-6
500
11/1/14

71
nike-sb-satire-shoes-new-slate-white-2110201022179579?brand=Alpinestars
500
11/1/14

72
womens-element-cleo-jacket-black-177200157919073?description=Large+Short
500
11/1/14

73
womens-element-tennesse-hoody-black-olive-177200157919008?description=15-16
500
11/1/14

74
mens-jeepers-peepers-rex-sunglasses-black-clear-177202118100003?brand=Oakley
503
10/9/14

75
gorilla-grip-adriano-dash-pad-deck-2110200168547349?brand=Converse
503
10/9/14

76
closeout-shirt-for-men-quiksilver-3047900994408565?brand=Surftech
503
10/9/14

77
womens-cheap-monday-high-spray-scratch-grey-177200156775622?price=30-40
500
11/1/14

78
mens-wolf-york-weybourne-hoody-midnight-blue-177200158024575?brand=Balin
500
11/1/14

79
mens-zeal-backyard-sunglasses-black-blue-gloss-copper-177202119076995?brand=Billabong+
503
10/9/14

80
womens-surfdome-hopton-long-board-shorts-true-black-177200123632700?price=500-750
500
11/1/14

81
regular-snow-beanie-for-boys-planter-youth-beanie-quiksilver-3047900333318915?price=500-750
500
11/1/14

82
womens-people-tree-zadie-open-knit-cardigan-multi-177200159212806?description=10
500
11/1/14

83
womens-snowboard-ski-jacket-darcy-jkt-quiksilver-3047901175502609?description=05
500
11/1/14

84
mens-patagonia-arbor-pack-26l-hand-luggage-copper-ore-177200000052121?brand=Billabong+
500
11/1/14

85
salobrena-b-screen-print-t-shirt-for-women-roxy-3048000492351691?brand=Santa+Cruz
500
11/1/14

86
mens-timex-mens-sport-with-aluminum-top-ring-watch-black-dial-orange-strap-177202115698820?description=15-16
500
11/1/14

87
girls-bonnie-baby-messie-t-shirt-cerise-177200123673157?description=11-12
500
11/1/14

88
womens-selected-ivy-ancle-dress-blue-graphite-177200160144926?description=Small
500
11/1/14

89
mens-moods-of-norway-tor-bjarne-t-shirt-jam-blue-177200156736415?brand=Roxy
500
11/1/14

90
mens-55dsl-finners-sweatshirt-black-177200041557245?description=04
503
10/9/14

91
womens-samsoe-samsoe-wake-boots-black-177200161412289?brand=Mctavish
503
10/9/14

92
womens-henri-lloyd-joni-3-4-sleeve-stripe-dress-black-177200123391134?brand=Volcom
500
11/1/14

93
mens-hubboards-dubb-edition-nrg-red-bodyboard-41-5inch-177202116947998?brand=Dakine
500
11/1/14

94
mens-billabong-eclipse-long-sleeve-rash-vest-blue-177200124571681?description=02
500
11/1/14

95
womens-pepe-jeans-andrew-t-shirt-black-177200085505823?description=38
500
11/1/14

96
mens-adidas-originals-fisherman-beanie-black-running-white-177202114619618?description=38
500
11/1/14

97
mens-marmot-alpinist-tech-jacket-cinder-dark-granite-177200044144637?brand=Bench+
500
11/1/14

98
womens-oneill-coastline-backpack-green-white-177202118105408?brand=Alder
503
10/9/14

99
circle-one-bamboo-shortboard-5ft-10-2110200175341426?brand=Etnies
503
10/9/14

100
surfdome-funboard-surfboard-bag-6ft-0-177200000055286?description=16
503
10/9/14

101
mens-morey-mach-ixl-pe-crescent-tail-yellow-bodyboard-42-5cm-177202116948793?price=5-10
500
11/1/14

102
womens-wolf-york-folly-lodge-slipper-sock-slippers-bordeaux-white-sand-177200088095557?brand=Bench+
500
11/1/14

103
womens-dr-denim-kissy-jeans-light-pink-177200050007886?price=500-750
500
11/1/14

104
mens-voi-jeans-norton-026-jeans-light-177200124681575?description=02
500
11/1/14

105
nectar-myers-sunglasses-grey-gold-2110200982218435?brand=Quiksilver
500
11/1/14

106
mens-quiksilver-basic-b-backpack-mouse-grey-177200203858745?description=07-8
500
11/1/14

107
womens-roxy-charger-backpack-pencil-case-corn-flower-177202115836133?description=Large+Tall
500
11/1/14

108
mens-scotch-soda-pattern-scarf-paisley-177202116874905?price=40-50
503
10/9/14

109
mens-electric-rip-rock-sunglasses-tortoise-shell-melnin-bronze-polarized-level-1-177202118206823?brand=Enjoi
503
10/9/14

110
womens-billabong-1st-point-1mm-surf-capsule-wetsuit-shorts-blue-177200123714374?brand=Icon
500
11/1/14

111
nixon-fader-watch-all-gun-sky-blue-2110200730507667?description=02
503
10/9/14

112
mens-timex-mens-sport-with-aluminum-top-ring-watch-black-dial-orange-strap-177202115698820?brand=Westbeach
503
10/9/14

113
mens-waxx-surf-board-shorts-diamonds-177200128342718?brand=Insight
500
11/1/14

114
womens-fox-stunner-jacket-black-177200159213596?description=30
500
11/1/14

115
angel-boost-halter-surfer-pant-beach-babe-halter-neck-bikini-for-women-roxy-3048000642958371?brand=Reef
503
10/9/14

116
lobble-t-shirt-4973100017027638?brand=ONeill
503
10/9/14

117
mens-carve-korbin-sunglasses-white-polarized-177200199118321?description=11-12
503
10/9/14

118
womens-pepe-jeans-jaimee-jeans-denim-light-blue-177200156874419?description=30
500
11/1/14

119
womens-carhartt-tess-pants-horn-stone-washed-177200003753701?description=08
500
11/1/14

120
girls-billieblush-bow-long-sleeve-t-shirt-off-white-177200161620323?description=Medium+Tall
500
11/1/14

121
womens-seafolly-fringe-benefits-pool-towel-indigo-177200200226997?description=10
503
10/9/14

122
beach-brights-hoodie-hooded-sweatshirt-for-women-roxy-3048000570619137?brand=Breo
503
10/9/14

123
cskins-hot-wired-fz-5-4-3-wetsuit-2015-blk-2110201950836336?brand=Globe
503
10/9/14

124
mens-trainerspotter-felix-backpack-black-177200000230754?description=34
503
10/9/14

125
quiksilver-womens-the-mission-leather-jacket-chocolate-177202113325753?brand=NSP
503
10/9/14

126
mens-the-north-face-open-gate-full-zip-hoody-cherry-stain-brown-177200158999355?brand=Von+Zipper
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #16  
Old November 7th, 2014, 10:42 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

Your sitemap looks good to me now.

To stop the 505 errors, you could try adding the following to your theme's header.php file in between your <head> and </head> tags:

PHP Code:
<?php
if ( is_dfr() && isset( $_GET['brand'] ) ) {
    echo 
'<meta name="robots" content="noindex, nofollow">';
}
?>
Eric
  #17  
Old November 7th, 2014, 11:18 AM
macfink macfink is offline
 
Join Date: Feb 2011
Posts: 685
Default

Thanks for that Eric


Is see also the other filters are being crawled as well price and description. However, i dont know where description is coming from as its not a filter?

description=Large

?price=100-150

What would the code be to no follow index?

<?php
if ( is_dfr() && isset( $_GET['brand'] ['description'] ['price'])) {
echo '<meta name="robots" content="noindex, nofollow">';
}
?>
__________________
ID 30949
Website:
http://www.freakfish.co.uk/
  #18  
Old November 7th, 2014, 11:21 AM
Eric's Avatar
Eric Eric is offline
Datafeedr Team
 
Join Date: Feb 2008
Posts: 16,902
Default

Hi,

Try this instead:

PHP Code:
<?php
if ( is_dfr() ) {
    
$noindex FALSE;
    if ( isset( 
$_GET['brand'] ) ) {
        
$noindex TRUE;
    }
    if ( isset( 
$_GET['description'] ) ) {
        
$noindex TRUE;
    }
    if ( isset( 
$_GET['price'] ) ) {
        
$noindex TRUE;
    }
    if ( 
$noindex ) {
        echo 
'<meta name="robots" content="noindex, nofollow">';
    }
}
?>
Eric
 


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem with amazon linked products from site csauls88 Questions 6 October 26th, 2014 09:01 PM
site map problem macfink Problems 6 June 26th, 2014 10:48 AM
Problem with images on new site tonejarvis Problems 6 January 15th, 2012 10:10 AM


All times are GMT -5. The time now is 01:26 PM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.