Posted December 2, 200915 yr anyone have a good "robots.txt" for IPB3? All of the ones I've found have been for IPB2.x
December 2, 200915 yr Author You see any reason I shouldn't include the calendar? We use the calendar on my website to track the dates for the contests that we hold and the information for the major autoshows.
December 2, 200915 yr You see any reason I shouldn't include the calendar? We use the calendar on my website to track the dates for the contests that we hold and the information for the major autoshows. Well... If it was me, I don't think I would. I only want the pages with the best content indexed by google. Do the calendar pages have quality content on them, aren't they just links to events in the forum? I'm not familiar with the IPB calendar yet.
December 3, 200915 yr Author They could link into threads in the forum or have information about auto show locations and times
December 3, 200915 yr They could link into threads in the forum or have information about auto show locations and times In that case it might not be a bad idea to let the bots in your calendar, you can always block them out later if you see the listing are rubbish.
December 3, 200915 yr Author doing further research today.. it seems that Bing really likes it if you put the path to your sitemap files in your robots.txt If you're using the sitemaps mod from this post Then you'll want to add these to the second line of your robots.txt after the "User-agent: *" sitemap: http://www.myforumname.com/indexsitemap.xml sitemap: http://www.myforumname.com/topicsitemap.xml sitemap: http://www.myforumname.com/forumsitemap.xml sitemap: http://www.myforumname.com/galleyImages.xml sitemap: http://www.myforumname.com/galleyAlbums.xml sitemap: http://www.myforumname.com/galleyCategories.xml sitemap: http://www.myforumname.com/eventsitemap.xml edit: Yes, "gallery" is misspelled "galley". It's a spelling error in the code of the mod.
December 3, 200915 yr Author Are you having any crawl issues with having that *.php in there? I added that line to my robots.txt, tested a thread in Webmaster tools, and it came up as blocked.
December 4, 200915 yr doing further research today.. it seems that Bing really likes it if you put the path to your sitemap files in your robots.txt If you're using the sitemaps mod from this post Then you'll want to add these to the second line of your robots.txt after the "User-agent: *" sitemap: http://www.myforumname.com/indexsitemap.xml sitemap: http://www.myforumname.com/topicsitemap.xml sitemap: http://www.myforumname.com/forumsitemap.xml sitemap: http://www.myforumname.com/galleyImages.xml sitemap: http://www.myforumname.com/galleyAlbums.xml sitemap: http://www.myforumname.com/galleyCategories.xml sitemap: http://www.myforumname.com/eventsitemap.xml edit: Yes, "gallery" is misspelled "galley". It's a spelling error in the code of the mod. That is good, I did it on my old forum as well Are you having any crawl issues with having that *.php in there? I added that line to my robots.txt, tested a thread in Webmaster tools, and it came up as blocked. not that I've noticed, but I haven't really had time to research it. I just pulled that robots.txt file from a post on the IPB support site.
December 25, 200915 yr Hmmm... I just tried out that mod and am getting the following when I try to view the sitemap(s): XML Parsing Error: no element found Location: http://www.xxxxxxxxxx/forum/forumsitemap.xml Line Number 1, Column 1: Any idea what could be triggering that? Thanks Oh and thank you for the link to the SEO mod. edit: never mind that error. It sometimes doesn't hurt to actually turn the mod ON. LOL *whistles*
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.