Oh no! We're being crawled..

Everything else not related to mapping or Other World Mapper.

Moderator: Kyete

Post Reply
User avatar
unklStewy
Posts: 103
Joined: Fri Nov 14, 2014 1:18 pm
Location: Wake Forest, NC
Contact:

Oh no! We're being crawled..

Post by unklStewy » Mon Nov 17, 2014 10:14 am

That was something that I didn't realize about phpBB, it displays when different search engine bots are crawling the forums for search indexes.

It displayed BING [BOT] as being logged into the service.

That is a pretty cool feature.

Casey :ugeek:
unklStewy
Stewart A.
Wisterian Realms
www.wisterian.net

User avatar
Kanchou
Site Admin
Posts: 1021
Joined: Mon Nov 10, 2014 2:23 pm

Re: Oh no! We're being crawled..

Post by Kanchou » Mon Nov 17, 2014 1:39 pm

Casey,

phpBB has a lot of cool features, we're really happy with it so far :)

Also, since the subforums are sectioned off via login, all the search bots can see is an empty forum. None of the topics discussed here would appear on a search.

If we give bots read access to the forums, we'll make sure to announce it so everyone is aware.

- Alejandro
Alejandro S. Canosa
Three Minds Software

User avatar
Big Mac
Posts: 94
Joined: Fri Nov 14, 2014 6:08 pm
Location: London, UK

Re: Oh no! We're being crawled..

Post by Big Mac » Mon Nov 17, 2014 2:47 pm

Kanchou wrote:Casey,

phpBB has a lot of cool features, we're really happy with it so far :)
phpBB is pretty cool. I used to be a moderator on a vBulletin forum, but I am now a junior admin on a D&D forum that uses phpBB. But they only just released 3.1 Ascraeus and most people are still on 3.0. This place looks a tiny bit odd to me, so I'm assuming you installed 3.1.
Kanchou wrote:Also, since the subforums are sectioned off via login, all the search bots can see is an empty forum. None of the topics discussed here would appear on a search.

If we give bots read access to the forums, we'll make sure to announce it so everyone is aware.
I presume you will want to allow the bots into the forums (at some point - probably on the day you start selling OWM) so that potential customers asking questions can find threads where users are discussing their issues. Essentially this community will become "user-to-user support".

Having said that, it might be good to have one or more private forums.
David "Big Mac" Shepheard
(A Spelljammer fan hoping to user Other World Mapper to make lots of maps of planets.)
You can see more of me over at The Piazza campaign settings forums

User avatar
unklStewy
Posts: 103
Joined: Fri Nov 14, 2014 1:18 pm
Location: Wake Forest, NC
Contact:

Re: Oh no! We're being crawled..

Post by unklStewy » Mon Nov 17, 2014 5:15 pm

Heya,

I used to run phpBB back in the day but it wasn't as advanced as it is now and it was also prone to security holes. I was just exaggerating my shock. The bot crawling feature is pretty nifty.

Casey :ugeek:
unklStewy
Stewart A.
Wisterian Realms
www.wisterian.net

User avatar
Kanchou
Site Admin
Posts: 1021
Joined: Mon Nov 10, 2014 2:23 pm

Re: Oh no! We're being crawled..

Post by Kanchou » Mon Nov 17, 2014 8:21 pm

unklStewy wrote:Heya,
I used to run phpBB back in the day but it wasn't as advanced as it is now and it was also prone to security holes. I was just exaggerating my shock. The bot crawling feature is pretty nifty.
I know :). I thought it was interesting how fast Google and Bing were trying to search the forums! I pointed out that it was a closed forum because the default user name is the Kickstarter email address.
I presume you will want to allow the bots into the forums (at some point - probably on the day you start selling OWM) so that potential customers asking questions can find threads where users are discussing their issues. Essentially this community will become "user-to-user support".
Indeed. The open forums will eventually be open to bot searches.

- Alejandro
Alejandro S. Canosa
Three Minds Software

Post Reply