Bephic Bot
Bephic's crawler and how to allow or block it.
16 articles
- Bephic Bot guide
What BephicBot and BephicSEO are, what they do when they visit a page, and how to ask them not to come back.
- What is BephicBot?
BephicBot is Bephic's robot that looks at a business's home page when another nearby business compares itself with others in its area; it always reads robots.txt first.
- What is BephicSEO?
BephicSEO is Bephic's robot that checks a website when someone asks for it in Bephic, almost always the site's owner, and on paid plans on a schedule the owner sets; it looks at one page and does not read robots.txt.
- Why did BephicBot visit my site?
Because a nearby business that uses Bephic wanted to see how it is doing against others in its area, and your site is among them; it looks at your home page once for that result.
- What does Bephic's robot read on my page?
A single page, with a normal read, and only what Google also looks at: title, description, whether it looks good on a phone, how heavy it is and how long it takes.
- How do I block BephicBot in robots.txt?
Add User-agent BephicBot and Disallow with a slash to your robots.txt; BephicBot reads it before each visit and will not come in again.
- How do I let BephicBot in if I block other robots?
Add a block of its own for BephicBot with Allow and a slash; BephicBot follows its own block, not the general one.
- How does BephicBot read my robots.txt?
It follows the robots.txt standard: it uses the block with its name or, if there is none, the general one; the longest matching rule wins and, on a tie, Allow; if robots.txt does not exist it comes in, and if your server fails it does not.
- How do I block BephicSEO?
BephicSEO does not read robots.txt because it only comes in to the one page its owner asked to check, when asked or on the schedule the owner set; if you do not want its visits, block its name on your server or write to us.
- How do I know a visit is really from Bephic?
A real Bephic robot states its name, points to bephic.com/bot, asks for a single page and, if it is BephicBot, reads your robots.txt first; if it does not behave like that, it may be someone pretending to be us.
- What are the signatures (user agents) of Bephic's robots?
BephicBot signs as Mozilla/5.0 (compatible; BephicBot/1.0; +https://bephic.com/bot) and BephicSEO as BephicSEO/1.0 (+https://bephic.com/bot).
- Do Bephic's robots slow down my site?
No; each visit is a single page, like a person opening your site, without crawling links or asking for pages in bursts, and it gives up quickly if your site does not answer.
- Does Bephic keep a copy of my page or use it to train AI?
No; Bephic's robots use what they read for that result and discard it, without keeping a copy of your page or using it to train any AI.
- How do I test whether BephicBot can come into my site?
On the Bephic Bot page, paste your robots.txt into the tester and it tells you at once whether BephicBot can come in and which rule decides it.
- How do I contact Bephic about its robots?
Write to us from the contact page with your site's address, the date and the signature you saw; if it looks like an attack or a vulnerability, write to [email protected].
- What happens to my page check if I use Bephic and block the robots?
Your own page is checked by BephicSEO, which does not read robots.txt, so blocking BephicBot does not affect it; blocking BephicSEO on your server does stop it.