Fynd Developer Blog
Date Posted: July 2025
Not every website wants to be found. That might sound strange coming from a search engine team, but it’s true.
Some pages just aren’t meant to be indexed, login forms, admin dashboards, test pages, random junk that isn’t ready for prime time. There’s a simple way websites let crawlers know this:
<meta name="robots" content="noindex">
If you’ve never seen that before, it’s basically a polite “no trespassing” sign for search engines, and our crawlers listen. If our crawler sees that noindex tag, it stops immediately. The page is skipped and won’t show up in Fynd results at all.
It’s all part of making Fynd a better, more respectful search engine. One that sees the open web, but knows when to keep out.