Date Posted: July 2025
One of the first things we worked on at Fynd was making sure our bots are polite.
Some search engines send lots of requests to a website all at once. This can slow the site down or even make it crash. That is not very nice.
At Fynd, we want to be good internet neighbors. So we made our crawler careful. It only makes one or two requests to a website every few minutes. This gives the site time to breathe and stay happy.
We are proud of this and will keep making sure Fynd is respectful to others online. Being a good net citizen matters.
Date Posted: April 2025
Fynd turns 1 year old tomorrow! It has been a fun and rewarding experience developing the code and watching the search engine come to life. I think it is pretty cool that it has become a sort of living, growing entity that does not require constant human input to keep running.
The core code is now complete, so over the last few months, and moving forward, development has shifted more toward improving the user interface, along with occasional tweaks to the crawlers and other backend components as needed.
Eventually, I would like to add image and news search features, which honestly seem pretty straightforward at this point. But before that, I will be focusing more on refining the Fynd UI.
Fynd has about 65 million pages indexed, and it continues to grow every second. I am very happy with the search results for most queries. While the index sounds large, it is still relatively small, and as it grows, the quality of the results keeps improving.
Looking ahead, my hope is that others will find Fynd as useful as I do for general internet searching and research, and appreciate having an alternative to mainstream search engines.
Date Posted: March 2025
Fynd has hit 50 million pages indexed, and the results are really shaping up nicely. The more pages indexed, the better the matches get. I foresee the sweet spot being around 200-250 million pages for optimal search quality.
Beyond that, I’m continuing to refine the UI, fine-tune the crawlers, and tackle spam pages to keep everything clean and relevant. Progress is steady, and things are going nicely.
Give it a try - Fynd
Date Posted: November 2024
Fynd has surpassed 20 million pages indexed, a milestone I set when starting the project in April 2024. The search engine continues to impress me with its results, and I make improvements as I see a need for them.
Date Posted: August 2024
Fynd has reached its first short-term milestone of 10 million pages indexed—a great accomplishment since starting the project several months ago.
Yesterday, I also overcame a major hurdle in performance scaling. The most glaring problem search engines face is scale, being able to index hundreds of millions of web pages or more to a database while maintaining speed. I am now confident that Fynd can scale to meet performance needs.
Going forward, I foresee handling spam sites as the most glaring issue. I cannot stress how easy it is to spot web pages, sites, and link farms built to try and game the system from a search engine perspective. I don’t know why people waste their time and money; it’s futile.
The next milestone is 20 million pages, where we hope to release a public beta so people can get accustomed to Fynd.