๐ ๐๐๐ถ๐น๐ ๐ ๐ฆ๐ฒ๐ฎ๐ฟ๐ฐ๐ต ๐๐ป๐ด๐ถ๐ป๐ฒ
I built a search engine. FrogFind inspired me.
I started with the crawler:
- Python requests
- SQLite3
- robots.txt compliance
I had no experience in this field.
I built the web app:
- Flask
- Redis for rate limits
- Custom search algorithms
I put the project in a pip package. It is called quokko. It has a CLI. You use it to make your own search engine.
The engine has 13 million entries. It finds niche parts of the web. It ignores Big Tech companies.
This is a hobby project. It is not a competitor to big companies. It is a tool for other small search engines.
Site: quokko.splot.dev Code: https://codeberg.org/splot-dev/quokko Source: https://dev.to/splotdev/i-built-an-independent-search-engine-and-the-results-were-interesting-1a9g