#mwmbl - non-profit search engine ๐ป mwmbl is a decentralized, non-profit search engine that helps people find information quickly (it is really fast). It has its own index, which makes it unique!
Users can contribute to the project by installing our crawler as a script or using the Firefox extension:
-
https://github.com/mwmbl/crawler-script-
https://addons.mozilla.org/en-US/fox/extension/mwmbl-web-crawler/mwmbl is an open-source community, and they want everyone's input! ๐ค The developer even considers moving the project from
#GitHub to
#codeberg.
Users can suggest domains to crawl if they seem legit. And if you have specific sites in mind that wasn't covered by the current index, feel free to add them too! ๐
Yesterday was a remarkable day for mwmbl - over 23 million URLs were crawled in just one day with only 158 crawlers! ๐ That's a big improvement from the past few weeks. And guess what?
For whatever reason,
#GitHub is always at the top of our list when it comes to crawling URLs. ๐คทโโ๏ธ
So,
@daoud, how many users can your infrastructure handle? Curious to know more about your project! ๐ค