Follow

The Open Search Foundation wants to build a cooperative search engine:

opensearchfoundation.org

Great project. Unfortunately, the white paper does not yet give much information on how they plan to build the search eninge (other then organisations offering processing time)

opensearchfoundation.org/wp-co

I like the focus on Europe, I wonder if their plans also involve Qwant:

qwant.com

@djoerd Or like NUTCH does cwiki.apache.org/confluence/di

The hard part, however, is to avoid lying, spamming or skewing by (unintentional) malicious nodes. AFAIK this has been unsolved as of yet. Well: probably a few ICO-blockchain-projects that attempt to solve this in that space.

@berkes Does Nutch allow running independent clients?
But you're right: It is hard to manage clients that misbehave...

@djoerd «Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster».

Its architecture is "clustered". Not distributed in the pure sense, but decentralized.

@djoerd IPSE is an interesting project that aims to solve misbehaving search agents through mining. ipse.io/ ipfssearch.io/en/

@berkes Nice, but the page reads a bit too much as an advertisement.

@patricksudlow Still on Duckduckgo. Maybe I should help trees more. .

Sign in to participate in the conversation
Mastodon

The "unofficial" Information Retrieval Mastodon Instance.

Goal: Make idf.social a viable and valuable social space for anyone working in Information Retrieval and related scientific research.

Everyone welcome but expect some level of geekiness on the instance and federated timelines.