Evaluating Evaluation Measures, Evaluating Information Access Systems, Designing and Constructing Test Collections, and Evaluating Again

Links to videos (total running time: about 100 minutes)


Slides (125 pages)


6,931,140 accounts
+13,313 in the last hour
+75,446 in the last day
+430,755 in the last week

Which browser do you use?
Thanks for any boosts! I wanna know!

Me: "haha, who uses all these crazy new top-level domain names?"

*Signs on the Fediverse*

Me: "oh"

I've figured out what pisses me off so much about Facebook's Galactica demo.

It's not because people can use to to write bad essays for their homework. There are plenty of large language models that can do that. It's because Facebook is presenting it as something that it most definitely is not.

Facebook is selling it as a knowledge engine, a "new interface to access and manipulate what we know about the universe."

Actually it's just a random bullshit generator.


I am dead, I can’t believe this AI intro text I just got. If you thumb through it, there are all the usual suspects like breadth-first search and probability.

Then you open the first chapter and it goes HARD on the current state of things.

Then it’s back to mathematical notation like nothing happened.

me, pedestring: omg cobblestone! so cute!!! BRING COBBLESTONE BACK

me, biking: c-c-cob-b-b-bles-t-t-tone s-s-s-uck-k-ks


The "unofficial" Information Retrieval Mastodon Instance.

Goal: Make idf.social a viable and valuable social space for anyone working in Information Retrieval and related scientific research.

Everyone welcome but expect some level of geekiness on the instance and federated timelines.