Special Tagatune Evaluation
This is pretty cool. The MIREX team is hosting a new evaluation
that will attempt to compare music tagging algorithms using the 'Tag a
Tune' (a member of the games-with-a-purpose family of labeling games).
The goal of this evaluation competition is to investigate a new method
of evaluating music tagging algorithms, by using them as bots in
Tagatune, and measuring the number of mistakes players make in guessing
whether they are listening to the same or different songs (we will call
this the Tagatune metric) when paired against different algorithm bots.
The details are here: SpecialTagatuneEvaluation