Login

Important: Submission policy

To preserve the integrity of the benchmark and prevent overfitting to the test data, we do not allow continuous submissions to the test set. Parameter tuning is strictly limited to the training data. Test set evaluation via this server should only be performed for your final system. To enforce this policy, updates to a method’s test set results are blocked for 24 hours after any test submission. This restriction applies to all test sequences, even if the submission concerns only one of them.

It is not permitted to create multiple test set submissions for the same method, or to register on this webpage with multiple e-mail addresses. We will ban users or domains if required.