QALB Shared Task FAQ page

I. How should I participate in the shared task?

You need to follow these steps:

  1. Use the following link to register in the shared task by April 15, 2015. 
  2. You'll be contacted by the organizers about the download information for the training and development dataset.
  3. Build your Error Correction system using the provided dataset and any other resource.  You're welcome to use any NLP framework (statistical, rule-based, etc.).
  4. Subscribe and follow the shared task group (forum) for announcements and updates to the dataset.  Please feel free to raise your questions and contribute to the discussions.
  5. Download the test dataset along with result submission instructions on or after May 16, 2015.  The download link for test dataset will be announced on the shared task group.
  6. Run your system on the test dataset.  Follow the submission instructions carefully and submit your results by May 24, 2015.
  7. Draft a system description paper in English about your approach and experiments.  The paper is expected to follow standard scientific writing and ACL templates (two column format).  The deadline for submitting the system description paper is May 31, 2015.
  8. Follow the shared task result announcements along with the answer keys to the test set around June 1, 2015.  Also the reviews for the system description papers will be released around June 4, 2015.
  9. Use the reviews and also the answer keys to the test set to modify your experiments and improve your system description paper before the camera ready deadline (June 21, 2015).
  10. Come to Beijing and meet your colleagues at the ACL and the ANLP workshop (July 30, 2015).
    Summary of the important dates:
  • Feb 15: Release of the initial training data
  • Apr 1: Final Release of training data
  • Thu. April 30: Registration deadline
  • Sat. May 16: Test set available
  • Sun. May 24: Systems' outputs collected
  • Sun. May 31: System description paper deadline
  • Mon. June 1: Shared task results and answers keys to be announced
  • Sun. June 7: Shared task paper notification
  • Sun. June, 21: Camera ready deadline for the system description paper
  • July 30th: ACL 2015 Workshop in Beijing