Log in

5th Linguistics Annotation Workshop (The LAW V)

Linguistic annotation of natural language corpora is the backbone of supervised methods of statistical natural language processing, as well as other types of corpus-based research. The Fifth LAW will provide a forum for presentation and discussion of innovative research on all aspects of linguistic annotation, including creation/evaluation of annotation schemes, methods for automatic and manual annotation, use and evaluation of annotation software and frameworks, representation of linguistic data and annotations, etc. As in the past, the LAW will provide a forum for annotation researchers to work towards standardization, best practices, and interoperability of annotation information and software. We invite submissions of long (8 pages) and short (4 pages) papers, posters, and demonstrations relating to any aspect of the linguistic annotation, including:

Annotation procedures

  • Innovative automated and manual strategies for annotation
  • Machine learning and knowledge-based methods for automation of corpus annotation
  • Creation, maintenance, and interactive exploration of annotation structures and annotated data

Annotation evaluation

  • Inter-annotator agreement and other evaluation metrics and strategies
  • Qualitative evaluation of linguistic representation

Annotation access and use

  • Representation formats/structures for merged annotations of different phenomena, and means to explore/manipulate them
  • Linguistic considerations for merging annotations of distinct phenomena

Annotation guidelines and standards

  • Best practices for annotation procedures and/or development and documentation of annotation schemes
  • Interoperability of annotation formats and/or frameworks among different systems as well as different tasks, frameworks, modalities, and languages

Annotation software and frameworks

  • Development, evaluation and/or innovative use of annotation software frameworks

Annotation schemes

  • New and innovative annotation schemes
  • Comparison of annotation schemes

The special themes for LAW V

  • Solutions for interoperability of different annotations schemes
  • Using combinations of different annotation layers to improve accuracy of automatic annotation software


Long paper submissions are limited 8 pages in length plus references. Posters and demo descriptions are limited to 4 pages plus references. Format requirements are the same as for full papers of HLT/ACL 2011. See http://www.acl2011.org/call.shtml#submission for style files. Submission will be electronic, using the Workshop's submission webpage at START: https://www.softconf.com/acl2011/law/

Please indicate on the front page:
  • Long paper, poster, or demonstration proposal;
  • All applicable paper categories from the following list (indicate multiple categories if appropriate): annotation frameworks and/or physical formats, annotation scheme design (on linguistic grounds), annotation tools and systems, corpus annotation, syntax, semantics, predicate‐argument structure, morphology, anaphora, discourse, opinion/sentiment;
  • language(s) your work applies to, as well and those you plan to handle in the future. If your work is language independent, indicate this as well;
  • Any non‐standard equipment needed for your paper or demonstration. All papers must be written and presented in English.


The reviewing of the papers will be blind. The paper should not include the authors' names and affiliations. Furthermore, self‐citations and other references (e.g. to projects, corpora, or software) that could reveal the author's identity should be avoided. For example, instead of "We previously showed (Smith, 1991) ...", write "Smith previously showed (Smith, 1991) ...".


Nancy Ide (Vassar College)
Adam Meyers (New York University)

Organizing Committee Members

Chu‐Ren Huang (The Hong Kong Polytechnic University)
Antonio Pareja‐Lora (Universidad Complutense de Madrid)
Massimo Poesio (University of Trento)
Sameer Pradhan (BBN Technologies)
Manfred Stede (Universitat Potsdam)
Nianwen Xue (Brandeis University)

Program Committee Co‐Chairs

Sameer Pradhan (BBN Technologies)
Katrin Tomanek (Friedrich‐Schiller‐Universität Jena)

Program Committee Members

Collin Baker (ICSI/University of California, Berkeley)
Pushpak Bhattacharyya (IIT Bombay)
Nicoletta Calzolari (ILC/CNR)
Richard Eckart de Castilho (Technische Universität Darmstadt)
Mona Diab (Columbia University)
Tomaz Erjavec (Josef Stefan Institute)
Alex Chengyu Fang (City University of Hong Kong)
Christiane Fellbaum (Princeton University)
Charles Fillmore (ICSI/UC Berkeley)
Eduard Hovy (USC/ISI)
Chu‐Ren Huang (Hong Kong Polytechnic)
Nancy Ide (Vassar College)
Richard Johansson (Lund University)
Aravind Joshi (University of Pennsylvania)
Edward Loper (BBN Technologies)
Adam Meyers (New York University)
Antonio Pareja‐Lora (Universidad Complutense de Madrid)
Martha Palmer (University of Colorado)
Massimo Poesio (University of Trento)
Sameer Pradhan (BBN Technologies)
Rashmi Prasad (University of Pennsylvania)
Vasin Punyakanok (BBN Technologies)
James Pustejovsky (Brandeis University)
Manfred Stede (Universität Potsdam)
Katrin Tomanek (Friedrich‐Schiller‐Universität Jena)
Nianwen Xue (Brandeis University)


Important Dates

April 08, 2011: Papers Due
May 2, 2011: Notification of acceptance
May 6, 2011: Camera ready final version due
June 23-24: LAW Workshop, Portland, Oregon


will be held in Portland, OR


RocketTheme Joomla Templates