LX-Chunker

Handle:	https://hdl.handle.net/21.11129/0000-000B-D2F9-F (persistent URL to this page)
URL:	http://lxcenter.di.fc.ul.pt/tools/en/LXChunkerEN.html

The present tool, that was built to deal with specific issues concerning orthographic conventions adopted for Portuguese, marks sentence boundaries with <s>…</s>, and paragraph boundaries with <p>…</p>. Unwraps sentences split over different lines.
A f-score of 99.94% was obtained when testing on a 12,000 sentence corpus accurately hand tagged with respect to sentence and paragraph boundaries.
LX-Chunker was developed and is maintained at University of Lisbon by the NLX-Natural Language and Speech Group of the Department of Informatics.

Download

DistributionLicence

MIT

Distribution Access/Medium: Downloadable

Licensors:

António Branco

http://www.di.fc.ul.pt/~ahb/

University of Lisbon, Faculty of Sciences

FCUL

Associate Professor with Habilitation

[javascript protected email address]

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Tel.: +351 217 500 087

Fax: +351 217 500 084

Department of Informatics

http://nlx.di.fc.ul.pt/

FCUL

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Portugal

[javascript protected email address]

Tel.: +351 217 500 087

Fax: +351 217 500 084

Distribution rights holders:

António Branco

http://www.di.fc.ul.pt/~ahb/

University of Lisbon, Faculty of Sciences

FCUL

Associate Professor with Habilitation

[javascript protected email address]

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Tel.: +351 217 500 087

Fax: +351 217 500 084

Department of Informatics

http://nlx.di.fc.ul.pt/

FCUL

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Portugal

[javascript protected email address]

Tel.: +351 217 500 087

Fax: +351 217 500 084

IPR Holder

University of Lisbon, Faculty of Sciences

http://nlx.di.fc.ul.pt/

Department of Informatics

University of Lisbon, Faculty of Sciences

FCUL

[javascript protected email address]

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Portugal

Tel.: +351 217 500 087

Fax: +351 217 500 084

Contact Person

António Branco

http://www.di.fc.ul.pt/~ahb/

University of Lisbon, Faculty of Sciences

FCUL

Associate Professor with Habilitation

[javascript protected email address]

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Tel.: +351 217 500 087

Fax: +351 217 500 084

Department of Informatics

http://nlx.di.fc.ul.pt/

FCUL

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Portugal

[javascript protected email address]

Tel.: +351 217 500 087

Fax: +351 217 500 084

Tool/Service

Tool

Language Independent

Input

Media type: Text

Resource type: Corpus

Modality: Written Language

Language: Portuguese

Mime type: Plain text

Character encoding: ISO - 8859 - 1

Output

Media type: Text

Resource type: Corpus

Modality: Written Language

Language: Portuguese

Mime type: Plain text

Annotation type: Segmentation

Segmentation level: Sentence

Operation

Operating system: Linux

Evaluation

Evaluated: True

Evaluation measure: Human

Resource Creation

Resource Creator

António Branco

http://www.di.fc.ul.pt/~ahb/

University of Lisbon, Faculty of Sciences

FCUL

Associate Professor with Habilitation

[javascript protected email address]

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Tel.: +351 217 500 087

Fax: +351 217 500 084

Department of Informatics

http://nlx.di.fc.ul.pt/

FCUL

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Portugal

[javascript protected email address]

Tel.: +351 217 500 087

Fax: +351 217 500 084

Metadata

Created: 09/10/2012

Last Updated: 10/27/2020

Source: METANET4U

META-SHARE

Metadata Language: english

Metadata Creator

Catarina Carvalheiro

http://nlx-server.di.fc.ul.pt/~catarina/

University of Lisbon, Faculty of Sciences

FCUL

Researcher

[javascript protected email address]

Departamento de Informática NLX - Grupo de Fala e Linguagem Natural, Faculdade de Ciências da Universidade de Lisboa, Edifício C6

1749-016 Lisbon

Tel.: +351 217 500 087

Fax: +351 217 500 084

Department of Informatics

http://nlx.di.fc.ul.pt/

FCUL

Faculdade de Ciências de Lisboa, Departamento de Informática. Campo Grande, 1749-016 Lisboa, Portugal

1749-016 Lisbon

Portugal

[javascript protected email address]

Tel.: +351 217 500 087

Fax: +351 217 500 084

Version

Version: 1

Last Updated: 09/10/2012

Usage

Foreseen UseNlp Applications

Use NLP Specific: Other

Actual Use - Nlp Applications

Use NLP Specific: Other

Documentation

Tool Documentation: Online

Document Type: Other

Catarina Carvalheiro, LX-Chunker Narrative Description, http://portulanclarin.net/repository/extradocs/LXChunker.pdf

Document Type: In Proceedings

António Branco and João Silva, Evaluating Solutions for the Rapid Development of State-of-the-Art POS Taggers for Portuguese., http://www.di.fc.ul.pt/~ahb/#publications , pp. 507-510. , Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC2004) , 2004

Editor: Maria Teresa Lino, Maria Francisca Xavier, Fátima Ferreira, Rute Costa and Raquel Silva

ISBN: 2-9517408-1-6

Document Language: english

People who looked at this resource also viewed the following:

People who downloaded this resource also downloaded the following:

Resources from the same creators