Web-based frequency dictionaries for medium density languages

Authors:
András Kornai;Péter Halácsy;Viktor Nagy;Csaba Oravecz;Viktor Trón;Dániel Varga
Affiliations:
MetaCarta Inc., Cambridge, MA;Media Research and Education Center, Budapest;Institute of Linguistics, Budapest;Institute of Linguistics, Budapest;U of Edinburgh;Media Research and Education Center, Budapest
Venue:
WAC '06 Proceedings of the 2nd International Workshop on Web as Corpus
Year:
2006

Citing 12
Cited 1

Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Maximum Entropy Markov Models for Information Extraction and Segmentation

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
The Evolution of the Web and Implications for an Incremental Crawler

VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
Introduction to the special issue on the web as corpus

Computational Linguistics - Special issue on web as corpus
TnT: a statistical part-of-speech tagger

ANLC '00 Proceedings of the sixth conference on Applied natural language processing
A stochastic parts program and noun phrase parser for unrestricted text

ANLC '88 Proceedings of the second conference on Applied natural language processing
Multext-East: parallel and comparable corpora and lexicons for six Central and Eastern European languages

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Statistical morphological disambiguation for agglutinative languages

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Classifying the Hungarian web

EACL '03 Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 1
Serial combination of rules and statistics: a case study in Czech tagging

ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Context-based morphological disambiguation with random fields

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Hunmorph: open source word analysis

Software '05 Proceedings of the Workshop on Software

Benefits of resource-based stemming in hungarian information retrieval

CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

Frequency dictionaries play an important role both in psycholinguistic experiment design and in language technology. The paper describes a new, freely available, web-based frequency dictionary of Hungarian that is being used for both purposes, and the language-independent techniques used for creating it.