Evaluation of natural language processing
See also:
NLP (Natural Language Processing)
An investigation into the validity of some metrics for automatically evaluating natural language generation systems [PDF] from psu.eduE Reiter… – Computational Linguistics, 2009 – MIT Press Page 1. An Investigation into the Validity of Some Metrics for Automatically Evaluating Natural Language Generation Systems Ehud Reiter * University of Aberdeen Anja Belz ** University of Brighton There is growing interest … Cited by 16 – Related articles – All 15 versions
A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies [PDF] from psu.eduJ Schatzmann, K Weilhammer, M Stuttle… – The Knowledge …, 2006 – portal.acm.org … In Proceedings of the IEEE 64, 532-556. 47. Karen Sparck Jones , Julia R. Galliers , JR Galliers, Evaluating Natural Language Processing Systems: An Analysis and Review, Springer-Verlag New York, Inc., Secaucus, NJ, 1996. … Cited by 105 – Related articles – BL Direct – All 9 versions
[HTML] An open-source framework for large-scale, flexible evaluation of biomedical text mining systems [HTML] from biomedcentral.comW Baumgartner, KB Cohen… – Journal of …, 2008 – archive.biomedcentral.com … BMC Bioinformatics 2005., 6(Suppl 1): OpenURL. Jones KS, Galliers JR, (Eds): Evaluating Natural Language Processing Systems, An Analysis and Review, Volume 1083 of Lecture Notes in Computer Science. Springer; 1996. OpenURL. … Cited by 20 – Related articles – Cached – All 14 versions
[PDF] Automatic learning and evaluation of user-centered objective functions for dialogue system optimisation [PDF] from brandeis.eduV Rieser… – Proc. of LREC, 2008 – pages.cs.brandeis.edu … In Proc. CHI, pages 1343-1346. Karen Sparck Jones and Julia Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Springer Verlag. Oliver Lemon and Olivier Pietquin. 2007. Machine learn- ing for spoken dialogue systems. In Proc. … Cited by 10 – Related articles – View as HTML – All 11 versions
Correlation between ROUGE and human evaluation of extractive meeting summaries [PDF] from psu.eduF Liu… – Proceedings of the 46th Annual Meeting of the …, 2008 – portal.acm.org … The icsi meeting corpus. In ICASSP. KS Jones and J. Galliers. 1996. Evaluating natural language processing systems: An analysis and review. Lecture Notes in Artificial Intelligence. D. Jones, F. Wlof, E. Gilbson, E. Williams, E. Fedorenko, D. Reynolds, and M. Zissman. 2003. … Cited by 15 – Related articles – All 12 versions
[PDF] Comparing automatic and human evaluation of NLG systems [PDF] from upenn.eduA Belz… – Proceedings of EACL, 2006 – acl.ldc.upenn.edu Page 1. Comparing Automatic and Human Evaluation of NLG Systems Anja Belz Natural Language Technology Group CMIS, University of Brighton UK ASBelz@brighton.ac.uk Ehud Reiter Dept of Computing Science University of Aberdeen UK ereiter@csd.abdn.ac.uk Abstract … Cited by 52 – Related articles – View as HTML – All 19 versions
Is text-to-speech synthesis ready for use in computer-assisted language learning? [PDF] from cnrs.frZ Handley – Speech Communication, 2009 – Elsevier Cited by 7 – Related articles – All 6 versions
An efficient statistical approach for automatic organic chemistry summarization [PDF] from florianboudin.orgF Boudin, JM Torres-Moreno… – Advances in Natural …, 2008 – Springer … 2, pp. 723-734 (2002) 15. Spärck Jones, K., Galliers, JR: Evaluating Natural Language Processing Systems: An Analysis and Review. Springer, Heidelberg (1996) 16. Lin, CY: Rouge: A Package for Automatic Evaluation of Summaries. … Cited by 6 – Related articles – All 9 versions
Introducing shared tasks to NLG: The TUNA shared task evaluation challenges A Gatt… – Empirical methods in natural language generation, 2011 – Springer Page 1. Introducing Shared Tasks to NLG: The TUNA Shared Task Evaluation Challenges Albert Gatt1,2 and Anja Belz3 1 Institute of Linguistics, Centre for Communication Technology, University of Malta albert.gatt@um.edu … Cited by 11 – Related articles – All 3 versions
Chinese text automatic summarization based on affinity propagation cluster C Zhao, Q Peng… – 2009 Sixth International Conference on …, 2009 – computer.org … [9] Frey, BJ and D. Dueck, “Clustering by passing messages between data points”, Science, 2007. 315(5814): pp. 972-976. [10] Jones KS, Galliers J R. Evaluating Natural Language Processing Systems : An Analysis and Review. Berlin: Springer,1996. … Related articles – All 4 versions
[PDF] Do we still need gold standard for evaluation [PDF] from psu.eduT Poibeau… – Proceedings of the Language Resources and …, 2008 – Citeseer … Computational Linguistics, 32(2):159-194. Karen Sparck Jones and Jean Gallier. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Oxford University Press, Oxford. Karel Van Den Eynde and Claire Blanche-Benveniste. 1978. … Cited by 8 – Related articles – View as HTML – All 14 versions
[BOOK] Handbook of Research on Text and Web Mining Techologies [PDF] from abo.fiM Song… – 2009 – abo.fi Page 1. Handbook of Research on Text and Web Mining Technologies Min Song New Jersey Institute of Technology, USA Yi-fang Brook Wu New Jersey Institute of Technology, USA Hershey • New York INFORMATION SCIENCE REFERENCE Volume II Page 2. … Cited by 4 – Related articles – View as HTML – Library Search – All 13 versions
[PDF] Reference-based vs. task-based evaluation of human language technology [PDF] from unipi.itA Popescu-Belis – ELRA Workshop on Evaluation Looking into …, 2008 – mailserver.di.unipi.it … 613-620. SparckJones K. and Galliers JR (1996). Evaluating Natural Language Processing Systems: An Analysis and Review, Berlin/New York, Springer-Verlag. Sparck Jones K.(2001). Automatic language and information processing: rethinking evaluation. … Related articles – View as HTML – All 7 versions
GEMS: Generative Modeling for Evaluation of Summaries R Katragadda – Computational Linguistics and Intelligent Text …, 2010 – Springer … pyramid based manual scores. References 1. Hirschman, L., Mani, I.: Evaluation (2001) 2. Jones, KS, Galliers, JR: Evaluating Natural Language Processing Systems: An Analysis and Review. Springer, New York (1996) 2 We have … Cited by 1 – Related articles
Statistical Automatic Summarization in Organic Chemistry [PDF] from arxiv.orgF Boudin, P Velazquez-Morales… – Arxiv preprint arXiv: …, 2009 – arxiv.org … In: JADT. Volume 2. (2002) 723-734 15. Spärck Jones, K., Galliers, JR: Evaluating Natural Language Processing Systems: An Analysis and Review. Springer (1996) 16. Lin, CY: Rouge: A Package for Automatic Evaluation of Summaries. … Related articles – All 4 versions
Automatic Summarization: An Overview H Saggion – Revue française de linguistique appliquée, 2008 – cairn.info … In Proceedings of LREC 2002. Spärck Jones, K. & Galliers, JR (1995). Evaluating Natural Language Processing Systems: An Analysis and Review. Lecture Notes in Artificial Intelligence, 1083. Spärck Jones, K. (1999). Automatic summarising: factors and directions. … Cited by 4 – Related articles – All 2 versions
Multilingual summarization evaluation without human models [PDF] from aclweb.orgH Saggion, JM Torres-Moreno, I Cunha… – Proceedings of the 23rd …, 2010 – portal.acm.org Page 1. Coling 2010: Poster Volume, pages 1059-1067, Beijing, August 2010 Multilingual Summarization Evaluation without Human Models Horacio Saggion TALN – DTIC Universitat Pompeu Fabra horacio.saggion@upf.edu … Related articles – All 11 versions
Textual properties and task based evaluation: investigating the role of surface properties, structure and content [PDF] from aclweb.orgA Gatt… – Proceedings of the 6th International Natural …, 2010 – portal.acm.org Page 1. Textual Properties and Task Based Evaluation: Investigating the Role of Surface Properties, Structure and Content. Albert Gatt Institute of Linguistics University of Malta albert.gatt@um.edu.mt François Portet Laboratoire … Related articles – All 8 versions
[PDF] Extrinsic summarization evaluation: A decision audit task [PDF] from psu.eduG Murray, T Kleinbauer, P Poller, T Becker… – ACM Transactions on …, 2009 – Citeseer Page 1. 2 Extrinsic Summarization Evaluation: A Decision Audit Task GABRIEL MURRAY University of British Columbia THOMAS KLEINBAUER, PETER POLLER and TILMAN BECKER German Research Center for Artificial … Cited by 6 – Related articles – View as HTML – All 19 versions
Exploring correlation between ROUGE and human evaluation on meeting summaries F Liu… – Audio, Speech, and Language Processing, IEEE …, 2010 – ieeexplore.ieee.org Page 1. IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 18, NO. 1, JANUARY 2010 187 Exploring Correlation Between ROUGE and Human Evaluation on Meeting Summaries Feifan Liu and Yang Liu, Member, IEEE … Cited by 4 – Related articles – All 4 versions
[PDF] A Robust and Adaptable Summarization Tool [PDF] from atala.orgH Saggion – Traitement Automatique des Langues, 2008 – atala.org Page 1. SUMMA A Robust and Adaptable Summarization Tool Horacio Saggion Department of Computer Science University of Sheffield 211 Portobello Street – Sheffield, England, UK saggion@dcs.shef.ac.uk Tel: +44-114-222-1947 Fax: +44-114-222-1810 ABSTRACT. … Related articles – View as HTML – All 2 versions
A semantic graph-based approach to biomedical summarisation L Plaza, A Díaz… – Artificial Intelligence in Medicine, 2011 – Elsevier Related articles
[PDF] Critical points in assessing learning performance via cross-validation [PDF] from tkk.fiH Suominen, T Pahikkala… – Proceedings of the 2nd …, 2008 – research.ics.tkk.fi Page 1. CRITICAL POINTS IN ASSESSING LEARNING PERFORMANCE VIA CROSS-VALIDATION Hanna Suominen, Tapio Pahikkala, Tapio Salakoski Turku Centre for Computer Science (TUCS) and University of Turku, Department … Cited by 2 – Related articles – View as HTML – All 3 versions
Supervised automatic evaluation for summarization with voted regression model T Hirao, M Okumura, N Yasuda… – Information Processing & …, 2007 – Elsevier Cited by 6 – Related articles – All 4 versions
Shared-task evaluations in HLT: Lessons for NLG [PDF] from upenn.eduA Belz… – Proceedings of the Fourth International Natural …, 2006 – portal.acm.org … In Proc. INLG’06. K. Spärck Jones and JR Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Springer Verlag. K. Spärck Jones, 1981. Information Retrieval Experi- ment, chapter 12. Butterworth & Co. 5Belz, March 2006. 135 Cited by 10 – Related articles – All 33 versions
Classification procedures for software evaluation [PDF] from archives-ouvertes.frM Amar, S David, R Panckhurst… – 2008 – hal.archives-ouvertes.fr … Pariente J.-CL. (1973), Le langage et l’individuel, Paris : Armand Colin. Sparck-Jones K., Gallier JR (1996), Evaluating Natural Language Processing Systems: an Analysis and Review, Berlin: Springer-Verlag. TREC: http://trec … Cited by 1 – Related articles – All 9 versions
[PDF] Computational linguistics beyond the processing of english [PDF] from linguateca.ptD Santos – 2007 – linguateca.pt … Journal of Experimental and Theoretical Artificial Intelligence, 13(1):9-23, 2001. [9] Karen Sparck-Jones and Julia R. Galliers. Evaluating Natural Language Processing Systems: An Analysis and Review. Springer, 1996. [10] Zeno Vendler. Verbs and times. … Cited by 1 – Related articles – View as HTML – All 2 versions
Learning query-biased web page summarization [PDF] from psu.eduC Wang, F Jing, L Zhang… – Proceedings of the sixteenth …, 2007 – portal.acm.org Page 1. Learning Query-Biased Web Page Summarization 1 Changhu Wang Department of EEIS, University of Science and Technology of China Hefei 230027, China (86)13581984028 wch@ustc.edu Feng Jing * , Lei Zhang * , Hong-Jiang Zhang † … Cited by 13 – Related articles – All 9 versions
Automatic evaluation of summaries using n-gram co-occurrence statistics [PDF] from upenn.eduCY Lin… – Proceedings of the 2003 Conference of the North …, 2003 – portal.acm.org Page 1. Automatic Evaluation of Summaries Using N-gram Co-Occurrence Statistics Chin-Yew Lin and Eduard Hovy Information Sciences Institute University of Southern California 4676 Admiralty Way Marina del Rey, CA 90292 {cyl,hovy}@isi.edu Abstract … Cited by 623 – Related articles – All 32 versions
User-model based personalized summarization A Díaz… – Information Processing & Management, 2007 – Elsevier Cited by 21 – Related articles – All 2 versions
Automatic multidocument summarization of research abstracts: Design and user evaluation [PDF] from wlv.ac.ukS Ou, CSG Khoo… – Journal of the American Society …, 2007 – Wiley Online Library Skip to Main Content. … Cited by 4 – Related articles – BL Direct – All 7 versions
Automatic analysis of medical dialogue in the home hemodialysis domain: structure induction and summarization [PDF] from psu.eduRC Lacson, R Barzilay… – Journal of biomedical informatics, 2006 – Elsevier Cited by 6 – Related articles – Library Search – All 13 versions
[PDF] Sumgraph: text summarization using centrality in the pathfinder network [PDF] from iadis.netK Patil… – IADIS International Journal on Computer Science and …, 2007 – iadis.net Page 1. IADIS International Journal on Computer Science and Information Systems Vol. 2, No. 1, pp. 18-32 ISSN: 1646-3692 18 SUMGRAPH: TEXT SUMMARIZATION USING CENTRALITY IN THE PATHFINDER NETWORK … Cited by 2 – Related articles – View as HTML
NP animacy identification for anaphora resolution [PDF] from psu.eduC Orasan… – Journal of Artificial Intelligence Research, 2007 – aaai.org Page 1. Journal of Artificial Intelligence Research 29 (2007) 79-103 Submitted 09/06; published 06/07 NP Animacy Identification for Anaphora Resolution Constantin Or?asan C.Orasan@wlv.ac.uk Richard Evans RJEvans@wlv.ac.uk … Cited by 5 – Related articles – All 13 versions
[PDF] Summary Evaluation with and without References [PDF] from ipn.mxJM Torres-Moreno, H Saggion, I da Cunha… – Polibits, 2010 – cidetec.ipn.mx … [3] Proceedings of the Text Analysis Conference. Gaithesburg, Maryland, USA: NIST, November 17-19 2008. [4] K. Spärck Jones and J. Galliers, Evaluating Natural Language Processing Systems, An Analysis and Review, ser. Lecture Notes in Computer Science. … Related articles – View as HTML – All 3 versions
[PDF] GEMS: Generative Modeling for Evaluation of Summaries [PDF] from iiit.ac.inK Rahul – 2010 – web2py.iiit.ac.in … pyramid based manual scores. References 1. Hirschman, L., Mani, I.: Evaluation. (2001) 2. Jones, KS, Galliers, JR: Evaluating Natural Language Processing Systems: An Analysis and Review. Springer-Verlag New York, Inc … Related articles – View as HTML
Evaluating Web search result summaries [PDF] from psu.eduS Liang, S Devlin… – Advances in Information Retrieval, 2006 – Springer … 11. Pagano, RR: Understanding statistics in the behavioural sciences. Wadsworth/Thomson Learning, USA (2001). 12. Sparck Jones, C. and Galliers, JR: Evaluating natural language processing systems: an analysis and review. Springer, New York (1996). 13. … Cited by 6 – Related articles – BL Direct – All 10 versions
General Principles of User-Oriented Evaluation Margaret King M King – Evaluation of Text and Speech Systems, 2007 – Springer Page 1. Chapter 5 GENERAL PRINCIPLES OF USER-ORIENTED EVALUATION Margaret King ISSCO – School of Translation and Interpretation, ETI University of Geneva, Switzerland Maghi.King@gmail.com Abstract This chapter … Cited by 4 – Related articles – All 4 versions
An E?cient Statistical Approach for Automatic Organic Chemistry Summarization JMTM FlorianBoudin1… – Advances in natural …, 2008 – books.google.com … 2, pp. 723-734 (2002) 15. Sparck Jones, K., Galliers, JR: Evaluating Natural Language Processing Systems: An Analysis and Review. Springer, Heidelberg (1996) 16. Lin, CY: Rouge: A Package for Automatic Evaluation of Summaries. … Related articles
Identifying commented passages of documents using implicit hyperlinks [PDF] from archives-ouvertes.frJY Delort – Proceedings of the seventeenth conference on …, 2006 – portal.acm.org Page 1. Identifying Commented Passages of Documents Using Implicit Hyperlinks Jean-Yves Delort University of Montpellier 2 Montpellier, France delort@lirmm.fr ABSTRACT This paper addresses the issue of automatically … Cited by 7 – Related articles – All 10 versions
[PDF] Establishing a methodology for benchmarking speech synthesis for computer-assisted language learning (CALL) [PDF] from psu.eduZ Handley… – Language Learning and Technology, 2005 – Citeseer Page 1. Language Learning & Technology http://llt.msu.edu/vol9num3/handley/ September 2005, Volume 9, Number 3 pp. 99-120 Copyright (c) 2005, ISSN 1094-3501 99 ESTABLISHING A METHODOLOGY FOR BENCHMARKING … Cited by 14 – Related articles – View as HTML – All 8 versions
[PDF] Task-based MT evaluation: from who/when/where extraction to event understanding [PDF] from mt-archive.infoJ Laoudi, CR Tate… – LREC-2006: Fifth International …, 2006 – mt-archive.info … Annotation. LAMP-TR-126. U. of Maryland, College Park. Spaerck-Jones, K. and JR Gallier. (1996). Evaluating Natural Language Processing Systems: An Analysis and Review. Springer, Berlin. Tate, C., S. Lee, C. Voss (2003). Task … Cited by 4 – Related articles – View as HTML – All 6 versions
A Framework for the Measurement of Simulated Behavior Performance [PDF] from dtic.milCM Cooper – 2011 – DTIC Document Page 1. A FRAMEWORK FOR THE MEASUREMENT OF SIMULATED BEHAVIOR PERFORMANCE THESIS Christopher M. Cooper, 2d Lt, USAF AFIT/GCE/ENG/11-02 DEPARTMENT OF THE AIR FORCE AIR UNIVERSITY AIR FORCE INSTITUTE OF TECHNOLOGY … Related articles – All 3 versions
[PDF] Multi-document biography summarization [PDF] from upenn.eduL Zhou, M Ticrea… – Proceedings of EMNLP, 2004 – acl.ldc.upenn.edu … New Brunswick, New Jersey: Association for Computational Linguistics. Karen Spärck Jones and Julia R. Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Lecture Notes in Artificial Intelligence 1083. Berlin: Springer. … Cited by 25 – Related articles – View as HTML – All 22 versions
[PDF] Do summaries help? a task-based evaluation of multi-document summarization [PDF] from psu.eduK McKeown, RJ Passonneau, DK Elson… – Proceedings of …, 2005 – Citeseer Page 1. Do Summaries Help? A Task-Based Evaluation of Multi-Document Summarization Kathleen McKeown Columbia University kathy@cs.columbia.edu Rebecca J. Passonneau Columbia University becky@cs.columbia.edu … Cited by 26 – Related articles – View as HTML – All 12 versions
[PDF] A Chinese Automatic Text Summarization system for mobile devices [PDF] from aclweb.orgL Yu, M Liu, F Ren… – The Pacific Asia Conference on …, 2006 – aclweb.org … 8. HP Edmundson.: New Methods in Automatic Extraction[A]. In Advances in Automatic Text Summarization[C]. (1998) 23-42 9. S. Jones and J. Galliers.: Evaluating Natural Language Processing Systems: an Analysis and Review. Springer, New York, (1996) 10. I. Mani. … Cited by 2 – Related articles – View as HTML – All 6 versions
Do summaries help? K McKeown, RJ Passonneau, DK Elson… – Proceedings of the …, 2005 – portal.acm.org Page 1. Do Summaries Help? A Task-Based Evaluation of Multi-Document Summarization Kathleen McKeown Columbia University kathy@cs.columbia.edu Rebecca J. Passonneau Columbia University becky@cs.columbia.edu … Cited by 21 – Related articles – All 2 versions
Letsum, an automatic legal text summarizing system [PDF] from psu.eduA Farzindar… – Legal knowledge and information …, 2004 – books.google.com … law. ICAIL, pages 84-93, 1987. [11] Karen Spark-Jones and Julia R. Galliers. Evaluating Natural Language Processing Systems: An Analysis and Review. Number 1083 in Lecture Notes in Artificial Intelligence. Springer, 1995. Cited by 14 – Related articles – All 8 versions
[PDF] Generation of reference summaries [PDF] from psu.eduM Hassel… – Proceedings of 2nd Language and Technology …, 2005 – Citeseer … WA. Spark-Jones, K. and JR Galliers. 1995. Evaluating Natural Language Processing Systems: An Analysis and Review. Number 1083 in Lecture Notes in Artificial Intelligence. Springer. Winkel, A. and D. Radev. 2002. MEADeval … Cited by 7 – Related articles – View as HTML – All 9 versions
Extracting conceptual relationships from specialized documents [PDF] from ncu.edu.twB Hui… – Data & Knowledge Engineering, 2005 – Elsevier Cited by 14 – Related articles – All 5 versions
[BOOK] Resource lean and portable automatic text summarization [PDF] from psu.eduM Hassel – 2007 – Citeseer Page 1. Resource Lean and Portable Automatic Text Summarization MARTIN HASSEL Doctoral Thesis Stockholm, Sweden 2007 Page 2. TRITA-CSC-A 2007:9 ISSN-1653-5723 ISRN-KTH/CSC/A–07/09–SE ISBN-978-91-7178-704-0 … Cited by 13 – Related articles – View as HTML – Library Search – All 11 versions
World wide web site summarization [PDF] from psu.eduY Zhang, N Zincir-Heywood… – WEB INTELLIGENCE AND …, 2004 – IOS Press Page 1. Web Intelligence and Agent Systems: An international journal 2 (2004) 39-53 39 IOS Press World Wide Web site summarization Yongzheng Zhang, Nur Zincir-Heywood and Evangelos Milios Faculty of Computer Science … Cited by 26 – Related articles – BL Direct – All 18 versions
Consensus Text Summarizer Based on Meta-Search Algorithms V Thapar, AA Mohamed… – Signal Processing and …, 2006 – ieeexplore.ieee.org … Technologies, 1993. [13] K. Spärck-Jones and JR Galliers, “Evaluating Natural Language Processing Systems: An Analysis and Review” presented at Lecture Notes in Artificial Intelligence 1083, Springer-Verlag, 1996. 407 Cited by 1 – Related articles – All 2 versions
Generating user-focused, content-based summaries for multi-documents using document graphs (PDF) AA Mohamed – 2005 – computer.org … Documentation, 28(1): 11-21, 1972. [19] K. Spärck-Jones and JR Galliers, “Evaluating Natural Language Processing Systems: An Analysis and Review,” Lecture Notes in Artificial Intelligence 1083. Springer-Verlag, 1996. 679 Cited by 4 – Related articles – All 2 versions
Accuracy and suitability: New challenges for evaluation M King – Language resources and evaluation, 2005 – Springer Page 1. Accuracy and Suitability: New Challenges for Evaluation MARGARET KING TIM/ISSCO, School of Translation and Interpretation, University of Geneva, Uni-Mail, 40 blvd du Pont d’Arve, CH-1205, Geneva E-mail: Margaret.King@issco.unige.ch 1. Paradigms of Evaluation … Cited by 3 – Related articles – BL Direct – All 5 versions
[PDF] Believable conversational agents: Introducing the intention map [PDF] from shef.ac.ukP Wallis – International conference on autonomous agents and …, 2005 – nlp.shef.ac.uk … [19] B. Reeves and C. Nass. The Media Equation. CSLI Publications, Stanford, 1996. [20] K. Sparck-Jones and JR Galliers. Evaluating Natural Language Processing Systems: An analysis and review. Lecture Notes in Artificial Intelligence. Springer, 1996. [21] H. Tennant. … Cited by 2 – Related articles – View as HTML – All 5 versions
Principles of Evaluation in Natural Language Processing [PDF] from archives-ouvertes.frP Paroubek, S Chaudiron… – Traitement …, 2007 – halshs.archives-ouvertes.fr Page 1. Principles of Evaluation in Natural Language Processing Patrick Paroubek1 – Stéphane Chaudiron2 – Lynette Hirschman3 LIMSI – CNRS, Bât. 508 Université Paris XI BP 133 – 91403 ORSAY Cedex – France pap@limsi.fr 1 … Related articles – All 7 versions
[PDF] Résumé automatique multi-document et indépendance de la langue: une premiere évaluation en français [PDF] from univ-avignon.frF Boudin… – … de la Langue Naturelle (TALN’09 …, 2009 – lia.univ-avignon.fr … Information Processing and Management, 40(6), 919-938. SPÄRCK JONES K. & GALLIERS JR (1996). Evaluating Natural Language Processing Systems : An Analysis and Review. Springer. TEUFEL S. & MOENS M. (1997). Sentence extraction as a classification task. … Cited by 2 – Related articles – View as HTML – All 6 versions
Mice from a mountain: Reflections on current issues in evaluation of written language technology R Gaizauskas… – Charting a New Course: Natural Language …, 2005 – Springer Page 1. 195 John I. Tait (ed.), Charting a New Course: Natural Language Processing and Information Retrieval. Essays in Honour of Karen Spärck Jones. 195-238 (c) 2005 Springer. Printed in the Netherlands. ROBERT GAIZAUSKAS AND EMMA J. BARKER … Cited by 2 – Related articles – All 2 versions
A text summarizer based on meta-search [PDF] from iiita.ac.inAA Mohamed… – Proceedings of the Fifth IEEE …, 2005 – computer.org … Documentation, 28(1): 11-21, 1972. [15] K. Spärck-Jones and JR Galliers, “Evaluating Natural Language Processing Systems: An Analysis and Review,” Lecture Notes in Artificial Intelligence 1083, Springer-Verlag, 1996. 674 Cited by 1 – Related articles – All 3 versions
[HTML] Evaluation of NLP technology for AAC using logged data [HTML] from stanford.eduA Copestake, D Flickinger – … at http://www-csli. stanford. edu/ …, 2003 – www-csli.stanford.edu … Proceedings of the Technology and Persons with Disabilities Conference (CSUN-98), Los Angeles, CA. Sparck Jones, K. and JR Galliers (1995) `Evaluating Natural Language Processing systems: an analysis and review’. Springer-Verlag. Cited by 12 – Related articles – Cached
[HTML] CESTA: The European MT Evaluation Campaign [HTML] from multilingual.comM DABBADIE, WM EL HADI… – Multilingual Computing & …, 2004 – multilingual.com … Sparck-Jones K., Gallier, JR (1996). Evaluating Natural Language Processing Systems: An Analysis and Review, Springer, Berlin. TREC, NIST Website, last updated, August 1st, 2000, visited by the authors, 23-03-2003. Vanni, M. and K. Miller (2001). … Cited by 3 – Related articles – Cached – All 12 versions
[PDF] Extrinsic evaluation of automatic metrics for summarization [PDF] from psu.eduB Dorr, C Monz, D Oard, S President, D Zajic… – 2004 – Citeseer Page 1. 1 LAMP-TR-115 July 20, 2004 CAR-TR-999 CS-TR-4610 UMIACS-TR-2004 Extrinsic Evaluation of Automatic Metrics for Summarization * Bonnie Dorr, Christof Monz, Douglas Oard, Stacy President, David Zajic University … Cited by 5 – Related articles – View as HTML – All 18 versions
Living up to standards [PDF] from aclweb.orgM King – Proceedings of the EACL 2003 Workshop on …, 2003 – portal.acm.org … ELSE project. (Evaluation in Speech and Language Engineering). Sparck-Jones, K. and Galliers JR 1996. Evaluating Natural Language Processing Systems:An Analysis and Review. Lecture Notes in Artificial Intelligence 1083. Springer-Verlag. Cited by 7 – Related articles – All 7 versions
[CITATION] LYNETTE HIRSCHMAN I MANI – The Oxford handbook of computational …, 2005 – Oxford University Press, USA Related articles
Summarizing Web sites automatically [PDF] from psu.eduY Zhang, N Zincir-Heywood… – Advances in Artificial Intelligence, 2003 – Springer Page 1. Summarizing Web Sites Automatically Yiquing Zhang Zhang, Nur Zincir-Heywood, and Evangelos Milios Dalhousie University Abstract. This research is directed towards automating the Web Site summarization task. … Cited by 10 – Related articles – BL Direct – All 22 versions
Work-in-progress project report: CESTA-machine translation evaluation campaign [PDF] from upenn.eduW Mustafa El Hadi, M Dabbadie, I Timimi… – Proceedings of the …, 2004 – portal.acm.org Page 1. Work-in-Progress project report : CESTA – Machine Translation Evaluation Campaign Widad Mustafa El Hadi IDIST / CERSATES Université de Lille 3 Domaine universitaire du “Pont de Bois” rue du Barreau BP 149 59653 … Cited by 2 – Related articles – All 16 versions
[PDF] Le rôle des métriques d’évaluation dans le processus de recherche en TAL [PDF] from atala.orgA Popescu-Belis – TAL (Traitement Automatique de la Langue, 2008 – atala.org Page 1. TAL. Volume 48 – n° 1/2007, pages 67 à 91 Le rôle des métriques d’évaluation dans le processus de recherche en TAL Andrei Popescu-Belis IDIAP Research Institute Centre du Parc Av des Prés-Beudin 20 Case postale … Cited by 5 – Related articles – View as HTML – All 4 versions
Corporizando algumas questões [PDF] from rcaap.ptD Santos – Avanços da linguística de Corpus no Brasil, 2008 – books.google.com … Amsterdam/Philadelphia, Benjamins, 2006, pp. 55-72. SPARCK-JONES, Karen & Julia R. GALL1ERS. Evaluating Natural Language Processing Systems: An Analysis and Review. Springer, 1996. SVARTVIK, Jan. Corpus linguistics 25+ years on. … Related articles – All 3 versions
Making miracles: Interactive translingual search for cebuano and hindi [PDF] from psu.eduD He, DW Oard, J Wang, J Luo… – ACM Transactions on …, 2003 – portal.acm.org Page 1. Making MIRACLEs: Interactive Translingual Search for Cebuano and Hindi DAQING HE, DOUGLAS W. OARD, JIANQIANG WANG, JUN LUO, DINA DEMNER-FUSHMAN, KAREEM DARWISH, and PHILIP RESNIK University … Cited by 21 – Related articles – All 17 versions
Reuse and challenges in evaluating language generation systems: Position paper [PDF] from psu.eduK Bontcheva – Proceedings of the EACL 2003 Workshop on …, 2003 – portal.acm.org … Journal of Applied Artificial Intelligence, 9(3):259- 287. Karen Sparck Jones and Julia R. Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Number 1083 in Lec- ture Notes in Artificial Intelligence. Springer Verlag, Berlin, Heidelberg. … Cited by 2 – Related articles – All 10 versions
[PDF] A daily scrum meeting summarizer for Agile software development teams [PDF] from ucalgary.caS Park – 2007 – ase.cpsc.ucalgary.ca Page 1. UNIVERSITY OF CALGARY A Daily Scrum Meeting Summarizer for Agile Software Development Teams By Shelly Park A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE … Related articles – View as HTML – All 11 versions
The diversity-based approach to open-domain text summarization* 1 T Nomoto… – Information processing & management, 2003 – Elsevier Cited by 14 – Related articles – All 7 versions
[PDF] Disseminating Research in Accessible Ways: the Globalization and Autonomy Compendium [PDF] from mcmaster.caW Coleman… – … on Text Analysis November 19-21 …, 2004 – tapor1.mcmaster.ca … ICAIL, pages 84-93. Karen Spark-Jones and Julia R. Galliers. 1995. Evaluating Natural Language Processing Systems: An Analysis and Review. Number 1083 in Lecture Notes in Artificial Intelligence. Springer. 36| CaSTA 2004-The Face of Text Related articles – View as HTML – All 2 versions
[PDF] Evaluation of Automatic Text Summarization [PDF] from psu.eduM Hassel – Licentiate thesis, School of Computer Science and …, 2004 – Citeseer Page 1. Evaluation of Automatic Text Summarization A practical implementation MARTIN HASSEL Licentiate Thesis Stockholm, Sweden 2004 Page 2. TRITA NA 2004-08 ISSN 0348-2952 ISRN KTH/NA/R–04/08–SE ISBN 91-7283-753-5 … Cited by 1 – Related articles – View as HTML – All 7 versions
[PDF] A local grammar for proper names [PDF] from psu.eduHN Traboulsi – 2004 – Citeseer Page 1. A Local Grammar for Proper Names Hayssam N Traboulsi Submitted for the MPhil to PhD Transfer from the University of Surrey Information Extraction and Multimedia Group Department of Computing School of Electronics … Cited by 5 – Related articles – View as HTML – All 2 versions
Extracting conceptual relationships from specialized documents [PDF] from buffalo.eduB Hui… – Conceptual Modeling-ER 2002, 2003 – Springer … Academic Press, Inc. (1993) 7. Sparck-Jones, K., Galliers, J.: Evaluating natural language processing systems: an analysis and review. New York: Springer (1996) 8. Hovy, E., Marcu, D.: Automated Text Summarization: Tutorial Notes. … Cited by 1 – Related articles – BL Direct – All 11 versions
MetaTools-Investigating Metadata Generation Tools-Final Report [PDF] from jisc.ac.ukM Polfreman… – 2008 – ie-repository.jisc.ac.uk Page 1. Project Acronym: MetaTools Version: 1a Contact: (until 31 October 2008): Malcolm Polfreman (malcolm.polfreman@kcl.ac.uk) Contact: (after 31 October 2008): Steve Grace (stephen.grace@kcl.ac.uk) Date: 30/10/2008 JISC Final Report MetaTools Final Report Project … All 6 versions
[PDF] An intrinsic approach to the evaluation of a conceptual generator [PDF] from psu.eduL Specia… – 2003 – Citeseer … 311-318. [17] Sparck-Jones, K. and Galliers, JR Evaluating Natural Language Processing Systems: an Analysis and Review. Springer-Verlag, 1996. [18] Teufel, S. and Moens, M. Argumentative classification of extracted sentences as a first step towards flexible abstracting. … Related articles – View as HTML – All 6 versions
[PDF] Addressing a Bottleneck in Data Integration using Automated Learning Techniques [PDF] from psu.eduE Hovy, J Ambite… – EMISSION INVENTORIES- APPLYING NEW …, 2003 – Citeseer … Journal of Autonomous Agents and Multi-Agent Systems 4:93-114. Spärck Jones, K. and JR Galliers. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. New York: Springer. Tejada, S., CA Knoblock, and S. Minton. 2001. … Related articles – View as HTML – All 4 versions
[PDF] ?? HowNet ????????????? [PDF] from clr.org.cn??, ???, ???… – ??????, 2005 – clr.org.cn … ????????????????. ??????. 2003.6(24),531~534 [10] Sparck-Jones, K., and Galliers, J. 1996. Evaluating Natural Language Processing Systems: An Analysis and Review. Lecture Notes in Artificial Intelligence 1083. Springer-Verlag. … Cited by 23 – Related articles – View as HTML – All 7 versions
?????????????????????? ?? – 2006 – nthur.lib.nthu.edu.tw … Vol. 38, No. 6, pp. 420-422. [36] Jones, KS, and Galliers, J., 1996, “Evaluating Natural Language Processing Systems: An Analysis and Review,” Technical Report TR-291, Computer Laboratory, University of Cambridge. [37 … All 2 versions
[PDF] Production automatique du résumé de textes juridiques: évaluation de qualité et d’acceptabilité [PDF] from umontreal.caA Farzindar… – TALN 2005, 2005 – rali.iro.umontreal.ca … In DUC03, p. 160-167, Edmonton, Alberta, Canada: Association for Computational Linguistics. SPARK-JONES K. & GALLIERS JR (1995). Evaluating Natural Language Processing Systems: An Analysis and Review. Number 1083 in Lecture Notes in Artificial Intelligence. … Cited by 9 – Related articles – View as HTML – All 5 versions
[PDF] Évaluation des systèmes d’acquisition de terminologie: nouvelles pratiques, nouvelles métriques [PDF] from univ-paris3.frI Timimi – Actes des 8e Journées internationales d’Analyse …, 2006 – cavi.univ-paris3.fr … Page 12. ISMAÏL TIMIMI JADT 2006 : 8es Journées internationales d’Analyse statistique des Données Textuelles 906 Sparck-Jones K. and Gallier JR (1996). Evaluating Natural Language Processing Systems : An Analysis and Review. Springer, Berlin, 1996. Timimi I. (1998). … Related articles – View as HTML – All 3 versions
Outiller la linguistique: de l’emprunt de techniques aux rencontres de savoirs B Habert – Revue française de linguistique appliquée, 2004 – cairn.info Cited by 8 – Related articles – All 3 versions
[PDF] ConPor: um modelo de geração conceitual para o português [PDF] from wlv.ac.ukL Specia… – 2003 – clg.wlv.ac.uk … 318. Sparck-Jones, K. and Galliers, JR (1996) “Evaluating Natural Language Processing Systems: an Analysis and Review”, Springer-Verlag. Uchida, H. (2001) “UNL Knowledge Base”, UNU/IAS/UNL Center, Tokyo. Uchida … Related articles – View as HTML – All 9 versions
[PDF] O processo de avaliação do sistema ConPor [PDF] from ufscar.brL Specia… – 2003 – dc.ufscar.br Page 1. Universidade de São Paulo – USP Universidade Federal de São Carlos – UFSCar Universidade Estadual Paulista – UNESP O processo de avaliação do sistema ConPor Lucia Specia Lucia Helena Machado Rino NILC-TR-03-05 Fevereiro, 2003 … Related articles – View as HTML – All 3 versions
Filtrage pour la construction de résumés multi-documents guidée par un profil [PDF] from archives-ouvertes.frO Ferret, S Leila Châar… – Traitement …, 2004 – hal-cea.archives-ouvertes.fr Page 1. TAL. Volume X – n° X/2004, pages X à Y Filtrage pour la construction de résumés multi-documents guidée par un profil Sana Leila Châar, Olivier Ferret et Christian Fluhr CEA – LIST/LIC2M (Laboratoire d’Ingénierie … Related articles – All 4 versions
[PDF] Prendre en compte la dimension globale d’un corpus dans la contextualisation du sens: expérimentations en informatique linguistique [PDF] from archives-ouvertes.frP Beust… – 2006 – hal.archives-ouvertes.fr Page 1. PRENDRE EN COMPTE LA DIMENSION GLOBALE D’UN CORPUS DANS LA CONTEXTUALISATION DU SENS : EXPÉRIMENTATIONS EN INFORMATIQUE LINGUISTIQUE Pierre BEUST, Thibault ROY GREYC CNRS … Cited by 1 – Related articles – View as HTML – All 8 versions