Research Interests

• digital libraries,
• information retrieval.

The research about digital libraries concerns the definition, design, development, and evaluation of architectures and components for digital library systems as well as the interoperability among different digital library systems.
In particular, the creation of annotation services has been investigated, as well as the definition of a reference model for digital libraries and the issues concerning the evaluation of quality in digital libraries.

The research about information retrieval concerns the development of multilingual information access systems and their evaluation, as well as the creation of software infrastructures for large-scale evaluation campaigns.
In particular, a digital library system, called DIRECT, for managing, accessing, and curating the scientific data produced during evaluation campaigns has been designed and developed.
This work is currently carried on by coordinating the PROMISE FP7 Network of Excellence.

Current Projects

International Projects

PROMISE (Contract n. 258191, 2010-2013) ^

It aims at providing a virtual laboratory for conducting participative research and experimentation to carry out, advance and bring automation into the evaluation and benchmarking of complex multilingual and multimedia information systems, by facilitating management and offering access, curation, preservation, re-use, analysis, visualization, and mining of the collected experimental data.

Role: Coordinator of the project.

ELIAS (Contract n. 09-RNP-085, 2011-2016) ^

It aims at achieving an evaluation methodology directed at user-oriented interactive evaluation, a new and tested set of interactive evaluation metrics, infrastructure and test suites based on these and an ongoing collaborative forum with evaluation cycles with a focus on evaluating information access systems, as well as producing a European network of new researchers trained in the improved methodologies.

Role: Member of the Steering Committe and representative for Italy.

CULTURA (Contract n. 269973, 2011-2014) ^

It aims delivering innovative adaptive services and an interactive user environment which dynamically tailors the investigation, comprehension and enrichment of digital humanities artefacts and collections. Through the provision of such functionality, CULTURA can empower all users to investigate, comprehend and contribute to digital cultural collections.

Role: : Participant of the unit of the Department; responsible of the re-design and re-engineering of the FAST annotation back-end used by the CULTURA adaptive environment.

National Projects

University of Padua Post-Doc Research Program Grant (2011-2013) ^

The research program entitle "Harnessing the Scientific Data Produced by the Experimental Evaluation of Multilingual Information Access Systems by means of Advanced, Distributed and Open Infrastructures" funds a post-doc grant for defining an appropriate conceptual model taking into consideration and describing all the entities involved in the evaluation process. From the conceptual model, appropriate data and metadata formats will be derived for representing, managing and exchanging information among the different components of the evaluation infrastructure.

Role: Scientific responsible for the research program and supervisor of the post-doc researcher.

PV (2008-2013) ^

It is a project of the Veneto Region aimed at designing and developing the portal to the libraries of the Region, offering advanced services such as annotation or geo-spatial location.

Role: Participant of the unit of the Department; responsible for the design and developement of the PV digital library system.

SIAR (2005-2013) ^

It is a project of the Veneto Region aimed at designing and developing the regional archival system for managing the historical archives of the Region.

Role: Participant of the unit of the Department; responsible for the design and developement of the SIAR system.

Past Projects

International Projects

EuropeanaConnect (Contract n. ECP-2008-DILI-528001, 2009-2011) ^

It develops services and components for the Europeana digital library with a special focus on multilinguality and interoperability.

Role: Leader of the unit of the Department; leader of task 2.1 about user requirements and use cases for multilinguality; leader of task 2.5 about evaluation of the multilingual information access components.

EuropeanaV1 (Contract n. ECP-2008-DILI-558001, 2009-2011) ^

It aims at delivering the European Digital Library as an operational service and the community behind it.

Role: Leader of the unit of the Department; member of the working group on the Europeana Data Model with a focus on multilinguality and annotations.

TrebleCLEF (Contract n. 215231, 2008-2009) ^

It fosters and promotes the experimental evaluation of multilingual information access systems.

Role: Leader of the unit of the Department; leader of WP2 about the organization of the CLEF evaluation campaigns and the design and development of the evaluation infrastructure; leader of task 2.4 about the systematic experiments which study the impact of languages over system components and are carried out in Grid@CLEF.

TELplus (Contract n. ECP-2006-DILI-510003, 2007-2009) ^

It aims at improving The European Library, which is the access point to 48 national libraries across Europe, and delivers components and additional functionalities to it.

Role: Participant of the unit of the Department; responsible of the design and development of the FAST annotation back-end used by the TELplus system.

SAPIR (Contract n. IST-045128, 2007-2009) ^

It delivers advanced multimedia (audio, text, images) search capabilities over P2P networks.

Role: Participant of the unit of the Department; responsible of the design of the SPINA framework for P2P text retrieval.

DELOS (Contract n. G038-507618, 2004-2007) ^

It is the European network of excellence on digital libraries. It developed the DELOS reference model for digital libraries, which provided the foundations for defining what a digital library is, and delivered the DelosDLMS, the next generation digital library management systems complying with the reference model.

Role: Participant of the unit of the Department; participant to the reference model for the part concerning quality in digital libraries; responsible for the design and developement of the FAST annotation service, adopted within the DelosDLMS prototype.

National Projects

SAN (2009-2011) ^

It is a project of the Direzione Generale Archivi (DGA) of the Ministry of Cultural Heritage and Activities for the design and development of a national archival system.

Role: Representative of the Veneto Region in the working group about the metadata for the archival resources managed by the SAN system.

ECD (Law n. 47/97-99, 2002-2005) ^

It is a national CNR project to develop methods and components to deliver enhanced content to the end-users of both digital libraries and the Web.

Role: Participant of the unit of the Department; responsible for the design and developement of the FAST annotation service.

Invited Talks

2013 ^

1. Ferro, N. (2013). Experimental Evaluation and the Web of Data. Keynote talk at Open Research Areas in Information Retrieval (OAIR 2013), 10th International Conference in the RIAO series, 24 May 2013, Instituto Superior de Engenharia de Lisboa (ISEL), Lisbon, Portugal.
2. Ferro, N. (2013). Multilingual and Multimedia Information Access Evaluation. Official Master's Degree in Artificial Intelligence, Pattern Recognition and Digital Imaging (MIARFID), 21 February 2013, Universitat Politècnica de València, Spain.
3. Ferro, N. (2013). Lessons Learned in Designing and Developing Digital Archives. International Workshop on Digital Archives for a Social History of Fashion and Costume, 15 February 2013, Università di Bologna Rimini Campus, Italy.
4. Ferro, N. (2013). Evaluation Infrastructures. PROMISE Winter School 2013 on Bridging between Information Retrieval and Databases, 7 February 2013, Bressanone, Italy.
5. Ferro, N. (2013). Supporting IR Experimentation through Evaluation Infrastructures. Integrating Data for Analysis, Anonymization, and Sharing (iDASH) External Webinar, National Institute of Health (NIH) Roadmap for Medical Research, 18 January 2013, Division of Biomedical Informatics, University of California, San Diego, USA.

2012 ^

6. Ferro, N. (2012). The CLEF Initiative From 2010 to 2013 and Onwards. Forum for Information Retrieval Evaluation (FIRE 2012), 19 December 2012, Kolkata, India.
7. Ferro, N. (2012). Evaluation Infrastructures for IR Experimentation. Forum for Information Retrieval Evaluation (FIRE 2012), 18 December 2012, Kolkata, India.
8. Ferro, N. (2012). The CLEF Initiative: From 2010 to 2012 and Onwards. MediaEval Benchmarking Initiative for Multimedia Evaluation, MediaEval 2012 Workshop, 5 October 2012, Pisa, Italy.
9. Ferro, N. (2012). Gearing up Evaluation to Drive and Support MLIA Systems Development. Special Session: EC Projects, a broad overview organized by "Unit E1 Language Technologies" at the Eighth International Conference on Language Resources and Evaluation (LREC 2012), 24 May 2012, Istanbul, Turkey.
10. Ferro, N. and Silvello, G. (2012). Evaluation Infrastructures: Experimentation, Visualization and... Simulation. University of Tampere, Finland, 23 March 2012.
11. The Second Strategic Workshop on Information Retrieval in Lorne (SWIRL 2012), Lorne, Australia, 15-17 February 2012.

2011 ^

12. Experimental Evaluation and Hypertexts. First Workshop on Personalised Multilingual Hypertext Retrieval (PMHR 2011), co-located with the 22nd ACM Conference Hypertext and Hypermedia. Eindhoven, The Netherlands, 6 June 2011.
13. Ferro, N. (2011). Perspectives for Large-scale Evaluation Campaigns and the Cross-Language Evaluation Forum. University of Lugano, Switzerland, 10 February 2011.

2010 ^

14. Ferro, N. (2010). Evaluation Campaigns: What Should We Do with Our Data?, Forum for Information Retrieval Evaluation (FIRE). DAIICT, Gandhinagar, Gujarat, India, 19-21 February 2010.
15. Ferro, N. (2010). CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum. The 8th NTCIR Workshop (2009/2010) - Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access, National Institute of Informatics (NII), Tokyo, Japan, 15-18 June 2010.
16. Ferro, N. (2010). Cross-Language Evaluation Forum. Networking Session "Benchmarking multimedia retrieval applications" at ICT 2010: Digitally Driven. Brussels, Belgium, 27-29 September 2010.
17. Ferro, N. (2010). Quality and Interoperability. DL.org Autumn School on Digital Libraries and Digital Repositories: Modelling, Best Practices & Interoperability}, Athens, Greece, 3-8 October 2010.
18. Ferro, N. (2010). CLEF and PROMISE. AI*IA Workshop on Human Language Technologies for Italian, Brescia, Italy, 1 December 2010.

2009 ^

19. Ferro, N. (2009). MLIA Architectures: Standalone Applications and Services to Complex Systems. TrebleCLEF Summer School on Multilingual Information Access. Santa Croce in Fossabanda, Pisa, Italy, 15-19 June 2009.
20. Ferro, N. (2009). Multilinguality and Digital Libraries. Fondazione Bruno Kessler (FBK), Trento, Italy, 18 June 2009.

2008 ^

21. Ferro, N. and Peters, C. (2008). From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum. The 7th NTCIR Workshop (2007/2008) - Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access, National Institute of Informatics (NII), Tokyo, Japan, 16-19 December 2008.

2007 ^

22. Agosti, M., Di Nunzio, G.M., Ferro, N., and Peters, C. (2007). CLEF: Ongoing Activities and Plans for the Future. The 6th NTCIR Workshop (2006/2007) - Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access, National Institute of Informatics (NII), Tokyo, Japan, 15-18 May 2007.
23. Ferro, N. (2007). From CLEF Towards Treble-CLEF. The Sixteenth Text REtrieval Conference (TREC 2007), National Institute of Standards and Technology (NIST), Gaithersburg, Maryland, USA, 6-9 November 2007.

Event Organization

2013 ^

• Program chair of PROMISE Winter School on Bridging between Information Retrieval and Databases, Bressanone, Italy, 4-8 February 2013;
• Program co-chair of 9th Italian Research Conference on Digital Libraries (IRCDL 2013), Rome, Italy, 31 January - 1 February 2013.

2012 ^

• Program chair of 20th Italian Symposium on Advanced Databases System (SEBD 2012), Venezia, Italy, 24-27 February 2012;
• Program co-chair of 8th Italian Research Conference on Digital Libraries (IRCDL 2012), Bari, Italy, 9-10 February 2012;
• Co-chair of PROMISE Winter School on Information Retrieval meets Information Visualization, Zinal, Switzerland, 23-27 January 2012;
• Co-chair of the Evaluation Lab on Cultural Heritage in CLEF (CHiC 2012), Rome, Italy, 17-20 September 2012, co-located with the CLEF 2012 - Conference and Labs of the Evaluation Forum.

2011 ^

• Co-chair of the Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation (DESIRE 2011), Glasgow, United Kingdom, 28 October 2011, co-located with the 20th ACM Conference on Information and Knowledge Management (CIKM 2011);
• Co-chair of the Workshop on Cultural Heritage in CLEF (CHiC 2011): From Use Cases to Evaluation in Practice for Multilingual Information Access to Cultural Heritage, Amsterdam, The Netherlands, 21-22 September 2011, co-located with the CLEF 2011 - Conference on Multilingual and Multimodal Information Access Evaluation.

2010 ^

• Program co-chair of CLEF 2010 - Conference on Multilingual and Multimodal Information Access Evaluation, Padova, Italy, 20-23 September 2010;
• Scientific chair of the Quality Working Group of the DL.org project (2009-2010).

2009 ^

• Co-chair of the Workshop on Multilinguality in Information Access to Digital Libraries (MLIA4DL 2009) - User Needs and Evaluation of Multilingual Resources Use, Trento, Italy, 9 September 2009, co-located with the International Conference on Digital Libraries and the Semantic Web (ICSD 2009);
• Chair of the Panel on Evaluation in Information Retrieval - Learning it, Applying it, Improving it, at the 7th European Summer School in Information Retrieval (ESSIR 2009), Padova, Italy, 2 September 2009;
• Co-organzier of the Grid@CLEF 2009, a pilot track in the Cross-Language Evaluation Forum (CLEF 2009) campaign.

2008 ^

• Co-organzier of the Workshop on Novel Methodologies for Evaluation in Information Retrieval, Glasgow, UK, 30 March 2008, co-located with the 30th European Conference on Information Retrieval (ECIR 2008).

Journals - Reviewer

• ACM Transactions on Information Systems (TOIS);
• ACM Transactions on Asian Language Information Processing (TALIP);
• ACM Computing Surveys (CSUR);
• IEEE Transactions on Knowledge and Data Engineering (TKDE);
• Information Processing & Management (IPM);
• Information Retrieval (IR);
• Information Systems (IS);
• International Journal on Digital Libraries (IJoDL);
• Journal of the American Society for Information Science and Technology (JASIST).

Conferences 2013 - Participation in Program Committees

• The 2013 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2013);
• 15th International Conference on Asia-Pacific Digital Libraries (ICADL 2013);
• 36th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2013);
• 21st Italian Symposium on Advanced Database Systems (SEBD 2013);
• 22nd ACM Conference on Information and Knowledge Management (CIKM 2013);
• 17th International Conference on Theory and Practice of Digital Libraries (TPDL 2013);
• 13th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2013);
• 35th European Conference on Information Retrieval (ECIR 2013);
• Workshop on Living Labs for Information Retrieval Evaluation (LL 2013), co-located with CIKM 2013;
• Workshop on Exploration, Navigation and Retrieval of Information in Cultural Heritage (ENRICH 2013), co-located with SIGIR 2013;

Conferences 2012 - Participation in Program Committees

• 34th European Conference on Information Retrieval (ECIR 2012);
• 21st ACM Conference on Information and Knowledge Management (CIKM 2012);
• 35th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2012);
• 12th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2012);
• International Conference on Theory and Practice of Digital Libraries (TPDL 2012);
• The 2012 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2012);
• 4th Symposium on Information Interaction in Context (IIiX 2012);
• Task Based and Aggregated Search Workshop (TBAS 2012), co-located with ECIR 2012.

Conferences 2011 - Participation in Program Committees

• 4th ACM International Conference on Web Search and Data Mining (WSDM 2011);
• 20th ACM Conference on Information and Knowledge Management (CIKM 2011);
• 33rd European Conference on Information Retrieval (ECIR 2011);
• 11th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2011);
• 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HTL 2011);
• Workshop Chair at International Conference on Theory and Practice of Digital Libraries (TPDL 2011);
• Special track on Metadata & Semantics for Cultural Collections & Applications at the 5th International Conference on Metadata and Semantic Research (MTSR 2011);
• 7th Italian Research Conference on Digital Libraries (IRCDL 2011);
• 5h International Workshop On Cross Lingual Information Access: Computational Linguistics and the Information Need of Multilingual Societies (CLIA 2011).

Conferences 2010 - Participation in Program Committees

• 6th Italian Research Conference on Digital Libraries (IRCDL 2010);
• 32nd European Conference on Information Retrieval (ECIR 2010);
• ECIR 2010 International Workshop on Contextual Information Access, Seeking and Retrieval Evaluation (CIRSE 2010);
• 7th International Conference on Language Resources and Evaluation (LREC 2010);
• LREC 2010 Workshop on Web Services and Processing Pipelines in HLT: Tool Evaluation, LR Production and Validation (WSPP 2010);
• 10th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2010);
• 18th Italian Symposium on Advanced Database Systems (SEBD 2010);
• 33rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2010);
• COLING 2010 International Workshop On Cross Lingual Information Access (CLIA 2010);
• The 2010 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2010);
• 3rd Symposium on Information Interaction in Context (IIiX 2010);
• 14th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2010), and Workshop Committee member;
• 19th ACM International Conference on Information and Knowledge Management (CIKM 2010).

Conferences 2009 - Participation in Program Committees

• 5th Italian Research Conference on Digital Libraries (IRCDL 2009);
• 31st European Conference on Information Retrieval (ECIR 2009);
• ECIR 2009 International Workshop on Contextual Information Access, Seeking and Retrieval Evaluation (CIRSE 2009);
• 17th Italian Symposium on Advanced Database Systems (SEBD 2009);
• 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2009);
• SIGIR 2009 Workshop on Information Access in a Multilingual World: Transitioning from Research to Real-World Applications (CLIR 2009);
• SIGIR 2009 Workshop on The Future of IR Evaluation (IREVAL 2009);
• The 2009 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2009);
• 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009).

Conferences 2008 - Participation in Program Committees

• 2nd Symposium on Information Interaction in Context (IIiX 2008);
• 30th European Conference on Information Retrieval (ECIR 2008);
• 16th Italian Symposium on Advanced Database Systems (SEBD 2008);
• 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2008);
• 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008).

Conferences 2007 - Participation in Program Committees

• 29th European Conference on Information Retrieval (ECIR 2007).

Conferences 2006 - Participation in Program Committees

• 1st Symposium on Information Interaction in Context (IIiX 2006).

Former PhD Students

• Gianmaria Silvello worked on nested sets models for representing hierarchical structures with a focus on interoperability among different digital library system.
  

  The aim is to facilitate the exchange of data and to enable a finer-grain access to resources maintained in different levels of a hierarchy.
  One possible application is to digital archives, since archives make a deep use of the tree data structure to keep the context of the managed documents.

Software

ICI (IMS Component Integrator) ^

It is the common library which provides classes and interfaces to support the design and development of the applications of the Information Management Systems (IMS) research group.

• Usage: FAST, DIRECT, CHIARA, and CIRCO are developed by relying on the ICI library.
• Development: since 2006.
• Language: Java.
• Size: about 85,000 lines of code.
• Additional information: More information are available here.

FAST (Flexible Annotation Service Tool) ^

It is a prototype annotation service for digital libraries and the Web which implements the proposed formal model for the annotation of digital content. It offers a light-weight RESTful interface to access the annotation functionalities.

• Usage: FAST is exploited in many different ways: as architectural framework for developing the DiLAS annotation service; as annotation service for annotating images in the DelosDLMS prototype; as annotation back-end in the TELplus system.
• Development: since 2004.
• Language: Java.
• Size: about 77,000 lines of code.
• Additional information: An online demo version is available, upon request for an account.
  It has been developed in the context of the ECD, DELOS, TELplus, PROMISE, and CULTURA projects.

DIRECT (Distributed Information Retrieval Evaluation Campaign Tool) ^

It is a prototype digital library system for managing the scientific data produced during an evaluation campaign and carrying out all the tasks of an evaluation campaign, like creation of topics, experiment submission, relevance assessments, performance and statistical analyses computation.

• Usage: DIRECT is adopted in the CLEF evaluation campaigns since 2005; it has been used by more than 500 users (participants, assessors, organizers, visitors, ...) around the world; it currently manages and makes accessible about 50 Gbyte of data.
• Development: since 2005.
• Language: Java.
• Size: about 250,000 lines of code.
• Additional information: DIRECT is accessible online and an account can be requested to access the managed data.
  It has been developed in the context of the CLEF evaluation campaigns and the TrebleCLEF and PROMISE projects.
  It has been developed together with Giorgio Maria Di Nunzio, Marco Dussin, Ivano Masiero, Simone Peruzzo, and Gianmaria Silvello

CHIARA (Cultural Heritage Information Access Application) ^

It is digital library for giving access to the library catalogs of the Veneto Region.

• Usage: CHIARA is used in the PV project.
• Development: since 2010.
• Language: Java.
• Size: about 5,000 lines of code.
• Additional information: CHIARA exploits the FAST annotation service to provide annotation functionalities on the managed contents.

CIRCO (Coordinated Information Retrieval Components Orchestration) ^

It is a framework focused on allowing distributed information retrieval experimentation by exchanging XML messages among components of an information retrieval system.

• Usage: CIRCO is used in the Grid@CLEF track.
• Development: since 2009.
• Language: Java.
• Size: about 33,000 lines of code.
• Additional information: CIRCO is available online as well as its specification.
  It has been developed in the context of the CLEF evaluation campaigns and the TrebleCLEF project.
  

JTE (Java TrecEval) ^

It is a library which wraps (via JNI) the trec_eval program used for scoring infrormation retrieval systems and exposes it as a plain Java object.

• Usage: JTE is used in DIRECT.
• Development: since 2006.
• Language: Java and C.
• Size: about 4,000 lines of Java code and about 2,000 lines of C code.
• Additional information: JTE is available upon request.
  It has been developed in the context of the CLEF evaluation campaigns and the TrebleCLEF project.
  

JMB (Java-Matlab Bridge) ^

It is a library which wraps (via JNI) the Matlab environment and exposes it as a plain Java object.

• Usage: JMB is used in DIRECT.
• Development: 2006-2009.
• Language: Java and C.
• Size: about 3,000 lines of Java code and about 2,000 lines of C code.
• Additional information: JMB is available upon request.
  It has been developed in the context of the CLEF evaluation campaigns and the TrebleCLEF project.
  It is no more developed since the same functionalities can be obtained via the Matlab Builder JA.

SPINA (Superimposed Peer Infrastructure for iNformation Access) ^

It is a Peer-to-Peer semi-structured overlay network for providing advanced and multimedia search capabilities with a particular focus on efficient peer selection and query routing. It supports both text and music search.

• Usage: SPINA is used in the SAPIR project.
• Development: 2007-2009.
• Language: Java.
• Size: about 67,000 lines of code.
• Additional information: It has been developed together with Lucio Benfante, Emanuele Di Buccio, Ivano Masiero, Riccardo Miotto, Alberto Poggiani, and Dino Polga.

Main Teaching Activities

Academic Year 2012/2013 ^

• Basi di Dati Progredito, corso di laurea magistrale in Scienze Statistiche, Italy;
• Fondamenti di Informatica, corso di laurea triennale in Scienze psicologiche cognitive e psicobiologiche (L-1) at the University of Padua, Italy.
• Basi di Dati, corsi di laurea magistrale in Ingegneria Informatica e Ingegneria delle Telecomunicazioni University of Padua, Italy;

Academic Year 2011/2012 ^

• Basi di Dati Progredito, corso di laurea magistrale in Scienze Statistiche at the Faculty of Statistical Sciences, University of Padua, Italy;
• Basi di Dati, corsi di laurea magistrale in Ingegneria Informatica e Ingegneria delle Telecomunicazioni at the Faculty of Engineering, University of Padua, Italy;
• Fondamenti di Informatica, corso di laurea triennale in Scienze psicologiche cognitive e psicobiologiche (L-1) at the University of Padua, Italy.

Academic Year 2010/2011 ^

• Basi di Dati Progredito, corso di laurea magistrale in Scienze Statistiche at the Faculty of Statistical Sciences, University of Padua, Italy.

Academic Year 2009/2010 ^

• Basi di Dati Progredito, corso di laurea magistrale in Scienze Statistiche at the Faculty of Statistical Sciences, University of Padua, Italy;
• Lessons for Informatica per la Cultura, corso di laurea magistrale in Ingegneria Informatica, at the Faculty of Engineering, University of Padua, Italy;
• Architettura dell'Informazione vocational course for the librarians of the University of Padua, organized by the Centre for Libraries of the University of Padua.

Academic Year 2008/2009 ^

• Basi di Dati Corso Progredito, corso di laurea specialistica in Statistica e Informatica at the Faculty of Statistical Sciences, University of Padua, Italy.

Academic Year 2007/2008 ^

• Sistemi di Elaborazione II, corso di laurea specialistica in Statistica e Informatica and corso di laurea triennale in Statistica e Tecnologie Informatiche at the Faculty of Statistical Sciences, University of Padua, Italy;
• Lessons for Basi di Dati Corso Progredito, corso di laurea specialistica in Statistica e Informatica at the Faculty of Statistical Sciences, University of Padua, Italy;
• Laboratory lessons for Sistemi Evoluti di Basi di Dati, corso di laurea specialistica in Statistica e Informatica at the Faculty of Statistical Sciences, University of Padua, Italy.

Academic Year 2006/2007 ^

• Sistemi di Elaborazione II, corso di laurea specialistica in Statistica e Informatica and corso di laurea triennale in Statistica e Tecnologie Informatiche at the Faculty of Statistical Sciences, University of Padua, Italy;
• Lessons for Basi di Dati Corso Progredito, corso di laurea specialistica in Statistica e Informatica at the Faculty of Statistical Sciences, University of Padua, Italy;
• Laboratory lessons for Sistemi Evoluti di Basi di Dati, corso di laurea specialistica in Statistica e Informatica at the Faculty of Statistical Sciences, University of Padua, Italy;
• Sistemi di Archivi Digitali at the Master I level on Formazione, gestione e conservazione di archivi digitali in ambito pubblico e privato of the Faculty of Humanities, University of Padua and University of Macerata, Italy.

Academic Year 2005/2006 ^

• Sistemi di Elaborazione II, corso di laurea specialistica in Statistica e Informatica and corso di laurea triennale in Statistica e Tecnologie Informatiche at the Faculty of Statistical Sciences, University of Padua, Italy;
• Laboratory lessons for Laboratorio di Fondamenti di Informatica, corso di laurea in Scienze della Comunicazione at the Faculty of Humanities, University of Padua, Italy.

Academic Year 2004/2005 ^

• Informatica Generale, corso di laurea in Lingue, letterature e Culture Moderne and corso di laurea in Mediazione Linguistica e Culturale at the Faculty of Humanities, University of Padua, Italy.

Academic Year 2003/2004 ^

• Laboratory lessons for Applicazioni di Informatica per la Ricerca psicologica, corso di laurea in Scienze Psicologiche, Sociali e del Lavoro and corso di laurea in Scienze Psicologiche Cognitive e Psicobiologiche at the Faculty of Psycology, University of Padua, Italy;
• Laboratory lessons for Gestione di basi di dati, corso del Fondo Sociale Europeo (FSE) Applicativo/Pratico (AP1) at the Faculty of Humanities, University of Padua, Italy;
• Lessons for Informatica at the Master I level on Gestione degli Archivi degli Enti Pubblici of the Faculty of Humanities, University of Padua, Italy.

Academic Year 2002/2003 ^

• Laboratory lessons for Basi di Dati 1 A, corso di laurea in Statistica e gestione delle imprese (SGI) and corso di laurea in Statistica, Popolazione e Società (SPS) at the Faculty of Statistical Sciences, University of Padua, Italy;
• Laboratory lessons for Basi di Dati 1 B, corso di laurea in Statistica e tecnologie informatiche (STI) and corso di laurea in Statistica, economia e finanza (SEF) at the Faculty of Statistical Sciences, University of Padua, Italy;
• Lessons for Fondamenti di Informatica, corso di laurea in Scienze della Comunicazione at the Faculty of Humanities, University of Padua, Italy;
• Laboratory lessons for Applicazioni di Informatica per la Ricerca psicologica, corso di laurea in Scienze Psicologiche Cognitive e Psicobiologiche and corso di laurea in Psicologia (vecchio ordinamento) at the Faculty of Psycology, University of Padua, Italy.

Academic Year 2001/2002 ^

• Laboratory lessons for Applicazioni di Informatica per la Ricerca psicologica, corso di laurea in Psicologia (vecchio ordinamento) at the Faculty of Psycology, University of Padua, Italy;
• Laboratory lessons for Applicazioni di Informatica per la Ricerca psicologica, corso di laurea in Scienze Psicologiche Cognitive e Psicobiologiche at the Faculty of Psycology, University of Padua, Italy.
• Lessons for Informatica at the Master I level on Studi Interculturali of the Faculty of Humanities, University of Padua, Italy.

Short Curriculum Vitae

Since March 2006 ^

Assistant Professor in Computer Science, Department of Information Engineering and Faculty of Statistical Sciences, University of Padua, Italy.

July 2005 - February 2006 ^

Post Doctoral Position in Computer Science at the Department of Information Engineering. Supervisor: prof. Maristella Agosti.

April 2005 ^

PhD dissertation and conferring of the PhD in Computer Science.

The title of the PhD thesis is "Formal Model and Conceptual Architecture of the Annotation Service for Dynamic Ubiquitous Knowledge Environments". Supervisor: prof. Maristella Agosti.

January - June 2005 ^

Research grant of the Department of Information Engineering on "Literature survey and preliminary analysis for the design of an annotation general-purpose digital library component contributing to the development of a modular digital library infrastructure"

January 2002 - December 2004 ^

Ph.D. Student in Computer Science at the Department of Information Engineering of the University of Padua. Supervisor: prof. Maristella Agosti.

Since January 2002 ^

Member of the Information Management Systems (IMS) research group at the Department of Information Engineering, University of Padua, Italy.

June 2001 - December 2001 ^

Intern at IBM Technology Deployment of Segrate, Milan, Italy.

The intern was about remote connectivity technologies to gain access to corporate intranet. Both wired broadband technologies, as xDSL and optical fiber, and wireless technologies, as GPRS, were studied and tested.

June 2001 ^

Qualified to be admitted to the Italian Engineering Association.

April 2001 ^

Laurea degree in Telecommunications Engineering at University of Padua.

The title of the thesis is "Online information access through handheld devices".
The subject of the thesis is on the design of search engines to be used through handheld devices, as PDAs or mobile phones.

Education

October 2006 ^

Grant in the context of the DELOS Researcher Exchange Program for visiting University of Basel, Switzerland, 23-27 October 2006.

October 2005 ^

Grant in the context of the DELOS Researcher Exchange Program for visiting Sapienza, University of Rome, 4-14 October 2005.

September 2004 ^

7th EDBT Summer School on XML & Databases, held in S. Margherita di Pula (Cagliari), Italy, 6-10 September 2004.

September 2003 ^

Grant for attending the 4th European Summer School on Information Retrieval (ESSIR 2003), held in Aussois, France, 31 August - 5 September 2003.

April 2003 ^

Grant for attending the 25th European Conference on Information Retrieval Research (ECIR 2003), held in Pisa, Italy, 14-16 April 2003.

July 2002 ^

Grant for attending the DELOS International Summer School on Digital Library Technologies (ISDL 2002), held in Pisa, Italy, 8-12 July 2002.

Membership

Since 2003 ^

ACM member and IEEE member.

Since 2010 ^

Information Retrieval Society of India (IRSI) advisory member.

Publications

International Journals ^

1. Ferro, N. and Silvello, G. (2013). NESTOR: A Formal Model for Digital Archives. Information Processing & Management. (in print)
2. Ferro, N., Hanbury, A., Müller, H., and Santucci, G. (2011). Harnessing the Scientific Data Produced by the Experimental Evaluation of Search Engines and Information Access Systems. Procedia Computer Science, 4:740-749.
3. Agosti, M. and Ferro, N. (2008). A Formal Model of Annotations of Digital Content. ACM Transactions on Information Systems (TOIS), 26(1):3:1-3:57.
4. Agosti, M., Bonfiglio-Dosio, G., and Ferro, N. (2007). A Historical and Contemporary Study on Annotations to Derive Key Features for Systems Design. International Journal on Digital Libraries, 8(1):1-19.
5. Bacchin, M., Ferro, N., and Melucci, M. (2005). A Probabilistic Model for Stemmer Generation. Information Processing & Management, 41(1):121-137.

International Scientific Dissemination Journals and Online ^

2013 ^

6. Agosti, M., Ferro, N., and Silvello, G. (2013). PROMISE Winter School 2013: Bridging between Information Retrieval and Databases. SIGIR Forum, 47(1):46-52.
7. Ferro, N. (2013). PROMISE Winter School 2013 on Bridging between Information Retrieval and Databases. ERCIM News, 93:56-57.
8. Forner, P., Bentivogli, L., Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., and Müller, H. (2013). PROMISE Technology Transfer Day: Spreading the Word on Information Access Evaluation at an Industrial Event. SIGIR Forum, 47(1):53-58.

2012 ^

9. Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012). PROMISE Retreat Report - Prospects and Opportunities for Information Access. SIGIR Forum, 46(2):60-84.
10. Agosti, M., Catarci, T., Ferro, N., Müller, H., and Santucci, G. (2012). PROMISE Winter School 2012 Information Retrieval meets Information Visualization. SIGIR Forum, 46(1):65-70.
11. Agosti, M., Ferro, N., and Thanos, C. (2012). DESIRE 2011 Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. SIGIR Forum, 46(1):51-55.
12. Allan, J., Aslam, J., Azzopardi, L., Belkin, N., Borlund, P., Bruza, P., Callan, J., Carman, M. Clarke, C., Craswell, N., Croft, W. B., Culpepper, J. S., Diaz, F., Dumais, S., Ferro, N., Geva, S., Gonzalo, J., Hawking, D., Järvelin, K., Jones, G., Jones, R., Kamps, J., Kando, N., Kanoulos, E., Karlgren, J., Kelly, D., Lease, M., Lin, J., Mizzaro, S., Moffat, A., Murdock, V., Oard, D. W., de Rijke, M., Sakai, T., Sanderson, M., Scholer, F., Si, L., Thom, J., Thomas, P., Trotman, A., Turpin, A., de Vries, A. P., Webber, W., Zhang, X., and Zhang, Y. (2012). Frontiers, Challenges, and Opportunities for Information Retrieval - Report from SWIRL 2012, The Second Strategic Workshop on Information Retrieval in Lorne, February 2012. SIGIR Forum, 46(1):2-32.
13. Catarci, T., Ferro, N., Forner, P., Hiemstra, D., Karlgren, J., Peñas, A., Santucci, G., and Womser-Hacker, C. (2012). CLEF 2012: Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics. SIGIR Forum, 46(2):29-33.
14. Ferro, N. (2012). The CLEF Initiative: Conference and Labs of the Evaluation Forum. ERCIM News, 88:63-64.
15. Ferro, N. (2012). CLEF 2012 and beyond: Perspectives for the Conference and Labs of the Evaluation forum. ERCIM News, 91:36-37.

2011 ^

16. Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V., and de Rijke, M. (2011). CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum, 45(2):32-37.
17. Ferro, N. (2011). DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation. ERCIM News, 86:54-55.
18. Ferro, N. (2011). PROMISE: Advancing the Evaluation of Multilingual and Multimedi Information Systems. ERCIM News, 84:49.

2010 ^

19. Agosti, M., Braschler, M., Choukri, K., Ferro, N., Harman, D. K., Peters, C., Pianta, E., de Rijke, M., and Smeaton, A. (2010). CLEF 2010 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum, 44(2):8-12.
20. Ferro, N. (2010). CLEF 2010: Innovation, Science, Experimentation. ERCIM News, 83:60.

2009 ^

21. Dussin, M. and Ferro, N. (2009). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1), http://www.ieee-tcdl.org/Bulletin/v5n1/Dussin/dussin1.html.
22. Dussin, M. and Ferro, N. (2009). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large- Scale Evaluation Campaigns. Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1), http://www.ieee-tcdl.org/Bulletin/v5n1/Dussin/dussin2.html.

National Journals ^

23. Ferro, N. (2012). La gestione e conservazione dei dati scientifici prodotti dalla valutazione sperimentale dei motori di ricerca. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina Parte II: Memorie della Classe di Scienze Matematiche, Fisiche e Naturali, CXXIV:41-52.
24. Ferro, N. (2011). La rete di eccellenza europea PROMISE. DigItalia, Rivista del digitale nei beni culturali, 6(1):113-122.
25. Agosti, M. and Ferro, N. (2010). Conferenza CLEF 2010 - Conference on Multilingual and Multimodal Information Access Evaluation. DigItalia, Rivista del digitale nei beni culturali, 5(2):176-180.
26. Agosti, M. and Ferro, N. (2010). Interoperabilità tra sistemi di biblioteche digitali. DigItalia, Rivista del digitale nei beni culturali, 5(1):95-112.
27. Agosti, M., Bonfiglio-Dosio, G., Ferro, N., and Silvello, G. (2008). Metodologie e percorsi interdisciplinari per la ideazione di un Sistema Informativo Archivistico. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina, CXX:261-287.
28. Agosti, M., Ferro, N., and Silvello, G. (2007). Proposta metodologica e architetturale per la gestione distribuita e condivisa di collezioni di documenti digitali. Archivi, 2(2):49-73.

International Conferences^

2013 ^

29. Agosti, M., Conlan, O., Ferro, N., Hampson, C., and Munnelly, G. (2013). Interacting with Digital Cultural Heritage Collections via Annotations: The CULTURA Approach. In Marinai, S. and Marriot, K., editors, Proc. 13th ACM Symposium on Document Engineering (DocEng 2013). (in print)
30. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Improving Ranking Evaluation Employing Visual Analytics. In Forner, P., Müller, H., Paredes, R., Rosso, P., and Stein, B., editors, Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. Proceed- ings of the Fourth International Conference of the CLEF Initiative (CLEF 2013). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany. (in print)
31. Ferro, N. and Silvello, G. (2013). Formal Models for Digital Archives: NESTOR and the 5S. In Aalberg, T., Dobreva, M., Papatheodorou, C., Tsakonas, G., and Farrugia, C., editors, Proc. 17th International Conference on Theory and Practice of Digital Libraries (TPDL 2013). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany. (in print)
32. Munnelly, G., Hampson, C., Ferro, N., and Conlan, O. (2013). The FAST-CAT: Empowering Cultural Heritage Annotations. In Proc. Digital Humanities 2013. (in print)

2012 ^

33. Agosti, M., Di Buccio, E., Ferro, N., Masiero, I., Peruzzo, S., and Silvello, G. (2012). DIRECTions: Design and Specification of an IR Evaluation Infrastructure. In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF 2012), pages 88-99. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany.
34. Angelini, M., Ferro, N., Granato, G. L., Santucci, G., and Silvello, G. (2012). Information Retrieval Failure Analysis: Visual analytics as a Support for Interactive What-If Investigation. In Santucci, G. and Ward, M., editors, Proc. IEEE Conference on Visual Analytics Science and Technology (VAST 2012), pages 204-206. IEEE Computer Society, Los Alamitos, CA, USA.
35. Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2012). Cumulated Relative Position: A Metric for Ranking Evaluation. In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF2012), pages 112-123. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany.
36. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2012). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Kamps, J., Kraaij, W., and Fuhr, N., editors, Proc. 4th Symposium on Information Interaction in Context (IIiX 2012), pages 195-203. ACM Press, New York, USA.

2011 ^

37. Agosti, M., Ferro, N., and Thanos, C. (2009). DESIRE 2011: First International Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. In Ounis, I., Ruthven, I., Berendt, B., de Vries, A. P., and Wenfei, F., editors, Proc. 20th International Conference on Information and Knowledge Management (CIKM 2011), pages 2631-2632. ACM Press, New York, USA.
38. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). Interactive Analysis and Exploration of Experimental Evaluation Results. In Wilson, M. L., Russell-Rose, T., Larsen, B., and Kalbach, J., editors, Proc. 1st European Workshop on Human-Computer Interaction and Information Retrieval (EuroHCIR 2011), pages 11-14.
39. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). To Re-rank or to Re-query: Can Visual Analytics Solve This Dilemma? In Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., and de Rijke, M., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross-Language Evaluation Forum (CLEF 2011), pages 119-130. Lecture Notes in Computer Science (LNCS) 6941, Springer, Heidelberg, Germany.
40. Ferro, N., Sabetta, A., Santucci, G., and Tino, G. (2011). Visual Comparison of Ranked Result Cumulated Gains. In Miksch, S. and Santucci, G., editors, Proc. 2nd International Workshop on Visual Analytics (EuroVA 2011), pages 21-24. Eurographics Association, Goslar, Germany.

2010 ^

41. Agosti, M., Di Nunzio, G. M., Dussin, M., and Ferro, N. (2010). 10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go. In Sakay, T., Sanderson, M., and Webber, W., editors, Proc. 3rd International Workshop on Evaluating Information Access (EVIA 2010), pages 16-24. National Institute of Informatics, Tokyo, Japan.
42. Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors (2010). Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010). Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany.
43. Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., Müller, H., Petras, V., Pianta, E., de Rijke, M., and Santucci, G. (2010). A PROMISE for Experimental Evaluation. In Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010), pages 140-144. Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany.
44. Ferro, N. (2010). CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum. In Kando, N. and Kishida, K., editors, Proc. 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 2-12. National Institute of Informatics, Tokyo, Japan. Invited talk.
45. Ferro, N. and Harman, D. (2010). CLEF 2009: Grid@CLEF Pilot Track Overview. In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 552-565. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany.
46. Ferro, N. and Peters, C. (2010). CLEF 2009 Ad Hoc Track Overview: TEL & Persian Tasks. In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 13-35. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany.

2009 ^

47. Agirre, E., Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2009). CLEF 2008: Ad Hoc Track Overview. In Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors, Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross-Language Evaluation Forum (CLEF 2008). Revised Selected Papers, pages 15-37. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany.
48. Agosti, M., Ferro, N., and Silvello, G. (2009). Access and Exchange of Hierarchically Structured Resources on the Web with the NESTOR Framework. In Baeza-Yates, R., Berendt, B., Bertino, E., Lim, E.-P., and Pasi, G., editors, Proc. 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, pages 659-662. IEEE Computer Society, Los Alamitos, CA, USA.
49. Agosti, M., Ferro, N., and Silvello, G. (2009). Enabling Cross-Language Access to Archival Metadata. In Cirinnà, C. and Lunghi, M., editors, International Conference on Cultural Heritage Online - Empowering Users: an Active Role for User Communities, pages 179-183. Fondazione Rinascimento Digitale, Firenze, Italy.
50. Dussin, M. and Ferro, N. (2009). Managing the Knowledge Creation Process of Large-Scale Evaluation Campaigns. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 63-74. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany. Best student paper award.
51. Ferro, N. (2009). Annotation Search: The FAST Way. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 15-26. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany.
52. Ferro, N. and Silvello, G. (2009). The NESTOR Framework: How to Handle Hierarchical Data Structures. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 215-226. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany.
53. Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors (2009). Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross–Language Evaluation Forum (CLEF 2008). Revised Selected Papers. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany.

2008 ^

54. Agosti, M. and Ferro, N. (2008). Annotations: a Way to Interoperability in DL. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 291-295. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
55. Agosti, M., Ferro, N., and Silvello, G. (2008). The Design of a DLS for the Management of Very Large Collections of Archival Objects. In Manghi, P., Pagano, P., and Zezula, P., editors, Proc. 1st Workshop on Very Large Digital Libraries (VLDL 2008). DELOS: an Association for Digital Libraries. Published Online.
56. Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2008). CLEF 2007: Ad Hoc Track Overview. In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, pages 13-32. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany.
57. Dussin, M. and Ferro, N. (2008). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 424. ACM Press, New York, USA.
58. Dussin, M. and Ferro, N. (2008). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 450. ACM Press, New York, USA.
59. Dussin, M. and Ferro, N. (2008). Design of a Digital Library System for Large-Scale Evaluation Campaigns. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 400-401. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
60. Ferro, N. and Peters, C. (2008). From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum. In Kando, N. and Sugimoto, M., editors, Proc. 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 577-593. National Institute of Informatics, Tokyo, Japan. Invited talk.
61. Ferro, N. and Silvello, G. (2008). A Methodology for Sharing Archival Descriptive Metadata in a Distributed Environment. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 268-279. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
62. Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Larson, R., Sanderson, M., Santos, D., Womser-Hacker, C., and Xie, X. (2008). GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview. In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, 745-772. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany.
63. Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Sanderson, M., Santos, D., and Womser-Hacker, C. (2008). An Evaluation Resource For Geographic Information Retrieval. In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008). http://www.lrec-conf.org/proceedings/lrec2008/pdf/8_paper.pdf.
64. Mandl, T., Womser-Hacker, C., Di Nunzio, G. M., and Ferro, N. (2008). How Robust are Multilingual Information Retrieval Systems? In Wainwright, R. L., and Haddad, H. M., editors, Proc. 2008 ACM Symposium on Applied Computing (SAC 2008), pages 1132-1136. ACM Press, New York, USA.
65. Peters, C., Braschler, M., Di Nunzio, G. M., Ferro, N., Gonzalo, J., and Sanderson, M. (2008). From Research to Application in Multilingual Information Access: the Contribution of Evaluation. In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008). http://www.lrec-conf.org/proceedings/lrec2008/pdf/913_paper.pdf.
66. Sanderson, M., Braschler, M., Ferro, N., and Gonzalo, J. (2008). Workshop on Novel Methodologies for Evaluation in Information Retrieval. In Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., and White, R. W ., editors, Advances in Information Retrieval. Proc. 30th European Conference on IR Research (ECIR 2008), page 750. Lecture Notes in Computer Science (LNCS) 4956, Springer, Heidelberg, Germany.

2007 ^

67. Agosti, M., Berretti, S., Brettlecker, G., del Bimbo, A., Ferro, N., Fuhr, N., Keim, D., Klas, C.-P., Lidy, T., Milano, D., Norrie, M., Ranaldi, P., Rauber, A., Schek, H.-J., Schreck, T., Schuldt, H., Signer, B., and Springmann, M. (2007). DelosDLMS - the Integrated DELOS Digital Library Management System. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 36-45. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
68. Agosti, M., Braschler, M., Ferro, N., Peters, C., and Siebinga, S. (2007). Roadmap for MultiLingual Information Access in The European Library. In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 136-147. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany.
69. Agosti, M., Coppotelli, T., Di Nunzio, G. M., Ferro, N., and van der Meulen, E. (2007). A Study of Web Logs for Personalizing the MultiLingual Information Access to The European Library. In Christodoulakis, S., editor, Workshop on Cross-Media and Personalized Learning Applications on top of Digital Libraries (LADL 2007), pages 19-28.
70. Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007). Annotations and Digital Libraries: Designing Adequate Test-beds. In Goh, D. H. L., Cao, T. H., Sølvberg, I., and Rasmussen, E., editors, Proc. 10th International Conference on Asian Digital Libraries. Digital Libraries - Asian Digital libraries: Looking Back 10 Years and Forging New Frontiers (ICADL 2007), pages 150-159. Lecture Notes in Computer Science (LNCS) 4822, Springer, Heidelberg, Germany.
71. Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007). An Approach for the Construction of an Experimental Test Collectionto Evaluate Search Systems that Exploit Annotations. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 167-176. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
72. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 11-20. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
73. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). The Importance of Scientific Data Curation for Evaluation Campaigns. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 157-166. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
74. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns. In Sakay, T. and Sanderson, M., and Evans, D. K., editors, Proc. 1st International Workshop on Evaluating Information Access (EVIA 2007), pages 62-73. National Institute of Informatics, Tokyo, Japan.
75. Agosti, M., Di Nunzio, G. M., Ferro, N., Harman, D., and Peters, C. (2007). The Future of Large-scale Evaluation Campaigns for Information Retrieval in Europe. In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 509-512. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany.
76. Agosti, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2007). CLEF: Ongoing Activities and Plans for the Future. In Kando, N. and Evans, D. K., editors, Proc. 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 493-504. National Institute of Informatics, Tokyo, Japan. Invited talk.
77. Agosti, M., Ferro, N., Fox, E. A., Gonçalves, M. A., and Lagoeiro, B. (2007). Towards a Reference Quality Model for Digital Libraries. In Castelli, D. and Fox, E. A., editors, Pre-proceedings of the First International Workshop on Foundations of Digital Libraries, pages 37-42.
78. Agosti, M., Ferro, N., and Orio, N. (2007). Design and Development of a Digital Archive of Illuminated Manuscripts. In del Bimbo, A., Cucchiara, R., and Boujemaa, N., editors, Proc. International Workshop on Visual and Multimedia Digital Libraries (WMDL 2007), pages 113-118. IEEE Computer Society, Los Alamitos, CA, USA.
79. Agosti, M., Ferro, N., and Silvello, G. (2007). An Architecture to Share Metadata among Geographically Distributed Archives. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 56-65. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
80. Braschler, M. and Ferro, N. (2007). Adding MultiLingual Information Access to The European Library TEL. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 218-227. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
81. Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2007). How to Compare Bilingual to Monolingual Cross-Language Information Retrieval. In Amati, G., Carpineto, C., and Romano, G., editors, Advances in Information Retrieval. Proc. 29th European Conference on IR Research (ECIR 2007), pages 533-540. Lecture Notes in Computer Science (LNCS) 4425, Springer, Heidelberg, Germany.
82. Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2007). CLEF 2006: Ad Hoc Track Overview. In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers , pages 21-34. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
83. Gey, F., Larson, R., Sanderson, M., Bischoff, K., Mandl, T., Womser-Hacker, K., Santos, D., Rocha, P., Di Nunzio, G. M., and Ferro, N. (2007). GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview. In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 852-876. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.

2006 ^

84. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006). A Data Curation Approach to Support In-depth Evaluation Studies. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 65-68.>/li>
85. Agosti, M. and Ferro, N. (2006). Search Strategies for Finding Annotations and Annotated Documents: the FAST Service. In Legind Larsen, H., Pasi, G., Ortiz-Arroyo, D., Andreasen, T., and Christiansen, H., editors, Proc. 7th International Conference on Flexible Query Answering Systems (FQAS 2006), pages 270-281. Lecture Notes in Artificial Intelligence (LNAI) 4027, Springer, Heidelberg, Germany.
86. Agosti, M., Ferro, N., Frommholz, I., Panizzi, E., Putz, W., and Thiel, U. (2006). Integration of the DiLAS Annotation Service into Digital Library Infrastructures. In Blandford, A. and Gow, J., editors, Proc. 1st International Workshop on Digital Libraries in the Context of Usersí Broader Activities (DL-CUBA 2006), pages 1-4. http://www.uclic.ucl.ac.uk/events/dl-cuba2006/.
87. Agosti, M., Ferro, N., and Orio, N. (2006). Graph-based Automatic Suggestion of Relationships among Images of Illuminated Manuscripts. In Haddad, H. M., Liebrock, K. M., Chbeir, R., Palakal, M. J., Ossowski, S., Yetongnoon, K., Wainwright, R. L., and Nicolle, C., editors, Proc. 21st ACM Symposium on Applied Computing (SAC 2006), pages 1063-1067. ACM Press, New York, USA.
88. Agosti, M., Ferro, N., Panizzi, E., and Trinchese, R. (2006). Annotation as a Support to User Interaction for Content Enhancement in Digital Libraries. In Celentano, A. and Mussio, P., editors, Proc. Working Conference on Advanced Visual Interfaces (AVI 2006), pages 151-154. ACM Press, New York, USA.
89. Braschler, M., Ferro, N., and Verleyen, J. (2006). Implementing MLIA in an existing DL system. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 73-76.
90. Di Nunzio, G. M. and Ferro, N. (2006). Scientific Evaluation of a DLMS: a service for evaluating information access components. In Gonzalo, J., Thanos, C., Verdejo, M. F., and Carrasco, R. C., editors, Proc. 10th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2006), pages 536-539. Lecture Notes in Computer Science (LNCS) 4172, Springer, Heidelberg, Germany.
91. Di Nunzio, G. M. and Ferro, N. (2006). Queries and Relevance Assessments: The Right Context for the Right Topic. In Joho, H., Urban, J., Villa, R., Jose, J. M., and van Rijsbergen, C. J., editors, First International Workshop on Adaptive Information Retrieval (AIR 2006), pages 26-27. http://www.dcs.gla.ac.uk/workshops/air/air2006_program.pdf.
92. Di Nunzio, G. M., Ferro, N., Jones, G. J. F., and Peters, C. (2006). CLEF 2005: Ad Hoc Track Overview. In Peters, C., Gey, F. C., Gonzalo, J., Jones, G. J. F., Kluck, M., Magnini, B., Müller, H., and de Rijke, M., editors, Accessing Multilingual Information Repositories: Sixth Workshop of the Cross-Language Evaluation Forum (CLEF 2005). Revised Selected Papers, pages 11-36. Lecture Notes in Computer Science (LNCS) 4022, Springer, Heidelberg, Germany.

2005 ^

93. Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Orio, N., Panizzi, E., Pejtersen, A. M., and Thiel, U. (2005). DiLAS: a Digital Library Annotation Service. In Boujut, J.-F., editor, Proc. International Workshop on Annotation for Collaboration - Methods, Tools, and Practices (IWAC 2005), pages 91-101. CNRS - Programme société de l'information.
94. Agosti, M. and Ferro, N. (2005). A System Architecture as a Support to a Flexible Annotation Service. In Türker, C., Agosti, M., and Schek, H.-J., editors, Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures: 6th Thematic Workshop of the EU Network of Excellence DELOS. Revised Selected Papers, pages 147-166. Lecture Notes in Computer Science (LNCS) 3664, Springer, Heidelberg, Germany.
95. Agosti, M. and Ferro, N. (2005). Annotations as Context for Searching Documents. In Crestani, F. and Ruthven, I., editors, Proc. 5th International Conference on Conceptions of Library and Information Science - Context: nature, impact and role (Colis 5), pages 155-170. Lecture Notes in Computer Science (LNCS) 3507, Springer, Heidelberg, Germany. Best Student Paper Award.
96. Agosti, M., Ferro, N., and Orio, N. (2005). Annotating Illuminated Manuscripts: an Effective Tool for Research and Education. In Marlino, M., Sumner, T., and Shipman, F., editors, Proc. 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), pages 121-130. ACM Press, New York, USA.
97. Agosti, M., Ferro, N., and Orio, N. (2005). Annotations as a Support to Research Users. In Catarci, T., Christodoulakis, S., and Del Bimbo, A., editors, Proc. 7th International Workshop of the EU Network of Excellence DELOS on Audio-Visual Content and Information Visualization in Digital Libraries (AVIVDiLib'05), pages 117-120. Centromedia, Viareggio, Italy.
98. Braschler, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2005). CLEF 2004: Ad Hoc Track Overview and Results Analysis. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 10-26. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.
99. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a System for Evaluating Information Access Components of Digital Libraries. In Rauber, A., Christodoulakis, S., and Min Tjoa, A., editors, Proc. 9th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2005), pages 483-484. Lecture Notes in Computer Science (LNCS) 3652, Springer, Heidelberg, Germany.
100. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a Distributed Tool for Information Retrieval Evaluation Campaigns. In Ioannidis, Y., Schek, H.-J., and Weikum, G., editors, Proc. 8th DELOS Thematic Workshop on Future Digital Library Management Systems: System Architecture and Information Access, pages 58-63. http://dbis.cs.unibas.ch/delos_website/delos-dagstuhl-handout-all.pdf.
101. Di Nunzio, G. M., Ferro, N., and Orio, N. (2005). Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 60-72. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.

2004 ^

102. Agosti, M. and Ferro, N. (2004). An Information Service Architecture for Annotations. In Agosti, M., Schek, H.-J., and Türker, C., editors, Digital Library Architectures: Peer-to-Peer, Grid, and Service-Orientation, Pre-proceedings of the 6th Thematic Workshop of the EU Network of Excellence DELOS, pages 115-126. Edizioni Libreria Progetto, Padova, Italy.
103. Agosti, M., Ferro, N., Frommholz, I., and Thiel, U. (2004). Annotations in Digital Libraries and Collaboratories - Facets, Models and Usage. In Heery, R. and Lyon, L., editors, Proc. 8th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2004), pages 244-255. Lecture Notes in Computer Science (LNCS) 3232, Springer, Heidelberg, Germany.
104. Di Nunzio, G. M., Ferro, N., Melucci, M., and Orio, N. (2004). Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Comparative Evaluation of Multilingual Information Access Systems: Fourth Workshop of the Cross-Language Evaluation Forum (CLEF 2003) Revised Selected Papers, pages 220-235. Lecture Notes in Computer Science (LNCS) 3237, Springer, Heidelberg, Germany.

2003 ^

105. Agosti, M., Bacchin, M., Ferro, N., and Melucci, M. (2003). Improving the Automatic Retrieval of Text Documents. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Advances in Cross-Language Information Retrieval: Third Workshop of the Cross-Language Evaluation Forum (CLEF 2002) Revised Papers, pages 279-290. Lecture Notes in Computer Science (LNCS) 2785, Springer, Heidelberg, Germany.
106. Agosti, M. and Ferro, N. (2003). Annotations: Enriching a Digital Library. In Koch, T. and Sølvberg, I. T., editors, Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pages 88-100. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany.

2002 ^

107. Bacchin, M., Ferro, N., and Melucci, M. (2002). The Effectiveness of a Graph-based Algorithm for Stemming. In Lim, E. P., Foo, S., Khoo, C. S. G., Chen, H., Fox, E. A., Urs, S. R., and Thanos, C., editors, Proc. 5th International Conference on Asian Digital Libraries. Digital Libraries: People, Knowledge, and Technology (ICADL 2002), pages 117-128. Lecture Notes in Computer Science (LNCS) 2555, Springer, Heidelberg, Germany.

International Book Chapters ^

108. Agosti, M., Ferro, N., and Silvello, G. (2011). How to Handle Hierarchically Structured Resources Addressing Interoperability Issues in Digital Libraries. In Biba, M. and Xhafa, F., editors, Learning Structure and Schemas from Documents, , pages 17-49. Springer-Verlag, Heidelberg, Germany.
109. Ferro, N. (2010). Quality and Interoperability: The Quest for the Optimal Balance. In Iglezakis, I., Kapidakis, S., and Synodinou, T., editors, E-Publishing and Digital Libraries: Legal and Organizational Issues, pages 48-68. IGI Global, USA.
110. Agosti, M. and Ferro, N. (2009). Towards an Evaluation Infrastructure for DL Performance Evaluation. In Tsakonas, G. and Papatheodorou, C., editors, Evaluation of Digital Libraries: An Insight to Useful Applications and Methods, pages 93-120. Chandos Publishing, Oxford, UK.
111. Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2008). A Statistical and Graphical Methodology for Comparing Bilingual to Monolingual Cross-Language Information Retrieval. In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 171-188. Springer-Verlag, Heidelberg, Germany.
112. Ferro, N. (2008). Digital Annotations: a Formal Model and its Applications. In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 113-146. Springer-Verlag, Heidelberg, Germany.
113. Agosti, M. and Ferro, N. (2003). Chapter X: Managing the Interactions between Handheld Devices, Mobile Applications, and Users. In Lim, E. P. and Siau, K., editors, Advances in Mobile Commerce Technologies, pages 204-233. Idea Group, Hershey, USA.

Monographs ^

114. Agosti, M., Ferro, N., Forner, P., Müller, H., and Santucci, G., editors (2013). Information Retrieval Meets Information Visualization - PROMISE Winter School 2012, Revised Tutorial Lectures. Lecture Notes in Computer Science (LNCS) 7757, Springer, Heidelberg, Germany.
115. Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012). PROMISE Retreat Report: Prospects and Opportunities for Information Access Evaluation. PROMISE network of excellence, ISBN 978-88-6321-039-2, http://www.promise-noe.eu/promise-retreat-report-2012/.
116. AA.VV. (2012). Enciclopedia della Scienza e della Tecnica, volume VII-VIII. Istituto dell'Enciclopedia italiana fondata da Giovanni Treccani.
117. Candela, L., Castelli, D., Ferro, N., Koutrika, G., Meghini, C., Pagano, P., Ross, S., Soergel, D., Agosti, M., Dobreva, M., Katifori, V., and Schuldt, H. (2007). The DELOS Digital Library Reference Model. Foundations for Digital Libraries. ISTI-CNR at Gruppo ALI, Pisa, Italy. http://www.delos.info/files/pdf/ReferenceModel/DELOS_DLReferenceModel_0.98.pdf.
118. Ferro, N. (2004). Formal Model and Conceptual Architecture of the Annotation Service for Dynamic Ubiquitous Knowledge Environments. PhD thesis, Department of Information Engineering. University of Padua, Italy.

National Conferences ^

2013 ^

119. Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2013). Cumulated Relative Position: A Metric for Ranking Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 57-60.
120. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 61-64.
121. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). A Visual Analytics Tool for Experimental Evaluation. In Proc. 21st Italian Symposium on Advanced Database Systems (SEBD 2013). (in print)

2012 ^

122. Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors (2013). Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012). Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
123. Ferro, N. and Silvello, G. (2013). Empowering Archives Through Annotations. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 57-68. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
124. Ferro, N. and Silvello, G. (2013). Modeling Archives by means of OAI-ORE. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 216-227. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
125. Ferro, N. and Silvello, G. (2012). Per il sistema archivistico regionale. In Regione del Veneto, editor, Memoria e innovazione. Nuovi strumenti / Nuove esigenze. Atti della Prima Giornata regionale degli Archivi, pages 91-101. Canova Edizioni, Treviso.
126. Ferro, N. and Tanca, L., editors (2012). Proc. 20th Italian Symposium on Advanced Database Systems (SEBD 2012). Edizioni Libreria Progetto, Padova, Italy, ISBN 978-88-96477-23-6.

2011 ^

127. Agosti, M., Ferro, N., Rigon, A., Silvello, G., Terenzoni, E., and Tommasi, C. (2011). SIAR: A User-Centric Digital Archive System. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 87-99. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
128. Crivellari, F., Deambrosis, G., Di Nunzio, G. M., and Ferro, N. (2011). EuropeanaConnect. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 130-131. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
129. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., and Silvello, G. (2011). PROMISE - Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 140-143. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
130. Ferro, N. and Silvello, G. (2011). The NESTOR Model: Properties and Applications in the Context of Digital Archives. In Mecca, G. and Greco, S., editors, Proc. 19th Italian Symposium on Advanced Database Systems (SEBD 2011), pages 274-285. Università della Basilicata, Italy.

2010 ^

131. Agosti, M., Ferro, N., and Silvello, G. (2010). The NESTOR Framework: Manage, Access and Exchange Hierarchical Data Structures. In Martoglia, R., Bergamaschi, S., Lodi, S., and Sartori, C., editors, Proc. 18th Italian Symposium on Advanced Database Systems (SEBD 2010), pages 242-253. Società Editrice Esculapio, Bologna, Italy.
132. Ferro, N. and Silvello, G. (2010). FAST and NESTOR: How to Exploit Annotation Hierarchies. In Agosti, M., Esposito, F., and Thanos, C., editors, Digital Libraries. Proceedings of the Sixth Italian Research Conference (IRCDL 2010), pages 55-66. Springer-Verlag, Heidelberg, Germany.

2009 ^

133. Di Buccio, E., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2009). Design of an Information Retrieval System Based on the Peer-to-Peer Paradigm: An Application to Music Retrieval. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 100-107. DELOS Association and Department of Information Engineering of the University of Padua.
134. Ferro, N. (2009). The FAST Annotation Service. In De Antonellis, V., Castano, S., Catania, B., and Guerrini, G., editors, Proc. 17th Italian Symposium on Advanced Database Systems (SEBD 2009), pages 169-176. Seneca Edizioni, Torino, Italia.
135. Ferro, N. and Peters, C. (2009). CLEF Ad-hoc: A Perspective on the Evolution of the Cross-Language Evaluation Forum. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 72-79. DELOS Association and Department of Information Engineering of the University of Padua.
136. Ferro, N. and Silvello, G. (2009). Design and Development of the Data Model of a Distributed DLS Architecture for Archive Metadata. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 12-21. DELOS Association and Department of Information Engineering of the University of Padua.

2008 ^

137. Agosti, M. and Ferro, N. (2008). Adding Advanced Annotation Functionalities to an Existing Digital Library. In D'Atri, A., De Marco, M., and Casalino, N., editors, Interdisciplinary Aspects of Information Systems Studies, pages 279-286. Physica-Verlag, Heidelberg, Germany.
138. Di Buccio, E., Ferro, N., and Melucci, M. (2008). Towards a Superimposed Peer Infrastructure for iNformation Access. In Gaglio, S., Infantino, I., and Saccà, D., editors, Proc. 16th Italian Symposium on Advanced Database Systems (SEBD 2008), pages 398-405. Fotograf, Palermo, Italy.
139. Di Buccio, E., Ferro, N., and Melucci, M. (2008). Content-based Information Retrieval in SPINA. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 89-92. ISTI-CNR at Gruppo ALI, Pisa, Italy.
140. Dussin, M. and Ferro, N. (2008). The Design of the User Interface of a Scientific DLS in the context of the Data, Information, Knowledge and Wisdom Hierarchy. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 105-113. ISTI-CNR at Gruppo ALI, Pisa, Italy.
141. Ferro, N. and Harman, D. (2008). Dealing with MultiLingual Information Access: Grid Experiments at TrebleCLEF. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 29-32. ISTI-CNR at Gruppo ALI, Pisa, Italy.
142. Ferro, N. and Silvello, G. (2008). A Distributed Digital Library System Architecture for Archive Metadata. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 99-104. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2007 ^

143. Agosti, M., Brettlecker, G., Ferro, N., Ranaldi, P., and Schuldt, H. (2007). Extending the DelosDLMS by the FAST Annotation Service. In In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 7-12. ISTI-CNR at Gruppo ALI, Pisa, Italy.
144. Agosti, M., Coppotelli, T., and Ferro, N. (2007). Construction of an Annotation Test Collection for Search Evaluation on Digital Libraries. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 15-17. ISTI-CNR at Gruppo ALI, Pisa, Italy.
145. Agosti, M., Di Buccio, E., Di Nunzio, G. M., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2007). Distributed Information Retrieval and Automatic Identification of Music Works in SAPIR. In Ceci, M., Malerba, D., and Tanca, L., editors, Proc. 15th Italian Symposium on Advanced Database Systems (SEBD 2007), pages 479-482. Sagraf srl, Z.I. Capurso, Bari, Italia.
146. Agosti, M., Ferro, N., and Orio, N. (2007). Annotations as a Tool for Disclosing Hidden Relationships between Illuminated Manuscripts. In Basili, R. and Pazienza, M. T., editors, Proc. 10th Congress of the Italian Association for Artificial Intelligence. Artificial Intelligence and Human-Oriented Computing (AI*IA 2007), pages 662-673. Lecture Notes in Computer Science (LNCS) 4733, Springer, Heidelberg, Germany.
147. Dussin, M. and Ferro, N. (2007). An Effective User Interface for a Scientific DLS to Support Information Retrieval Evaluation. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 18-21. ISTI-CNR at Gruppo ALI, Pisa, Italy.
148. Ferro, N., Marcante, A., Martin, A., and Panizzi, E. (2007). Annotations: What We Learned from DELOS. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 13-14. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2006 ^

149. Di Nunzio, G. M. and Ferro, N. (2006). Uniform Methodology for Evaluating Information Access Components of Digital Libraries. In Agosti, M. and Thanos, C., editors, Proc. 2nd Italian Research Conference on Digital Library Management Systems (IRCDL 2006), pages 25-28. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2005 ^

150. Ferro, N. (2005). Design Choices for a Flexible Annotation Service. In Agosti, M. and Thanos, C., editors, Post-proceedings of the First Italian Research Conference on Digital Library Management Systems (IRCDL 2005), pages 101-110. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2004 ^

151. Bacchin, M., Ferro, N., and Melucci, M. (2004). A Probabilistic Model for Stemmer Generation. In Agosti, M., Dessì, N., and Schreiber, F. A., editors, Proc. 12th Italian Symposium on Advanced Database Systems (SEBD 2004), pages 230-237. LITHOSgrafiche, Cagliari, Italy.

Teaching Monographs ^

152. Agosti, M. and Ferro, N. (2007). Elementi di Basi di Dati, 2 edizione. Edizioni Libreria Progetto, Padova, Italia.
153. Agosti, M. and Ferro, N. (2003). Elementi di Basi di Dati. Edizioni Libreria Progetto, Padova, Italia.

Publications - Journals

International Journals ^

1. Ferro, N. and Silvello, G. (2013). NESTOR: A Formal Model for Digital Archives. Information Processing & Management. (in print)
2. Ferro, N., Hanbury, A., Müller, H., and Santucci, G. (2011). Harnessing the Scientific Data Produced by the Experimental Evaluation of Search Engines and Information Access Systems. Procedia Computer Science, 4:740-749.
3. Agosti, M. and Ferro, N. (2008). A Formal Model of Annotations of Digital Content. ACM Transactions on Information Systems (TOIS), 26(1):3:1-3:57.
4. Agosti, M., Bonfiglio-Dosio, G., and Ferro, N. (2007). A Historical and Contemporary Study on Annotations to Derive Key Features for Systems Design. International Journal on Digital Libraries, 8(1):1-19.
5. Bacchin, M., Ferro, N., and Melucci, M. (2005). A Probabilistic Model for Stemmer Generation. Information Processing & Management, 41(1):121-137.

International Scientific Dissemination Journals and Online ^

2013 ^

6. Agosti, M., Ferro, N., and Silvello, G. (2013). PROMISE Winter School 2013: Bridging between Information Retrieval and Databases. SIGIR Forum, 47(1):46-52.
7. Ferro, N. (2013). PROMISE Winter School 2013 on Bridging between Information Retrieval and Databases. ERCIM News, 93:56-57.
8. Forner, P., Bentivogli, L., Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., and Müller, H. (2013). PROMISE Technology Transfer Day: Spreading the Word on Information Access Evaluation at an Industrial Event. SIGIR Forum, 47(1):53-58.

2012 ^

9. Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012). PROMISE Retreat Report - Prospects and Opportunities for Information Access. SIGIR Forum, 46(2):60-84.
10. Agosti, M., Catarci, T., Ferro, N., Müller, H., and Santucci, G. (2012). PROMISE Winter School 2012 Information Retrieval meets Information Visualization. SIGIR Forum, 46(1):65-70.
11. Agosti, M., Ferro, N., and Thanos, C. (2012). DESIRE 2011 Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. SIGIR Forum, 46(1):51-55.
12. Allan, J., Aslam, J., Azzopardi, L., Belkin, N., Borlund, P., Bruza, P., Callan, J., Carman, M. Clarke, C., Craswell, N., Croft, W. B., Culpepper, J. S., Diaz, F., Dumais, S., Ferro, N., Geva, S., Gonzalo, J., Hawking, D., Järvelin, K., Jones, G., Jones, R., Kamps, J., Kando, N., Kanoulos, E., Karlgren, J., Kelly, D., Lease, M., Lin, J., Mizzaro, S., Moffat, A., Murdock, V., Oard, D. W., de Rijke, M., Sakai, T., Sanderson, M., Scholer, F., Si, L., Thom, J., Thomas, P., Trotman, A., Turpin, A., de Vries, A. P., Webber, W., Zhang, X., and Zhang, Y. (2012). Frontiers, Challenges, and Opportunities for Information Retrieval - Report from SWIRL 2012, The Second Strategic Workshop on Information Retrieval in Lorne, February 2012. SIGIR Forum, 46(1):2-32.
13. Catarci, T., Ferro, N., Forner, P., Hiemstra, D., Karlgren, J., Peñas, A., Santucci, G., and Womser-Hacker, C. (2012). CLEF 2012: Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics. SIGIR Forum, 46(2):29-33.
14. Ferro, N. (2012). The CLEF Initiative: Conference and Labs of the Evaluation Forum. ERCIM News, 88:63-64.
15. Ferro, N. (2012). CLEF 2012 and beyond: Perspectives for the Conference and Labs of the Evaluation forum. ERCIM News, 91:36-37.

2011 ^

16. Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V., and de Rijke, M. (2011). CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum, 45(2):32-37.
17. Ferro, N. (2011). DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation. ERCIM News, 86:54-55.
18. Ferro, N. (2011). PROMISE: Advancing the Evaluation of Multilingual and Multimedi Information Systems. ERCIM News, 84:49.

2010 ^

19. Agosti, M., Braschler, M., Choukri, K., Ferro, N., Harman, D. K., Peters, C., Pianta, E., de Rijke, M., and Smeaton, A. (2010). CLEF 2010 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum, 44(2):8-12.
20. Ferro, N. (2010). CLEF 2010: Innovation, Science, Experimentation. ERCIM News, 83:60.

2009 ^

21. Dussin, M. and Ferro, N. (2009). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1), http://www.ieee-tcdl.org/Bulletin/v5n1/Dussin/dussin1.html.
22. Dussin, M. and Ferro, N. (2009). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large- Scale Evaluation Campaigns. Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1), http://www.ieee-tcdl.org/Bulletin/v5n1/Dussin/dussin2.html.

National Journals ^

23. Ferro, N. (2012). La gestione e conservazione dei dati scientifici prodotti dalla valutazione sperimentale dei motori di ricerca. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina Parte II: Memorie della Classe di Scienze Matematiche, Fisiche e Naturali, CXXIV:41-52.
24. Ferro, N. (2011). La rete di eccellenza europea PROMISE. DigItalia, Rivista del digitale nei beni culturali, 6(1):113-122.
25. Agosti, M. and Ferro, N. (2010). Conferenza CLEF 2010 - Conference on Multilingual and Multimodal Information Access Evaluation. DigItalia, Rivista del digitale nei beni culturali, 5(2):176-180.
26. Agosti, M. and Ferro, N. (2010). Interoperabilità tra sistemi di biblioteche digitali. DigItalia, Rivista del digitale nei beni culturali, 5(1):95-112.
27. Agosti, M., Bonfiglio-Dosio, G., Ferro, N., and Silvello, G. (2008). Metodologie e percorsi interdisciplinari per la ideazione di un Sistema Informativo Archivistico. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina, CXX:261-287.
28. Agosti, M., Ferro, N., and Silvello, G. (2007). Proposta metodologica e architetturale per la gestione distribuita e condivisa di collezioni di documenti digitali. Archivi, 2(2):49-73.

Publications - International Book Chapters

1. Agosti, M., Ferro, N., and Silvello, G. (2011). How to Handle Hierarchically Structured Resources Addressing Interoperability Issues in Digital Libraries. In Biba, M. and Xhafa, F., editors, Learning Structure and Schemas from Documents, pages 17-49. Springer-Verlag, Heidelberg, Germany.
2. Ferro, N. (2010). Quality and Interoperability: The Quest for the Optimal Balance. In Iglezakis, I., Kapidakis, S., and Synodinou, T., editors, E-Publishing and Digital Libraries: Legal and Organizational Issues, pages 48-68. IGI Global, USA.
3. Agosti, M. and Ferro, N. (2009). Towards an Evaluation Infrastructure for DL Performance Evaluation. In Tsakonas, G. and Papatheodorou, C., editors, Evaluation of Digital Libraries: An Insight to Useful Applications and Methods, pages 93-120. Chandos Publishing, Oxford, UK.
4. Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2008). A Statistical and Graphical Methodology for Comparing Bilingual to Monolingual Cross-Language Information Retrieval. In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 171-188. Springer-Verlag, Heidelberg, Germany.
5. Ferro, N. (2008). Digital Annotations: a Formal Model and its Applications. In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 113-146. Springer-Verlag, Heidelberg, Germany.
6. Agosti, M. and Ferro, N. (2003). Chapter X: Managing the Interactions between Handheld Devices, Mobile Applications, and Users. In Lim, E. P. and Siau, K., editors, Advances in Mobile Commerce Technologies, pages 204-233. Idea Group, Hershey, USA.

Publications - International Conferences

2013 ^

1. Agosti, M., Conlan, O., Ferro, N., Hampson, C., and Munnelly, G. (2013). Interacting with Digital Cultural Heritage Collections via Annotations: The CULTURA Approach. In Marinai, S. and Marriot, K., editors, Proc. 13th ACM Symposium on Document Engineering (DocEng 2013). (in print)
2. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Improving Ranking Evaluation Employing Visual Analytics. In Forner, P., Müller, H., Paredes, R., Rosso, P., and Stein, B., editors, Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. Proceed- ings of the Fourth International Conference of the CLEF Initiative (CLEF 2013). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany. (in print)
3. Ferro, N. and Silvello, G. (2013). Formal Models for Digital Archives: NESTOR and the 5S. In Aalberg, T., Dobreva, M., Papatheodorou, C., Tsakonas, G., and Farrugia, C., editors, Proc. 17th International Conference on Theory and Practice of Digital Libraries (TPDL 2013). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany. (in print)
4. Munnelly, G., Hampson, C., Ferro, N., and Conlan, O. (2013). The FAST-CAT: Empowering Cultural Heritage Annotations. In Proc. Digital Humanities 2013. (in print)

2012 ^

5. Agosti, M., Di Buccio, E., Ferro, N., Masiero, I., Peruzzo, S., and Silvello, G. (2012). DIRECTions: Design and Specification of an IR Evaluation Infrastructure. In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF 2012), pages 88-99. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany.
6. Angelini, M., Ferro, N., Granato, G. L., Santucci, G., and Silvello, G. (2012). Information Retrieval Failure Analysis: Visual analytics as a Support for Interactive What-If Investigation. In Santucci, G. and Ward, M., editors, Proc. IEEE Conference on Visual Analytics Science and Technology (VAST 2012), pages 204-206. IEEE Computer Society, Los Alamitos, CA, USA.
7. Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2012). Cumulated Relative Position: A Metric for Ranking Evaluation. In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF2012), pages 112-123. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany.
8. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2012). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Kamps, J., Kraaij, W., and Fuhr, N., editors, Proc. 4th Symposium on Information Interaction in Context (IIiX 2012), pages 195-203. ACM Press, New York, USA.

2011 ^

9. Agosti, M., Ferro, N., and Thanos, C. (2009). DESIRE 2011: First International Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. In Ounis, I., Ruthven, I., Berendt, B., de Vries, A. P., and Wenfei, F., editors, Proc. 20th International Conference on Information and Knowledge Management (CIKM 2011), pages 2631-2632. ACM Press, New York, USA.
10. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). Interactive Analysis and Exploration of Experimental Evaluation Results. In Wilson, M. L., Russell-Rose, T., Larsen, B., and Kalbach, J., editors, Proc. 1st European Workshop on Human-Computer Interaction and Information Retrieval (EuroHCIR 2011), pages 11-14.
11. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). To Re-rank or to Re-query: Can Visual Analytics Solve This Dilemma? In Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., and de Rijke, M., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross-Language Evaluation Forum (CLEF 2011), pages 119-130. Lecture Notes in Computer Science (LNCS) 6941, Springer, Heidelberg, Germany.
12. Ferro, N., Sabetta, A., Santucci, G., and Tino, G. (2011). Visual Comparison of Ranked Result Cumulated Gains. In Miksch, S. and Santucci, G., editors, Proc. 2nd International Workshop on Visual Analytics (EuroVA 2011), pages 21-24. Eurographics Association, Goslar, Germany.

2010 ^

13. Agosti, M., Di Nunzio, G. M., Dussin, M., and Ferro, N. (2010). 10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go. In Sakay, T., Sanderson, M., and Webber, W., editors, Proc. 3rd International Workshop on Evaluating Information Access (EVIA 2010), pages 16-24. National Institute of Informatics, Tokyo, Japan.
14. Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors (2010). Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010). Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany.
15. Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., Müller, H., Petras, V., Pianta, E., de Rijke, M., and Santucci, G. (2010). A PROMISE for Experimental Evaluation. In Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010), pages 140-144. Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany.
16. Ferro, N. (2010). CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum. In Kando, N. and Kishida, K., editors, Proc. 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 2-12. National Institute of Informatics, Tokyo, Japan. Invited talk.
17. Ferro, N. and Harman, D. (2010). CLEF 2009: Grid@CLEF Pilot Track Overview. In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 552-565. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany.
18. Ferro, N. and Peters, C. (2010). CLEF 2009 Ad Hoc Track Overview: TEL & Persian Tasks. In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 13-35. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany.

2009 ^

19. Agirre, E., Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2009). CLEF 2008: Ad Hoc Track Overview. In Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors, Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross-Language Evaluation Forum (CLEF 2008). Revised Selected Papers, pages 15-37. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany.
20. Agosti, M., Ferro, N., and Silvello, G. (2009). Access and Exchange of Hierarchically Structured Resources on the Web with the NESTOR Framework. In Baeza-Yates, R., Berendt, B., Bertino, E., Lim, E.-P., and Pasi, G., editors, Proc. 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, pages 659-662. IEEE Computer Society, Los Alamitos, CA, USA.
21. Agosti, M., Ferro, N., and Silvello, G. (2009). Enabling Cross-Language Access to Archival Metadata. In Cirinnà, C. and Lunghi, M., editors, International Conference on Cultural Heritage Online - Empowering Users: an Active Role for User Communities, pages 179-183. Fondazione Rinascimento Digitale, Firenze, Italy.
22. Dussin, M. and Ferro, N. (2009). Managing the Knowledge Creation Process of Large-Scale Evaluation Campaigns. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 63-74. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany. Best student paper award.
23. Ferro, N. (2009). Annotation Search: The FAST Way. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 15-26. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany.
24. Ferro, N. and Silvello, G. (2009). The NESTOR Framework: How to Handle Hierarchical Data Structures. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 215-226. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany.
25. Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors (2009). Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross–Language Evaluation Forum (CLEF 2008). Revised Selected Papers. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany.

2008 ^

26. Agosti, M. and Ferro, N. (2008). Annotations: a Way to Interoperability in DL. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 291-295. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
27. Agosti, M., Ferro, N., and Silvello, G. (2008). The Design of a DLS for the Management of Very Large Collections of Archival Objects. In Manghi, P., Pagano, P., and Zezula, P., editors, Proc. 1st Workshop on Very Large Digital Libraries (VLDL 2008). DELOS: an Association for Digital Libraries. Published Online.
28. Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2008). CLEF 2007: Ad Hoc Track Overview. In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, pages 13-32. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany.
29. Dussin, M. and Ferro, N. (2008). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 424. ACM Press, New York, USA.
30. Dussin, M. and Ferro, N. (2008). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 450. ACM Press, New York, USA.
31. Dussin, M. and Ferro, N. (2008). Design of a Digital Library System for Large-Scale Evaluation Campaigns. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 400-401. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
32. Ferro, N. and Peters, C. (2008). From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum. In Kando, N. and Sugimoto, M., editors, Proc. 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 577-593. National Institute of Informatics, Tokyo, Japan. Invited talk.
33. Ferro, N. and Silvello, G. (2008). A Methodology for Sharing Archival Descriptive Metadata in a Distributed Environment. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 268-279. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
34. Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Larson, R., Sanderson, M., Santos, D., Womser-Hacker, C., and Xie, X. (2008). GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview. In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, 745-772. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany.
35. Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Sanderson, M., Santos, D., and Womser-Hacker, C. (2008). An Evaluation Resource For Geographic Information Retrieval. In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008). http://www.lrec-conf.org/proceedings/lrec2008/pdf/8_paper.pdf.
36. Mandl, T., Womser-Hacker, C., Di Nunzio, G. M., and Ferro, N. (2008). How Robust are Multilingual Information Retrieval Systems? In Wainwright, R. L., and Haddad, H. M., editors, Proc. 2008 ACM Symposium on Applied Computing (SAC 2008), pages 1132-1136. ACM Press, New York, USA.
37. Peters, C., Braschler, M., Di Nunzio, G. M., Ferro, N., Gonzalo, J., and Sanderson, M. (2008). From Research to Application in Multilingual Information Access: the Contribution of Evaluation. In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008). http://www.lrec-conf.org/proceedings/lrec2008/pdf/913_paper.pdf.
38. Sanderson, M., Braschler, M., Ferro, N., and Gonzalo, J. (2008). Workshop on Novel Methodologies for Evaluation in Information Retrieval. In Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., and White, R. W ., editors, Advances in Information Retrieval. Proc. 30th European Conference on IR Research (ECIR 2008), page 750. Lecture Notes in Computer Science (LNCS) 4956, Springer, Heidelberg, Germany.

2007 ^

39. Agosti, M., Berretti, S., Brettlecker, G., del Bimbo, A., Ferro, N., Fuhr, N., Keim, D., Klas, C.-P., Lidy, T., Milano, D., Norrie, M., Ranaldi, P., Rauber, A., Schek, H.-J., Schreck, T., Schuldt, H., Signer, B., and Springmann, M. (2007). DelosDLMS - the Integrated DELOS Digital Library Management System. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 36-45. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
40. Agosti, M., Braschler, M., Ferro, N., Peters, C., and Siebinga, S. (2007). Roadmap for MultiLingual Information Access in The European Library. In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 136-147. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany.
41. Agosti, M., Coppotelli, T., Di Nunzio, G. M., Ferro, N., and van der Meulen, E. (2007). A Study of Web Logs for Personalizing the MultiLingual Information Access to The European Library. In Christodoulakis, S., editor, Workshop on Cross-Media and Personalized Learning Applications on top of Digital Libraries (LADL 2007), pages 19-28.
42. Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007). Annotations and Digital Libraries: Designing Adequate Test-beds. In Goh, D. H. L., Cao, T. H., Sølvberg, I., and Rasmussen, E., editors, Proc. 10th International Conference on Asian Digital Libraries. Digital Libraries - Asian Digital libraries: Looking Back 10 Years and Forging New Frontiers (ICADL 2007), pages 150-159. Lecture Notes in Computer Science (LNCS) 4822, Springer, Heidelberg, Germany.
43. Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007). An Approach for the Construction of an Experimental Test Collectionto Evaluate Search Systems that Exploit Annotations. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 167-176. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
44. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 11-20. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
45. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). The Importance of Scientific Data Curation for Evaluation Campaigns. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 157-166. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
46. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns. In Sakay, T. and Sanderson, M., and Evans, D. K., editors, Proc. 1st International Workshop on Evaluating Information Access (EVIA 2007), pages 62-73. National Institute of Informatics, Tokyo, Japan.
47. Agosti, M., Di Nunzio, G. M., Ferro, N., Harman, D., and Peters, C. (2007). The Future of Large-scale Evaluation Campaigns for Information Retrieval in Europe. In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 509-512. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany.
48. Agosti, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2007). CLEF: Ongoing Activities and Plans for the Future. In Kando, N. and Evans, D. K., editors, Proc. 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 493-504. National Institute of Informatics, Tokyo, Japan. Invited talk.
49. Agosti, M., Ferro, N., Fox, E. A., Gonçalves, M. A., and Lagoeiro, B. (2007). Towards a Reference Quality Model for Digital Libraries. In Castelli, D. and Fox, E. A., editors, Pre-proceedings of the First International Workshop on Foundations of Digital Libraries, pages 37-42.
50. Agosti, M., Ferro, N., and Orio, N. (2007). Design and Development of a Digital Archive of Illuminated Manuscripts. In del Bimbo, A., Cucchiara, R., and Boujemaa, N., editors, Proc. International Workshop on Visual and Multimedia Digital Libraries (WMDL 2007), pages 113-118. IEEE Computer Society, Los Alamitos, CA, USA.
51. Agosti, M., Ferro, N., and Silvello, G. (2007). An Architecture to Share Metadata among Geographically Distributed Archives. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 56-65. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
52. Braschler, M. and Ferro, N. (2007). Adding MultiLingual Information Access to The European Library TEL. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 218-227. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
53. Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2007). How to Compare Bilingual to Monolingual Cross-Language Information Retrieval. In Amati, G., Carpineto, C., and Romano, G., editors, Advances in Information Retrieval. Proc. 29th European Conference on IR Research (ECIR 2007), pages 533-540. Lecture Notes in Computer Science (LNCS) 4425, Springer, Heidelberg, Germany.
54. Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2007). CLEF 2006: Ad Hoc Track Overview. In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers , pages 21-34. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
55. Gey, F., Larson, R., Sanderson, M., Bischoff, K., Mandl, T., Womser-Hacker, K., Santos, D., Rocha, P., Di Nunzio, G. M., and Ferro, N. (2007). GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview. In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 852-876. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.

2006 ^

56. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006). A Data Curation Approach to Support In-depth Evaluation Studies. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 65-68.>/li>
57. Agosti, M. and Ferro, N. (2006). Search Strategies for Finding Annotations and Annotated Documents: the FAST Service. In Legind Larsen, H., Pasi, G., Ortiz-Arroyo, D., Andreasen, T., and Christiansen, H., editors, Proc. 7th International Conference on Flexible Query Answering Systems (FQAS 2006), pages 270-281. Lecture Notes in Artificial Intelligence (LNAI) 4027, Springer, Heidelberg, Germany.
58. Agosti, M., Ferro, N., Frommholz, I., Panizzi, E., Putz, W., and Thiel, U. (2006). Integration of the DiLAS Annotation Service into Digital Library Infrastructures. In Blandford, A. and Gow, J., editors, Proc. 1st International Workshop on Digital Libraries in the Context of Usersí Broader Activities (DL-CUBA 2006), pages 1-4. http://www.uclic.ucl.ac.uk/events/dl-cuba2006/.
59. Agosti, M., Ferro, N., and Orio, N. (2006). Graph-based Automatic Suggestion of Relationships among Images of Illuminated Manuscripts. In Haddad, H. M., Liebrock, K. M., Chbeir, R., Palakal, M. J., Ossowski, S., Yetongnoon, K., Wainwright, R. L., and Nicolle, C., editors, Proc. 21st ACM Symposium on Applied Computing (SAC 2006), pages 1063-1067. ACM Press, New York, USA.
60. Agosti, M., Ferro, N., Panizzi, E., and Trinchese, R. (2006). Annotation as a Support to User Interaction for Content Enhancement in Digital Libraries. In Celentano, A. and Mussio, P., editors, Proc. Working Conference on Advanced Visual Interfaces (AVI 2006), pages 151-154. ACM Press, New York, USA.
61. Braschler, M., Ferro, N., and Verleyen, J. (2006). Implementing MLIA in an existing DL system. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 73-76.
62. Di Nunzio, G. M. and Ferro, N. (2006). Scientific Evaluation of a DLMS: a service for evaluating information access components. In Gonzalo, J., Thanos, C., Verdejo, M. F., and Carrasco, R. C., editors, Proc. 10th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2006), pages 536-539. Lecture Notes in Computer Science (LNCS) 4172, Springer, Heidelberg, Germany.
63. Di Nunzio, G. M. and Ferro, N. (2006). Queries and Relevance Assessments: The Right Context for the Right Topic. In Joho, H., Urban, J., Villa, R., Jose, J. M., and van Rijsbergen, C. J., editors, First International Workshop on Adaptive Information Retrieval (AIR 2006), pages 26-27. http://www.dcs.gla.ac.uk/workshops/air/air2006_program.pdf.
64. Di Nunzio, G. M., Ferro, N., Jones, G. J. F., and Peters, C. (2006). CLEF 2005: Ad Hoc Track Overview. In Peters, C., Gey, F. C., Gonzalo, J., Jones, G. J. F., Kluck, M., Magnini, B., Müller, H., and de Rijke, M., editors, Accessing Multilingual Information Repositories: Sixth Workshop of the Cross-Language Evaluation Forum (CLEF 2005). Revised Selected Papers, pages 11-36. Lecture Notes in Computer Science (LNCS) 4022, Springer, Heidelberg, Germany.

2005 ^

65. Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Orio, N., Panizzi, E., Pejtersen, A. M., and Thiel, U. (2005). DiLAS: a Digital Library Annotation Service. In Boujut, J.-F., editor, Proc. International Workshop on Annotation for Collaboration - Methods, Tools, and Practices (IWAC 2005), pages 91-101. CNRS - Programme société de l'information.
66. Agosti, M. and Ferro, N. (2005). A System Architecture as a Support to a Flexible Annotation Service. In Türker, C., Agosti, M., and Schek, H.-J., editors, Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures: 6th Thematic Workshop of the EU Network of Excellence DELOS. Revised Selected Papers, pages 147-166. Lecture Notes in Computer Science (LNCS) 3664, Springer, Heidelberg, Germany.
67. Agosti, M. and Ferro, N. (2005). Annotations as Context for Searching Documents. In Crestani, F. and Ruthven, I., editors, Proc. 5th International Conference on Conceptions of Library and Information Science - Context: nature, impact and role (Colis 5), pages 155-170. Lecture Notes in Computer Science (LNCS) 3507, Springer, Heidelberg, Germany. Best Student Paper Award.
68. Agosti, M., Ferro, N., and Orio, N. (2005). Annotating Illuminated Manuscripts: an Effective Tool for Research and Education. In Marlino, M., Sumner, T., and Shipman, F., editors, Proc. 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), pages 121-130. ACM Press, New York, USA.
69. Agosti, M., Ferro, N., and Orio, N. (2005). Annotations as a Support to Research Users. In Catarci, T., Christodoulakis, S., and Del Bimbo, A., editors, Proc. 7th International Workshop of the EU Network of Excellence DELOS on Audio-Visual Content and Information Visualization in Digital Libraries (AVIVDiLib'05), pages 117-120. Centromedia, Viareggio, Italy.
70. Braschler, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2005). CLEF 2004: Ad Hoc Track Overview and Results Analysis. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 10-26. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.
71. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a System for Evaluating Information Access Components of Digital Libraries. In Rauber, A., Christodoulakis, S., and Min Tjoa, A., editors, Proc. 9th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2005), pages 483-484. Lecture Notes in Computer Science (LNCS) 3652, Springer, Heidelberg, Germany.
72. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a Distributed Tool for Information Retrieval Evaluation Campaigns. In Ioannidis, Y., Schek, H.-J., and Weikum, G., editors, Proc. 8th DELOS Thematic Workshop on Future Digital Library Management Systems: System Architecture and Information Access, pages 58-63. http://dbis.cs.unibas.ch/delos_website/delos-dagstuhl-handout-all.pdf.
73. Di Nunzio, G. M., Ferro, N., and Orio, N. (2005). Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 60-72. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.

2004 ^

74. Agosti, M. and Ferro, N. (2004). An Information Service Architecture for Annotations. In Agosti, M., Schek, H.-J., and Türker, C., editors, Digital Library Architectures: Peer-to-Peer, Grid, and Service-Orientation, Pre-proceedings of the 6th Thematic Workshop of the EU Network of Excellence DELOS, pages 115-126. Edizioni Libreria Progetto, Padova, Italy.
75. Agosti, M., Ferro, N., Frommholz, I., and Thiel, U. (2004). Annotations in Digital Libraries and Collaboratories - Facets, Models and Usage. In Heery, R. and Lyon, L., editors, Proc. 8th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2004), pages 244-255. Lecture Notes in Computer Science (LNCS) 3232, Springer, Heidelberg, Germany.
76. Di Nunzio, G. M., Ferro, N., Melucci, M., and Orio, N. (2004). Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Comparative Evaluation of Multilingual Information Access Systems: Fourth Workshop of the Cross-Language Evaluation Forum (CLEF 2003) Revised Selected Papers, pages 220-235. Lecture Notes in Computer Science (LNCS) 3237, Springer, Heidelberg, Germany.

2003 ^

77. Agosti, M., Bacchin, M., Ferro, N., and Melucci, M. (2003). Improving the Automatic Retrieval of Text Documents. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Advances in Cross-Language Information Retrieval: Third Workshop of the Cross-Language Evaluation Forum (CLEF 2002) Revised Papers, pages 279-290. Lecture Notes in Computer Science (LNCS) 2785, Springer, Heidelberg, Germany.
78. Agosti, M. and Ferro, N. (2003). Annotations: Enriching a Digital Library. In Koch, T. and Sølvberg, I. T., editors, Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pages 88-100. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany.

2002 ^

79. Bacchin, M., Ferro, N., and Melucci, M. (2002). The Effectiveness of a Graph-based Algorithm for Stemming. In Lim, E. P., Foo, S., Khoo, C. S. G., Chen, H., Fox, E. A., Urs, S. R., and Thanos, C., editors, Proc. 5th International Conference on Asian Digital Libraries. Digital Libraries: People, Knowledge, and Technology (ICADL 2002), pages 117-128. Lecture Notes in Computer Science (LNCS) 2555, Springer, Heidelberg, Germany.

Publications - National Conferences

2013 ^

1. Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2013). Cumulated Relative Position: A Metric for Ranking Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 57-60.
2. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 61-64.
3. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). A Visual Analytics Tool for Experimental Evaluation. In Proc. 21st Italian Symposium on Advanced Database Systems (SEBD 2013). (in print)

2012 ^

4. Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors (2013). Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012). Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
5. Ferro, N. and Silvello, G. (2013). Empowering Archives Through Annotations. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 57-68. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
6. Ferro, N. and Silvello, G. (2013). Modeling Archives by means of OAI-ORE. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 216-227. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
7. Ferro, N. and Silvello, G. (2012). Per il sistema archivistico regionale. In Regione del Veneto, editor, Memoria e innovazione. Nuovi strumenti / Nuove esigenze. Atti della Prima Giornata regionale degli Archivi, pages 91-101. Canova Edizioni, Treviso.
8. Ferro, N. and Tanca, L., editors (2012). Proc. 20th Italian Symposium on Advanced Database Systems (SEBD 2012). Edizioni Libreria Progetto, Padova, Italy, ISBN 978-88-96477-23-6.

2011 ^

9. Agosti, M., Ferro, N., Rigon, A., Silvello, G., Terenzoni, E., and Tommasi, C. (2011). SIAR: A User-Centric Digital Archive System. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 87-99. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
10. Crivellari, F., Deambrosis, G., Di Nunzio, G. M., and Ferro, N. (2011). EuropeanaConnect. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 130-131. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
11. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., and Silvello, G. (2011). PROMISE - Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 140-143. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
12. Ferro, N. and Silvello, G. (2011). The NESTOR Model: Properties and Applications in the Context of Digital Archives. In Mecca, G. and Greco, S., editors, Proc. 19th Italian Symposium on Advanced Database Systems (SEBD 2011), pages 274-285. Università della Basilicata, Italy.

2010 ^

13. Agosti, M., Ferro, N., and Silvello, G. (2010). The NESTOR Framework: Manage, Access and Exchange Hierarchical Data Structures. In Martoglia, R., Bergamaschi, S., Lodi, S., and Sartori, C., editors, Proc. 18th Italian Symposium on Advanced Database Systems (SEBD 2010), pages 242-253. Società Editrice Esculapio, Bologna, Italy.
14. Ferro, N. and Silvello, G. (2010). FAST and NESTOR: How to Exploit Annotation Hierarchies. In Agosti, M., Esposito, F., and Thanos, C., editors, Digital Libraries. Proceedings of the Sixth Italian Research Conference (IRCDL 2010), pages 55-66. Springer-Verlag, Heidelberg, Germany.

2009 ^

15. Di Buccio, E., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2009). Design of an Information Retrieval System Based on the Peer-to-Peer Paradigm: An Application to Music Retrieval. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 100-107. DELOS Association and Department of Information Engineering of the University of Padua.
16. Ferro, N. (2009). The FAST Annotation Service. In De Antonellis, V., Castano, S., Catania, B., and Guerrini, G., editors, Proc. 17th Italian Symposium on Advanced Database Systems (SEBD 2009), pages 169-176. Seneca Edizioni, Torino, Italia.
17. Ferro, N. and Peters, C. (2009). CLEF Ad-hoc: A Perspective on the Evolution of the Cross-Language Evaluation Forum. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 72-79. DELOS Association and Department of Information Engineering of the University of Padua.
18. Ferro, N. and Silvello, G. (2009). Design and Development of the Data Model of a Distributed DLS Architecture for Archive Metadata. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 12-21. DELOS Association and Department of Information Engineering of the University of Padua.

2008 ^

19. Agosti, M. and Ferro, N. (2008). Adding Advanced Annotation Functionalities to an Existing Digital Library. In D'Atri, A., De Marco, M., and Casalino, N., editors, Interdisciplinary Aspects of Information Systems Studies, pages 279-286. Physica-Verlag, Heidelberg, Germany.
20. Di Buccio, E., Ferro, N., and Melucci, M. (2008). Towards a Superimposed Peer Infrastructure for iNformation Access. In Gaglio, S., Infantino, I., and Saccà, D., editors, Proc. 16th Italian Symposium on Advanced Database Systems (SEBD 2008), pages 398-405. Fotograf, Palermo, Italy.
21. Di Buccio, E., Ferro, N., and Melucci, M. (2008). Content-based Information Retrieval in SPINA. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 89-92. ISTI-CNR at Gruppo ALI, Pisa, Italy.
22. Dussin, M. and Ferro, N. (2008). The Design of the User Interface of a Scientific DLS in the context of the Data, Information, Knowledge and Wisdom Hierarchy. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 105-113. ISTI-CNR at Gruppo ALI, Pisa, Italy.
23. Ferro, N. and Harman, D. (2008). Dealing with MultiLingual Information Access: Grid Experiments at TrebleCLEF. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 29-32. ISTI-CNR at Gruppo ALI, Pisa, Italy.
24. Ferro, N. and Silvello, G. (2008). A Distributed Digital Library System Architecture for Archive Metadata. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 99-104. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2007 ^

25. Agosti, M., Brettlecker, G., Ferro, N., Ranaldi, P., and Schuldt, H. (2007). Extending the DelosDLMS by the FAST Annotation Service. In In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 7-12. ISTI-CNR at Gruppo ALI, Pisa, Italy.
26. Agosti, M., Coppotelli, T., and Ferro, N. (2007). Construction of an Annotation Test Collection for Search Evaluation on Digital Libraries. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 15-17. ISTI-CNR at Gruppo ALI, Pisa, Italy.
27. Agosti, M., Di Buccio, E., Di Nunzio, G. M., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2007). Distributed Information Retrieval and Automatic Identification of Music Works in SAPIR. In Ceci, M., Malerba, D., and Tanca, L., editors, Proc. 15th Italian Symposium on Advanced Database Systems (SEBD 2007), pages 479-482. Sagraf srl, Z.I. Capurso, Bari, Italia.
28. Agosti, M., Ferro, N., and Orio, N. (2007). Annotations as a Tool for Disclosing Hidden Relationships between Illuminated Manuscripts. In Basili, R. and Pazienza, M. T., editors, Proc. 10th Congress of the Italian Association for Artificial Intelligence. Artificial Intelligence and Human-Oriented Computing (AI*IA 2007), pages 662-673. Lecture Notes in Computer Science (LNCS) 4733, Springer, Heidelberg, Germany.
29. Dussin, M. and Ferro, N. (2007). An Effective User Interface for a Scientific DLS to Support Information Retrieval Evaluation. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 18-21. ISTI-CNR at Gruppo ALI, Pisa, Italy.
30. Ferro, N., Marcante, A., Martin, A., and Panizzi, E. (2007). Annotations: What We Learned from DELOS. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 13-14. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2006 ^

31. Di Nunzio, G. M. and Ferro, N. (2006). Uniform Methodology for Evaluating Information Access Components of Digital Libraries. In Agosti, M. and Thanos, C., editors, Proc. 2nd Italian Research Conference on Digital Library Management Systems (IRCDL 2006), pages 25-28. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2005 ^

32. Ferro, N. (2005). Design Choices for a Flexible Annotation Service. In Agosti, M. and Thanos, C., editors, Post-proceedings of the First Italian Research Conference on Digital Library Management Systems (IRCDL 2005), pages 101-110. ISTI-CNR at Gruppo ALI, Pisa, Italy.

2004 ^

33. Bacchin, M., Ferro, N., and Melucci, M. (2004). A Probabilistic Model for Stemmer Generation. In Agosti, M., Dessì, N., and Schreiber, F. A., editors, Proc. 12th Italian Symposium on Advanced Database Systems (SEBD 2004), pages 230-237. LITHOSgrafiche, Cagliari, Italy.

Publications - Monographs

1. Agosti, M., Ferro, N., Forner, P., Müller, H., and Santucci, G., editors (2013). Information Retrieval Meets Information Visualization - PROMISE Winter School 2012, Revised Tutorial Lectures. Lecture Notes in Computer Science (LNCS) 7757, Springer, Heidelberg, Germany.
2. Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012). PROMISE Retreat Report: Prospects and Opportunities for Information Access Evaluation. PROMISE network of excellence, ISBN 978-88-6321-039-2, http://www.promise-noe.eu/promise-retreat-report-2012/.
3. AA.VV. (2012). Enciclopedia della Scienza e della Tecnica, volume VII-VIII. Istituto dell'Enciclopedia italiana fondata da Giovanni Treccani.
4. Candela, L., Castelli, D., Ferro, N., Koutrika, G., Meghini, C., Pagano, P., Ross, S., Soergel, D., Agosti, M., Dobreva, M., Katifori, V., and Schuldt, H. (2007). The DELOS Digital Library Reference Model. Foundations for Digital Libraries. ISTI-CNR at Gruppo ALI, Pisa, Italy. http://www.delos.info/files/pdf/ReferenceModel/DELOS_DLReferenceModel_0.98.pdf.
5. Ferro, N. (2004). Formal Model and Conceptual Architecture of the Annotation Service for Dynamic Ubiquitous Knowledge Environments. PhD thesis, Department of Information Engineering. University of Padua, Italy.

Publications - Teaching Monographs

1. Agosti, M. and Ferro, N. (2007). Elementi di Basi di Dati, 2 edizione. Edizioni Libreria Progetto, Padova, Italia.
2. Agosti, M. and Ferro, N. (2003). Elementi di Basi di Dati. Edizioni Libreria Progetto, Padova, Italia.

Publications - 2013

International Journals^

1. Ferro, N. and Silvello, G. (2013). NESTOR: A Formal Model for Digital Archives. Information Processing & Management. (in print)

International Scientific Dissemination Journals^

2. Agosti, M., Ferro, N., and Silvello, G. (2013). PROMISE Winter School 2013: Bridging between Information Retrieval and Databases. SIGIR Forum, 47(1):46-52.
3. Ferro, N. (2013). PROMISE Winter School 2013 on Bridging between Information Retrieval and Databases. ERCIM News, 93:56-57.
4. Forner, P., Bentivogli, L., Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., and Müller, H. (2013). PROMISE Technology Transfer Day: Spreading the Word on Information Access Evaluation at an Industrial Event. SIGIR Forum, 47(1):53-58

International Conferences ^

5. Agosti, M., Conlan, O., Ferro, N., Hampson, C., and Munnelly, G. (2013). Interacting with Digital Cultural Heritage Collections via Annotations: The CULTURA Approach. In Marinai, S. and Marriot, K., editors, Proc. 13th ACM Symposium on Document Engineering (DocEng 2013). (in print)
6. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Improving Ranking Evaluation Employing Visual Analytics. In Forner, P., Müller, H., Paredes, R., Rosso, P., and Stein, B., editors, Information Access Evaluation meets Multilinguality, Multimodality, and Visualization. Proceed- ings of the Fourth International Conference of the CLEF Initiative (CLEF 2013). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany. (in print)
7. Ferro, N. and Silvello, G. (2013). Formal Models for Digital Archives: NESTOR and the 5S. In Aalberg, T., Dobreva, M., Papatheodorou, C., Tsakonas, G., and Farrugia, C., editors, Proc. 17th International Conference on Theory and Practice of Digital Libraries (TPDL 2013). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany. (in print)
8. Munnelly, G., Hampson, C., Ferro, N., and Conlan, O. (2013). The FAST-CAT: Empowering Cultural Heritage Annotations. In Proc. Digital Humanities 2013. (in print)

Monographs ^

9. Agosti, M., Ferro, N., Forner, P., Müller, H., and Santucci, G., editors (2013). Information Retrieval Meets Information Visualization - PROMISE Winter School 2012, Revised Tutorial Lectures. Lecture Notes in Computer Science (LNCS) 7757, Springer, Heidelberg, Germany.

National Conferences ^

10. Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2013). Cumulated Relative Position: A Metric for Ranking Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 57-60.
11. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Basili, R., Sebastiani, F., and Semeraro, G., editors, Proc. 4th Italian Information Retrieval Workshop (IIR 2013), pages 61-64.
12. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2013). A Visual Analytics Tool for Experimental Evaluation. In Proc. 21st Italian Symposium on Advanced Database Systems (SEBD 2013). (in print)

Publications - 2012

International Scientific Dissemination Journals^

1. Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012). PROMISE Retreat Report - Prospects and Opportunities for Information Access. SIGIR Forum, 46(2):60-84.
2. Agosti, M., Catarci, T., Ferro, N., Müller, H., and Santucci, G. (2012). PROMISE Winter School 2012 Information Retrieval meets Information Visualization. SIGIR Forum, 46(1):65-70.
3. Agosti, M., Ferro, N., and Thanos, C. (2012). DESIRE 2011 Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. SIGIR Forum, 46(1):51-55.
4. Allan, J., Aslam, J., Azzopardi, L., Belkin, N., Borlund, P., Bruza, P., Callan, J., Carman, M. Clarke, C., Craswell, N., Croft, W. B., Culpepper, J. S., Diaz, F., Dumais, S., Ferro, N., Geva, S., Gonzalo, J., Hawking, D., Järvelin, K., Jones, G., Jones, R., Kamps, J., Kando, N., Kanoulos, E., Karlgren, J., Kelly, D., Lease, M., Lin, J., Mizzaro, S., Moffat, A., Murdock, V., Oard, D. W., de Rijke, M., Sakai, T., Sanderson, M., Scholer, F., Si, L., Thom, J., Thomas, P., Trotman, A., Turpin, A., de Vries, A. P., Webber, W., Zhang, X., and Zhang, Y. (2012). Frontiers, Challenges, and Opportunities for Information Retrieval - Report from SWIRL 2012, The Second Strategic Workshop on Information Retrieval in Lorne, February 2012. SIGIR Forum, 46(1):2-32.
5. Catarci, T., Ferro, N., Forner, P., Hiemstra, D., Karlgren, J., Peñas, A., Santucci, G., and Womser-Hacker, C. (2012). CLEF 2012: Information Access Evaluation meets Multilinguality, Multimodality, and Visual Analytics. SIGIR Forum, 46(2):29-33.
6. Ferro, N. (2012). The CLEF Initiative: Conference and Labs of the Evaluation Forum. ERCIM News, 88:63-64.
7. Ferro, N. (2012). CLEF 2012 and beyond: Perspectives for the Conference and Labs of the Evaluation forum. ERCIM News, 91:36-37.

National Journals^

8. Ferro, N. (2012). La gestione e conservazione dei dati scientifici prodotti dalla valutazione sperimentale dei motori di ricerca. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina. Parte II: Memorie della Classe di Scienze Matematiche, Fisiche e Naturali, CXXIV:41-52.

International Conferences ^

9. Agosti, M., Di Buccio, E., Ferro, N., Masiero, I., Peruzzo, S., and Silvello, G. (2012). DIRECTions: Design and Specification of an IR Evaluation Infrastructure. In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF 2012), pages 88-99. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany.
10. Angelini, M., Ferro, N., Granato, G. L., Santucci, G., and Silvello, G. (2012). Information Retrieval Failure Analysis: Visual analytics as a Support for Interactive What-If Investigation. In Santucci, G. and Ward, M., editors, Proc. IEEE Conference on Visual Analytics Science and Technology (VAST 2012), pages 204-206. IEEE Computer Society, Los Alamitos, CA, USA.
11. Angelini, M., Ferro, N., Järvelin, K., Keskustalo, H., Pirkola, A., Santucci, G., and Silvello, G. (2012). Cumulated Relative Position: A Metric for Ranking Evaluation. In Catarci, T., Forner, P., Hiemstra, D., Peñas, A., and Santucci, G., editors, Information Access Evaluation. Multilinguality, Multimodality, and Visual Analytics. Proceedings of the Third International Conference of the CLEF Initiative (CLEF2012), pages 112-123. Lecture Notes in Computer Science (LNCS) 7488, Springer, Heidelberg, Germany.
12. Angelini, M., Ferro, N., Santucci, G., and Silvello, G. (2012). Visual Interactive Failure Analysis: Supporting Users in Information Retrieval Evaluation. In Kamps, J., Kraaij, W., and Fuhr, N., editors, Proc. 4th Symposium on Information Interaction in Context (IIiX 2012), pages 195-203. ACM Press, New York, USA.

Monographs ^

13. Agosti, M., Berendsen, R., Bogers, T., Braschler, M., Buitelaar, P., Choukri, K., Di Nunzio, G. M., Ferro, N., Forner, P., Hanbury, A., Friberg Heppin, K., Hansen, P., Järvelin, A., Larsen, B., Lupu, M., Masiero, I., Müller, H., Peruzzo, S., Petras, V., Piroi, F., de Rijke, M., Santucci, G., Silvello, G., and Toms, E. (2012). PROMISE Retreat Report: Prospects and Opportunities for Information Access Evaluation. PROMISE network of excellence, ISBN 978-88-6321-039-2, http://www.promise-noe.eu/promise-retreat-report-2012/.
14. AA.VV. (2012). Enciclopedia della Scienza e della Tecnica, volume VII-VIII. Istituto dell'Enciclopedia italiana fondata da Giovanni Treccani.

National Conferences ^

15. Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors (2013). Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012). Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
16. Ferro, N. and Silvello, G. (2013). Empowering Archives Through Annotations. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 57-68. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
17. Ferro, N. and Silvello, G. (2013). Modeling Archives by means of OAI-ORE. In Agosti, M., Esposito, F., Ferilli, S., and Ferro, N., editors, Digital Libraries and Archives - Proc. 8th Italian Research Conference (IRCDL 2012), pages 216-227. Communications in Computer and Information Science (CCIS) 354, Springer, Heidelberg, Germany.
18. Ferro, N. and Silvello, G. (2012). Per il sistema archivistico regionale. In Regione del Veneto, editor, Memoria e innovazione. Nuovi strumenti / Nuove esigenze. Atti della Prima Giornata regionale degli Archivi, pages 91-101. Canova Edizioni, Treviso.
19. Ferro, N. and Tanca, L., editors (2012). Proc. 20th Italian Symposium on Advanced Database Systems (SEBD 2012). Edizioni Libreria Progetto, Padova, Italy, ISBN 978-88-96477-23-6.

Publications - 2011

International Journals^

1. Ferro, N., Hanbury, A., Müller, H., and Santucci, G. (2011). Harnessing the Scientific Data Produced by the Experimental Evaluation of Search Engines and Information Access Systems. Procedia Computer Science, 4:740-749.

International Scientific Dissemination Journals^

2. Clough, P., Ferro, N., Forner, P., Gonzalo, J., Huurnink, B., Kekäläinen, J., Lalmas, M., Petras, V., and de Rijke, M. (2011). CLEF 2011 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum, 45(2):32-37.
3. Ferro, N. (2011). DIRECT: the First Prototype of the PROMISE Evaluation Infrastructure for Information Retrieval Experimental Evaluation. ERCIM News, 86:54-55.
4. Ferro, N. (2011). PROMISE: Advancing the Evaluation of Multilingual and Multimedi Information Systems. ERCIM News, 84:49.
5. Ferro, N., Hanbury, A., Müller, H., and Santucci, G. (2011). Harnessing the Scientific Data Produced by the Experimental Evaluation of Search Engines and Information Access Systems. Procedia Computer Science, 4:740-749.

National Journals^

5. Ferro, N. (2011). La rete di eccellenza europea PROMISE. DigItalia, Rivista del digitale nei beni culturali, 6(1):113-122.

International Conferences ^

6. Agosti, M., Ferro, N., and Thanos, C. (2009). DESIRE 2011: First International Workshop on Data infrastructurEs for Supporting Information Retrieval Evaluation. In Ounis, I., Ruthven, I., Berendt, B., de Vries, A. P., and Wenfei, F., editors, Proc. 20th International Conference on Information and Knowledge Management (CIKM 2011), pages 2631-2632. ACM Press, New York, USA.
7. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). Interactive Analysis and Exploration of Experimental Evaluation Results. In Wilson, M. L., Russell-Rose, T., Larsen, B., and Kalbach, J., editors, Proc. 1st European Workshop on Human-Computer Interaction and Information Retrieval (EuroHCIR 2011), pages 11-14.
8. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., Santucci, G., and Tino, G. (2011). To Re-rank or to Re-query: Can Visual Analytics Solve This Dilemma? In Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., and de Rijke, M., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the Second International Conference of the Cross-Language Evaluation Forum (CLEF 2011), pages 119-130. Lecture Notes in Computer Science (LNCS) 6941, Springer, Heidelberg, Germany.
9. Ferro, N., Sabetta, A., Santucci, G., and Tino, G. (2011). Visual Comparison of Ranked Result Cumulated Gains. In Miksch, S. and Santucci, G., editors, Proc. 2nd International Workshop on Visual Analytics (EuroVA 2011), pages 21-24. Eurographics Association, Goslar, Germany.

International Book Chapters ^

10. Agosti, M., Ferro, N., and Silvello, G. (2011). How to Handle Hierarchically Structured Resources Addressing Interoperability Issues in Digital Libraries. In Biba, M. and Xhafa, F., editors, Learning Structure and Schemas from Documents, pages 17-49. Springer-Verlag, Heidelberg, Germany.

National Conferences ^

11. Agosti, M., Ferro, N., Rigon, A., Silvello, G., Terenzoni, E., and Tommasi, C. (2011). SIAR: A User-Centric Digital Archive System. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 87-99. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
12. Crivellari, F., Deambrosis, G., Di Nunzio, G. M., and Ferro, N. (2011). EuropeanaConnect. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 130-131. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
13. Di Buccio, E., Dussin, M., Ferro, N., Masiero, I., and Silvello, G. (2011). PROMISE - Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation. In Agosti, M., Esposito, F., Meghini, C., and Orio, N., editors. Digital Libraries and Archives - Proc. 7th Italian Research Conference (IRCDL 2011), pages 140-143. Communications in Computer and Information Science (CCIS) 249, Springer, Heidelberg, Germany.
14. Ferro, N. and Silvello, G. (2011). The NESTOR Model: Properties and Applications in the Context of Digital Archives. In Mecca, G. and Greco, S., editors, Proc. 19th Italian Symposium on Advanced Database Systems (SEBD 2011), pages 274-285. Università della Basilicata, Italy.

Publications - 2010

International Scientific Dissemination Journals^

1. Agosti, M., Braschler, M., Choukri, K., Ferro, N., Harman, D. K., Peters, C., Pianta, E., de Rijke, M., and Smeaton, A. (2010). CLEF 2010 Conference on Multilingual and Multimodal Information Access Evaluation. SIGIR Forum, 44(2):8-12.
2. Ferro, N. (2010). CLEF 2010: Innovation, Science, Experimentation. ERCIM News, 83:60.

National Journals^

3. Agosti, M. and Ferro, N. (2010). Conferenza CLEF 2010 - Conference on Multilingual and Multimodal Information Access Evaluation. DigItalia, Rivista del digitale nei beni culturali, 5(2) (in print).
4. Agosti, M. and Ferro, N. (2010). Interoperabilità tra sistemi di biblioteche digitali. DigItalia, Rivista del digitale nei beni culturali, 5(1):95-112.

International Conferences^

5. Agosti, M., Di Nunzio, G. M., Dussin, M., and Ferro, N. (2010). 10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go. In Sakay, T., Sanderson, M., and Webber, W., editors, Proc. 3rd International Workshop on Evaluating Information Access (EVIA 2010), pages 16-24. National Institute of Informatics, Tokyo, Japan.
6. Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors (2010). Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010). Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany.
7. Braschler, M., Choukri, K., Ferro, N., Hanbury, A., Karlgren, J., Müller, H., Petras, V., Pianta, E., de Rijke, M., and Santucci, G. (2010). A PROMISE for Experimental Evaluation. In Agosti, M., Ferro, N., Peters, C., de Rijke, M., and Smeaton, A., editors, Multilingual and Multimodal Information Access Evaluation. Proceedings of the International Conference of the Cross-Language Evaluation Forum (CLEF 2010), pages 140-144. Lecture Notes in Computer Science (LNCS) 6360, Springer, Heidelberg, Germany.
8. Ferro, N. (2010). CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum. In Kando, N. and Kishida, K., editors, Proc. 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 2-12. National Institute of Informatics, Tokyo, Japan. Invited talk.
9. Ferro, N. and Harman, D. (2010). CLEF 2009: Grid@CLEF Pilot Track Overview. In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 552-565. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany.
10. Ferro, N. and Peters, C. (2010). CLEF 2009 Ad Hoc Track Overview: TEL & Persian Tasks. In Peters, C., Di Nunzio, G. M., Kurimo, M., Mandl, T., Mostefa, D., Peñas, A., and Roda, G., editors. Multilingual Information Access Evaluation Vol. I Text Retrieval Experiments - Tenth Workshop of the Cross-Language Evaluation Forum (CLEF 2009). Revised Selected Papers, pages 13-35. Lecture Notes in Computer Science (LNCS) 6241, Springer, Heidelberg, Germany.

International Book Chapters ^

11. Ferro, N. (2010). Quality and Interoperability: The Quest for the Optimal Balance. In Iglezakis, I., Kapidakis, S., and Synodinou, T., editors, E-Publishing and Digital Libraries: Legal and Organizational Issues, pages 48-68. IGI Global, USA.

National Conferences ^

12. Agosti, M., Ferro, N., and Silvello, G. (2010). The NESTOR Framework: Manage, Access and Exchange Hierarchical Data Structures. In Martoglia, R., Bergamaschi, S., Lodi, S., and Sartori, C., editors, Proc. 18th Italian Symposium on Advanced Database Systems (SEBD 2010), pages 242-253. Società Editrice Esculapio, Bologna, Italy.
13. Ferro, N. and Silvello, G. (2010). FAST and NESTOR: How to Exploit Annotation Hierarchies. In Agosti, M., Esposito, F., and Thanos, C., editors, Digital Libraries. Proceedings of the Sixth Italian Research Conference (IRCDL 2010), pages 55-66. Springer-Verlag, Heidelberg, Germany.

Publications - 2009

International Journals (online) ^

1. Dussin, M. and Ferro, N. (2009). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1), http://www.ieee-tcdl.org/Bulletin/v5n1/Dussin/dussin1.html.
2. Dussin, M. and Ferro, N. (2009). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large- Scale Evaluation Campaigns. Bulletin of IEEE Technical Committee on Digital Libraries (IEEE-TCDL), 5(1), http://www.ieee-tcdl.org/Bulletin/v5n1/Dussin/dussin2.html.

International Conferences^

3. Agirre, E., Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2009). CLEF 2008: Ad Hoc Track Overview. In Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors, Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross-Language Evaluation Forum (CLEF 2008). Revised Selected Papers, pages 15-37. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany.
4. Agosti, M., Ferro, N., and Silvello, G. (2009). Access and Exchange of Hierarchically Structured Resources on the Web with the NESTOR Framework. In Baeza-Yates, R., Berendt, B., Bertino, E., Lim, E.-P., and Pasi, G., editors, Proc. 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, pages 659-662. IEEE Computer Society, Los Alamitos, CA, USA.
5. Agosti, M., Ferro, N., and Silvello, G. (2009). Enabling Cross-Language Access to Archival Metadata. In Cirinnà, C. and Lunghi, M., editors, International Conference on Cultural Heritage Online - Empowering Users: an Active Role for User Communities, pages 179-183. Fondazione Rinascimento Digitale, Firenze, Italy.
6. Dussin, M. and Ferro, N. (2009). Managing the Knowledge Creation Process of Large-Scale Evaluation Campaigns. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 63-74. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany. Best student paper award.
7. Ferro, N. (2009). Annotation Search: The FAST Way. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 15-26. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany.
8. Ferro, N. and Silvello, G. (2009). The NESTOR Framework: How to Handle Hierarchical Data Structures. In Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., and Tsakonas, G., editors, Proc. 13th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2009), pages 215-226. Lecture Notes in Computer Science (LNCS) 5714, Springer, Heidelberg, Germany.
9. Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G. J. F., Kurimo, M., Mandl, T., and Peñas, A., editors (2009). Evaluating Systems for Multilingual and Multimodal Information Access: Ninth Workshop of the Cross–Language Evaluation Forum (CLEF 2008). Revised Selected Papers. Lecture Notes in Computer Science (LNCS) 5706, Springer, Heidelberg, Germany.

International Book Chapters ^

10. Agosti, M. and Ferro, N. (2009). Towards an Evaluation Infrastructure for DL Performance Evaluation. In Tsakonas, G. and Papatheodorou, C., editors, Evaluation of Digital Libraries: An Insight to Useful Applications and Methods, pages 93-120. Chandos Publishing, Oxford, UK.

National Conferences ^

11. Di Buccio, E., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2009). Design of an Information Retrieval System Based on the Peer-to-Peer Paradigm: An Application to Music Retrieval. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 100-107. DELOS Association and Department of Information Engineering of the University of Padua.
12. Ferro, N. (2009). The FAST Annotation Service. In De Antonellis, V., Castano, S., Catania, B., and Guerrini, G., editors, Proc. 17th Italian Symposium on Advanced Database Systems (SEBD 2009), pages 169-176. Seneca Edizioni, Torino, Italia.
13. Ferro, N. and Peters, C. (2009). CLEF Ad-hoc: A Perspective on the Evolution of the Cross-Language Evaluation Forum. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 72-79. DELOS Association and Department of Information Engineering of the University of Padua.
14. Ferro, N. and Silvello, G. (2009). Design and Development of the Data Model of a Distributed DLS Architecture for Archive Metadata. In Agosti, M., Esposito, F., and Thanos, C., editors. Post-proceedings of the Fifth Italian Research Conference on Digital Library Systems (IRCDL 2009), pages 12-21. DELOS Association and Department of Information Engineering of the University of Padua.

Publications - 2008

International Journals ^

1. Agosti, M. and Ferro, N. (2008). A Formal Model of Annotations of Digital Content. ACM Transactions on Information Systems (TOIS), 26(1):3:1-3:57.

National Journals ^

2. Agosti, M., Bonfiglio-Dosio, G., Ferro, N., and Silvello, G. (2008). Metodologie e percorsi interdisciplinari per la ideazione di un Sistema Informativo Archivistico. Atti e Memorie dell'Accademia Galileana di Scienze Lettere ed Arti in Padova, già Dei Ricoverati e Patavina, CXX:261-287.

International Conferences ^

3. Agosti, M. and Ferro, N. (2008). Annotations: a Way to Interoperability in DL. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 291-295. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
4. Agosti, M., Ferro, N., and Silvello, G. (2008). The Design of a DLS for the Management of Very Large Collections of Archival Objects. In Manghi, P., Pagano, P., and Zezula, P., editors, Proc. 1st Workshop on Very Large Digital Libraries (VLDL 2008). DELOS: an Association for Digital Libraries. Published Online.
5. Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2008). CLEF 2007: Ad Hoc Track Overview. In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, pages 13-32. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany.
6. Dussin, M. and Ferro, N. (2008). DIRECT: Applying the DIKW Hierarchy to Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 424. ACM Press, New York, USA.
7. Dussin, M. and Ferro, N. (2008). The Role of the DIKW Hierarchy in the Design of a Digital Library System for the Scientific Data of Large-Scale Evaluation Campaigns. In Larsen, R., Paepcke, A., Borbinha, J. L., and Naaman, M., editors, Proc. 8th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2008), page 450. ACM Press, New York, USA.
8. Dussin, M. and Ferro, N. (2008). Design of a Digital Library System for Large-Scale Evaluation Campaigns. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 400-401. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
9. Ferro, N. and Peters, C. (2008). From CLEF to TrebleCLEF: the Evolution of the Cross-Language Evaluation Forum. In Kando, N. and Sugimoto, M., editors, Proc. 7th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 577-593. National Institute of Informatics, Tokyo, Japan. Invited talk.
10. Ferro, N. and Silvello, G. (2008). A Methodology for Sharing Archival Descriptive Metadata in a Distributed Environment. In Christensen-Dalsgaard, B., Castelli, D., Lippincott, J. K., and Ammitzbøll Jurik, B., editors, Proc. 12th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2008), pages 268-279. Lecture Notes in Computer Science (LNCS) 5173, Springer, Heidelberg, Germany.
11. Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Larson, R., Sanderson, M., Santos, D., Womser-Hacker, C., and Xie, X. (2008). GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview. In Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D. W., Peñas, A., Petras, V., and Santos, D., editors, Advances in Multilingual and Multimodal Information Retrieval: Eighth Workshop of the Cross-Language Evaluation Forum (CLEF 2007). Revised Selected Papers, 745-772. Lecture Notes in Computer Science (LNCS) 5152, Springer, Heidelberg, Germany.
12. Mandl, T., Gey, F., Di Nunzio, G. M., Ferro, N., Sanderson, M., Santos, D., and Womser-Hacker, C. (2008). An Evaluation Resource For Geographic Information Retrieval. In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008). http://www.lrec-conf.org/proceedings/lrec2008/pdf/8_paper.pdf.
13. Mandl, T., Womser-Hacker, C., Di Nunzio, G. M., and Ferro, N. (2008). How Robust are Multilingual Information Retrieval Systems? In Wainwright, R. L., and Haddad, H. M., editors, Proc. 2008 ACM Symposium on Applied Computing (SAC 2008), pages 1132-1136. ACM Press, New York, USA.
14. Peters, C., Braschler, M., Di Nunzio, G. M., Ferro, N., Gonzalo, J., and Sanderson, M. (2008). From Research to Application in Multilingual Information Access: the Contribution of Evaluation. In European Language Resources Association (ELRA), editor, Proc. 6th International Language Resources and Evaluation Conference (LREC 2008). http://www.lrec-conf.org/proceedings/lrec2008/pdf/913_paper.pdf.
15. Sanderson, M., Braschler, M., Ferro, N., and Gonzalo, J. (2008). Workshop on Novel Methodologies for Evaluation in Information Retrieval. In Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., and White, R. W ., editors, Advances in Information Retrieval. Proc. 30th European Conference on IR Research (ECIR 2008), page 750. Lecture Notes in Computer Science (LNCS) 4956, Springer, Heidelberg, Germany.

International Book Chapters ^

16. Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2008). A Statistical and Graphical Methodology for Comparing Bilingual to Monolingual Cross-Language Information Retrieval. In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 171-188. Springer-Verlag, Heidelberg, Germany.
17. Ferro, N. (2008). Digital Annotations: a Formal Model and its Applications. In Agosti, M., editor, Information Access through Search Engines and Digital Libraries, pages 113-146. Springer-Verlag, Heidelberg, Germany.

National Conferences ^

18. Agosti, M. and Ferro, N. (2008). Adding Advanced Annotation Functionalities to an Existing Digital Library. In D'Atri, A., De Marco, M., and Casalino, N., editors, Interdisciplinary Aspects of Information Systems Studies, pages 279-286. Physica-Verlag, Heidelberg, Germany.
19. Di Buccio, E., Ferro, N., and Melucci, M. (2008). Towards a Superimposed Peer Infrastructure for iNformation Access. In Gaglio, S., Infantino, I., and Saccà, D., editors, Proc. 16th Italian Symposium on Advanced Database Systems (SEBD 2008), pages 398-405. Fotograf, Palermo, Italy.
20. Di Buccio, E., Ferro, N., and Melucci, M. (2008). Content-based Information Retrieval in SPINA. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 89-92. ISTI-CNR at Gruppo ALI, Pisa, Italy.
21. Dussin, M. and Ferro, N. (2008). The Design of the User Interface of a Scientific DLS in the context of the Data, Information, Knowledge and Wisdom Hierarchy. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 105-113. ISTI-CNR at Gruppo ALI, Pisa, Italy.
22. Ferro, N. and Harman, D. (2008). Dealing with MultiLingual Information Access: Grid Experiments at TrebleCLEF. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 29-32. ISTI-CNR at Gruppo ALI, Pisa, Italy.
23. Ferro, N. and Silvello, G. (2008). A Distributed Digital Library System Architecture for Archive Metadata. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Fourth Italian Research Conference on Digital Library Systems (IRCDL 2008), pages 99-104. ISTI-CNR at Gruppo ALI, Pisa, Italy.

Publications - 2007

International Journals ^

1. Agosti, M., Bonfiglio-Dosio, G., and Ferro, N. (2007). A Historical and Contemporary Study on Annotations to Derive Key Features for Systems Design. International Journal on Digital Libraries, 8(1):1-19.

National Journals ^

2. Agosti, M., Ferro, N., and Silvello, G. (2007). Proposta metodologica e architetturale per la gestione distribuita e condivisa di collezioni di documenti digitali. Archivi, 2(2):49-73.

International Conferences^

3. Agosti, M., Berretti, S., Brettlecker, G., del Bimbo, A., Ferro, N., Fuhr, N., Keim, D., Klas, C.-P., Lidy, T., Milano, D., Norrie, M., Ranaldi, P., Rauber, A., Schek, H.-J., Schreck, T., Schuldt, H., Signer, B., and Springmann, M. (2007). DelosDLMS - the Integrated DELOS Digital Library Management System. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 36-45. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
4. Agosti, M., Braschler, M., Ferro, N., Peters, C., and Siebinga, S. (2007). Roadmap for MultiLingual Information Access in The European Library. In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 136-147. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany.
5. Agosti, M., Coppotelli, T., Di Nunzio, G. M., Ferro, N., and van der Meulen, E. (2007). A Study of Web Logs for Personalizing the MultiLingual Information Access to The European Library. In Christodoulakis, S., editor, Workshop on Cross-Media and Personalized Learning Applications on top of Digital Libraries (LADL 2007), pages 19-28.
6. Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007). Annotations and Digital Libraries: Designing Adequate Test-beds. In Goh, D. H. L., Cao, T. H., Sølvberg, I., and Rasmussen, E., editors, Proc. 10th International Conference on Asian Digital Libraries. Digital Libraries - Asian Digital libraries: Looking Back 10 Years and Forging New Frontiers (ICADL 2007), pages 150-159. Lecture Notes in Computer Science (LNCS) 4822, Springer, Heidelberg, Germany.
7. Agosti, M., Coppotelli, T., Ferro, N., and Pretto, L. (2007). An Approach for the Construction of an Experimental Test Collectionto Evaluate Search Systems that Exploit Annotations. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 167-176. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
8. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 11-20. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
9. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). The Importance of Scientific Data Curation for Evaluation Campaigns. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 157-166. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
10. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2007). A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns. In Sakay, T. and Sanderson, M., and Evans, D. K., editors, Proc. 1st International Workshop on Evaluating Information Access (EVIA 2007), pages 62-73. National Institute of Informatics, Tokyo, Japan.
11. Agosti, M., Di Nunzio, G. M., Ferro, N., Harman, D., and Peters, C. (2007). The Future of Large-scale Evaluation Campaigns for Information Retrieval in Europe. In Fuhr, N., Kovacs, L., and Meghini, C., editors, Proc. 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), pages 509-512. Lecture Notes in Computer Science (LNCS) 4675, Springer, Heidelberg, Germany.
12. Agosti, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2007). CLEF: Ongoing Activities and Plans for the Future. In Kando, N. and Evans, D. K., editors, Proc. 6th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pages 493-504. National Institute of Informatics, Tokyo, Japan. Invited talk.
13. Agosti, M., Ferro, N., Fox, E. A., Gonçalves, M. A., and Lagoeiro, B. (2007). Towards a Reference Quality Model for Digital Libraries. In Castelli, D. and Fox, E. A., editors, Pre-proceedings of the First International Workshop on Foundations of Digital Libraries, pages 37-42.
14. Agosti, M., Ferro, N., and Orio, N. (2007). Design and Development of a Digital Archive of Illuminated Manuscripts. In del Bimbo, A., Cucchiara, R., and Boujemaa, N., editors, Proc. International Workshop on Visual and Multimedia Digital Libraries (WMDL 2007), pages 113-118. IEEE Computer Society, Los Alamitos, CA, USA.
15. Agosti, M., Ferro, N., and Silvello, G. (2007). An Architecture to Share Metadata among Geographically Distributed Archives. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 56-65. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
16. Braschler, M. and Ferro, N. (2007). Adding MultiLingual Information Access to The European Library TEL. In Thanos, C., Borri, F., and Candela, L., editors, Digital Libraries: Research and Development. First International DELOS Conference. Revised Selected Papers, pages 218-227. Lecture Notes in Computer Science (LNCS) 4877, Springer, Heidelberg, Germany.
17. Crivellari, F., Di Nunzio, G. M., and Ferro, N. (2007). How to Compare Bilingual to Monolingual Cross-Language Information Retrieval. In Amati, G., Carpineto, C., and Romano, G., editors, Advances in Information Retrieval. Proc. 29th European Conference on IR Research (ECIR 2007), pages 533-540. Lecture Notes in Computer Science (LNCS) 4425, Springer, Heidelberg, Germany.
18. Di Nunzio, G. M., Ferro, N., Mandl, T., and Peters, C. (2007). CLEF 2006: Ad Hoc Track Overview. In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers , pages 21-34. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.
19. Gey, F., Larson, R., Sanderson, M., Bischoff, K., Mandl, T., Womser-Hacker, K., Santos, D., Rocha, P., Di Nunzio, G. M., and Ferro, N. (2007). GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview. In Peters, C., Clough, P., Gey, F. C., Karlgren, J., Magnini, B., Oard, D. W., de Rijke, M., and Stempfhuber, M., editors, Evaluation of Multilingual and Multi-modal Information Retrieval: Seventh Workshop of the Cross-Language Evaluation Forum (CLEF 2006). Revised Selected Papers, pages 852-876. Lecture Notes in Computer Science (LNCS) 4730, Springer, Heidelberg, Germany.

Monographs ^

20. Candela, L., Castelli, D., Ferro, N., Koutrika, G., Meghini, C., Pagano, P., Ross, S., Soergel, D., Agosti, M., Dobreva, M., Katifori, V., and Schuldt, H. (2007). The DELOS Digital Library Reference Model. Foundations for Digital Libraries. ISTI-CNR at Gruppo ALI, Pisa, Italy. http://www.delos.info/files/pdf/ReferenceModel/DELOS_DLReferenceModel_0.98.pdf.

National Conferences ^

21. Agosti, M., Brettlecker, G., Ferro, N., Ranaldi, P., and Schuldt, H. (2007). Extending the DelosDLMS by the FAST Annotation Service. In In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 7-12. ISTI-CNR at Gruppo ALI, Pisa, Italy.
22. Agosti, M., Coppotelli, T., and Ferro, N. (2007). Construction of an Annotation Test Collection for Search Evaluation on Digital Libraries. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 15-17. ISTI-CNR at Gruppo ALI, Pisa, Italy.
23. Agosti, M., Di Buccio, E., Di Nunzio, G. M., Ferro, N., Melucci, M., Miotto, R., and Orio, N. (2007). Distributed Information Retrieval and Automatic Identification of Music Works in SAPIR. In Ceci, M., Malerba, D., and Tanca, L., editors, Proc. 15th Italian Symposium on Advanced Database Systems (SEBD 2007), pages 479-482. Sagraf srl, Z.I. Capurso, Bari, Italia.
24. Agosti, M., Ferro, N., and Orio, N. (2007). Annotations as a Tool for Disclosing Hidden Relationships between Illuminated Manuscripts. In Basili, R. and Pazienza, M. T., editors, Proc. 10th Congress of the Italian Association for Artificial Intelligence. Artificial Intelligence and Human-Oriented Computing (AI*IA 2007), pages 662-673. Lecture Notes in Computer Science (LNCS) 4733, Springer, Heidelberg, Germany.
25. Dussin, M. and Ferro, N. (2007). An Effective User Interface for a Scientific DLS to Support Information Retrieval Evaluation. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 18-21. ISTI-CNR at Gruppo ALI, Pisa, Italy.
26. Ferro, N., Marcante, A., Martin, A., and Panizzi, E. (2007). Annotations: What We Learned from DELOS. In Agosti, M., Esposito, F., and Thanos, C., editors, Post-proceedings of the Third Italian Research Conference on Digital Library Systems (IRCDL 2007), pages 13-14. ISTI-CNR at Gruppo ALI, Pisa, Italy.

Teaching Monographs ^

27. Agosti, M. and Ferro, N. (2007). Elementi di Basi di Dati, 2 edizione. Edizioni Libreria Progetto, Padova, Italia.

Publications - 2006

International Conferences ^

1. Agosti, M., Di Nunzio, G. M., and Ferro, N. (2006). A Data Curation Approach to Support In-depth Evaluation Studies. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 65-68.>/li>
2. Agosti, M. and Ferro, N. (2006). Search Strategies for Finding Annotations and Annotated Documents: the FAST Service. In Legind Larsen, H., Pasi, G., Ortiz-Arroyo, D., Andreasen, T., and Christiansen, H., editors, Proc. 7th International Conference on Flexible Query Answering Systems (FQAS 2006), pages 270-281. Lecture Notes in Artificial Intelligence (LNAI) 4027, Springer, Heidelberg, Germany.
3. Agosti, M., Ferro, N., Frommholz, I., Panizzi, E., Putz, W., and Thiel, U. (2006). Integration of the DiLAS Annotation Service into Digital Library Infrastructures. In Blandford, A. and Gow, J., editors, Proc. 1st International Workshop on Digital Libraries in the Context of Usersí Broader Activities (DL-CUBA 2006), pages 1-4. http://www.uclic.ucl.ac.uk/events/dl-cuba2006/.
4. Agosti, M., Ferro, N., and Orio, N. (2006). Graph-based Automatic Suggestion of Relationships among Images of Illuminated Manuscripts. In Haddad, H. M., Liebrock, K. M., Chbeir, R., Palakal, M. J., Ossowski, S., Yetongnoon, K., Wainwright, R. L., and Nicolle, C., editors, Proc. 21st ACM Symposium on Applied Computing (SAC 2006), pages 1063-1067. ACM Press, New York, USA.
5. Agosti, M., Ferro, N., Panizzi, E., and Trinchese, R. (2006). Annotation as a Support to User Interaction for Content Enhancement in Digital Libraries. In Celentano, A. and Mussio, P., editors, Proc. Working Conference on Advanced Visual Interfaces (AVI 2006), pages 151-154. ACM Press, New York, USA.
6. Braschler, M., Ferro, N., and Verleyen, J. (2006). Implementing MLIA in an existing DL system. In Gey, F. C., Kando, N., Peters, C., and Lin, C.-Y., editors, Proc. International Workshop on New Directions in Multilingual Information Access (MLIA 2006), pages 73-76.
7. Di Nunzio, G. M. and Ferro, N. (2006). Scientific Evaluation of a DLMS: a service for evaluating information access components. In Gonzalo, J., Thanos, C., Verdejo, M. F., and Carrasco, R. C., editors, Proc. 10th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2006), pages 536-539. Lecture Notes in Computer Science (LNCS) 4172, Springer, Heidelberg, Germany.
8. Di Nunzio, G. M. and Ferro, N. (2006). Queries and Relevance Assessments: The Right Context for the Right Topic. In Joho, H., Urban, J., Villa, R., Jose, J. M., and van Rijsbergen, C. J., editors, First International Workshop on Adaptive Information Retrieval (AIR 2006), pages 26-27. http://www.dcs.gla.ac.uk/workshops/air/air2006_program.pdf.
9. Di Nunzio, G. M., Ferro, N., Jones, G. J. F., and Peters, C. (2006). CLEF 2005: Ad Hoc Track Overview. In Peters, C., Gey, F. C., Gonzalo, J., Jones, G. J. F., Kluck, M., Magnini, B., Müller, H., and de Rijke, M., editors, Accessing Multilingual Information Repositories: Sixth Workshop of the Cross-Language Evaluation Forum (CLEF 2005). Revised Selected Papers, pages 11-36. Lecture Notes in Computer Science (LNCS) 4022, Springer, Heidelberg, Germany.

National Conferences ^

10. Di Nunzio, G. M. and Ferro, N. (2006). Uniform Methodology for Evaluating Information Access Components of Digital Libraries. In Agosti, M. and Thanos, C., editors, Proc. 2nd Italian Research Conference on Digital Library Management Systems (IRCDL 2006), pages 25-28. ISTI-CNR at Gruppo ALI, Pisa, Italy.

Publications - 2005

International Journals ^

1. Bacchin, M., Ferro, N., and Melucci, M. (2005). A Probabilistic Model for Stemmer Generation. Information Processing & Management, 41(1):121-137.

International Conferences ^

2. Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Orio, N., Panizzi, E., Pejtersen, A. M., and Thiel, U. (2005). DiLAS: a Digital Library Annotation Service. In Boujut, J.-F., editor, Proc. International Workshop on Annotation for Collaboration - Methods, Tools, and Practices (IWAC 2005), pages 91-101. CNRS - Programme société de l'information.
3. Agosti, M. and Ferro, N. (2005). A System Architecture as a Support to a Flexible Annotation Service. In Türker, C., Agosti, M., and Schek, H.-J., editors, Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures: 6th Thematic Workshop of the EU Network of Excellence DELOS. Revised Selected Papers, pages 147-166. Lecture Notes in Computer Science (LNCS) 3664, Springer, Heidelberg, Germany.
4. Agosti, M. and Ferro, N. (2005). Annotations as Context for Searching Documents. In Crestani, F. and Ruthven, I., editors, Proc. 5th International Conference on Conceptions of Library and Information Science - Context: nature, impact and role (Colis 5), pages 155-170. Lecture Notes in Computer Science (LNCS) 3507, Springer, Heidelberg, Germany. Best Student Paper Award.
5. Agosti, M., Ferro, N., and Orio, N. (2005). Annotating Illuminated Manuscripts: an Effective Tool for Research and Education. In Marlino, M., Sumner, T., and Shipman, F., editors, Proc. 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), pages 121-130. ACM Press, New York, USA.
6. Agosti, M., Ferro, N., and Orio, N. (2005). Annotations as a Support to Research Users. In Catarci, T., Christodoulakis, S., and Del Bimbo, A., editors, Proc. 7th International Workshop of the EU Network of Excellence DELOS on Audio-Visual Content and Information Visualization in Digital Libraries (AVIVDiLib'05), pages 117-120. Centromedia, Viareggio, Italy.
7. Braschler, M., Di Nunzio, G. M., Ferro, N., and Peters, C. (2005). CLEF 2004: Ad Hoc Track Overview and Results Analysis. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 10-26. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.
8. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a System for Evaluating Information Access Components of Digital Libraries. In Rauber, A., Christodoulakis, S., and Min Tjoa, A., editors, Proc. 9th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2005), pages 483-484. Lecture Notes in Computer Science (LNCS) 3652, Springer, Heidelberg, Germany.
9. Di Nunzio, G. M. and Ferro, N. (2005). DIRECT: a Distributed Tool for Information Retrieval Evaluation Campaigns. In Ioannidis, Y., Schek, H.-J., and Weikum, G., editors, Proc. 8th DELOS Thematic Workshop on Future Digital Library Management Systems: System Architecture and Information Access, pages 58-63. http://dbis.cs.unibas.ch/delos_website/delos-dagstuhl-handout-all.pdf.
10. Di Nunzio, G. M., Ferro, N., and Orio, N. (2005). Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources. In Peters, C., Clough, P., Gonzalo, J., Jones, G. J. F., Kluck, M., and Magnini, B., editors, Multilingual Information Access for Text, Speech and Images: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004) Revised Selected Papers, pages 60-72. Lecture Notes in Computer Science (LNCS) 3491, Springer, Heidelberg, Germany.

National Conferences ^

10. Ferro, N. (2005). Design Choices for a Flexible Annotation Service. In Agosti, M. and Thanos, C., editors, Post-proceedings of the First Italian Research Conference on Digital Library Management Systems (IRCDL 2005), pages 101-110. ISTI-CNR at Gruppo ALI, Pisa, Italy.

Publications - 2004

International Conferences ^

1. Agosti, M. and Ferro, N. (2004). An Information Service Architecture for Annotations. In Agosti, M., Schek, H.-J., and Türker, C., editors, Digital Library Architectures: Peer-to-Peer, Grid, and Service-Orientation, Pre-proceedings of the 6th Thematic Workshop of the EU Network of Excellence DELOS, pages 115-126. Edizioni Libreria Progetto, Padova, Italy.
2. Agosti, M., Ferro, N., Frommholz, I., and Thiel, U. (2004). Annotations in Digital Libraries and Collaboratories - Facets, Models and Usage. In Heery, R. and Lyon, L., editors, Proc. 8th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2004), pages 244-255. Lecture Notes in Computer Science (LNCS) 3232, Springer, Heidelberg, Germany.
3. Di Nunzio, G. M., Ferro, N., Melucci, M., and Orio, N. (2004). Experiments to Evaluate Probabilistic Models for Automatic Stemmer Generation and Query Word Translation. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Comparative Evaluation of Multilingual Information Access Systems: Fourth Workshop of the Cross-Language Evaluation Forum (CLEF 2003) Revised Selected Papers, pages 220-235. Lecture Notes in Computer Science (LNCS) 3237, Springer, Heidelberg, Germany.

Monographs ^

4. Ferro, N. (2004). Formal Model and Conceptual Architecture of the Annotation Service for Dynamic Ubiquitous Knowledge Environments. PhD thesis, Department of Information Engineering. University of Padua, Italy.

National Conferences ^

5. Bacchin, M., Ferro, N., and Melucci, M. (2004). A Probabilistic Model for Stemmer Generation. In Agosti, M., Dessì, N., and Schreiber, F. A., editors, Proc. 12th Italian Symposium on Advanced Database Systems (SEBD 2004), pages 230-237. LITHOSgrafiche, Cagliari, Italy.

Publications - 2003

International Conferences ^

1. Agosti, M., Bacchin, M., Ferro, N., and Melucci, M. (2003). Improving the Automatic Retrieval of Text Documents. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M., editors, Advances in Cross-Language Information Retrieval: Third Workshop of the Cross-Language Evaluation Forum (CLEF 2002) Revised Papers, pages 279-290. Lecture Notes in Computer Science (LNCS) 2785, Springer, Heidelberg, Germany.
2. Agosti, M. and Ferro, N. (2003). Annotations: Enriching a Digital Library. In Koch, T. and Sølvberg, I. T., editors, Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pages 88-100. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany.

International Book Chapters ^

3. Agosti, M. and Ferro, N. (2003). Chapter X: Managing the Interactions between Handheld Devices, Mobile Applications, and Users. In Lim, E. P. and Siau, K., editors, Advances in Mobile Commerce Technologies, pages 204-233. Idea Group, Hershey, USA.

Teaching Monographs ^

4. Agosti, M. and Ferro, N. (2003). Elementi di Basi di Dati. Edizioni Libreria Progetto, Padova, Italia.

Publications - 2002

International Conferences^

1. Bacchin, M., Ferro, N., and Melucci, M. (2002). The Effectiveness of a Graph-based Algorithm for Stemming. In Lim, E. P., Foo, S., Khoo, C. S. G., Chen, H., Fox, E. A., Urs, S. R., and Thanos, C., editors, Proc. 5th International Conference on Asian Digital Libraries. Digital Libraries: People, Knowledge, and Technology (ICADL 2002), pages 117-128. Lecture Notes in Computer Science (LNCS) 2555, Springer, Heidelberg, Germany.