Call for Evaluations and Experiments

The Semantic Web (and Linked Data) has been an active area of research for several years. This 11th edition of the International Semantic Web conference introduces the Evaluations and Experiments Track. Its goal is to consolidate research material and to gain new scientific insights and results by providing a place for in-depth experimental studies of significant scale. It aims at promoting experimental evaluations in Semantic Web/Linked Data research trying to create a research cycle between theory and experiments as in other sciences (e.g., physics). Papers in this track can fit in different categories:

• Experimental studies comparing a spectrum of approaches to a particular problem and, through extensive experiments, providing a comprehensive perspective on the underlying phenomena or approaches.
• Analyses of experimental results providing insights on the nature or characteristics of studied phenomena, including negative results.
• Result verification focusing on verifying or refuting published results and, through the renewed analysis, help to advance the state of the art.
• Benchmarking, focusing on datasets and algorithms for comprehensible and systematic evaluation of existing and future systems.

Availability of experimental datasets is highly important (if not compulsory).

In addition, these papers will be more specifically judged on the basis of their:

• Precise description of control experimental conditions
• Reproducibility
• Applicability range (broad coverage results being better than narrow applicability).

Special attention will be paid to reproducibility. Hence, experimental settings will have to be extensively described so that the results could be independently reproduced and counter-experiments could be designed.

The experimental approach is based on systematic scientific methods used in many disciplines. http://www.experiment-resources.com/ provides a good collection of methods, experiment design strategies, and resources.

Topics of Interests

For a list of topic of interests please visit the Call for Research Papers http://iswc2012.semanticweb.org/call-research-papers

Submission

Pre-submission of abstracts is a strict requirement. All papers and abstracts have to be submitted electronically via the Conference Submission System http://www.easychair.org/conferences/?conf=iswc2012et.

All research submissions must be in English, and no longer than 12 pages. Papers that exceed this limit will be rejected without review. Submissions must be in PDF formatted in the style of the Springer Publications format for Lecture Notes in Computer Science (LNCS). For details
on the LNCS style, see Springer’s Author Instructions. ISWC-2012 submissions are not anonymous.

Accepted papers will be distributed to conference attendees and also published by Springer in the printed conference proceedings, as part of the Lecture Notes in Computer Science series. At least one author of each accepted paper must register for the conference and present the paper there.

Important Dates

No extensions of the submission deadline will be granted.

Research Track Chairs

Manfred Hauswirth, DERI - National University of Galway, Ireland
Jérôme Euzenat, INRIA & LIG, France
Josiane Xavier Parreira, DERI - National University of Galway, Ireland