1st International Workhop on Benchmarking RDF Systems (BeRSys 2013) co-located with ESWC 2013


Sunday, May 26, 2013 (All day)
The BeRSys 2013 workshop will provide a forum where topics related to the evaluation (included, but not limited to, 
expressive power, usability and performance) of RDF data management platforms can be discussed and elaborated. 
The BeRSys 2013 workshop will be the first workshop dedicated to benchmarking of different aspects of RDF engines. 
The objectives of this new workshop are to:
  • create a discussion forum where researchers and industrials can meet and discuss topics related to the performance of RDF systems
  • expose and initiate discussions on best practices, different application needs and scenarios related to RDF data management


The BerSys workshop is co-sponsored by the Linked Data Benchmark Council (LDBC), a new EU FP7 project that aims to establish industry consensus on graph and RDF database benchmarks, benchmark practices and benchmark results. LDBC will also sponsor the BerSys workshop, providing it financial security. The sponsorship will be used to cover costs of the meeting, but also facilitate some travel grants for students attending the workshop.

Topics Of Interest

We will solicit contributions presenting experiences with benchmarking RDF systems as well as technical contributions regarding the development of benchmarks for different aspects of RDF data management ranging from query processing and reasoning to data integration and ETL techniques. We welcome contributions from a diverse set of domain areas such as life science (bioinformatics, pharmaceutical domain), social networks, cultural informatics news, digital forensics among others.
More specifically, the topics of interest include but are not limited to:

  • descriptions of RDF data management use cases and query workloads
  • benchmarks for RDF SPARQL 1.0 and SPARQL 1.1 query workloads
  • benchmarks RDF data integration tasks including but not limited to ontology aligment, instance matching and ETL techniques
  • benchmark metrics
  • temporal and geospatial benchmarks
  • evaluation of benchmark performance results on RDF engines
  • benchmark principles
  • query processing and optimization algorithms for RDF systems.

Important Dates

  • Submission Deadline: March 21, 2013
  • Notification of Acceptance: April 7, 2013
  • Camera Ready Copy: April 30, 2013
  • Workshop Day: May 26, 2013

Paper Submission Instructions

Authors are invited to submit original, unpublished research papers that are not being considered for publication in any other forum. Manuscripts should be submitted electronically as PDF files and be formatted using the LNCS style. Papers cannot exceed six pages in length. Nevertheless, authors are allowed to include extra material beyond the six pages as a clearly marked appendix, which reviewers are not obliged to read but could read if they feel it is useful.

Accepted papers will be included in the workshop proceedings to be distributed at the workshop, and will be available on the workshop's Web site.

BerSys'2013 will use the EasyChair system for the paper review and production process. All the papers should be submitted in electronic format (pdf version) using the following link: https://www.easychair.org/conferences/?conf=bersys2013

A URL will be posted here a few weeks before the submission deadline.

Accespter Papers

1. Towards a SPARQL 1.1 Feature Benchmark on Real-World Social. Martin Przyjaciel-Zablocki, Alexander Schätzle, Thomas Hornung and Io Taxidou

2. ParlBench: a SPARQL-benchmark for electronic publishing applications. Tatiana Tarasova and Maarten Marx

3. On the need to include functional testing in RDF stream engine benchmarks. Daniele Dell'Aglio, Marco Balduini and Emanuele Della Valle.

Workshop Program

Joint Program of
1st International Workshop on Benchmarking RDF Systems
3rd International Workshop on Usage Analysis and the Web of Data & USEWOD Data Challenge

Sunday, May 26th 2013, Full Day Program

09:30-10:30 Session 1
09:30-09:40   Introduction - Ioan Toma & Laura Hollink
09:40-10:30   Keynote BeRSys: "Benchmarking Geospatial RDF Stores" - Prof. Manolis Koubarakis

10:30-11:00 Coffee break

11:00-12:30 Session 2
11:00-11:30 "Towards a SPARQL 1.1 Feature Benchmark on Real-World Social Network Data" - Martin Przyjaciel-Zablocki, Alexander Schätzle, Thomas Hornung, Io Taxidou
11:30-12:00 "ParlBench: a SPARQL-benchmark for electronic publishing applications" - Tatiana Tarasova, Maarten Marx
12:00-12:30 "Caching and Prefetching Strategies for SPARQL Queries" - Johannes Lorey, Felix Naumann

12:30-14:00 Lunch

14:00-15:30 Session 3
14:00-14:50 Keynote USEWOD: "DBpedia SPARQL Benchmark - Performance Assessment with Real Queries on Real Data" - Dr. Axel-C. Ngonga Ngomo
14:50-15:20 "On the need to include functional testing in RDF stream engine benchmarks" - Daniele Dell'Aglio, Marco Balduini, Emanuele Della Valle
15:20-15:30 Wrap-up



Those who are interested in attending the workshop should register through the main conference.

Program Committee

  • Barry Bishop, Ontotext (Bulgaria)
  • Paul Groth, VUA (The Netherlands)
  • Andreas Harth, KIT (Germany)
  • Ulf Leser, Humboldt-Universitaet zu Berlin (Germany)
  • Grigoris Karvounarakis, LogicBox (USA)
  • Tasos Kementsietsidis, IBM-Watson (USA)
  • Manolis Koubarakis, University of Athens (Greece)
  • Thomas Neumann, TU Munich (Germany)
  • Emmanuel Pietriga, INRIA & INRIA Chile

Organizing Committee

  • Irini Fundulaki, FORTH, Greece
    email: fundul at ics dot forth dot gr
  • Ioana Manolescu, Inria Saclay, France
    email:ioana dot manolescu at inria dot fr
  • Ioan Toma, STI2, Austria
    email: ioan dot toma at sti2 dot at