Hobbit so far. Hobbit is now one year old! | News

Press Releases


Hobbit so far. Hobbit is now one year old!

HOBBIT during its first year was very active in several areas: members of the consortium attended a number of academic and industry-related events and conferences and published a number of posts on several topics related to benchmarking. Furthermore, members of the HOBBIT community were asked to complete a Survey that allowed HOBBIT partners to clarify the requirements for the HOBBIT benchmarks and platform. Our next immediate steps include the release of the first version of the HOBBIT platform and the establishment of the HOBBIT association.

Attendance to conferences and events

HOBBIT has attended several academic and industry driven conferences and events. We are proud to inform you that HOBBIT was present at the following academic events:

HOBBIT was present  at the following industry-driven events:

  • The  post EDF 2106 event (July 1, Eindhoven, Netherlands), that was co-organized by  HOBBIT, BigDataEurope and BYTE projects. Axel Ngonga Ngomo (InfAI) gave a presentation of HOBBIT and with Irini Fundulaki (FORTH) and Frank Salliau (iMinds) discussed with the attendees their requirements regarding the benchmarks for Linked Data.
  • Finally, HOBBIT was present at the ApacheCon Europe (November 15-18, Sevilla, Spain), where  Axel Nonga Ngomo (InfAI) presented the project.


During the same period, several interesting posts were also published at the HOBBIT website (project-hobbit.eu/) including a post on HOBBIT’s initial data management plan, a mini survey on benchmarking RDF Query Engines, the approaches and benchmarks on versioning for Big Linked Data, HOBBIT’s potential for enabling the business value of IoT, the industrial perspecitves of HOBBIT and IT Management,  a post on linking benchmark for spatial data, and finally a post on HOBBIT’s future. Furthermore several posts were published to present the HOBBIT’s participation in the conferences presented previously.


We developed a survey that was distributed to the HOBBIT community with the purpose of gathering the requirements for the HOBBIT platform and benchmarks. The aim of this fully anonymized survey was for the HOBBIT consortium to determine how a participant’s’ company or organization could benefit from the HOBBIT platform. The survey participants were evenly divided among the different profiles, namely solution providers, technology users and scientific community (with most of them having two or more of these profiles).  The survey supported our belief that HOBBIT platform will prove itself very useful for both the academia and industry since it will provide useful tools to the people involved. 

More specifically 61 people (representing their organization) participated in the survey: 48 solution providers, 46 technology users and finally 47 people from the scientific community (note that participants may be associated with multiple profiles). From the results of the survey we note that Solution Providers are very interested in Storage and Querying solutions, equally but less interested in Interlinking, Classification/Enrichment and Discovery tools. Technology Users are mostly interested in Storage/Querying, followed by Classification/Enrichment and then Interlinking and members of the Scientific Community are very interested in Storage/Querying, followed by Classification/Enrichment and Discovery followed by Interlinking, Extraction, and Reasoning.

Participants were also asked the Key Performance Indicators (KPIs) of interest. Most prominent are Correctness, Accuracy followed by Runtime / Speed. Scalability, Memory and CPU usage are also important KPIs for the Survey participants.

Moving forward

Next steps

HOBBIT’s next big step will be the release of the first version of the HOBBIT platform by February 2017. In addition, we are organizing the first HOBBIT evaluation campaigns that will take place in 2017: the DEBS Grand Challenge (Holistic Benchmarking of Big Linked Data),the Instance Matching Benchmark Challenge for Spatial Data at the OAEI workshop of ISWC, and the Mighty Storage Challenge that will be held in conjunction with ESWC 2017 More details can be found at the project’s website https://project-hobbit.eu/challenges/.

Furthermore, an alpha version of the HOBBIT Data Generators is ready: currently we can generate Twitter, molding machine data as well as transportation data using those generators.

HOBBIT association

Finally, we are planning to establish the HOBBIT association by December 2017. We believe that it will play a key role in disseminating and extending the HOBBIT benchmarking platform (including benchmarks, the KPIs, use cases and datasets). Towards this direction, we will initiate a new survey to gather information from the industry and other potential partners on frameworks used to evaluate their software.  The goal of the HOBBIT association will be to provide industry-grade benchmarks for Big Linked Data. The HOBBIT association intends to offer various types of membership depending on companies’ specific needs,  will work, hand in hand with other European benchmarking associations such as LDBC,  provide periodic open reports comparing system performances for each of the Big Linked Data  steps and  financed via member fees, donations and the implementation of dedicated benchmarks for companies. These financial resources will be used to maintain the platform and organize further challenges for Big Linked Data  even after the completion of the HOBBIT project.

Join our community to remain informed at project-hobbit.eu/get-involved. If you have any questions, do not hesitate to contact us as explained at project-hobbit.eu/contacts.