Common use of Test Collection Clause in Contracts

Test Collection. In our experiments, we used the DBpedia-Entity V2 test collection [12]. The col- lection consists of 467 queries and relevance assessments for 49280 query-entity pairs, where the entities are drawn from the DBpedia 2015-10 dump. The rele- xxxxx assessments are graded values of 2, 1, and 0 for highly relevant, relevant, and not relevant entities, respectively. The queries are categorized into 4 differ- ent groups: SemSearch ES consisting of short and ambiguous keyword queries (e.g.,“Nokia E73”), INEX-LD containing IR-Style keyword queries (e.g., “gui- tar chord minor”), ListSearch consisting of queries seeking for a list of entities (e.g., “States that border Oklahoma”), and QALD-2 containing entity-bearing natural language queries (e.g., “Which country does the creator of Xxxxx come from”). Following the baseline runs curated with the DBpedia-Entity V2 collec- tion, we used the stopped version of queries, where stop patterns like “which” and “who” are removed from the queries.

Test Collection. In our experiments, we used the DBpedia-Entity V2 test collection [12]. The col- lection consists of 467 queries and relevance assessments for 49280 query-entity pairs, where the entities are drawn from the DBpedia 2015-10 dump. The rele- xxxxx assessments are graded values of 2, 1, and 0 for highly relevant, relevant, and not relevant entities, respectively. The queries are categorized into 4 differ- differ- ent groups: SemSearch ES consisting of short and ambiguous keyword queries (e.g.,“Nokia E73”), INEX-LD containing IR-Style keyword queries (e.g., “gui- tar chord minor”), ListSearch consisting of queries seeking for a list of entities (e.g., “States that border Oklahoma”), and QALD-2 containing entity-bearing natural language queries (e.g., “Which country does the creator of Xxxxx Miffy come from”). Following the baseline runs curated with the DBpedia-Entity V2 collec- tion, we used the stopped version of queries, where stop patterns like “which” and “who” are removed from the queries.