Efficient semantic-aware detection of near duplicate resources

Ekaterini Ioannou; Odysseas Papapetrou; Dimitrios Skoutas; Wolfgang Nejdl

doi:10.1007/978-3-642-13489-0_10

Efficient semantic-aware detection of near duplicate resources

Ekaterini Ioannou
, Odysseas Papapetrou
, Dimitrios Skoutas
, Wolfgang Nejdl

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Abstract

Efficiently detecting near duplicate resources is an important task when integrating information from various sources and applications. Once detected, near duplicate resources can be grouped together, merged, or removed, in order to avoid repetition and redundancy, and to increase the diversity in the information provided to the user. In this paper, we introduce an approach for efficient semantic-aware near duplicate detection, by combining an indexing scheme for similarity search with the RDF representations of the resources. We provide a probabilistic analysis for the correctness of the suggested approach, which allows applications to configure it for satisfying their specific quality requirements. Our experimental evaluation on the RDF descriptions of real-world news articles from various news agencies demonstrates the efficiency and effectiveness of our approach.

Original language	English
Title of host publication	The Semantic Web: Research and Applications
Subtitle of host publication	7th Extended Semantic Web Conference 2010, Proceedings part II
Place of Publication	Berlin
Publisher	Springer
Pages	136-150
Number of pages	15
ISBN (Print)	978-3-642-13488-3
DOIs	https://doi.org/10.1007/978-3-642-13489-0_10
Publication status	Published - 2010
Externally published	Yes
Event	7th Extended Semantic Web Conference - Heraklion, Greece Duration: 30 May 2010 → 2 Jun 2010

Publication series

Name	Lecture Notes in Computer Science
Volume	6089

Conference

Conference	7th Extended Semantic Web Conference
Abbreviated title	ESWC 2010
Country/Territory	Greece
City	Heraklion
Period	30/05/10 → 2/06/10

Access to Document

10.1007/978-3-642-13489-0_10

Cite this

@inproceedings{9bf870f22fc647708301b166a539ac96,

title = "Efficient semantic-aware detection of near duplicate resources",

abstract = "Efficiently detecting near duplicate resources is an important task when integrating information from various sources and applications. Once detected, near duplicate resources can be grouped together, merged, or removed, in order to avoid repetition and redundancy, and to increase the diversity in the information provided to the user. In this paper, we introduce an approach for efficient semantic-aware near duplicate detection, by combining an indexing scheme for similarity search with the RDF representations of the resources. We provide a probabilistic analysis for the correctness of the suggested approach, which allows applications to configure it for satisfying their specific quality requirements. Our experimental evaluation on the RDF descriptions of real-world news articles from various news agencies demonstrates the efficiency and effectiveness of our approach.",

author = "Ekaterini Ioannou and Odysseas Papapetrou and Dimitrios Skoutas and Wolfgang Nejdl",

year = "2010",

doi = "10.1007/978-3-642-13489-0\_10",

language = "English",

isbn = "978-3-642-13488-3",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "136--150",

booktitle = "The Semantic Web: Research and Applications",

address = "Germany",

note = "7th Extended Semantic Web Conference, ESWC 2010 ; Conference date: 30-05-2010 Through 02-06-2010",

}

Ioannou, E, Papapetrou, O, Skoutas, D & Nejdl, W 2010, Efficient semantic-aware detection of near duplicate resources. in The Semantic Web: Research and Applications: 7th Extended Semantic Web Conference 2010, Proceedings part II. Lecture Notes in Computer Science, vol. 6089, Springer, Berlin, pp. 136-150, 7th Extended Semantic Web Conference, Heraklion, Greece, 30/05/10. https://doi.org/10.1007/978-3-642-13489-0_10

Efficient semantic-aware detection of near duplicate resources. / Ioannou, Ekaterini; Papapetrou, Odysseas; Skoutas, Dimitrios et al.
The Semantic Web: Research and Applications: 7th Extended Semantic Web Conference 2010, Proceedings part II. Berlin: Springer, 2010. p. 136-150 (Lecture Notes in Computer Science; Vol. 6089).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Efficient semantic-aware detection of near duplicate resources

AU - Ioannou, Ekaterini

AU - Papapetrou, Odysseas

AU - Skoutas, Dimitrios

AU - Nejdl, Wolfgang

PY - 2010

Y1 - 2010

N2 - Efficiently detecting near duplicate resources is an important task when integrating information from various sources and applications. Once detected, near duplicate resources can be grouped together, merged, or removed, in order to avoid repetition and redundancy, and to increase the diversity in the information provided to the user. In this paper, we introduce an approach for efficient semantic-aware near duplicate detection, by combining an indexing scheme for similarity search with the RDF representations of the resources. We provide a probabilistic analysis for the correctness of the suggested approach, which allows applications to configure it for satisfying their specific quality requirements. Our experimental evaluation on the RDF descriptions of real-world news articles from various news agencies demonstrates the efficiency and effectiveness of our approach.

AB - Efficiently detecting near duplicate resources is an important task when integrating information from various sources and applications. Once detected, near duplicate resources can be grouped together, merged, or removed, in order to avoid repetition and redundancy, and to increase the diversity in the information provided to the user. In this paper, we introduce an approach for efficient semantic-aware near duplicate detection, by combining an indexing scheme for similarity search with the RDF representations of the resources. We provide a probabilistic analysis for the correctness of the suggested approach, which allows applications to configure it for satisfying their specific quality requirements. Our experimental evaluation on the RDF descriptions of real-world news articles from various news agencies demonstrates the efficiency and effectiveness of our approach.

U2 - 10.1007/978-3-642-13489-0_10

DO - 10.1007/978-3-642-13489-0_10

M3 - Conference contribution

SN - 978-3-642-13488-3

T3 - Lecture Notes in Computer Science

SP - 136

EP - 150

BT - The Semantic Web: Research and Applications

PB - Springer

CY - Berlin

T2 - 7th Extended Semantic Web Conference

Y2 - 30 May 2010 through 2 June 2010

ER -

Efficient semantic-aware detection of near duplicate resources

Abstract

Publication series

Conference

Access to Document

Fingerprint

Cite this