Deduplication of metadata harvested from Open Archives Initiative repositories - Information Services and Use - Volume 33, Number 2 / 2013 - IOS Press

Use the link to access the full text article from Information Services & Use available from IOS Press.  The abstract reads as follows: "Open access (OA) is a way of providing unrestricted access via the Internet to peer-reviewed journal articles as well as theses, monographs and book chapters. Many open access repositories have been created in the last decade. There is also a number of registry websites that index these repositories. This article analyzes the repositories indexed by the Open Archives Initiative (OAI) organization in terms of record duplication. Based on the sample of 958 metadata files containing records modified in 2012 we provide an estimate on the number of duplicates in the entire collection of repositories indexed by OAI. In addition, this work describes several open source tools that form a generic workflow suitable for deduplication of bibliographic records."