Service Class Driven Dynamic Data Source Discovery with DynaBot

Daniel Rocco, James Caverlee, Ling Liu and Terence Critchlow
Additional contact information
Daniel Rocco: University of West Georgia, USA
James Caverlee: Georgia Institute of Technology, USA
Ling Liu: Georgia Institute of Technology, USA
Terence Critchlow: Lawrence Livermore National Laboratory, USA

International Journal of Web Services Research (IJWSR), 2007, vol. 4, issue 3, 26-48

Abstract: Dynamic Web data sources on the Deep Web provide intuitive access to real-time information and large data repositories anywhere that Web access is available. Although recent studies suggest that the dynamic Web is larger and growing faster than static Web, dynamic content is often ignored by existing search engine indexers owing to technical challenges inherent in searching dynamic sources. To address these challenges, we present DynaBot, a service-centric crawler for discovering and clustering Deep Web sources. Dyna- Bot has three unique characteristics. First, DynaBot utilizes a service class model implemented through the construction of service class descriptions (SCDs). Second, DynaBot employs a modular architecture for focused crawling of the Deep Web. Third, DynaBot incorporates algorithms for efficiently probing, discovering, and clustering Deep Web sources through SCD-based service analysis. Experimental results demonstrate DynaBot’s effectiveness and suggest techniques for efficiently managing service discovery given the immense scale of the Deep Web.

Date: 2007
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 4018/jwsr.2007070102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jwsr00:v:4:y:2007:i:3:p:26-48

Access Statistics for this article

International Journal of Web Services Research (IJWSR) is currently edited by Liang-Jie Zhang

More articles in International Journal of Web Services Research (IJWSR) from IGI Global
Bibliographic data for series maintained by Journal Editor ().