Data Extraction using Content-Based Handles | ||
Journal of AI and Data Mining | ||
مقاله 15، دوره 6، شماره 2، مهر 2018، صفحه 399-407 اصل مقاله (1.16 M) | ||
نوع مقاله: Original/Review Paper | ||
شناسه دیجیتال (DOI): 10.22044/jadm.2017.990 | ||
نویسندگان | ||
A. Pouramini* ؛ S. Khaje Hassani؛ Sh. Nasiri | ||
Department of Computer Engineering, University of Sirjan Technology, Sirjan, Iran. | ||
چکیده | ||
In this paper, we present an approach and a visual tool, called HWrap (Handle Based Wrapper), for creating web wrappers to extract data records from web pages. In our approach, we mainly rely on the visible page content to identify data regions on a web page. In our extraction algorithm, we inspired by the way a human user scans the page content for specific data. In particular, we use text features such as textual delimiters, keywords, constants or text patterns, which we call handles, to construct patterns for the target data regions and data records. We offer a polynomial algorithm, in which these patterns are checked against the page elements in a mixed bottom-up and top-down traverse of the DOM-tree. The extracted data is directly mapped onto a hierarchical XML structure, which forms the output of the wrapper. The wrappers that are generated by this method are robust and independent of the HTML structure. Therefore, they can be adapted to similar websites to gather and integrate information. | ||
کلیدواژهها | ||
Web Data Record Extraction؛ Web Wrapper Generation؛ Web Information Extraction | ||
سایر فایل های مرتبط با مقاله
|
||
آمار تعداد مشاهده مقاله: 1,375 تعداد دریافت فایل اصل مقاله: 732 |