An Efficient Data Indexing Approach on Hadoop Using Java Persistence API
Abstract
Data indexing is common in data mining when working with high-dimensional, large-scale data sets. Hadoop, a cloud computing project using the MapReduce framework in Java, has become of significant interest in distributed data mining. To resolve problems of globalization, random-write and duration in Hadoop, a data indexing approach on Hadoop using the Java Persistence API (JPA) is elaborated in the implementation of a KD-tree algorithm on Hadoop. An improved intersection algorithm for distributed data indexing on Hadoop is proposed, it performs O(M+logN), and is suitable for occasions of multiple intersections. We compare the data indexing algorithm on open dataset and synthetic dataset in a modest cloud environment. The results show the algorithms are feasible in large-scale data mining.
Fichier principal
An_Efficient_Data_Indexing_Approach_on_Hadoop_using_Java_Persistence_API.pdf (484.95 Ko)
Télécharger le fichier
Origin | Files produced by the author(s) |
---|
Loading...