Data Mining for Spatial Big Data classification using Hadoop Map Reduce Framework

Paper ID: EIJTEM_2021_8_2_47-52

Author's Name: Katta Padmaja

Volume: 8

Issue: 2

Year: 2021

Page No: 47-52

Abstract:

In the wake of availability of Earth Observation System (EOS) and World Wind project promoted by NASA, spatial imagery is available for empirical study. The data collected from the satellites is the big data which is in the form of spatial imagery. Such data cannot process without the usage of highly effective computing infrastructure. In this paper cloud computing based Hadoop MapReduce framework is used to perform data mining operations like classification on big data. A framework and methodology is proposed to achieve this. Spatial imagery is given as input to the framework which performs spatial clustering using the new programming paradigm known as MapReduce. A classifier is built with training set and then the model is used to label unlabelled data. The results revealed the utility of the proposed methodology.

Keywords: Big data, security, data mining, big data classification

References:

[1] Acar, U. A., & Chen, Y. (2013). Streaming Big Data with Self-Adjusting Computation. Proceedings of the 2013 Workshop on Data Driven Functional Programming - DDFP ’13, 15-18. doi: 10.1145/2429376.2429382
[2] Agrawal, R., Imieliński, T., & Swami, A. (1993). Mining Association Rules between Sets of Items in Large Databases. Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, 22(2), 207-216. doi: 10.1145/170035.170072
[3] Bak, P. (1996). How Nature Works: The Science of Self-Organised Critically (1 ed.): Copernicus.
[4] Batty, M., & Longley, P. A. (1994). Fractal Cities: A Geometry of Form and Function. London: Academic Press.
[5] Bernasocchi, M., Çöltekin, A., & Gruber, S. (2012). An Open Source Geovisual Analytics Toolbox for Multivariate Spatio-Temporal Data for Environmental Change Modeling. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 1-2(2), 123-128.
[6] Carbin, M., Misailović, S., & Rinard, M. C. (2013). Verifying Quantitative Reliability for Programs that Execute on Unreliable Hardware. ACM SIGPLAN NOTICES - OOPSLA '13, 48(10), 33-52. doi: 10.1145/2544173.2509546
[7] Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly Detection: A Survey. ACM Computing Surveys, 41(3), 1-58. doi: 10.1145/1541880.1541882
[8] Cheng, T & Adepeju, M. (2014). Modifiable Temporal Unit Problem (MTUP) and its Effect on Space-Time Cluster Detection. PLOS ONE 9(6), e100465.
[9] Cheng, T., Haworth, J., & Manley, E. (2012). Advances in Geocomputation (1996-2011). Computers, Environment and Urban Systems, 36(6), 481-487. doi: 10.1016/j.compenvurbsys.2012.10.002
[10] Cheng, T., Wang, J., Haworth, J., Heydecker, B., Chow, A. (2014). A Dynamic Spatial Weight Matrix and Localized Space–Time Autoregressive Integrated Moving Average for Network Modeling, Geographical Analysis. Geographical Analysis, 46: 75–97 DOI: 10.1111/gean.12026.
[11] Choo, J., & Park, H. (2013). Customizing Computational Methods for Visual Analytics with Big Data. IEEE Computer Graphics and Applications, 33(4), 22-28.
[12] Çöltekin, A. (2009). Space-Variant Image Coding for Stereoscopic Media. Picture Coding Symposium, 2009 (PCS 2009), 1-4. doi: 10.1109/PCS.2009.5167396
[13] Çöltekin, A., & Reichenbacher, T. (2011). High Quality Geographic Services and Bandwidth Limitations. Future Internet, 3(4), 379-396. doi: 10.3390/fi3040379
[14] Crampton, J. W., Graham, M., Poorthuis, A., Shelton, T., Stephens, M., Wilson, M. W., & Zook, M. (2013). Beyond the Geotag: Situating ‘Big Data’and Leveraging the Potential of the Geoweb. Cartography and Geographic Information Science, 40(2), 130-139. doi: 10.1080/15230406.2013.777137
[15] Cutler, D. R., Edwards, T. C. Jr., Beard, K. H., Cutler, A., Hess, K. T., Gibson, J., & Lawler, J. J., 2007. Random Forests for Classification in Ecology. Ecology, 88(11), 2783-2792.
[16] Intel. 2013. Planning Guide Getting Started With Big Data. Intel IT Center. p1-24.
[17] Xindong Wu, Xingquan Zhu, Gong-Qing Wu. (2014). Data Mining with Big Data. IEEE. 26 (1), p.97-107.

View PDF