Title :
Big data parallelism: Challenges in different computational paradigms
Author :
Mondal, Koushik ; Dutta, Paramartha
Author_Institution :
Comput. Centre Indian Inst. of Technol., Indore, India
Abstract :
Developers are engaged themselves in processing big data for different computational environments especially in different information systems, biological expression preparations and visual and graphical modelling. Digital Elevation Models (DEMs) in Geographic Information Systems (GIS) is one such information systems where in memory computation faces a lot challenges to manipulate and visualize the data. Scalable distributed framework broadly exhibit two design characteristics: (i) they are using memory scalability in such a manner that the amount of memory required by each process decreases as the number of processes used to solve a given problem instance increases, and (ii) they exploit coarse grain parallelism in the sense that they structure their computations into a sequence of local computation followed by communication phases in which the local computations take a non-trivial amount of time and often involve a non-trivial subset of the process´ memory. In this paper we will discuss about big data, data science, different models available in the parallel paradigms, the pros and cons and the probable way out to work with high dimensional data.
Keywords :
Big Data; data visualisation; learning (artificial intelligence); parallel processing; Big Data parallelism; computational paradigms; data visualization; machine learning; scalable distributed framework; Big data; Computational modeling; Data models; Mathematical model; Memory management; Parallel processing; Stochastic processes; Big Data; Data Science; High Dimensional Data; Machine Learning; Parallel Computing; Scalable framework; Semi-stochastic;
Conference_Titel :
Computer, Communication, Control and Information Technology (C3IT), 2015 Third International Conference on
Conference_Location :
Hooghly
Print_ISBN :
978-1-4799-4446-0
DOI :
10.1109/C3IT.2015.7060186