Analysis of Climate Temperature Prediction Using Map reduce Hadoop and Hive

Vol-4 | Issue-02 | February 2019 | Published Online: 20 February 2019    PDF ( 374 KB )
Author(s)
ManpreetKaur 1; Dr. Vijay Dhir 2

1Research Scholar MTech , Department of CSE Sant Baba Bhag Singh University, Jalandhar, India

2Professor of CSE Department, Sant Baba Bhag Singh University, Jalandhar, India

Abstract

Now a day’s big data increasing very fastly from various sources. It is a hottest topic in present days. Big data is a term that refers to a collection of huge amount of data that is very difficult to analyze, capture, manage and store into the traditional database. Big data is generated from numerous sources like internal and external sources. The generated data can be in any form like in structured from and unstructured from. To capture these types of data easily, the big data technologies and tools are used. The big data tools are hadoop framework, pig, hive, map reduce, hdfs and cassandra which manages the data into structured form easily. In this paper the tools of big data are described. To perform the analysis technique on the big data the mainly hadoop framework is used which includes many tools such as hdfs (Hadoop Distributed File System), map reduce and hive etc. In this research we use map reduce and hive tools to analyze the weather related data. Map reduce is a main component of hadoop framework which is used to perform various operations simultaneously. Second tool is hive which is used to perform database operations. It is a data warehouse tool which uses hiveql queries to process the data which is similar to the sql queries.

Keywords
Big Data, Hadoop, Map reduce,HDFS, Hive
Statistics
Article View: 336