Mapreduce algorithm for weather dataset / (Record no. 7424)

MARC details
000 -LEADER
fixed length control field 03537ntm a2200277 a 4500
001 - CONTROL NUMBER
control field vtls000101358
003 - CONTROL NUMBER IDENTIFIER
control field KUKTEM
005 - DATE AND TIME OF LATEST TRANSACTION
control field 20251117113350.0
008 - FIXED-LENGTH DATA ELEMENTS--GENERAL INFORMATION
fixed length control field 170928t2017 my a f am 000 0 eng d
020 ## - INTERNATIONAL STANDARD BOOK NUMBER
International Standard Book Number THE0001157(Local)
039 #9 - LEVEL OF BIBLIOGRAPHIC CONTROL AND CODING DETAIL [OBSOLETE]
Level of rules in bibliographic description 201905141046
Level of effort used to assign nonsubject heading access points nazirah
Level of effort used to assign subject headings 201710030928
Level of effort used to assign classification fateeha
Level of effort used to assign subject headings 201709281127
Level of effort used to assign classification fateeha
-- 201709281110
-- fateeha
040 ## - CATALOGING SOURCE
Original cataloging agency UMP
090 ## - LOCALLY ASSIGNED LC-TYPE CALL NUMBER (OCLC); LOCAL CALL NUMBER (RLIN)
Classification number (OCLC) (R) ; Classification number, CALL (RLIN) (NR) FSKKP .K435 2017 r Thesis
100 0# - MAIN ENTRY--PERSONAL NAME
Personal name Khalid Adam Ismail Hammad
245 10 - TITLE STATEMENT
Title Mapreduce algorithm for weather dataset /
Statement of responsibility, etc. Khalid Adam Ismail Hammad
260 ## - PUBLICATION, DISTRIBUTION, ETC.
Place of publication, distribution, etc. Kuantan, Pahang :
Name of publisher, distributor, etc. UMP,
Date of publication, distribution, etc. 2017
300 ## - PHYSICAL DESCRIPTION
Extent x, 118 p. :
Other physical details ill. (some col.) ;
Dimensions 30 cm. +
Accompanying material 1 CD-ROM
500 ## - GENERAL NOTE
General note Faculty of Computer Systems & Software Engineering
502 ## - DISSERTATION NOTE
Dissertation note Thesis (Master of Science) -- Universiti Malaysia Pahang – 2017
504 ## - BIBLIOGRAPHY, ETC. NOTE
Bibliography, etc. note Bibliography : p. 74-79
520 3# - SUMMARY, ETC.
Summary, etc. Weather forecasting plays a vital role in human daily routine, business and their decisions. The technology for weather forecasting is evolving rapidly due to the critical needs in obtaining the accurate prediction results. From the literature exploration, the researchers have found that weather data is important to be analysed in form of structure data. Most of data in weather is represented in unstructured data with different attributes such as temperature, humidity, visibility, and pressure. These data were captured by different types of sensors. The weather data consists of high volumes, high velocity and variety of data which is reflects to the characteristics of Big Data. In addition, these characteristics also contribute to the complexity on the data processing and prediction. Big Data analytics is a new concept to process the Big Data. For weather data, this new concept will help to organise the data into structure data. The well-known method for Big Data analytics is MapReduce Model. Nevertheless, the usage of MapReduce Model in processing weather dataset is not widely explored. Therefore, this research is focus on analysing the weather dataset using MapReduce Algorithm. The historical dataset in 10 years’ period (1997 to 2007) has been used and this dataset is obtained from NOAA. This original dataset is stored in Hadoop Distributed File System. Next, MapReduce Algorithm is developed using Java programming. The algorithm is tested using small and big dataset. The temperature, humidity and visibility attributes from the dataset has been extracted by the MapReduce Algorithm into structure data. Graphical analysis has been used to represent the result from the MapReduce Algorithm. Results from the proposed algorithm have been compared with the existing model known as AWK (Alfred Aho, Peter Weinberger, and Brian Kernighan) model. The purpose of the comparison is to investigate the capability of the proposed model in parallel processing. The comparison results shown that MapReduce Algorithm has produced 37%, 25% and 11% less compared to AWK in term of processing time for 10GB, 5GB and 1GB data, respectively. This result has revealed the significant impact to the used of MapReduce Algorithm in weather prediction. In addition, the MapReduce results have discovered the significant pattern of temperature, humidity and visibility information which is valuable for the weather prediction.
610 20 - SUBJECT ADDED ENTRY--CORPORATE NAME
Corporate name or jurisdiction name as entry element Faculty of Computer Systems & Software Engineering
General subdivision Dissertations
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name entry element Universities and Colleges
General subdivision Dissertations
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name entry element Theses
Holdings
Withdrawn status Lost status Source of classification or shelving scheme Damaged status Not for loan Home library Current library Date acquired Total checkouts Full call number Barcode Date last seen Copy number Price effective from Koha item type
  Not lost Library of Congress Classification   Not for loan UMPLIB PEKAN UMPLIB PEKAN 04/09/2019   FSKKP .K435 2017 r Thesis 0000119803 04/09/2019 1 04/09/2019 Thesis
  Not lost Library of Congress Classification   Not for loan UMPLIB PEKAN UMPLIB PEKAN 04/09/2019   CD 10863 | FSKKP .K435 2017 r Thesis 0000119804 04/09/2019 1 04/09/2019 Thesis

Perpustakaan Universiti Malaysia Pahang Al-Sultan Abdullah
26600 Pekan, Pahang Darul Makmur
Phone: +609 431 5063 (Gambang) / +609 431 5035 (Pekan)
Email: umplibrary@umpsa.edu.my

Connect With Us