MARC details
| 000 -LEADER |
|---|
| fixed length control field |
02953nrm a2200337 i 4500 |
| 003 - CONTROL NUMBER IDENTIFIER |
|---|
| control field |
MY-KuUP |
| 005 - DATE AND TIME OF LATEST TRANSACTION |
|---|
| control field |
20251125111037.0 |
| 006 - FIXED-LENGTH DATA ELEMENTS--ADDITIONAL MATERIAL CHARACTERISTICS |
|---|
| fixed length control field |
t||||fr|||| 000 0 |
| 007 - PHYSICAL DESCRIPTION FIXED FIELD--GENERAL INFORMATION |
|---|
| fixed length control field |
ta |
| 008 - FIXED-LENGTH DATA ELEMENTS--GENERAL INFORMATION |
|---|
| fixed length control field |
250505t20232023my ||||f |||| s0| 0 eng d |
| 020 ## - INTERNATIONAL STANDARD BOOK NUMBER |
|---|
| International Standard Book Number |
THE0010027 (Local) |
| Qualifying information |
Hardback |
| 040 ## - CATALOGING SOURCE |
|---|
| Original cataloging agency |
UMPSA |
| Language of cataloging |
eng |
| Transcribing agency |
UMPSA |
| Description conventions |
rda |
| 090 ## - LOCALLY ASSIGNED LC-TYPE CALL NUMBER (OCLC); LOCAL CALL NUMBER (RLIN) |
|---|
| Classification number (OCLC) (R) ; Classification number, CALL (RLIN) (NR) |
PSM .S66 2023 r Bc. |
| 100 1# - MAIN ENTRY--PERSONAL NAME |
|---|
| Personal name |
Soon, Kien Yuan, |
| Relator term |
author. |
| 245 10 - TITLE STATEMENT |
|---|
| Title |
Data lakehouse architecture for self-service data analytics / |
| Statement of responsibility, etc. |
Soon Kien Yuan |
| 264 #1 - PRODUCTION, PUBLICATION, DISTRIBUTION, MANUFACTURE, AND COPYRIGHT NOTICE |
|---|
| Place of production, publication, distribution, manufacture |
Kuantan Pahang : |
| Date of production, publication, distribution, manufacture, or copyright notice |
2023 |
| 264 #4 - PRODUCTION, PUBLICATION, DISTRIBUTION, MANUFACTURE, AND COPYRIGHT NOTICE |
|---|
| Date of production, publication, distribution, manufacture, or copyright notice |
© 2023 |
| 300 ## - PHYSICAL DESCRIPTION |
|---|
| Extent |
xii, 80 pages : |
| Other physical details |
illustrations ; |
| Accompanying material |
1 CD-ROM. |
| 336 ## - CONTENT TYPE |
|---|
| Source |
rdacontent |
| Content type term |
text |
| 337 ## - MEDIA TYPE |
|---|
| Source |
rdamedia |
| Media type term |
unmediated |
| 338 ## - CARRIER TYPE |
|---|
| Source |
rdacarrier |
| Carrier type term |
volume |
| 347 ## - DIGITAL FILE CHARACTERISTICS |
|---|
| Source |
rda |
| File type |
text file |
| Encoding format |
PDF |
| 500 ## - GENERAL NOTE |
|---|
| General note |
Center for Mathematical Sciences |
| 502 ## - DISSERTATION NOTE |
|---|
| Dissertation note |
Bachelor of Applied Science In Data Analytics With Honour -- Universiti Malaysia Pahang – 2023 |
| 504 ## - BIBLIOGRAPHY, ETC. NOTE |
|---|
| Bibliography, etc. note |
Includes bibliographical references |
| 520 3# - SUMMARY, ETC. |
|---|
| Summary, etc. |
This project focuses on designing and implementing a Data Lakehouse architecture to facilitate self-service analytics. The objectives include creating a collaborative analytics environment, streamlining the management of multiple ETL processes, adopting a costeffective and non-proprietary architecture, integrating with BI tools, ensuring high query performance for interactive visualization, enabling data warehousing capabilities, and offering a self-service data discovery and metadata platform. The project followed an iterative development methodology that involves requirement gathering and planning, design, implementation, testing, deployment, and maintenance phases. The logical design consists of six layers which are data ingestion, storage, catalog, semantic, processing, and consumption. The physical design utilized Dremio as the core component, along with Apache Iceberg and Arrow Flight Engine for data format and query processing. The project also adopted an Integrated Multi-Zone Analytics Framework to handle different data tasks and workloads. The implementation was performed using Docker, and the testing validates the achievement of the objectives. Deployment was done on an Azure Kubernetes Service (AKS) cluster, although the deployment of the Dremio cluster is hindered due to budget and resource limitations. Maintenance activities included security, backup, node monitoring, cost usage, configuration tuning, metadata management, and training and support. This project concludes that the objectives have been achieved and suggests some future enhancements, such as using Project Nessie for catalog storage, considering Dremio Enterprise Edition for advanced features, and exploring Databricks and MLflow if expecting extensive machine learning workloads. |
| 610 20 - SUBJECT ADDED ENTRY--CORPORATE NAME |
|---|
| Corporate name or jurisdiction name as entry element |
Center for Mathematical Sciences |
| General subdivision |
Dissertations |
| 650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM |
|---|
| Topical term or geographic name entry element |
Universities and colleges |
| General subdivision |
Dissertations |
| 650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM |
|---|
| Topical term or geographic name entry element |
Final Year Report |
| General subdivision |
Dissertations |
| 942 ## - ADDED ENTRY ELEMENTS (KOHA) |
|---|
| Source of classification or shelving scheme |
Library of Congress Classification |
| Koha item type |
Final Year Report |