Hybrid spatio-temporal models for deepfake detection using facial movement analysis (Record no. 102522)

MARC details
000 -LEADER
fixed length control field 04703ntm a2200337 i 4500
003 - CONTROL NUMBER IDENTIFIER
control field MY-KuUP
005 - DATE AND TIME OF LATEST TRANSACTION
control field 20251125111039.0
006 - FIXED-LENGTH DATA ELEMENTS--ADDITIONAL MATERIAL CHARACTERISTICS
fixed length control field t||||fr|||| 000 0
007 - PHYSICAL DESCRIPTION FIXED FIELD--GENERAL INFORMATION
fixed length control field ta
008 - FIXED-LENGTH DATA ELEMENTS--GENERAL INFORMATION
fixed length control field 250514t20242024my a|||fr|||| 000 0 eng d
020 ## - INTERNATIONAL STANDARD BOOK NUMBER
Qualifying information hardback
International Standard Book Number THE0010056 (Local)
040 ## - CATALOGING SOURCE
Language of cataloging eng
Transcribing agency UMPSA
Description conventions rda
Original cataloging agency UMPSA
090 ## - LOCALLY ASSIGNED LC-TYPE CALL NUMBER (OCLC); LOCAL CALL NUMBER (RLIN)
Classification number (OCLC) (R) ; Classification number, CALL (RLIN) (NR) FTKEE .S25 2024 r Thesis
100 0# - MAIN ENTRY--PERSONAL NAME
Personal name Muhammad Salihin Saealal,
Relator term author.
245 10 - TITLE STATEMENT
Title Hybrid spatio-temporal models for deepfake detection using facial movement analysis
Statement of responsibility, etc. Muhammad Salihin Bin Saealal
264 #1 - PRODUCTION, PUBLICATION, DISTRIBUTION, MANUFACTURE, AND COPYRIGHT NOTICE
Place of production, publication, distribution, manufacture Kuantan, Pahang :
Name of producer, publisher, distributor, manufacturer UMPSA,
Date of production, publication, distribution, manufacture, or copyright notice 2024
264 #4 - PRODUCTION, PUBLICATION, DISTRIBUTION, MANUFACTURE, AND COPYRIGHT NOTICE
Date of production, publication, distribution, manufacture, or copyright notice © 2024
300 ## - PHYSICAL DESCRIPTION
Extent xiv, 148 pages ;
Other physical details illustrations ;
Dimensions 30 cm. +
Accompanying material 1 CD-ROM
336 ## - CONTENT TYPE
Source rdacontent
Content type term text
337 ## - MEDIA TYPE
Source rdamedia
Media type term unmediated
338 ## - CARRIER TYPE
Source rdacarrier
Carrier type term volume
347 ## - DIGITAL FILE CHARACTERISTICS
Source rda
File type text file
Encoding format PDF
500 ## - GENERAL NOTE
General note Faculty of Electrical & Electronics Engineering Technology
502 ## - DISSERTATION NOTE
Dissertation note Thesis (Doctor of Philosophy) -- Universiti Malaysia Pahang – 2024
504 ## - BIBLIOGRAPHY, ETC. NOTE
Bibliography, etc. note Includes bibliographical references
520 3# - SUMMARY, ETC.
Summary, etc. Deepfake detection is an emerging field dedicated to identifying synthetic media where individuals’ likenesses are manipulated through advanced machine learning techniques. While deepfakes hold potential for innovation in entertainment and creative industries, they also pose serious threats such as misinformation, privacy invasion, and digital fraud. Effective deepfake detection is crucial for mitigating these risks. Current detection methods face several challenges. One significant issue is the over-reliance on spatial information, which limits the ability to detect subtle manipulations that may not be obvious in individual frames but become apparent over time. Furthermore, existing techniques often struggle to integrate both spatial and temporal information effectively, which is necessary for a comprehensive analysis. The development of robust and computationally efficient models is essential to ensure practical implementation and widespread adoption of deepfake detection solutions. A deeper examination of eye blinking sequences, for example, could reveal subtle inconsistencies that are indicative of manipulation, while leveraging both spatial and temporal facial data can enhance detection accuracy. This thesis explores two innovative approaches for detecting deepfake videos. The first approach focuses on analyzing eye blinking patterns, capitalizing on the observation that deepfake generators struggle to replicate natural blinking dynamics accurately. By compiling a robust dataset through meticulous frame-by-frame analysis of genuine and deepfake videos, significant disparities in blinking patterns were identified. The second approach delves into the spatial and temporal analysis of facial features. Recognizing that deepfakes, despite their sophistication, often leave subtle traces of manipulation in both individual frames and frame transitions, this research employs 3D data representation to capture these inconsistencies. Leveraging the insights from the first approach, an initial fully connected model achieved 90.8% accuracy. This promising result was further improved by integrating Convolutional Neural Networks (CNNs) with Bidirectional Long Short-Term Memory (BiLSTM) networks, boosting the accuracy by 4.6%, reaching an impressive 95.4%. For the second approach, a baseline 3D CNN model processing sequences of images initially achieved an accuracy of 95.5%. This performance was enhanced by incorporating a specialized called NuanceFusion layer, resulting in an improvement of 1.8%. Further enhancement was achieved with an advanced model integrating 2D CNN and BiLSTM networks, increasing accuracy by 3.4% and achieving a perfect recall of 100%. This streamlined approach effectively combines spatial and temporal analysis for robust deepfake detection. Through comprehensive experimentation and analysis, this thesis demonstrates the effectiveness of both blinking pattern analysis and spatial-temporal facial feature analysis for deepfake detection. The research not only highlights the strengths of each approach but also explores the trade-offs between accuracy, computational efficiency, and resource utilization, offering valuable insights for tailoring solutions based on specific application requirements. The findings provide a solid foundation for future research, emphasizing the need for continuously adapting and refining deepfake detection methodologies in the face of an ever-evolving digital landscape.
610 20 - SUBJECT ADDED ENTRY--CORPORATE NAME
Corporate name or jurisdiction name as entry element Faculty of Electrical & Electronics Engineering Technology
General subdivision Dissertations
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name entry element Universities and colleges
General subdivision Dissertations
650 #0 - SUBJECT ADDED ENTRY--TOPICAL TERM
Topical term or geographic name entry element Theses
General subdivision Dissertations
942 ## - ADDED ENTRY ELEMENTS (KOHA)
Source of classification or shelving scheme Library of Congress Classification
Koha item type Thesis
Holdings
Withdrawn status Lost status Source of classification or shelving scheme Damaged status Not for loan Home library Current library Date acquired Total checkouts Full call number Barcode Date last seen Price effective from Koha item type
  Not lost Library of Congress Classification   Not for loan UMPLIB PEKAN UMPLIB PEKAN 14/05/2025   FTKEE .S25 2024 r Thesis T000003489 14/05/2025 14/05/2025 Thesis
  Not lost Library of Congress Classification   Final Processing UMPLIB PEKAN UMPLIB PEKAN 14/05/2025   CD13729 T000003490 14/05/2025 14/05/2025 Thesis

Perpustakaan Universiti Malaysia Pahang Al-Sultan Abdullah
26600 Pekan, Pahang Darul Makmur
Phone: +609 431 5063 (Gambang) / +609 431 5035 (Pekan)
Email: umplibrary@umpsa.edu.my

Connect With Us