Author Identifier (ORCID)

Matthew Gaber: https://orcid.org/0000-0003-1684-1392

Mohiuddin Ahmed: https://orcid.org/0000-0002-4559-4768

Helge Janicke: https://orcid.org/0000-0002-1345-2829

Abstract

The effectiveness of an AI model in accurately classifying novel malware hinges on the quality of the features it is trained on, which in turn depends on the effectiveness of the analysis tool used. Peekaboo, a Dynamic Binary Instrumentation (DBI) tool, defeats malware evasion techniques to capture authentic behavior at the Assembly (ASM) instruction level. This behavior exhibits patterns consistent with Zipf's law, a distribution commonly seen in natural languages, making Transformer models particularly effective for binary classification tasks. We introduce Alpha, a framework for zero-day malware detection that leverages Transformer models, Support Vector Machines (SVMs) and ASM language features. Alpha is trained on malware and benign software data extracted at the ASM level, enabling it to detect entirely new malware samples with exceptional accuracy. Alpha eliminates any common functions from the test samples that are in the training dataset. This forces the model to rely on contextual patterns and novel ASM instruction combinations to detect malicious behavior, rather than memorizing familiar features. By combining the strengths of DBI, ASM analysis, and Transformer architectures, Alpha offers a powerful approach to proactively addressing the evolving threat of malware. Alpha demonstrates excellent accuracy for Ransomware, Worms and APTs with flawless classification for both malicious and benign samples. The results highlight the model's exceptional performance in detecting truly new malware samples.

Document Type

Journal Article

Date of Publication

12-1-2025

Volume

128

Publication Title

Computers and Electrical Engineering

Publisher

Elsevier

School

School of Science

RAS ID

84387

Creative Commons License

Creative Commons Attribution-Noncommercial 4.0 License
This work is licensed under a Creative Commons Attribution-Noncommercial 4.0 License

Comments

Gaber, M., Ahmed, M., & Janicke, H. (2025). Zero day malware detection with Alpha: Fast DBI with transformer models for real world application. Computers & Electrical Engineering, 128, 110751. https://doi.org/10.1016/j.compeleceng.2025.110751

Share

 
COinS
 

Link to publisher version (DOI)

10.1016/j.compeleceng.2025.110751