January 8, 2025
Conference Paper

Transformer Masked Autoencoders for RF Device Fingerprinting

Abstract

Machine learning methods for RF device fingerprinting typically rely on CNN-based models. Transformer-based models have outperformed CNNs for modulation classification tasks, but there are few implementations for device fingerprinting. We train a transformer for device fingerprinting with the largest device count to date and explore several variations of the architecture. Additionally, we demonstrate that pre-training an RF transformer as a Masked Autoencoder improves classification accuracy, as has been observed for CNN fingerprinting models and vision transformers.

Published: January 8, 2025

Citation

Parpart G.G., J.H. Tu, B.J. Clymer, J.H. Lee, and J.T. Babcock. 2024. Transformer Masked Autoencoders for RF Device Fingerprinting. In IEEE Military Communications Conference (MILCOM 2024), October 28-November 1, 2024, Washington, D.C., 859-862. Piscataway, New Jersey:IEEE. PNNL-SA-198258. doi:10.1109/MILCOM61039.2024.10773654

Research topics