Internet of Things (IoT) and Internet of Medical Things (IoMT) networks provide a massive amount of data. These types of data need a protection level, such as an intrusion detection framework. Deep learning models become a powerful tool for this purpose. Therefore, this work proposes an intrusion detection framework based on a deep learning technique which employs TabTransformer and self-attention mechanisms to imprison intricate dependencies among tabular features and detect abnormal attack behaviors. Precisely, each numerical feature is mapped into a learnable embedding vector and augmented with positional encodings to preserve feature identity and inter-feature relationships within the embedding space. The main task for the proposed model is to achieve binary classification tasks the model should classify the traffic data as either normal or abnormal. Furthermore, the model utilized a benchmark dataset such as the CICIoMT2024. Furthermore, this type of dataset faces issues, such as imbalance. So, the system integrates SMOTE-based data balancing, Stratified K-Fold Cross-Validation, and threshold optimization to ensure fairness and reproducibility to accomplish a binary classification task. As a consequence, experiments on the CICIoMT2024 dataset yield superior results, achieving a mean accuracy of 99.85. Through SHAP-based interpretability, key features influencing model predictions are identified, confirming the framework’s transparency, robustness, and suitability for real-world ARP intrusion detection.