AB - The fast evolution of Internet of Things (IoT) is placing increased demands on network infrastructures to be versatile and robust, especially in dynamic, heterogeneous, and resource-limited environments. Existing cluster-based and communication protocols struggle with protocol rigidity, insufficient integrated security, and limited reconfigurability. This paper proposes a novel security-aware hybrid clustering framework integrating BIRCH-DBSCAN algorithms, MQTT/CoAP switching adaptively, and AES-128 encryption with session-based key rotation for end-to-end confidentiality. By featuring a three-layer architecture designed with autonomous cluster recovery, layered verification, and a reconfiguration system upon performance, energy, and mobility changes. Evaluated and tested on ContikiNG simulation, the approach provides 43.3% latency reduction, 22.8 % energy efficiency improvement, 99.91 % delivery reliability, and zero breaches over 39 adaptive switches with just 4.2% overhead. The results attest to the platform's strength and viability for future IoT deployments for efficient and responsive communications in changing conditions. AU - Dighriri, OM AU - Nanda, P AU - Mohanty, M AU - Alrashed, B AU - Haddadi, I DA - 2025/01/01 DO - 10.1109/AICCSA66935.2025.11315394 JO - 22nd International Conference on Computer Systems and Applications-AICCSA PB - IEEE PY - 2025/01/01 TI - Protocol-Aware Hybrid Clustering for IoT: Adaptive Reconfiguration and Secure Communication with MQTT/CoAP Integration VL - 00 Y1 - 2025/01/01 Y2 - 2026/06/07 ER -