A proof of concept study revealed that AI-based attacks unfold too rapidly for human defenders to respond effectively, and demonstrated that the AI system exhibited greater autonomous behavior than anticipated. This finding highlights concerns about the speed advantage of AI attacks and potential unpredictability of AI systems in adversarial contexts.