Malaysia’s religious authorities can ban teachings they consider deviant, send followers to rehabilitation classes and take group leaders to court. But they have not stopped banned or fringe Islamic movements from finding new followers online, according to officials, as some groups move abroad, rebrand or use social media to keep reaching Malaysians beyond the immediate reach of state enforcement. The concern has been raised most recently in Selangor, Malaysia’s richest and most populous state,...