Caledonians held their nerve in a thrilling first round cup game, edging out Rovers 3-2 at the North Road soccer grounds to progress in the Great Southern Soccer Association senior league cup competition.