Protecting groups play a vital role in the assembly of oligosaccharides. The pivaloyl (Piv) ester is commonly used to ensure 1,2‐trans‐selective glycosylation reactions. A significant drawback of the Piv ester is its stability, necessitating strong alkaline conditions for its removal. We here present the cyanopivaloyl (CNPiv) group, a modified pivaloyl group having a cyano group appended to the tert‐butyl moiety. The CNPiv group benefits from the profitable features of the Piv group (stability and effective neighboring‐group participation with minimal orthoester formation during glycosylation reactions), but can be removed under mild conditions (reduction of the cyano function followed by mild base treatment). The applicability of the CNPiv group is demonstrated in the assembly of two rhamnose oligosaccharides, a hexarhamnan that represents a fragment of the capsular polysaccharide of Enterococcus faecium and a tetrarhamnan that is part of the polyrhamnose backbone of the Lancefield Group A carbohydrate (GAC).