Neuronal polarization, the formation of one long axon and several short dendrites, is an obligatory process to integrate and propagate information within the brain. Axon formation is the key event during neuronal polarization and is based on tightly regulated rearrangements of the cytoskeleton. Here, we discuss how the cytoskeleton drives neuronal polarization. First, we convey the role of the actin cytoskeleton and microtubules during axon formation. Second, we discuss different cytoskeletal binding and regulating proteins, which are essential to specify the axon. Finally, we outline plus end tracking proteins (+TIPs) as important regulators for neuronal polarization by mediating the interaction between the actin cytoskeleton and microtubules and compare this function to other polarity processes.