Hearing loss is the most common sensory deficit in the world, and most frequently it originates in the inner ear. Yet, the inner ear has been difficult to access for diagnosis because of its small size, delicate nature, complex three-dimensional anatomy, and encasement in the densest bone in the body. Evolving optical methods are promising to afford cellular diagnosis of pathologic changes in the inner ear. To appropriately interpret results from these emerging technologies, it is important to characterize optical properties of cochlear tissues. Here, we focus on that characterization using quantitative polarized light microscopy (qPLM) applied to unstained cochlear sections of the mouse, a common animal model of human hearing loss. We find that the most birefringent cochlear materials are collagen fibrils and myelin. Retardance of the otic capsule, the spiral ligament, and the basilar membrane are substantially higher than that of other cochlear structures. Retardance of the spiral ligament and the basilar membrane decrease from the cochlear base to the apex, compared with the more uniform retardance of other structures. The intricate structural details revealed by qPLM of unstained cochlear sections ex vivo strongly motivate future application of polarization-sensitive optical coherence tomography to human cochlea in vivo.