Habituation is one of the oldest forms of learning, broadly expressed across sensory systems and taxa. Here, we demonstrate that olfactory habituation induced at different timescales (comprising different odor exposure and intertrial interval durations) is mediated by different neural mechanisms. First, the persistence of habituation memory is greater when mice are habituated on longer timescales. Second, the specificity of the memory (degree of cross-habituation to similar stimuli) also depends on induction timescale. Third, we demonstrate a pharmacological double dissociation between the glutamatergic mechanisms underlying short- and long-timescale odor habituation. LY341495, a class II/III metabotropic glutamate receptor antagonist, blocked habituation only when the induction timescale was short. Conversely, MK-801, an N-methyl-D-aspartate (NMDA) receptor antagonist, prevented habituation only when the timescale was long. Finally, whereas short-timescale odor habituation is mediated within the anterior piriform cortex, infusion of MK-801 into the olfactory bulbs prevented odor habituation only at longer timescales. Thus, we demonstrate two neural mechanisms underlying simple olfactory learning, distinguished by their persistence and specificity, mediated by different olfactory structures and pharmacological effectors, and differentially utilized based solely on the timescale of odor presentation.