Many neurons display significant patterning in their spike trains (e.g. oscillations, bursting), and there is accumulating evidence that information is contained in these patterns. In many cases, this patterning is caused by intrinsic mechanisms rather than external signals. In this review, we focus on spiking activity that displays nonrenewal statistics (i.e. memory that persists from one firing to the next). Such statistics are seen in both peripheral and central neurons and appear to be ubiquitous in the CNS. We review the principal mechanisms that can give rise to nonrenewal spike train statistics. These are separated into intrinsic mechanisms such as relative refractoriness and network mechanisms such as coupling with delayed inhibitory feedback. Next, we focus on the functional roles for nonrenewal spike train statistics. These can either increase or decrease information transmission. We also focus on how such statistics can give rise to an optimal integration timescale at which spike train variability is minimal and how this might be exploited by sensory systems to maximize the detection of weak signals. We finish by pointing out some interesting future directions for research in this area. In particular, we explore the interesting possibility that synaptic dynamics might be matched with the nonrenewal spiking statistics of presynaptic spike trains in order to further improve information transmission.