Environmental stochasticity is a key determinant of population viability. Decades of work exploring how environmental stochasticity influences population dynamics have highlighted the ability of some natural populations to limit the negative effects of environmental stochasticity, one of these strategies being demographic buffering. Whilst various methods exist to quantify demographic buffering, we still do not know which environment factors and demographic characteristics are most responsible for the demographic buffering observed in natural populations. Here, we introduce a framework to quantify the relative effects of three key drivers of demographic buffering: environment components (e.g., temporal autocorrelation and variance), population structure, and demographic rates (e.g., progression and fertility). Using Integral Projection Models, we explore how these drivers impact the demographic buffering abilities of three plant species with different life histories and demonstrate how our approach successfully characterises a population’s capacity to demographically buffer against environmental stochasticity in a changing world.