Soil bacterial communities play an important role in nutrient recycling and storage in terrestrial ecosystems. Loess soils are one of the most important soil resources for maintaining the stability of vegetation ecosystems and are mainly distributed in northwest China. Estimating the distributions and affecting factors of soil bacterial communities associated with various types of vegetation will inform our understanding of the effect of vegetation restoration and climate change on these processes. In this study, we collected soil samples from 15 sites from north to south on the Loess Plateau of China that represent different ecosystem types and analyzed the distributions of soil bacterial communities by high-throughput 454 pyrosequencing. The results showed that the 142444 sequences were grouped into 36816 operational taxonomic units (OTUs) based on 97% similarity. The results of the analysis showed that the dominant taxonomic phyla observed in all samples were Actinobacteria, Proteobacteria, Chloroflexi, Acidobacteria and Planctomycetes. Actinobacteria and Proteobacteria were the two most abundant groups in all samples. The relative abundance of Actinobacteria increased from 14.73% to 40.22% as the ecosystem changed from forest to sandy, while the relative abundance of Proteobacteria decreased from 35.35% to 21.40%. Actinobacteria and Proteobacteria had significant correlations with mean annual precipitation (MAP), pH, and soil moisture and nutrients. MAP was significantly correlated with soil chemical and physical properties. The relative abundance of Actinobacteria, Proteobacteria and Planctomycetes correlated significantly with MAP, suggesting that MAP was a key factor that affected the soil bacterial community composition. However, along with the MAP gradient, Chloroflexi, Bacteroidetes and Cyanobacteria had narrow ranges that did not significantly vary with the soil and environmental factors. Overall, we conclude that the edaphic properties and/or vegetation types are driving bacterial community composition. MAP was a key factor that affects the composition of the soil bacteria on the Loess Plateau of China.