Based on panel data of 1655 counties (cities) during 2006-2010, empirical analysis is conducted on the influential factors for China’s rural banking industry structure, and the results show that rural banking industry structure is significantly affected by financial market scale, economic growth, economic structure, governmental interference extent and investment rate in China’s rural areas, that the deposit and loan market concentration ratio of China’s rural banks can be decreased by the enlargement of rural deposit and loan scale, by rural economic growth and by the increase of the ratio of scaled industrial enterprises in secondary industry in China’s rural areas, however, the deposit and loan market concentration ratio of China’s rural banks can be increased by the increasing of the ratio of county-regional financial expenditure to annual nominal GDP and the ratio of rural fixed asset investment quantity to GDP, thus, on the one hand, China should boost the development of scaled industrial enterprises in rural areas to drive medium-sized and small enterprise development and realize rapid growth of rural economy to promote the enlargement of rural financial market scale, on the other hand, China should reduce excessive interference of local government on rural economy so that the market concentration ratio of China’s rural banks can be effectively decreased.