After the founding of new China，in order to provide capital accumulation for industrialization for giving the priority to heavy industry，Chinese Government sets up dual finance system by collecting agricultural tax，has used urban and rural dual public goods supply system，which lead to that the tax burden of the peasants is heavier than that of urban residents but the public goods enjoyed by the peasants are less than that of urban residents and which accelerate the formation and evolution of urban and rural dual economic structure. In the middle stage of industrialization，Chinese Government in time adjusted economic development strategy，implemented the policy for industry to regurgitate agriculture，canceled agricultural tax in 2006，as a result，urban and rural dual tax system disappeared. By a series of reform of supply system of rural public goods，meanwhile，the supply system of urban and rural dual public goods also disappeared，however，the duality of the financial distribution still exists. The unification of dual finance system does not mean that the consequence of long-term dual financial system can be eliminated at once，but urban and rural income gap，consumption gap and public service gap will still exist for a long time. In order to accelerate urban and rural integration，governments should enlarge the financial support to “Three-agriculture”and raise urban and rural dual financial expenditure rate.