There is high risk of potential safety hazard for traditional system management mode of datacenter, and VPN is a kind of security technology based on open internet and suitable for system management. By the analysis of traditional datacenter management system, this paper puts forward system management based on VPN technology and designs the rolebased security policy, which solves the security problems of the traditional management mode. The system management mode is verified secure by the deployment and implementation of Chongqing Technology and Business University datacenter.