The relationship between the Party and the masses is a basic issue to determine the existence of a ruling party and is also important basis for constructing socialist harmonious society. Currently, China’s relationship between the Party and the masses is good as a whole and is harmonious in main aspect but some inharmonious factors emerge, which make the relationship face challenge. Thus, on the basis Of carefully analyzing harmonious factors affecting the relationship, Chinese Communist Party is required to construct harmonious relationship between the Party and the masses from the perspective of economy, politics, mechanism and working style.