Fusion image is solved by gradient image fusion via minimizing the distance between the gradient field and fusion gradient field of fusion image，therefore，the accuracy of fusion gradient field directly determines the quality of fusion image.Because there is the complementarity between the information of source images，the accuracy of the structure tensor based gradient field is not high.In order to ensure the quality of fusion image，other perception terms are needed to be added to correct while reconstruction.Thus，this paper advocates an edge map based gradient field fusion method，weighting fusion is processed at edge pixel by the weight of gradient value while maximum modules are fused at nonedge pixel.Experiment result indicates that the accuracy of the gradient field by the gradient field fusion is high and that the reconstructed fusion images have satisfactory visual quality and objective assessment quality.