While conventional hole-drilling methods can only measure uniform residual stresses along a specime′s depth, an incremental hole-drilling method is used to measure non-uniform residual stresses inside a specimen. The calibration constants matrix is calculated using the finite element calibration method, and a practical measurement technology of non-uniform stress is established. An agglutinate 3-D finite element model of a specimen with rosette is built using ANSYS software, and the calibration constants in each layer are calculated with a dividing-layer loading method. The calibration constants matrix is obtained when the hole depth reaches h=0.5 D to completely release residual stresses, and is used to form the five layer non-uniform stresses with the five-step hole-drilling method. Then, the five-step incremental hole drilling method and the calculated calibration constants matrix are used to experimentally measure the non-uniform residual stresses within the Cr12MoV quenching specimens. Comparing these measurements with the results of conventional hole-drilling methods shows that the finite element calibration method can simulate non-uniform residual stresses field inner specimen to calculate the calibration constants matrix. In addition, the five-step incremental hole-drilling results show that the five-layer non-uniform residual stresses can be built up in Cr12MoV quenching specimens.