With the utilization of diffusion tensor information of image voxels, a novel MRF (Markov Random Field) segmentation algorithm was proposed for diffusion tensor MRI (DT-MRI) images benefitted from the introduction of Frobenius norm. The comparison of the segmentation effects between the proposed algorithm and K-means segmentation algorithm for DT-MRI image was made, which showed that the new algorithm could segment the DT-MRI images more accurately than the K-means algorithm. Moreover, with the same segmentation algorithm of MRF, better outcomes were achieved in DT-MRI than in conventional MRI (T2WI) image.