The previous studies have found that the health status of the elderly was closely related to self-reported quality of life. But these studies generally used the cross-section data, and also tended to choose the single dimensional index to measure the health status. Using "Chinese Longitudinal Healthy Longevity Survey"(CLHLS) data, from multi dimensions of health including body health, mental health and self-rated health, this paper tested the effect of health changes on the self-reported quality of life of the elderly in China with the fixed effects model. Our study showed that the improvements of body health, mental health and self-rated health among the elderly could improve their levels of quality of life. However, three dimensional indexes exerted different influences. The mental health and self-rated health played a mediating effect between body health and self-reported quality of life.