Realization of agricultural output growth will depend on agricultural investment and improvement of agricultural total factor productivity. Scarcity of agricultural production resources determines that the continuous growth of agricultural output can only rely on total factor productivity. Using the method of data envelopment analysis parameters, this paper estimates the total factor productivity in grain-producing provinces of China and employs Malmquist index method to further divide total factor productivity into scale efficiency, pure technical efficiency and technological progress. The result shows that from 2000 to 2009, changes of TFP in grain-producing provinces are not stable, technology in grain-producing provinces shows the progressive tendency, but there is a big difference in their technical efficiency and the reasons causing such changes are also different.