The problems of tracking point drift and target losing are prone to occur to the single feature tracking algorithm of infra-red imaging guidance system. A new tracking algorithm based on composite features was proposed. The algorithm utilizes gray feature and point feature of the infrared target image, and overcomes the default of single matching method. The flow and power assign strategy of the algorithm were proposed, by comparing the characters of three tracking algorithms, the validity of the algorithm was proved.