Based on repeated experiments as well as continuous researching and improving, an efficient scheme to measure velocity and displacement of the coxa and knee movements based on video image processing technique is presented in this paper. The scheme performed precise and real-time quantitative measurements of 2D velocity or displacement of the coxa and knee using a video camera mounted on one side of the healing and training beds. The beds were based on simplified pinhole projection model. In addition, we used a special-designed auxiliary calibration target, composed by 24 circle points uniformly located on two concentric circles and two straight rods which can rotate freely along the concentric center within the vertical plane, to do the measurements. Experiments carried out in our laboratory showed that the proposed scheme could basically satisfy the requirements about precision and processing speed of such kind of system, and would be very suitable to be applied to smart evaluation/training and healing system for muscles/balance function disability as an advanced and intuitional helping method.