We developed a rehabilitation system by using the virtual reality technique and the Kinect in this paper. The system combines rehabilitation training with HMI and serious game organically, and provides a game and motion database to meet different patients' demands. Extended interface of game database is provided in two ways: personalized games can be developed by Virtools and Flash games which are suitable for patients' rehabilitation can be download from the Internet directly. In addition, the system provides patients with flexible interaction and easy control mode, and also presents real time data recording. An objective and subjective evaluation method is proposed to review the effectiveness of the rehabilitation training. According to the results of short questionnaires and the evaluation results of patients' rehabilitation training, the system compared with traditional rehabilitation can record and analyze the training data, which is useful to make rehabilitation plans. More entertainment and lower cost will increase patients' motivation, which helps to increase the rehabilitation effectiveness.
In this paper, the research has been conducted by the Microsoft kinect for windows v2 for obtaining the walking trajectory data from hemiplegic patients, based on which we achieved automatic identification of the hemiplegic gait and sorted the significance of identified features. First of all, the experimental group and two control groups were set up in the study. The three groups of subjects respectively completed the prescribed standard movements according to the requirements. The walking track data of the subjects were obtained straightaway by Kinect, from which the gait identification features were extracted: the moving range of pace, stride and center of mass (up and down/left and right). Then, the bayesian classification algorithm was utilized to classify the sample set of these features so as to automatically recognize the hemiplegia gait. Finally, the random forest algorithm was used to identify the significance of each feature, providing references for the diagnose of disease by ranking the importance of each feature. This thesis states that the accuracy of classification approach based on bayesian algorithm reaches 96%; the sequence of significance based on the random forest algorithm is step speed, stride, left-right moving distance of the center of mass, and up-down moving distance of the center of mass. The combination of step speed and stride, and the combination of step speed and center of mass moving distance are important reference for analyzing and diagnosing of the hemiplegia gait. The results may provide creative mind and new references for the intelligent diagnosis of hemiplegia gait.
Gesture imitation is a common rehabilitation strategy in limb rehabilitation training. In traditional rehabilitation training, patients need to complete training actions under the guidance of rehabilitation physicians. However, due to the limited resources of the hospital, it cannot meet the training and guidance needs of all patients. In this paper, we proposed a following control method based on Kinect and NAO robot for the gesture imitation task in rehabilitation training. The method realized the joint angles mapping from Kinect coordination to NAO robot coordination through inverse kinematics algorithm. Aiming at the deflection angle estimation problem of the elbow joint, a virtual space plane was constructed and realized the accurate estimation of deflection angle. Finally, a comparative experiment for deflection angle of the elbow joint angle was conducted. The experimental results showed that the root mean square error of the angle estimation value of this method in right elbow transverse deflection and vertical deflection directions was 2.734° and 2.159°, respectively. It demonstrates that the method can follow the human movement in real time and stably using the NAO robot to show the rehabilitation training program for patients.
The gait acquisition system can be used for gait analysis. The traditional wearable gait acquisition system will lead to large errors in gait parameters due to different wearing positions of sensors. The gait acquisition system based on marker method is expensive and needs to be used by combining with the force measurement system under the guidance of rehabilitation doctors. Due to the complex operation, it is inconvenient for clinical application. In this paper, a gait signal acquisition system that combines foot pressure detection and Azure Kinect system is designed. Fifteen subjects are organized to participate in gait test, and relevant data are collected. The calculation method of gait spatiotemporal parameters and joint angle parameters is proposed, and the consistency analysis and error analysis of the gait parameters of proposed system and camera marking method are carried out. The results show that the parameters obtained by the two systems have good consistency (Pearson correlation coefficient r ≥ 0.9, P < 0.05) and have small error (root mean square error of gait parameters is less than 0.1, root mean square error of joint angle parameters is less than 6). In conclusion, the gait acquisition system and its parameter extraction method proposed in this paper can provide reliable data acquisition results as a theoretical basis for gait feature analysis in clinical medicine.