Summary of the invention
The present invention is directed to existing rehabilitation training system, the healing hand function training system that provides a kind of actual situation to merge, cost is low, and it is little to take up room, and the patient is not had injury.
In order to solve the problems of the technologies described above, the present invention is achieved by the following technical solutions:
The healing hand function training system that a kind of actual situation merges comprises:
Image capture device is used for gathering in real time many viewpoints user hand images, and carries out being sent to background process equipment after the pre-service;
Background process equipment generates virtual scene and shows output, described many viewpoints pretreatment image is carried out three-dimensional modeling generate the hand three-dimensional model, is shown in the virtual scene, and sets up the man-machine interaction feedback mechanism.
Further, described image capture device comprises: at least two be used for from different viewpoint images acquired video camera, be used to support the support of described video camera and the client that connects one to one with video camera, described client receives the image of camera acquisition, and to the image pre-service.
For the ease of regulating the angle of video camera, described support is provided with the The Cloud Terrace with the corresponding one by one flexible connection of described video camera.
Because need to gather the multi-faceted image of user's hand, described video camera preferably adopts 5.
Further again, described background process equipment comprises server and display, described server generates virtual scene, and export display to and show, server receives pretreatment image simultaneously and carries out three-dimensional modeling, and the hand three-dimensional model of setting up is shown in the virtual scene, and sets up the man-machine interaction feedback mechanism.
Wherein, described man-machine interaction feedback mechanism is: server carries out computational analysis to the variation of hand three-dimensional model, and virtual scene is made corresponding change and shown output.
Based on above-mentioned healing hand function training system, the healing hand function training method that the present invention provides a kind of actual situation to merge simultaneously may further comprise the steps:
(1), image capture device is gathered background information, and is stored;
(2), image capture device is gathered many viewpoints user hand images in real time, and is carried out being sent to background process equipment after the pre-service;
(3), background process equipment shows the output virtual scene, and to described many viewpoints pretreatment image Real-time modeling set, the hand three-dimensional model of setting up is shown in the virtual scene;
(4), virtual scene is made corresponding change and is shown output according to the variation of hand three-dimensional model.
Further, described background process equipment comprises server and display, comprises following substep in the step (3):
(31), show initial virtual scene at the display end;
(32), server receives many viewpoints pretreatment image in real time, and sets up the hand three-dimensional model;
(33), the hand three-dimensional model of setting up is shown in the virtual scene.
Further again, the Real-time modeling set method is in the step (3):
(a), initial space is carried out subdivision successively, obtain the voxel visual shell model of hand according to the Octree modeling principle;
(b), utilizing the cube method of advancing that voxel visual shell model surface is carried out gridding handles;
(c), utilize the visual shell model of surface mesh being formatted to carry out texture based on the texture mapping method of viewpoint.
Further again, also comprise the step of the inside and outside parameter of calibrating camera before in step (31).
Compared with prior art, advantage of the present invention and good effect are: the healing hand function training system that actual situation of the present invention merges, by building a virtual training environment, the guiding user action, make it in actual situation is mutual, realize the training of hand motion ability, accelerate healing hand function, and can not increase the weight of the hand burden, accomplished the hand not damaged; Device structure is simple, and it is little to take up room; Cost of manufacture is low; The healing hand function training method that actual situation of the present invention merges, simple to operate; The user also can suitably train under the guidance of no specialist, and the user is not had injury; Adopt the actual situation interactive system of immersion to train in real time, obtain training effect preferably.
After reading the detailed description of embodiment of the present invention in conjunction with the accompanying drawings, other characteristics of the present invention and advantage will become clearer.
Embodiment
Below in conjunction with accompanying drawing the specific embodiment of the present invention is described in further detail.
The present invention might cause mechanical damage to the patient in order to solve the auxiliary patient's rehabilitation training of existing apparatus, and present healing robot apparatus expensive, it is big to take up room, and the problem that practical application has little significance, the healing hand function training system that provides a kind of actual situation to merge, use a plurality of video cameras to gather many viewpoints hand images of user in real time, carry out the hand three-dimensional modeling, generation hand three-dimensional model also is shown in the virtual scene, when actual hand motion, the hand three-dimensional model moves thereupon, and virtual scene is made real-time response, has realized the seamless fusion of actual hand and virtual environment, user's feeling of immersion is good, equipment is simple, and it is little to take up room, and to user's not damaged.
Embodiment one, the healing hand function training system that the actual situation of present embodiment merges, comprise: image capture device and background process equipment, described image capture device is gathered user's hand images in real time, and the hand images of being gathered carried out being sent to background process equipment after the pre-service, described background process equipment receives pretreatment image, utilize dimensional Modeling Technology, described pretreatment image is carried out three-dimensional modeling generate the hand three-dimensional model, and demonstration output virtual scene and hand three-dimensional model, this hand three-dimensional model places virtual scene, with the seamless fusion of virtual scene.Because image capture device is gathered user's hand images and modeling in real time, therefore, when user's hand motion, its three-dimensional model is action thereupon also, background process equipment is by setting up the man-machine interaction feedback mechanism, computational analysis is carried out in variation to the hand three-dimensional model, and virtual scene is made corresponding change and shown output.The healing hand function training system that this actual situation merges is by building a virtual scene, this virtual scene can produce corresponding feedback to the variation of hand, form the rehabilitation training environment of an actual situation fusion, positive guide, the guiding user action, make it in actual situation is mutual, realize the training of hand motion ability, accelerate healing hand function, and can not increase the weight of the hand burden, accomplished the hand not damaged.
As a specific embodiment, referring to shown in Figure 1, described image capture device comprises: video camera 1-1, the support 1-2 and the client 1-3 that are used for images acquired, described video camera 1-1 is arranged on the support 1-2, by support 1-2 support cameras 1-1, because video camera 1-1 must gather hand information from a plurality of visual angles, therefore video camera 1-1 is at least two, in order to obtain the image of many viewpoints, be convenient to behind the three-dimensional modeling truer, and consider the saving cost simultaneously, and reducing operand, described video camera 1-1 preferably adopts 5.The number of described client 1-3 equates with the number of video camera 1-1, and client 1-3 and video camera 1-1 connect one to one, and described client 1-3 receives the image that video camera 1-1 gathers, and image is carried out being sent to background process equipment after the pre-service.The image pre-service comprises denoising, the extraction of hand foreground information etc.
Described background process equipment comprises server 2-1 and display 2-2, described server 2-1 generates virtual scene, and export display 2-2 to and show, server 2-1 receives the pretreatment image that client 1-3 sends simultaneously, because pretreatment image is a multi-view image, therefore server 2-1 can adopt certain modeling method that hand is carried out three-dimensional modeling by analytical calculation, and the hand three-dimensional model of setting up seamlessly is shown in the virtual scene.Because video camera 1-1 gathers user's hand images and in real time by server 2-1 Real-time modeling set, therefore, when user's hand motion, its three-dimensional model is action thereupon also, server 2-1 makes corresponding change with virtual scene, scene that is virtually reality like reality by calculating, realize man-machine interaction, the guiding user better finishes the hand function training in the virtual training environment.Show virtual scene and hand three-dimensional model by display 2-2, the user can observe the hand exercise situation of oneself, can help functional rehabilitation more according to the guiding positive action of the virtual scene that shows.The information transmission of client 1-3 and server 2-1 preferably adopts the LAN transmission to realize, therefore, is provided with the network switch 3 between described client 1-3 and server 2-1.
For the ease of regulating the angle of video camera 1-1, described support 1-2 is provided with the The Cloud Terrace 1-4 with the corresponding one by one flexible connection of described video camera.Those skilled in the art can be known easily: The Cloud Terrace is the installation of specialty, the fastening of fixed cameras, can adjust the supervision angle of video camera flexibly, does not do elaborating at this.
Based on above-mentioned healing hand function training system, the healing hand function training method that present embodiment provides a kind of actual situation to merge simultaneously may further comprise the steps:
S1, image capture device are gathered background information, and storage;
S2, image capture device are gathered many viewpoints hand images of user in real time, and carry out being sent to background process equipment after the pre-service;
S3, background process equipment show the output virtual scene, and to described many viewpoints pretreatment image Real-time modeling set, and the hand three-dimensional model of setting up is shown in the virtual scene;
S4, virtual scene are made corresponding change and are shown output according to the variation of hand three-dimensional model.
Wherein, image capture device is gathered background information, for the ease of in step S2, extracting user's hand images information, at first gather background image, and storage, when user's hand places the space, utilize the background subtraction method very easily the hand foreground information to be extracted, the image pre-service comprises the foreground information extraction of image denoising and hand images etc.
As a specific embodiment, described background process equipment comprises server and display, comprises following substep among the step S3:
S31, show initial virtual scene at the display end;
S32, server receive many viewpoints pretreatment image in real time, and set up the hand three-dimensional model;
S33, the hand three-dimensional model of setting up is shown in the virtual scene.
In step S31, because virtual scene is set up by server end, and when user's hand motion, its three-dimensional model is action thereupon also, server is made corresponding change by computational analysis with virtual scene, and shows output at display, therefore, server at first shows initial virtual scene by display.
Wherein, the Real-time modeling set method is among the step S3:
(a), according to the Octree modeling principle to the space subdivision, obtain the voxel visual shell model of hand;
(b), utilizing the cube method of advancing that voxel visual shell model surface is carried out gridding handles;
(c), utilize the visual shell model of surface mesh being formatted to carry out texture based on the texture mapping method of viewpoint.
Because Octree method fast operation in modeling, present embodiment preferably adopts the Octree modeling principle to carry out modeling, satisfy the real-time requirement of the healing hand function training method of this actual situation fusion, the Octree method is modeled as prior art, does not do elaborating at this.
In order to make the hand three-dimensional model surface smoothing of foundation, precision is higher, and the voxel visual shell model that present embodiment preferably adopts the cube method of advancing that previous step is set up carries out gridding to be handled.
In order to make the hand three-dimensional model have more verisimilitude and feeling of immersion, more near real human body skin, comprise also in the present embodiment that the visual shell model that surface mesh is formatted carries out texture, the texture source is the many viewpoints hand images after the pre-service, make it seem more approaching true, the method of texture is the texture mapping method based on viewpoint, and this method is a prior art, does not elaborate at this.
In addition, because the shooting angle of video camera may be adjusted, some parameters (such as the inside and outside parameter of video camera etc.) can change accordingly, therefore, the step that also comprised the inside and outside parameter of calibrating camera before step S31, this step are arranged between other steps, can processed offline.Camera calibration can be realized in the following ways: with a uniform black and white chessboard grid template as destination object, after video camera fixes, gather the image of the template of diverse location and angle, carry out the extraction and the calculating of angle point with this group image, thereby obtain the model of video camera, i.e. the inside and outside parameter of video camera.
The healing hand function training method that the actual situation of present embodiment merges, simple to operate, the user also can suitably train under the guidance of no specialist, and the user is not had injury, adopt immersion and interactively actual situation to merge scene and train, obtain training effect preferably.
Certainly; this actual situation merges the healing hand function training system and not only is confined to carry out the hand function rehabilitation training; also can be by transforming; be used for other position function rehabilitation trainings of human body; above-mentioned explanation is not to be limitation of the present invention; the present invention also is not limited in above-mentioned giving an example, and variation, remodeling, interpolation or replacement that those skilled in the art are made in essential scope of the present invention also should belong to protection scope of the present invention.