CN106650217A - Information processing apparatus and information processing method - Google Patents

Information processing apparatus and information processing method Download PDF

Info

Publication number
CN106650217A
CN106650217A CN201610908922.1A CN201610908922A CN106650217A CN 106650217 A CN106650217 A CN 106650217A CN 201610908922 A CN201610908922 A CN 201610908922A CN 106650217 A CN106650217 A CN 106650217A
Authority
CN
China
Prior art keywords
information
subject
bone
coordinate
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610908922.1A
Other languages
Chinese (zh)
Other versions
CN106650217B (en
Inventor
菅田裕纪
野崎晃
田中泰洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Marketing Japan Inc
Canon IT Solutions Inc
Original Assignee
Canon Marketing Japan Inc
Canon IT Solutions Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2015213489A external-priority patent/JP2017080199A/en
Priority claimed from JP2015213490A external-priority patent/JP6803111B2/en
Priority claimed from JP2015213491A external-priority patent/JP2017084194A/en
Priority claimed from JP2015213496A external-priority patent/JP2017080203A/en
Priority claimed from JP2015213492A external-priority patent/JP2017080201A/en
Application filed by Canon Marketing Japan Inc, Canon IT Solutions Inc filed Critical Canon Marketing Japan Inc
Priority to CN201910679377.7A priority Critical patent/CN110391017A/en
Publication of CN106650217A publication Critical patent/CN106650217A/en
Application granted granted Critical
Publication of CN106650217B publication Critical patent/CN106650217B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G06F3/04855—Interaction with scrollbars
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment

Abstract

The present invention relates to an information processing apparatus and an information processing method. The coordinate processing apparatus comprises a comparison animation selecting unit used for selecting animations subjected to comparison; a coordinate obtaining unit used for obtaining coordinate information of a joint of a subject; a skeletal information generation unit generating the skeletal information based on the coordinate information acquired by the coordinate acquisition unit, and the coordinate information is obtained by the coordinate acquisition unit, and a display unit configured to compare the skeletal information of the subject with the object corresponding to the item related to the animation received by the comparison animation selection receiving unit, and to compare the skeletal information of the subject Bone information is displayed side by side.

Description

Information processor and information processing method
Technical field
The present invention relates to information processor and information processing method.
Background technology
In recent years, using digitally recorder, object movable movement capturing technology to be nursed, in rehabilitation training Effect measuring.
One of mode as movement capturing technology, there is in the following manner：By to subject's additional marking and from multiple Orientation is photographed using camera, and detection mark simultaneously records the active transition of subject for numerical data.In addition, also There is in the following manner：Do not use mark and the distance from sensor to subject is determined using infrared ray sensor, according to survey The value made, records the activity of subject.
In patent document 1, the mechanism of the movement capturing technology used in the scene of rehabilitation training is disclosed.
Patent document 1：Japanese Unexamined Patent Publication 2015-61577 publications
The content of the invention
In patent document 1, following mechanism is described：According to each pass of the subject obtained using movement capturing technology The coordinate information of section generates bone information and bone information is shown in into picture, so as to show the action of subject.
Patent document 1 record mechanism in, wish to it is past oneself action, other people action with this move In the case of being compared, need to confirm each image, animation one by one.But, in this place in reason method, it is difficult to slap in detail Hold difference.
In addition, for example, in the case of background difference, due to the difference of background, it is difficult to grasp subject's in detail The difference of action.
In addition, in order to grasp difference in detail, needs are meticulously adjusted to the size of the people for becoming comparison other, position Match.But, the adjustment operation is the operation of very time consuming labour.
Therefore, it is an object of the invention to provide one kind is easily mastered and compares when compared with other images, animation The mechanism of the difference of object.
In addition, it is an object of the invention to provide a kind of size for mitigating the people for becoming comparison other, the adjustment of position are made The mechanism of the time labour of industry.
The present invention relates to a kind of information processor, it is characterised in that possess：Relatively animation selects to accept unit, accepts The selection of the animation being compared；Coordinate acquisition unit, obtains the coordinate information in the joint of subject；Bone information generates single Unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone information of subject；And display unit, By and to by it is described compare animation and select to accept unit accepted the layout that the related project of animation for selecting is mapped, general The bone information of the subject is displayed side by side with the bone information for becoming comparison other.
The invention further relates to a kind of information processor, it is characterised in that possess：Coordinate acquisition unit, acquirement is tested The coordinate information in the joint of person；Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates The bone information of subject；Layout determining means, according to the direction of action of the subject layout is determined；And show Unit, by the layout determined by the layout determining means, by the bone information of the subject and becomes comparison other Bone information be displayed side by side.
The invention further relates to a kind of information processor, it is characterised in that possess：Coordinate acquisition unit, acquirement is tested The coordinate information in the joint of person；Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates The bone information of subject；Display unit, by the bone information of the subject and the bone information for becoming comparison other It is displayed side by side；And reversion instruction accepts unit, accepting makes the bone information of the subject or becomes comparison other The left and right reversion of bone information and the instruction that shown, the display unit makes to accept unit by the reversion instruction and accepts The left and right of the bone information of the instruction for inverting left and right and being shown inverts and is shown.
The invention further relates to a kind of information processor, it is characterised in that possess：Coordinate acquisition unit, acquirement is tested The coordinate information in the joint of person；Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates The bone information of subject；Display unit, by the bone information of the subject and the bone information for becoming comparison other Overlap and show；Position adjustment indicates to accept unit, accepts and adjusts the bone information of the subject and become comparison other The instruction of the position of bone information；And position adjustment unit, indicating that accepting unit has accepted position adjustment by position adjustment Instruction in the case of, by making some joint coordinates of the subject and corresponding with the joint coordinates becoming described The related joint coordinates of the bone information of comparison other are unanimously carrying out position adjustment.
The invention further relates to a kind of information processor, it is characterised in that possess：Coordinate acquisition unit, acquirement is tested The coordinate information in the joint of person；Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates The bone information of subject；Display unit, by the bone information of the subject and the bone information for becoming comparison other Overlap and show；Size adjusting indicates to accept unit, accepts and adjusts the bone information of the subject and become comparison other The instruction of the size of bone information；And size adjusting unit, indicating that accepting unit has accepted size adjusting by size adjusting Instruction in the case of, by making some interarticular distance of the subject and interarticular apart from corresponding with this Become the related interarticular distance of bone information of the comparison other unanimously to carry out size adjusting.
The invention further relates to a kind of information processor, it is characterised in that possess：Coordinate acquisition unit, acquirement is tested The coordinate information in the joint of person；Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates The bone information of subject；Display unit, by the bone information of the subject and the bone information for becoming comparison other It is displayed side by side；Setting accepts unit, in the picture shown by the display unit, accepts the setting of display format；And deposit Storage unit, stores and accepts the setting content that unit has accepted by the setting.
The invention further relates to a kind of information processor, it is characterised in that possess：Coordinate acquisition unit, acquirement is tested The coordinate information in the joint of person；Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates The bone information of subject；Display unit, by the bone information of the subject and the bone information for becoming comparison other It is displayed side by side；Whether selection accepts unit, in the picture shown in the display unit, accept for showing including being tested The selection of the background video of person；And determining means, the content that unit has accepted selection is accepted according to by the selection, decision is It is no to show the background video for including subject.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Compare animation Selection accepts operation, and the comparison animation of described information processing meanss selects to accept the selection that unit accepts the animation being compared； Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone Information generation process, the bone information signal generating unit of described information processing meanss is according to acquirement in obtaining operation in the coordinate Coordinate information, generates the bone information of subject；And show operation, the display unit of described information processing meanss by and To by it is described compare animation and select to accept operation accepted the layout that the related project of animation for selecting is mapped, will be described The bone information of subject is displayed side by side with the bone information for becoming comparison other.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Coordinate is obtained Operation, the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone information is generated Operation, the bone information signal generating unit of described information processing meanss is according to the coordinate letter obtained in obtaining operation in the coordinate Breath, generates the bone information of subject；Layout determines operation, and the layout determining means of described information processing meanss is according to described The direction of action of subject is determining layout；And operation is shown, the display unit of described information processing meanss is by institute The layout that layout determines to be determined in operation is stated, by the bone information of the subject and the bone information for becoming comparison other simultaneously Row shows.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Coordinate is obtained Operation, the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone information is generated Operation, the bone information signal generating unit of described information processing meanss is according to the coordinate letter obtained in obtaining operation in the coordinate Breath, generates the bone information of subject；Operation is shown, the display unit of described information processing meanss is by the subject's Bone information is displayed side by side with the bone information for becoming comparison other；And reversion instruction accepts operation, described information process dress The reversion put indicates to accept unit and accepts the bone information for making the subject or the bone information that becomes comparison other The instruction that left and right inverts and shown, in the display operation, making to have been accepted in the reversion instruction accepts operation makes The left and right of the bone information of the instruction that left and right inverts and shown inverts and is shown.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Coordinate is obtained Operation, the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone information is generated Operation, the bone information signal generating unit of described information processing meanss is according to the coordinate letter obtained in obtaining operation in the coordinate Breath, generates the bone information of subject；Operation is shown, the display unit of described information processing meanss is by the subject's Bone information is overlapped with the bone information for becoming comparison other and shown；Position adjustment indicates to accept operation, described information process dress The position adjustment put indicates that accepting unit accepts the bone information for adjusting the subject and the bone letter for becoming comparison other The instruction of the position of breath；And position adjustment operation, the position adjustment unit of described information processing meanss is by position adjustment Instruction accept the instruction that operation has accepted position adjustment in the case of, by make the subject some joint coordinates and The related joint coordinates of the bone information for becoming the comparison other corresponding to the joint coordinates are unanimously carrying out position tune It is whole.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Coordinate is obtained Operation, the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone information is generated Operation, the bone information signal generating unit obtains the coordinate information that operation is obtained according to by the coordinate, generates subject Bone information；Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes The bone information of comparison other is overlapped and shown；Size adjusting indicates to accept operation, and the size adjusting of described information processing meanss refers to Show the instruction for accepting the size that unit accepts the bone information for adjusting the subject and the bone information for becoming comparison other； And size adjusting operation, accept in the size adjusting unit of described information processing meanss accepts operation in size adjusting instruction In the case of the instruction of size adjusting, by making some interarticular distance of the subject and interarticular with this Apart from the related interarticular distance of the corresponding bone information for becoming the comparison other unanimously carrying out size adjusting.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Coordinate is obtained Operation, the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone information is generated Operation, the bone information signal generating unit obtains the coordinate information that operation is obtained according to by the coordinate, generates subject Bone information；Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes The bone information of comparison other is displayed side by side；Setting accepts operation, and the setting of described information processing meanss accepts unit described In showing the picture shown in operation, the setting of display format is accepted；And storage operation, the storage of described information processing meanss Unit is stored in the setting and accepts the setting content accepted in operation.
The invention further relates to the information processing method in a kind of information processor, it is characterised in that possess：Coordinate is obtained Operation, the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；Bone information is generated Operation, the bone information signal generating unit obtains the coordinate information that operation is obtained according to by the coordinate, generates subject Bone information；Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes The bone information of comparison other is displayed side by side；Selection accepts operation, and the selection of described information processing meanss accepts unit described In showing the picture shown in operation, accept and be directed to the selection for whether showing the background video including subject；And determine Operation, the determining means of described information processing meanss accepts the content that operation has accepted selection according to by the selection, determines Whether display includes the background video of subject.
In accordance with the invention it is possible to when compared with other images, animation, be easily mastered the difference with comparison other.
In addition, according to the present invention, mitigation becomes the size of the people of comparison other, the time labour of the adjustment operation of position.
Description of the drawings
Fig. 1 is the figure of the functional structure for illustrating information processor 101.
Fig. 2 is the figure of the hardware configuration for illustrating information processor 101.
Fig. 3 is the flow chart for illustrating the process being measured while photographing to subject.
Fig. 4 is to be shown with the flow chart that the measure of the projects in the case of pre-recorded movable information is processed.
Fig. 5 is to illustrate that report makes the flow chart for processing.
Fig. 6 is the figure of an example for illustrating subject's list.
Fig. 7 is the figure of an example of the coordinate information for illustrating each joint.
Fig. 8 is the figure of the situation for illustrating the subject obtained by movable information obtaining section 151.
Fig. 9 is the figure of an example of the bone information for illustrating the subject formed according to the coordinate information in each joint.
Figure 10 is to illustrate to accept the quilt shown in the display 212 of information processor 101 from user in the present invention The figure of one example of the picture of the selection of experimenter.
Figure 11 is illustrated in the present invention when the selection of the project for having accepted " usual walking " from user in step S301 In the case of information processor 101 CPU201 perform process an example figure.
Figure 12 is illustrated in the present invention when the selection of the project for having accepted " usual walking " from user in step S301 In the case of in the display 212 of information processor 101 show picture an example figure.
Figure 13 is illustrated in the present invention when the project for having accepted " eye opening stands on one leg " from user in step S301 The figure of an example of the process that the CPU201 of information processor 101 is performed in the case of selection.
Figure 14 is illustrated in the present invention when information processor 101 in step s 302 has started the photography of subject When in the display 212 of information processor 101 show picture an example figure.
Figure 15 is the CPU201 extraction and determination results for illustrating the information processor 101 in step S502 in the present invention The figure of the example for processing.
Figure 16 is that the CPU201 for illustrating the information processor 101 in step S503 in the present invention makes the process of report An example figure.
Figure 17 is to illustrate to show in the display 212 of information processor 101 when measurement result is extracted in the present invention The figure of one example of the picture for showing.
Figure 18 is illustrated in the present invention after measurement result is extracted in the display 212 of information processor 101 The figure of one example of the picture of display.
Figure 19 is to illustrate the survey for storing measurement result in the storage device 204 of information processor 101 in the present invention Determine the figure of an example of results management form.
Figure 20 is to illustrate to be made and exported printing equipment etc. by the CPU201 of information processor 101 in the present invention The figure of one example of report.
Figure 21 is the one of the picture for having synthesized the image and bone information photographed and obtain in movable information obtaining section 151 Individual example.
Figure 22 is an example of the picture of the area that have adjusted the region for showing bone information.
Figure 23 is an example of the picture for being longitudinally displayed side by side the animation of the animation of evaluation object and comparison other.
Figure 24 is an example of the picture for laterally side by side showing the animation of the animation of evaluation object and comparison other.
Figure 25 is the figure of an example for being shown for the form that each project registers layout.
Figure 26 is the figure in the case that the left and right of the animation for illustrating the top made in the picture of Figure 23 has inverted.
Figure 27 is an example of the picture for showing the animation overlap of comparison other.
Figure 28 be not display background etc. and only show an example of the picture of bone information.
Figure 29 is to illustrate the action for evaluating subject and show for subject, the flow process of the process of the message of assistant Figure.
Figure 30 is the figure of an example for illustrating appreciation condition.
Figure 31 is the figure of an example for illustrating message form.
(symbol description)
101：Information processor.
Specific embodiment
Hereinafter, referring to the drawings, embodiments of the present invention are described in detail.
Fig. 1 is the figure of the functional structure for illustrating information processor 101.
The detection of movable information obtaining section 151 is nursed, the people in the space of rehabilitation training (in the present invention, is tested Person (receive nursing, the personnel of rehabilitation training)) activity, obtain the movable information of subject.
Specifically, movable information obtaining section 151 is known sensor group as Kinect (registration mark), built-in RGB camera, depth transducer, sound transducer etc., are capable of identify that (in the present invention, subject (receives shield to subject Reason, the personnel of rehabilitation training)) position, activity, sound, face etc..
Depth transducer be set to using determined using infrared ray until subject distance by the way of sensor.Root According to which, without the need for the distance from sensor to subject can be determined to subject's additional marking etc..
Store each data obtained by movable information obtaining section 151 as animation data to storage part 165.
The movable information obtained by each sensor of movable information obtaining section 151 is sent to into movable information analysis unit 152, Carry out data parsing.
In movable information analysis unit 152, each data obtained by movable information obtaining section 151 are parsed, by subject Action be transformed to coordinate information.
Fig. 8 shows the situation of the subject obtained by movable information obtaining section 151.Movable information obtaining section 151 is led to The activity of detection subject is crossed, is matched with the human body pattern for prestoring, obtain the seat of the human body surface of subject Mark.Then, the coordinate in each joint of the bone for forming the subject is calculated, according to the coordinate information for calculating, is generated by reality The bone information of the person of testing.
Fig. 7 illustrates an example of the coordinate information in each joint.In addition, Fig. 9 illustrates the coordinate information shape according to each joint Into subject bone information an example.
By so calculating the coordinate information in each joint, and the change of the coordinate in each joint is detected, be capable of identify that and tested Person by pin lift or knee sprung action.
Determination part 153 according to the movable information parsed by movable information analysis unit 152 and setting corresponding with projects, Carry out the measure in the project.
Relatively animation selects receiving unit 154 to accept to right as the animation of the storage in storage part 165, hope and measure The selection of the animation that the animation of elephant compares.
Coordinate obtaining section 155 obtains the coordinate in the joint of subject by obtained from movable information analysis unit 152 is converted Information.
Bone information generating unit 156 generates the bone of subject according to the coordinate information obtained by coordinate obtaining section 155 Information.
Display part 157 according to the layout being mapped with each measure project, the layout determined by layout determination section 158, and Row shows the bone information of subject and the bone information of comparison other.In addition, by the bone information of subject and comparing The bone information of object is overlapped and shown.
Layout determination section 158 determines the layout of the animation data of display bone information according to the direction of action of subject. Specifically, determine that the animation data of the animation data of subject and comparison other is arranged above and below or the cloth such as left-right situs Office.
Reversion indicates that receiving unit 159 accepts the bone information for making subject or the bone information that becomes comparison other The instruction that left and right inverts and shown.In the case where reversion instruction has been accepted, display unit 157 makes to have accepted reversion instruction Bone information left and right reversion and shown.
Position adjustment indicates that receiving unit 160 accepts the bone information of adjustment subject and becomes the bone letter of comparison other The instruction of the position of breath.
In position adjustment portion 161, when indicating that receiving unit 160 has accepted position adjustment instruction by position adjustment, pass through Sit some joint coordinates of subject and the joint of the bone information for becoming comparison other corresponding with the joint coordinates Target position consistency, carries out the position adjustment of the bone information of subject and the bone information of comparison other.
Size adjusting indicates that receiving unit 162 accepts the bone information of the bone information and comparison other for adjusting subject The instruction of size.
Size adjusting portion 163 by size adjusting indicate receiving unit 162 accepted instruction in the case of, by making to be tested The interarticular distance of some of person and the interarticular distance one with the interarticular bone apart from corresponding comparison other Cause to adjust size.In addition, having accepted the finger for increasing the size of bone information in receiving unit 162 is indicated in size adjusting In the case of showing, making the instruction that the size of bone information reduces, by according to the instruction make bone information increase or reduce come Adjustment size.
In the picture of the bone information that setting receiving unit 164 accepts the bone information and comparison other that show subject The setting of various set informations (comparing the set informations such as combination, layout, position, the size of animation).
Then, by set information Store to storage part 165.
Select receiving unit 166 in display picture, accepting shows background video or non-display selection.
Determination section 167 decides whether display background image according to the content accepted by selection receiving unit 166.
Fig. 2 is the block diagram of an example of the hardware configuration of the information processor 101 for illustrating embodiments of the present invention.
As shown in Fig. 2 in information processor 101, via system bus 200, connecting CPU (Central Processing Unit, CPU) 201, ROM (Read Only Memory, read-only storages) 202, RAM (Random Access Memory, random access memory) 203, storage device 204, the input control of input controller 205, sound Device processed 206, Video Controller 207, Memory Controller 208 and communication I/F controllers 209.
CPU201 pair of each equipment being connected with system bus 200, controller are generally controlled.
ROM202 or storage device 204 keep BIOS (the Basic Input/ of the control program performed as CPU201 Output System, basic input output system), OS (Operating System, operating system), for realizing this information The program of the embodied on computer readable of processing method and required various data (including data form).
The functions such as main storage, workspace of the RAM203 as CPU201.CPU201 when performing and processing by inciting somebody to action Required program etc. is loaded into RAM203 from ROM202 or storage device 204, and performs loaded program, each so as to realize Plant action.
Input controller 205 controls the input from the grade input unit of keyboard/touch panel 210.Input unit is not limited to This, or mouse, multi-touch screen etc. can detect the touch panel of the position touched with multiple fingers.
Be aligned in by user show in touch panel icon, cursor, button and press (touched with finger etc.), energy Enough carry out various instructions.
Using the input unit, it is input into for the destination of the available communications destination in various communicators.
Sound input controller 206 controls the input from microphone 211.Can be to the sound that is input into from microphone 211 Carry out voice recognition.
Video Controller 207 controls the display to the grade external output devices of display 212.Display is set to also include and master The display of the subnotebook PC that body is integrally formed.Additionally, external output devices are not limited to display, or example Such as projecting apparatus.In addition, with regard to the device that can be accepted by above-mentioned touch operation, additionally it is possible to accept from keyboard/touch The input of panel 210.
Additionally, Video Controller 207 can control the VRAM (VRAM) for carrying out display control, as video Memory area, can either utilize a part of RAM203, it is also possible to arrange special VRAM in addition.
In the present invention, have：1st VRAM region, in the case of user's operation information processing meanss Show；And the 2nd VRAM region, it is used for and the 1st VRAM region in the case where predetermined picture is shown Display content is overlapped and shown.VRAM region is not limited to 2, as long as the resource of information processor can allow, can be with With multiple.
Memory Controller 208 controls the access to external memory storage 213.As external memory storage, can be using storage The external memory of bootstrap, various applications, character font data, user file, editing files and various data etc. is (hard Disk), floppy disk (FD) or be connected to the compact flash memory (CompactFlash of pcmcia card groove via adapter；Registration mark) deposit Reservoir etc..
It is attached with external equipment/communicates via communication I/F controllers 209, network 214, performs network logical Letter control process.For example, the communication using TCP/IP, the 3G lines of expect someone's call using ISDN circuit and mobile phone can be carried out The communication on road.
Additionally, storage device 204 is the medium for being persistently stored information, its mode is not limited to the storage dress such as hard disk Put.For example, it is also possible to be the media such as SSD (Solid State Drive, solid-state drive).
In addition it is possible to interim storage when being used as the various process carried out in communication terminal in the present embodiment Device region.
Next, using the flow chart shown in Fig. 3, illustrating the place being measured while photographing to subject Reason.Additionally, the process shown in the flow chart of Fig. 3 is the CPU201 of information processor 101 reads and performs predetermined program Process.
In step S301, the selection of subject and the selection of project are accepted from user.
Subject's information is registered in the subject's list shown in Fig. 6.In addition, as project, having measurement to open eyes single " eye opening stands on one leg " of feet station vertical time, measurement can carry out in limiting time several times " the chair sitting " of sitting action, Measurement full stride " a maximum step ", measurement 5m distance walking needed for time " usual walking ", measurement until from Chair stands and comes and goes the distance of 3m and sit on " TUG (TimedUp＆Go) " of the time of chair etc..
By the selection for accepting project, enactment document, the program needed for the measure of the project is read in.
With regard to subject's information, not only can from already registered with information in select, it is also possible to newly register.
In step s 302, accept photography from user to indicate.When photography instruction has been accepted, information processor 101 Movable information obtaining section 151 starts to photograph subject.That is, the image for including subject is obtained.In addition, obtaining by each Information (coordinate information in each joint of subject etc.) the i.e. movable information that sensor is obtained.
In step S303, in the case of having many individuals in the image that photography is obtained, accept is with regard to which individual The selection of subject.
Hereinafter, using Figure 10, the process of step S303 is described in detail.
Figure 10 be in step S303 information processor 101 accept with regard to which individual from user be subject choosing The picture selected, the picture of Figure 10 is shown in the display 212 of information processor 101.
In the 1003 of Figure 10, the animation of the acquirement of movable information obtaining section 151 of display information processor 101.
In the 1001 of Figure 10, together with the bone information determined with the coordinate information by each joint, show by motion letter The situation of the people (subject or assistant) that breath obtaining section 151 is obtained.
First, when the mouse pointer 1004 by being implemented by user operation and during by servant's switching push button 1005, root According to the information obtained by movable information obtaining section 151, the bone information of subject is shown in into 1001.
Next, the operation of the mouse pointer 1004 by being implemented by user, it is intended that be shown in the 1001 of Figure 10 people In subject.
Then, from drop-down list 1002, by the mouse pointer 1004 by user operation, for being indicated by mouse The people that device 1004 is selected is who is selected.
In drop-down list 1002, include in subject's list (Fig. 6) of the management of advance display information processor 101 Subject name.
In step s 304, the coordinate in each joint of subject is obtained from the movable information for obtaining in step s 302 Information.In the case of using regeneration animation, using the movable information included in the animation data of regeneration object, obtain by reality The coordinate information in each joint of the person of testing.In addition, according to coordinate information, generating the bone information of subject.
Fig. 7 illustrates an example of the coordinate information in each joint.
In step S305, synthesize in step S303 obtain image and according to each joint for obtaining in step s 304 Coordinate information obtained from bone information, and be shown in display 212.
Figure 21 illustrates the picture for having synthesized the image and bone information photographed and obtain in the movable information obtaining section 151 One example.
In the 2101 of Figure 21, with the status display image and bone information of synthesis.In addition, in 2102, show from upper Bone information in the case of side's observation subject, in 2103, shows the bone observed from the side in the case of subject Bone information.
According to the coordinate information in each joint obtained in movable information obtaining section 151, calculate and generate 2102,2103 Region in show bone information.
2102nd, the area of 2103 viewing area is adjusted to that the area of bone information can be shown.For example, shown in Figure 21 Picture be it is unadjusted in the case of picture.In this case, although the bone information for being shown in 2103 is hardly moved, still Big blank is produced around bone information.
Figure 22 is an example for having carried out the picture in the case of the adjustment of size.In the way of bone information to be received It is adjusted, blank parts reduce.
Useless blank is not shown by so controlling into, can 3 bone informations be concentrated nearer, so being easier Observation.
With regard to the determining method of indication range, for example consider the rectangle for determining storage bone information and from the rectangle by The method that predetermined width is shown as blank.
In step S306, using the bone information for having parsed in step s 304, carry out being selected with step S301 The corresponding measure of project for going out.
Using Figure 11, Figure 13, Figure 29, the content of specific process is illustrated.
Next, using Figure 11, illustrating in the present invention, the item of " usual walking " is accepted from user in step S301 In the case that purpose is selected, the process of the CPU201 execution of information processor 101.
Additionally, in the process of Figure 11, the picture shown in the display 212 of information processor 101 is for example to scheme 12。
Here, explanation Figure 12.
The measurement of Figure 12 starts (end) coordinate 1201 and represents the measurement for starting or terminating usual walking set in advance (x, y, z) coordinate.The x coordinate the 1st time for starting (end) coordinate 1201 with measurement in the x coordinate of the tiptoe of subject is Chong Die Timing, start number of seconds counting.Then, starting the 2nd Chong Die timing of x coordinate of (end) coordinate 1201 with measurement, Terminate the counting of number of seconds.
For example, in the case where subject comes up from the left of the picture of Figure 12, the measurement on the left of the picture of Figure 12 Start the x coordinate of (end) coordinate 1201 time point Chong Die with the x coordinate of the tiptoe of subject, start the counting of number of seconds. Then, the measurement on the right side of the picture of Figure 12 starts the x coordinate weight of the x coordinate of (end) coordinate 1201 and the tiptoe of subject Folded time point, terminates the counting of number of seconds.
In terms of the characteristic of movable information obtaining section 151, in the model from the left and right two ends of camera coverage to predetermined distance In enclosing, the determination precision of the coordinate in joint is low.Therefore, measurement starts (ends) coordinate 1201 and is set to and the picture of a Figure 12 left side Compare the position (coordinate) for vacating a little distance in right two ends.
The 1202 expression timelines of Figure 12, timeline 1202 shows in the case where the photographed data that video recording is obtained is evaluated.
The 1203 of Figure 12 are evaluation time specifying parts.User makes evaluation time specifying part by using the operation of mouse etc. 1203 movements, arbitrarily can specify the time to be evaluated.Evaluate video recording obtain photographed data when, wish with measurement Start to be used in the case of the action of evaluation subject in intervals different between (end) coordinate 1201.
Return to the explanation of Figure 11.
In step S1101, information processor 101 determines from the image of frame for becoming currently processed object is tested The coordinate of the tiptoe of person.
In step S1102, can information processor 101 judges in step S1101 from becoming currently processed object Frame image in determine subject tiptoe coordinate.If can determine, process is set to be transferred to step S1103, If not can determine that, terminate present treatment.
The reasons why illustrating the process of execution step S1102.Movable information obtaining section 151 will just facing to fortune with subject Premised on dynamic information acquiring section 151, the position coordinates in each joint of subject is determined.Therefore, in the quilt as usual walking In the case that experimenter is by side orientation movements information acquiring section 151, it is difficult to by S304, step S305 the step of Fig. 3, obtain The coordinate information in each joint of subject.If step cannot do not performed in the case where the coordinate information in each joint is obtained Rapid S1103 later process, so the process for passing through step S1102, can judgement the later process of execution step S1103.
In step S1103, information processor 101 judges the tiptoe of the subject determined in step S1101 Coordinate be whether the outside that 2 measurements set in advance start (end) coordinate 1201 coordinate.
When the coordinate of the tiptoe of the subject determined in step S1101 is that 2 measurements set in advance start (knot Beam) coordinate 1201 outside coordinate in the case of, information processor 101 terminate present treatment.When the determination in step S1101 The coordinate of the tiptoe of the subject for going out be 2 measurements set in advance start (end) coordinate 1201 in addition to outside In the case of the coordinate of (that is, on coordinate or inner side), information processor 101 makes process be transferred to step S1104.
In step S1104, information processor 101 judges the tiptoe of the subject determined in step S1101 Coordinate whether be that 2 measurements set in advance start on some coordinate in (end) coordinate 1201.
When the coordinate of the tiptoe of the subject determined in step S1101 is that 2 measurements set in advance start (knot Beam) on some coordinate in coordinate 1201 in the case of, information processor 101 makes process be transferred to step S1105.When The coordinate of the tiptoe of the subject determined in step S1101 is not that 2 measurements set in advance start (end) coordinate In the case of on 1201 any one coordinate, information processor 101 is judged as that what is determined in step S1101 is tested Coordinate 2 measurements set in advance of the tiptoe of person start between (end) coordinate 1201 (inner side).Then, shift process To step S1109.
In step S1105, information processor 101 judges to be judged in step S1104 to be 2 surveys set in advance Whether it is the 1st time that amount starts on some coordinate in (end) coordinate 1201.
When be judged in step S1104 be 2 measurements set in advance start in (end) coordinate 1201 some For in the case of the 1st time, information processor 101 makes process be transferred to step S1106 on coordinate.It is being judged to not be the 1st time In the case of (i.e. the 2nd time), information processor 101 makes process be transferred to step S1107.
In step S1106, information processor 101 performs the counting of number of seconds, terminates present treatment.
In step S1107, information processor 101 terminates the counting of the number of seconds performed in step S1106.So Afterwards, in step S1108, the evaluation of the action of subject is performed, and is stored to measurement result management table (Figure 19).
If further illustrating the process of step S1108, information processor 101 is first by measuring starting point The distance of the X-direction between (X1, Y1, Z1) and measurement end point (X2, Y2, Z2) is the absolute value (unit is rice) of X1-X2, Obtain walking distance.
With regard to measurement starting point referred to herein, in the case where subject comes up from the left of the picture of Figure 12 figure is referred to Measurement on the left of 12 picture starts (end) coordinate 1201 (from the beginning of the measurement on right side is referred in the case where coming up from right side (end) coordinate 1201), or refer to the subject's included in the image of frame when "No" is judged as in step S1109 The coordinate of tiptoe.
In addition, with regard to measurement end point referred to herein, in the case where subject comes up from the left of the picture of Figure 12 Refer to the measurement on the right side of the picture of Figure 12 start (end) coordinate 1201 (refer in the case where coming up from the right side left side measurement open Begin (end) coordinate 1201).
Additionally, in the present embodiment, it is set to substantially subject and comes on foot calculating walking distance to positive side.
But, it is also contemplated that the not straight walking of subject and it is oblique (to Figure 12 picture with front side or inboard) skew Situation.Accordingly, as other embodiment, it is also proposed that consider it is oblique (to Figure 12 picture with front side or inboard) skew situation And the method for calculating walking distance.Specifically, according to measurement starting point (X1, Y1, Z1) and measurement end point (X2, Y2, Z2) Between x coordinate and z coordinate, calculate walking distance.
Next, information processor 101 by by the walking distance previously obtained divided by step S1107 until knot Beam counts the spent time, obtains the walking speed of subject.
Then, information processor 101 finally calculate with previously obtained walking speed walking 5m when required time, It is longer than the time set in advance or short according to the time, determine whether to have carried out correct generally walking.Numeral as 5m Be in order to judge the action of the usual walking of subject and required distance.
By carrying out calculating as described above, for example, even the room that subject cannot be narrow as walking 5m, Whether correctly can determine that has carried out the action of usual walking.
In step S1109, information processor 101 determines whether to have started number of seconds counting.
In the case where being judged to after the beginning counted in number of seconds, information processor 101 terminates present treatment.Sentencing In the case of being set to before the beginning counted in number of seconds, process is set to be transferred to step S1106.
Although the situation for being judged to "No" in step S1109 refers to that subject opens in 2 measurements set in advance The inner side of beginning (end) coordinate 1201, but do not start the situation of number of seconds counting.For example, when the tiptoe in subject reaches advance 2 measurements of setting do not determine that (identification) goes out the situation of the coordinate information in each joint of subject when starting on coordinate 1201 Under, "No" is judged in step S1109.
In this case, in step S1106, subject is identified between (end) coordinate 1201 from the beginning of in measurement Tiptoe coordinate when from start number of seconds counting, so as to without the need for again photograph and the action of subject can be evaluated.
More than, terminate the explanation of Figure 11.
Next, using Figure 13, illustrating to have accepted " eye opening stands on one leg " from user in step S301 in the present invention Project selection in the case of, the process that the CPU201 of information processor 101 is performed.
In step S1301, information processor 101 judges whether the pin of subject lifts.
More specifically, first, before the process of execution step S1301, information processor 101 is predefined by reality The value of the y-coordinate of the double-legged heel of the person of testing.Then, by determining that the difference of the seat target value of the heel of each pin is predetermined Within scope, it is judged as that both feet contact together ground.
Next, in step S1301, from the image of frame for becoming currently processed object, the y for determining a certain leg sits Target value whether with the value of the y-coordinate of the double-legged heel of the subject determined before the process of execution step S1301 Compare changed it is predetermined more than.Then, changed it is predetermined more than in the case of, information processor 101 is judged as pin lift Rise.
In the case that the pin for being judged to subject in step S1301 is lifted, information processor 101 is transferred to step The process of rapid S1302.In the case where the pin for being judged to subject is not lifted, information processor 101 is transferred to step The process of S1304.
In step S1302, information processor 101 judges to be judged in step S1301 the subject's for lifting Whether pin is raised up to predetermined height.
The feelings of predetermined height whether are raised up in the pin that determined the subject for being judged to lift in step S1301 Under condition, in step S1303, information processor 101 starts the counting of number of seconds.It is being judged to be judged in step S1301 In the case that the pin of the subject for lifting is not raised up to predetermined height, information processor 101 terminates present treatment.
More specifically, according to the value of the y-coordinate of each pin of subject whether with the process in execution step S1301 it The value of the y-coordinate of the double-legged heel of front determination is compared and has changed the predetermined above to be judged.Changed it is predetermined more than In the case of, information processor 101 is judged as that the pin is raised up to predetermined height (with reference to Figure 30).
Additionally, the value of " predetermined " in step S1302 be than step S1301 in " predetermined " the big value of value.
In step S1304, information processor 101 judges forward in the image of the frame than becoming currently processed object The pin for whether being judged as subject in frame is lifted ("Yes" in step S1301).
If being judged as the pin of subject in the image of the forward frame of the image of the frame than becoming currently processed object ("Yes" in step S1304) is lifted, then makes process be transferred to step S1305.It is being judged in the figure than the current frame for determining In the case of not being judged as that the pin of subject lifts ("No" in step S1304) in the image of forward frame, it is judged as Subject does not lift pin, terminates present treatment.
In step S1305, information processor 101 judges whether the pin of subject puts down.
More specifically, in step S1305, from the image of frame for becoming currently processed object, the y for determining each pin sits Target value whether with the value of the y-coordinate of the double-legged heel of the subject determined before the process of execution step S1301 Compare do not change it is predetermined more than, do not change it is predetermined more than in the case of, be judged as that the pin puts down.
In the case that the pin for being judged to subject in step S1305 puts down, the process of step S1306 is transferred to, Terminate the counting of the number of seconds of execution in step S1303.In the case where the pin for being judged to subject does not put down, be judged to by Experimenter still lifts pin, terminates present treatment.
In step S1307, information processor 101 according to from step S1303 start number of seconds counting to Terminate the number of seconds counted till counting in step S1306 less than predetermined number of seconds (such as 24 seconds) is also above, evaluate by reality The locomitivity of the person of testing.By evaluation result storage to measurement result management table (Figure 19).
More than, terminate the explanation of Figure 13.
Additionally, in fig. 13, it is set to information processor 101 and automatically judges that the lifting for pin of subject is put down, but Also can be as shown in figure 14, user (such as estimator) manually specifies the lifting for pin of subject to put down.
Therefore, Figure 14 used below, illustrates that user (such as estimator) manually specifies the lifting for pin of subject to put Under mechanism.
In information processor when Figure 14 is the photography of the beginning of information processor 101 subject in step s 302 The picture shown in 101 display 212.
In 1401, the animation of the acquirement of movable information obtaining section 151 of display information processor 101.
1402 is to lift to put down button.Put down button 1402 and press when the operation of the mouse by being implemented by user etc. will be lifted When lower 1st time, stop the process of Figure 13, be judged as that subject lifts on pin in the timing being pressed, start the counting of number of seconds.
Then, when the operation of the mouse by being implemented by user etc. will lift and put down button 1402 and press the 2nd time, information Processing meanss 101 are judged as that subject puts down on pin, terminate the counting of number of seconds.Then, according to the number of seconds for counting to get, evaluate The locomitivity of subject.
Additionally, in the present embodiment, put down button 1402 and press when the operation of the mouse by being implemented by user etc. will be lifted When lower 1st time, information processor 101 stops the process of Figure 13.But, as other embodiment, it is also possible to when in Figure 13 The step of S1303 process after pressed by the operation of the mouse implemented by user etc. and lift the situation for putting down button 1402 Under, information processor 101 not execution step S1304, the process of step S1305 and terminate the counting of number of seconds, or, when in step Pressed by the operation of the mouse implemented by user etc. before the process of rapid S1302 in the case of lifting and putting down button 1402, Information processor 101 not execution step S1301, the process of step S1302 and start the counting of number of seconds, execution step afterwards S1304 later process.
As shown in Figure 14 user (such as estimator) can manually specify the lifting for pin of subject to put down, so as to In the case that as shown in Figure 13 information processor 101 automatically judges the lifting and put down of the pin of subject, although by reality The person of testing lifts pin but information processor is still judged to not lift the situation of pin, is judged to not although subject puts down pin In the case of putting down pin, it is also possible to correct result of determination.
More than, terminate the explanation of Figure 14.
Next, using Figure 29, illustrating the action for evaluating subject and showing for subject, the message of assistant Process.Process shown in the flow chart of Figure 29 is that the CPU201 of information processor 101 reads and perform predetermined control journey The process of sequence.
In step S2901, judge whether the bone information determined meets pre-determined appreciation condition.
(step S2901 in the case where appreciation condition is met："Yes"), make process be transferred to step S2902.
(step S2901 in the case where appreciation condition is unsatisfactory for："No"), make process be transferred to step S2903.
Figure 30 illustrates an example of appreciation condition.As shown in figure 30, for each project, by appreciation condition and evaluation Appearance is mapped.
For example, with regard to " project：Chair sitting ", in the case where the angle of knee is more than 175 degree, is evaluated as what is stood Action, in the case of for less than 95 degree, is evaluated as the action for taking a seat.Then, the action stood and take a seat it is dynamic In the case of work, it is evaluated as sitting action having carried out 1 time.
In eye opening stands on one leg, in the case where the difference of the height of the pin of left and right is more than 5cm, it is evaluated as having lifted list Pin.
In step S2902, evaluation of estimate is added etc..For example, if chair sitting, then add 1 time.In addition, During eye opening stands on one leg, in the case where the beginning condition for standing on one leg is met, start the measurement of the time of standing on one leg.Meeting In the case of termination condition, end stands on one leg the measurement of time.
In step S2903, according to the bone coordinate determined, message is determined.
Message form according to Figure 31, determines message content.For example, in project：In chair sitting, at the angle of knee In the case of spending for more than 175 degree, it is determined that message as " sit down, please ".In addition, the state when the angle in knee less than 175 degree Under be transferred in the situation of the action for taking a seat (situation that the angle of knee diminishes), it is determined that message as " please stand firm ".
In addition, in eye opening stands on one leg, if not lifting the state of pin, it is determined that " please lifting on pin " is such to disappear Breath, the pin for lifting it is highly relatively low in the case of, it is determined that message as " please again raising pin a little ", if steadily lifting Play the state of pin, it is determined that message as " in measurement ".
By so showing message, if subject, assistant be able to recognise whether to have carried out to be evaluated as sane action, Carry out which type of action then can be evaluated.
In step S2904, the message determined in step 2903 is displayed in.As an example, the 2201 of Figure 22 are illustrated.
Return to the explanation of Fig. 3.
The process of step S304～S306 is the place carried out whenever animation frame is obtained by movable information obtaining section 151 Reason.By so whenever obtain frame when recognize bone information, can detect the coordinate information in each joint change and identification maneuver.
In step S307, the CPU201 of information processor 101 is stored in the result (figure determined in step S306 19)。
Next, using Fig. 4, illustrating to use the measure of the projects in the case of pre-recorded movable information to process.
Additionally, the selection for passing through user, determines the real-time measure shown in execution Fig. 3 (while movable information is obtained The process being also measured), be also carried out the measure of the pre-recorded movable information of use shown in Fig. 4.
In step S401, accept from user (is carried out to the animation to be regenerated to the action of subject that hope is determined Animation obtained from photography) selection, accept the animation regeneration indicate.
Additionally, animation data includes the data obtained by each sensor of movable information obtaining section 151.
In step S402, the choosing of the animation for the animation for selecting having been accepted in step S401 and having become comparison other is accepted Select.
In step S403, for regenerating the animation of object and the animation of comparison other, various settings are accepted.
In step s 404, it is stored in the setting accepted in step S402.The preservation of 2801 in by pressing Figure 28 Button, performs preservation and processes.
In step S405, to being carried out again by the animation for having carried out regenerating the animation for indicating and be set to comparison other It is raw.
Now, at the same time press regeneration button in the case of, while regenerate two animations, press it is single regeneration by In the case of button, the animation being pressed individually is regenerated.
Then, the S304 later process of the step of performing Fig. 3.
As shown in Figure 3, Figure 4, the situation of the evaluation action in real time while photographing to subject is allowed hand over With preserve subject is photographed obtained from animation and post-evaluation action situation, so as to for example wish it is anti-on the spot Feed in the case of subject, user is set to evaluation action in real time, iting is desirable to first to record multiple subjects As and situation about being evaluated afterwards, user (estimator) wish to be confirmed while careful activity etc. is observed repeatedly Situation, the hope that situation, hope are evaluated the animation that photography is obtained as sundry item is by explaining function confirmation by reality In the case that situation, the subject of the angle of the bone of the person of testing are together with estimator, user can be set to preservation to quilt Experimenter carry out photographing the animation that obtains and post-evaluation action.
In addition, preserve carry out photographing the animation that obtains to subject and post-evaluation action in the case of, with Have in the case of error detection that user can manually change advantage as evaluation result without the need for photography again.
Figure 23, Figure 24 illustrate an example for comparing picture.
Figure 23 is longitudinally side by side to show the animation (bone information) of the animation (bone information) of evaluation object and comparison other One example of the picture for showing.
Figure 24 is laterally side by side to show the animation (bone information) of the animation (bone information) of evaluation object and comparison other One example of the picture for showing.
Layout (longitudinal arrangement, transversely arranged) with regard to comparing picture, for example there are as below methods：Each project is directed in advance Registration longitudinal arrangement or transversely arranged, is shown according to the registration content.Figure 25 is shown for each project and registers cloth The form of office.
As shown in figure 25, illustrate that chair sitting is transversely arranged, usual walking is longitudinal arrangement.So, by stepping in advance Note, can by subject in the vertical direction mobile such project (" chair sitting " etc.) be set to it is transversely arranged, will be on a left side The project (" usual walking " etc.) that right moves up is set to longitudinal arrangement.By so determining arrangement side according to moving direction Method, can be shown with the layout being easily compared.
The method for so being pre-registered is have in the situation (situation of pre-determined project) of the project of predefining Effect.
Would indicate that be which project is photographed obtained from data information with selected by step S401, S402 Animation data be mapped record, using the form of Figure 25, it is determined that the layout being mapped with the project of the record.
In addition, method of the track of also with good grounds subject to determine layout.For example, if with the track of subject (moving direction) is left and right directions, then be arranged above and below, if the track of subject is above-below direction, the side of left-right situs Formula, according to the activity of subject layout is determined.
By the method so according to the track of subject to be judged, in the case where project is not predefined, Also can be shown with the layout being easily compared.
In addition, in relatively picture, the left and right that can make animation inverts.
Figure 26 is the figure in the case that the left and right of the animation for illustrating the top made in the picture of Figure 23 has inverted.Such as Figure 26 institutes Show, the people shot in the animation on top is in fig 23 right direction, but be in fig. 26 left direction.
By being chosen in the check box that illustrates in the 2601 of Figure 26, the instruction of the meaning for representing reversion is accepted.When When choosing " the upper picture reversion " in 2601, the picture reversion on top.When " lower picture reversion " is chosen, the picture of bottom is anti- Turn.If chosen to both, the picture reversion of both up and down.
By so being inverted, such as it is being determined but this from the from left to right walking of image before 1 month It is determined from right to left under such circumstances, it is also possible to unify both walking directions, so easily comparing and energy It is enough to grasp both difference in detail.
In addition, in relatively picture, can not only be displayed side by side the image of comparison other, but also can overlap aobvious Show.
Figure 27 is illustrated and is overlapped the example for showing.2701 and 2702 in Figure 27 are the images of comparison other.In addition, 2703 is the image for overlapping 2701 and 2702 image.
In relatively picture, size, the position of the image of comparison other can be adjusted.
With regard to size, by being chosen in " size " of the adjust automatically menu 2704 of Figure 27, using for example until The length of head and waist, is adjusted in the mode for making the length consistent between the bone information of comparison other.So, lead to Crossing makes some interarticular distance in the bone information of subject and interarticular compares apart from corresponding becoming with this The interarticular distance that the bone information of object is related is consistent, carries out size adjusting.
In addition, can not only automatically adjust, but also can be adjusted by the operation of user.In this case, energy Size in enough by pressing Figure 27 adjusts button 2705,2706 to adjust.Enter in the case where increasing button 2705 is pressed Row increase, is reduced in the case where reduction button 2706 is pressed.
The adjustment of size can so be carried out, so as to be compared between the people different to height situation, multiplying power with Past photographs in different situation of the people for obtaining etc., still easily compares and can grasp in detail both difference.
With regard to position, by being chosen in " position " of the adjust automatically menu 2704 of Figure 27, so that such as head The mode consistent between the bone information of comparison other in position be adjusted.That is, by make subject some pass Save the related joint coordinates of coordinate and the bone information for becoming the comparison other corresponding to the joint coordinates consistent, carry out Position adjustment.In addition, carrying out adjustment position in the central mode for making one to mirror in composograph.
In addition it is possible to carry out drag operation come adjustment position by user.
So, by can adjustment position, the bone information of comparison other can be configured at desired position and be carried out Relatively or make its overlap and be compared, easily compare and can grasp in detail both difference.
In addition, when being chosen in " both " in adjust automatically menu 2704, both adjustment size and position.
In addition, in relatively picture, can not show only show bone information including the background video of subject.
Figure 28 illustrates an example of the picture that only show bone information.
There is display switching menu in the right-hand member of the picture shown in Figure 28, when carrying out in project as " color " wherein When choosing, display background, when cancellation is chosen, only shows bone information.
That is, accept and be directed to the selection for whether showing the background video including subject, according to the content for being accepted, determine Whether display includes the background video of subject.
For example, in the case where being photographed to the animation of comparison other in different rooms respectively, the difference of background It is different to become interference and the movable of bone relatively becomes difficult.Particularly, in the composite image, different backgrounds is overlapping one another Show, so being very difficult to observation, it is difficult to compare.Therefore, by eliminating background, comparison other can be clearly shown, can Both difference is grasped in detail.
Set content (comparing combination, picture layout, position, size of animation etc.) in above-mentioned various pictures is protected Save as and compare script, it is recycling.
In the information of relatively script, including information, regeneration starting position, regeneration ending position, the scaling of animation file State, the adjustment position of resultant image, the setting of left and right reversion.
So, script is compared by the way that set content is saved as, even if wish to see again after again, it is also possible to The time labour that omission sets again.
Next, using Fig. 5, illustrating to report that making is processed.
In step S501, the selection of subject is accepted from user, accept the measurement result (report) of the subject Output indication.
In step S502, extraction has accepted the measurement result of the subject of output indication.
Here, using Figure 15, describing measurement result extraction process in detail.
In step S1501, information processor 101 accepts the setting of extraction conditions from user.Figure 17 illustrates extraction bar The image of part setting screen.In the picture of Figure 17, as extraction conditions, setting Start Date 1701, Close Date 1702.
In step S1502, information processor 101 accepts the selection of project from user.In the picture of Figure 17, as Project 1703, stands on one leg from eye opening, chair sitting, a maximum step, usual walking, selects in TUG.
In step S1503, information processor 101 is according to the extraction bar accepted in step S1501 and S1502 Part, project, extract the measurement result of this and last time from the measurement result management table shown in Figure 19.Specifically, lead to The extraction button 1704 for pressing Figure 17 is crossed, present treatment is performed, in Start Date 1701 and Close Date as extraction conditions In the range of 1702, for the project 1703 selected, measurement result management table is retrieved, by newest measurement result and second New measurement result as this result, last time result and extract.
It is newest by what is included in the scope during specified for the project (generally have multiple specify) so specified Measurement result and the second new result as this measurement result, last time measurement result and extract, so as to without the need for implementing for each Individual project settings search condition is come a succession of as retrieving measurement result and selected this measurement result and last time measurement result Operation, can extract the measurement result for output report.
Here, using Figure 19, illustrating measurement result management table.In measurement result management table, wrap as project Include measurement result ID1901, subject 1902, determine date-time 1903, project 1904, measured value 1905, evaluation score 1906th, animation file 1907.Measurement result ID1901 is the character string for uniquely identifying measurement result.Subject 1902 It is the subject for receiving measure.It is the date-time for starting to determine to determine date-time 1903.Project 1904 is determined Project, be open eyes stand on one leg, chair sitting, a maximum step, usual walking, some in TUG.Measured value 1905 is table Show the numerical value of measurement result.Evaluation score 1906 is the fraction evaluated based on measured value 1905.Animation file 1907 be with The filename of the corresponding animation data of measurement result or the link to animation data.
In step S1504, information processor 101 is shown in the measurement result extracted in step S1503 aobvious Show device 212 etc..Figure 18 illustrates the image for extracting result display picture.In the picture of Figure 18, the measure knot for showing and extracting The thumbnail image 1801 of really corresponding animation data.
Return to the explanation of Fig. 5.
In step S503, according to the result extracted in step S502, report is made.
Here, using Figure 16, describing report making in detail and processing.
For having accepted each project for selecting, the repeatedly process of execution step S1601 to S1605 in step S1502.
In step S1601, information processor 101 obtains this and the last time that extract in step S1503 Measurement result.
In step S1602, information processor 101 judges whether the measurement result obtained in step S1601 is commented Valency.Specifically, according to whether setting value to be judged in the evaluation score 1906 of measurement result management table.If Evaluate, then enter into step S1604, if do not evaluated, enter into step S1603.
In step S1603, information processor 101 is directed to NE measurement result implementation evaluation, is registered in measure The measured value 1905 and evaluation score 1906 of results management form.
In step S1604, information processor 101 retrieves each frame figure of animation from animation corresponding with measurement result Picture, for the two field picture of the distinctive timing of item extraction.Condition with regard to determining distinctive timing, in advance for each Mesh and determine, for example stand on one leg if opening eyes, be determined as pin being put into timing, the i.e. state on ground from pin is lifted State is converted to the timing of the state that pin is put into ground, if a maximum step is then determined as determining both feet fork maximum When, the state for lifting on pin when tidemark is judged to pin is put into the timing on ground.According to the seat for each joint Value, changing condition, dependency relation of the coordinate data in multiple joints of mark data etc., set specific condition.Additionally, with regard to spy The two field picture of the timing of levying property, both can extract in present treatment, it is also possible to evaluate when extract and pre-save and in Ben Chu Recall in reason.In addition, in the present embodiment, 1 distinctive two field picture is gone out for each item extraction, but it is also possible to according to bar Part extracts multiple two field pictures.
In step S1605, information processor 101 is by the distinctive two field picture extracted in step S1604 Thumbnail image and the evaluation result for projects are exported as Report elements.When extracting multiple spies in step S1604 In the case of the two field picture of levying property, both corresponding thumbnail image can be arranged and be exported multiple, it is also possible to be converged into 1 and come defeated Go out.
By the breviary that evaluation result for projects and distinctive two field picture are so exported as Report elements Figure image, can not only grasp situation by numeric data, it is also possible to whether good visually intuitively grasp measurement result Deng.
In step S1606, collect the Report elements for projects output, additional report makes day, subject's letter Cease, determine the information relevant with measure such as Locale information to make report.
Return to the explanation of Fig. 5.
In step S504, the CPU201 of information processor 101 exports the report made in step S503.
Figure 20 illustrates the output example of the report for making in present treatment and exporting in step S504.In the output of Figure 20 In example, making day, implementer (subject) are shown in report information hurdle 2001, implements place, director, in comprehensive annotation The annotation from estimator is shown in hurdle 2002, the spider diagram of the evaluation score of each project is shown in spider diagram hurdle 2003. The selected project of user is directed in pickup project hurdle 2004, according to the distinctive image extracted in step S1605, Show thumbnail and bone image.In project category result bar 2005, this and last time of project category is pressed in display The improvement degree that implement day, result (measured value), judges according to the evaluation score of this and last time, from estimator to project The thumbnail image of annotation and the distinctive two field picture extracted in step S1605.
In addition, the program in the present invention makes computer perform Fig. 3～Fig. 5, Figure 11, Figure 13, Figure 15, Figure 16, Figure 29 The program of process.Additionally, the program in the present invention can also be Fig. 3～Fig. 5, Figure 11, Figure 13, Figure 15, Figure 16, Figure 29 everywhere Manage respective program.
As described above, it is supplied to by the recording medium of the program that record is had the function of realizing above-mentioned embodiment and is System or device, and the system either the computer (or CPU, MPU) of device reads and performs and stores in the recording medium Program, the purpose of the present invention can be also reached certainly.
In this case, the program itself for reading from recording medium realizes the new function of the present invention, and record has the program Recording medium constitute the present invention.
As being used to supply the recording medium of program, for example, floppy disk, hard disk, CD, photomagneto disk, CD- can be used ROM, CD-R, DVD-ROM, tape, non-volatile storage card, ROM, EEPROM, silicone disc etc..
In addition, the function of above-mentioned embodiment is not only realized by the read-out program of computer execution, and certainly Also include the instruction according to the program, OS (operating system) for working on computers etc. carry out a part for actual treatment or All, the situation of the function of above-mentioned embodiment is realized by the process.
Further, situations below is also included certainly：Computer is inserted in the program read from recording medium is written to After the memory that expansion board and the Function Extension part of computer connection possess, according to the instruction of the program code, CPU possessed in the expansion board, Function Extension part etc. carries out some or all of actual treatment, by this Reason realizes the function of above-mentioned embodiment.
In addition, the present invention both can apply to the system being made up of multiple equipment, it is also possible to be applied to by an equipment structure Into device.In addition, the present invention applies also for the situation by reaching to system or unit feeding program certainly.In the feelings Under condition, by the way that the recording medium of program stored for reaching the present invention is read into into the system or device, the system or Person's device can enjoy the effect of the present invention.
Further, downloaded using signal procedure by the server from network, database and read for reaching this Bright program, the system or device can enjoy the effect of the present invention.Additionally, being combined with the respective embodiments described above and its deformation The structure of example is also all contained in the present invention.

Claims (26)

1. a kind of information processor, it is characterised in that possess：
Relatively animation selects to accept unit, accepts the selection of the animation being compared；
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；And
Display unit, by and to selected to accept unit to have accepted the related project of animation that selects corresponding by the animation that compares The layout got up, the bone information of the subject and the bone information for becoming comparison other are displayed side by side.
2. a kind of information processor, it is characterised in that possess：
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；
Layout determining means, according to the direction of action of the subject layout is determined；And
Display unit, by the layout determined by the layout determining means, by the bone information of the subject and becomes The bone information of comparison other is displayed side by side.
3. information processor according to claim 2, it is characterised in that
The layout determining means is by the bone of subject in the case of left and right directions with the activity in the subject Information and become comparison other bone information be longitudinally displayed side by side, the subject activity be above-below direction situation The lower bone information by subject and become mode that the bone information of comparison other shows laterally side by side determining layout.
4. a kind of information processor, it is characterised in that possess：
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；
Display unit, the bone information of the subject and the bone information for becoming comparison other are displayed side by side；And
Reversion instruction accepts unit, accepts the bone information that makes the bone information of the subject or become comparison other The instruction that left and right inverts and shown,
The display unit makes to indicate to accept unit by the reversion and has accepted the bone of instruction that makes left and right reversion and shown The left and right of bone information inverts and is shown.
5. a kind of information processor, it is characterised in that possess：
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；
Display unit, by the bone information of the subject and the bone information for becoming comparison other display is overlapped；
Position adjustment indicates to accept unit, accepts the bone information for adjusting the subject and the bone letter for becoming comparison other The instruction of the position of breath；And
Position adjustment unit, in the case where indicating to accept the instruction that unit has accepted position adjustment by position adjustment, by making Some joint coordinates of the subject and the bone information institute for becoming the comparison other corresponding with the joint coordinates Related joint coordinates are unanimously carrying out position adjustment.
6. information processor according to claim 5, it is characterised in that
The position adjustment indicates to accept unit and then the drag operation by being implemented by user, accepts the position of the bone information The adjustment put,
The position adjustment unit adjusts the position of the bone information according to the drag operation implemented by user.
7. a kind of information processor, it is characterised in that possess：
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；
Display unit, by the bone information of the subject and the bone information for becoming comparison other display is overlapped；
Size adjusting indicates to accept unit, accepts the bone information for adjusting the subject and the bone letter for becoming comparison other The instruction of the size of breath；And
Size adjusting unit, in the case where indicating to accept the instruction that unit has accepted size adjusting by size adjusting, by making Some interarticular distance of the subject and interarticular apart from the corresponding bone for becoming the comparison other with this The related interarticular distance of bone information is unanimously carrying out size adjusting.
8. information processor according to claim 7, it is characterised in that
The size adjusting indicates to accept unit by accepting the instruction or reduction that the size for making bone information increases from user Instruction come accept size adjusting indicate,
The size adjusting unit adjusts bone according to the instruction for being indicated to accept the user that unit has accepted by the size adjusting The size of information.
9. a kind of information processor, it is characterised in that possess：
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；
Display unit, the bone information of the subject and the bone information for becoming comparison other are displayed side by side；
Setting accepts unit, in the picture shown by the display unit, accepts the setting of display format；And
Memory cell, stores and accepts the setting content that unit has accepted by the setting.
10. information processor according to claim 9, it is characterised in that
In the setting content stored by the memory cell, including to compare the combination of animation, layout, position, size related Setting.
11. a kind of information processors, it is characterised in that possess：
Coordinate acquisition unit, obtains the coordinate information in the joint of subject；
Bone information signal generating unit, according to the coordinate information obtained by the coordinate acquisition unit, generates the bone of subject Information；
Display unit, the bone information of the subject and the bone information for becoming comparison other are displayed side by side；
Whether selection accepts unit, in the picture shown in the display unit, accept for showing including subject's The selection of background video；And
Determining means, according to by the selection content that unit has accepted selection is accepted, and deciding whether to show includes subject Background video.
12. information processors according to claim 11, it is characterised in that
The determining means by it is described selection accept unit accepted represent show include subject background video meaning In the case of the selection of think of, determine to show the background video for including subject,
The display unit shows the image for having synthesized background video and bone information including subject.
13. information processors according to claim 11, it is characterised in that
The determining means is represented and is not shown background video including subject accepting unit by the selection and accepted In the case of the selection of the meaning, decision does not show the background video including subject,
The display unit does not show and show bone information including the background video of subject.
Information processing method in a kind of 14. information processors, it is characterised in that possess：
Relatively animation selects to accept operation, and the comparison animation selection of described information processing meanss accepts unit and accepts what is be compared The selection of animation；
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit of described information processing meanss obtains operation according in the coordinate The coordinate information of middle acquirement, generates the bone information of subject；And
Show operation, the display unit of described information processing meanss pass through and with by it is described compare animation selection and accept operation receive The layout that the related project of the animation for selecting is mapped is managed, by the bone information of the subject and has become comparison other Bone information be displayed side by side.
Information processing method in a kind of 15. information processors, it is characterised in that possess：
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit of described information processing meanss obtains operation according in the coordinate The coordinate information of middle acquirement, generates the bone information of subject；
Layout determines operation, and the layout determining means of described information processing meanss is determined according to the direction of action of the subject Determine layout；And
Operation is shown, the display unit of described information processing meanss passes through the layout of the decision in layout decision operation, by The bone information of the subject is displayed side by side with the bone information for becoming comparison other.
16. information processing methods according to claim 15, it is characterised in that
It is by subject in the case of left and right directions with the activity in the subject in the layout determines operation Bone information and become the bone information of comparison other and be longitudinally displayed side by side, be above-below direction in the activity of the subject In the case of by the bone information of subject and become mode that the bone information of comparison other shows laterally side by side determining cloth Office.
Information processing method in a kind of 17. information processors, it is characterised in that possess：
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit of described information processing meanss obtains operation according in the coordinate The coordinate information of middle acquirement, generates the bone information of subject；
Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes comparison other Bone information be displayed side by side；And
Reversion instruction accepts operation, and the reversion of described information processing meanss indicates that accepting unit accepts the bone for making the subject The instruction that the left and right of bone information or the bone information for becoming comparison other inverts and shown,
In the display operation, make to have been accepted in the reversion instruction accepts operation the finger for making left and right reversion and being shown The left and right of the bone information for showing inverts and is shown.
Information processing method in a kind of 18. information processors, it is characterised in that possess：
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit of described information processing meanss obtains operation according in the coordinate The coordinate information of middle acquirement, generates the bone information of subject；
Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes comparison other Bone information overlap show；
Position adjustment indicates to accept operation, and the position adjustment of described information processing meanss indicates that accepting unit accepts the adjustment quilt The instruction of the bone information of experimenter and the position of the bone information for becoming comparison other；And
Position adjustment operation, the position adjustment unit of described information processing meanss is indicating that accepting operation accepts by position adjustment In the case of the instruction of position adjustment, by making some joint coordinates of the subject and corresponding with the joint coordinates The related joint coordinates of the bone information for becoming the comparison other unanimously carrying out position adjustment.
19. information processing methods according to claim 18, it is characterised in that
Indicate to accept in operation in the position adjustment, and then the drag operation by being implemented by user, accept the bone letter The adjustment of the position of breath,
In the position adjustment operation, according to the drag operation implemented by user, the position of the bone information is adjusted.
Information processing method in a kind of 20. information processors, it is characterised in that possess：
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit obtains the coordinate letter that operation is obtained according to by the coordinate Breath, generates the bone information of subject；
Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes comparison other Bone information overlap show；
Size adjusting indicates to accept operation, and the size adjusting of described information processing meanss indicates that accepting unit accepts the adjustment quilt The instruction of the bone information of experimenter and the size of the bone information for becoming comparison other；And
Size adjusting operation, accepts in the size adjusting unit of described information processing meanss accepts operation in size adjusting instruction In the case of the instruction of size adjusting, by making some interarticular distance of the subject and interarticular with this Apart from the related interarticular distance of the corresponding bone information for becoming the comparison other unanimously carrying out size adjusting.
21. information processing methods according to claim 20, it is characterised in that
Indicate to accept in operation in the size adjusting, by accept from user instruction that the size for making bone information increases or The instruction of reduction come accept size adjusting indicate,
In the size adjusting operation, according to the instruction for being indicated to accept the user that unit has accepted by the size adjusting, adjust The size of whole bone information.
Information processing method in a kind of 22. information processors, it is characterised in that possess：
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit obtains the coordinate letter that operation is obtained according to by the coordinate Breath, generates the bone information of subject；
Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes comparison other Bone information be displayed side by side；
Setting accepts operation, and the setting of described information processing meanss is accepted in the picture that unit shows in the display operation, Accept the setting of display format；And
Storage operation, the memory cell of described information processing meanss is stored in the setting and accepts in the setting accepted in operation Hold.
23. information processing methods according to claim 22, it is characterised in that
By it is described storage operation storage setting content in, including with combination, layout, position, the size phase for comparing animation The setting of pass.
Information processing method in a kind of 24. information processors, it is characterised in that possess：
Coordinate obtains operation, and the coordinate acquisition unit of described information processing meanss obtains the coordinate information in the joint of subject；
Bone information generation process, the bone information signal generating unit obtains the coordinate letter that operation is obtained according to by the coordinate Breath, generates the bone information of subject；
Operation is shown, the display unit of described information processing meanss is by the bone information of the subject and becomes comparison other Bone information be displayed side by side；
Selection accepts operation, and the selection of described information processing meanss is accepted in the picture that unit shows in the display operation, Accept and be directed to the selection for whether showing the background video including subject；And
Determine operation, the determining means of described information processing meanss by the selection according to accepting in operation accepted and select Hold, decide whether to show the background video for including subject.
25. information processing methods according to claim 24, it is characterised in that
In the decision operation, operation is accepted by the selection background shadow for representing that display includes subject is accepted In the case of the selection of the meaning of picture, determine to show the background video for including subject,
In the display operation, display has synthesized the image of the background video including subject and bone information.
26. information processing methods according to claim 24, it is characterised in that
In the decision operation, accepting operation by the selection and having accepted expression background including subject is not shown In the case of the selection of the meaning of image, decision does not show the background video including subject,
In the display operation, do not show and show bone information including the background video of subject.
CN201610908922.1A 2015-10-29 2016-10-19 Information processing apparatus and information processing method Active CN106650217B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910679377.7A CN110391017A (en) 2015-10-29 2016-10-19 Information processing unit and information processing method

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
JP2015-213490 2015-10-29
JP2015-213489 2015-10-29
JP2015213489A JP2017080199A (en) 2015-10-29 2015-10-29 Information processing device, information processing method and program
JP2015-213491 2015-10-29
JP2015213490A JP6803111B2 (en) 2015-10-29 2015-10-29 Information processing equipment, information processing methods, programs
JP2015213491A JP2017084194A (en) 2015-10-29 2015-10-29 Information processing device, information processing method, and program
JP2015-213496 2015-10-29
JP2015-213492 2015-10-29
JP2015213496A JP2017080203A (en) 2015-10-29 2015-10-29 Information processing device, information processing method and program
JP2015213492A JP2017080201A (en) 2015-10-29 2015-10-29 Information processing device, information processing method and program

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201910679377.7A Division CN110391017A (en) 2015-10-29 2016-10-19 Information processing unit and information processing method

Publications (2)

Publication Number Publication Date
CN106650217A true CN106650217A (en) 2017-05-10
CN106650217B CN106650217B (en) 2020-06-30

Family

ID=58855608

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610908922.1A Active CN106650217B (en) 2015-10-29 2016-10-19 Information processing apparatus and information processing method
CN201910679377.7A Pending CN110391017A (en) 2015-10-29 2016-10-19 Information processing unit and information processing method

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910679377.7A Pending CN110391017A (en) 2015-10-29 2016-10-19 Information processing unit and information processing method

Country Status (1)

Country Link
CN (2) CN106650217B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107274467A (en) * 2017-06-29 2017-10-20 厦门游亨世纪科技有限公司 A kind of model animation interlock method based on Unity3D
CN109411089A (en) * 2018-09-05 2019-03-01 广州维纳斯家居股份有限公司 Determination method, apparatus, intelligent elevated table and the storage medium of user health situation

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111026277A (en) * 2019-12-26 2020-04-17 深圳市商汤科技有限公司 Interaction control method and device, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1783784A (en) * 2004-11-08 2006-06-07 索尼株式会社 Information processing apparatus and method, recording medium, and program
CN101001311A (en) * 2006-01-09 2007-07-18 上海乐金广电电子有限公司 System providing and editing action effect using video signal and its method
CN101821798A (en) * 2007-10-16 2010-09-01 松下电器产业株式会社 Image display device and image display method
CN102831380A (en) * 2011-06-15 2012-12-19 康佳集团股份有限公司 Body action identification method and system based on depth image induction
JP2015061577A (en) * 2013-01-18 2015-04-02 株式会社東芝 Movement-information processing device
WO2015062616A1 (en) * 2013-10-30 2015-05-07 Barco Control Rooms Gmbh Synchronization of videos in a display wall
CN104969543A (en) * 2013-02-14 2015-10-07 松下知识产权经营株式会社 Electronic mirror device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4264368B2 (en) * 2004-02-24 2009-05-13 日本ナレッジ株式会社 Practical skill analysis system and program
WO2012046392A1 (en) * 2010-10-08 2012-04-12 パナソニック株式会社 Posture estimation device and posture estimation method
JP6188332B2 (en) * 2013-01-21 2017-08-30 東芝メディカルシステムズ株式会社 Medical image display apparatus and program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1783784A (en) * 2004-11-08 2006-06-07 索尼株式会社 Information processing apparatus and method, recording medium, and program
CN101001311A (en) * 2006-01-09 2007-07-18 上海乐金广电电子有限公司 System providing and editing action effect using video signal and its method
CN101821798A (en) * 2007-10-16 2010-09-01 松下电器产业株式会社 Image display device and image display method
CN102831380A (en) * 2011-06-15 2012-12-19 康佳集团股份有限公司 Body action identification method and system based on depth image induction
JP2015061577A (en) * 2013-01-18 2015-04-02 株式会社東芝 Movement-information processing device
CN104969543A (en) * 2013-02-14 2015-10-07 松下知识产权经营株式会社 Electronic mirror device
WO2015062616A1 (en) * 2013-10-30 2015-05-07 Barco Control Rooms Gmbh Synchronization of videos in a display wall

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107274467A (en) * 2017-06-29 2017-10-20 厦门游亨世纪科技有限公司 A kind of model animation interlock method based on Unity3D
CN109411089A (en) * 2018-09-05 2019-03-01 广州维纳斯家居股份有限公司 Determination method, apparatus, intelligent elevated table and the storage medium of user health situation

Also Published As

Publication number Publication date
CN110391017A (en) 2019-10-29
CN106650217B (en) 2020-06-30

Similar Documents

Publication Publication Date Title
US9348950B2 (en) Perceptually guided capture and stylization of 3D human figures
JP6842044B2 (en) Information processing equipment, information processing methods, programs
JPWO2005101318A1 (en) Facial image creation apparatus and method
US20150269759A1 (en) Image processing apparatus, image processing system, and image processing method
CN116648729A (en) Head portrait display device, head portrait generation device, and program
CN107924577B (en) Cosmetic part creation device and cosmetic part creation method
JP2013190974A (en) Information processing apparatus, information processing method, and program
CN106650217A (en) Information processing apparatus and information processing method
JP6744559B2 (en) Information processing device, information processing method, and program
JP6165815B2 (en) Learning system, learning method, program, recording medium
JP2017080197A (en) Information processing device, information processing method and program
US11612345B2 (en) Input device, measurement system, and computer-readable medium
JP2013200867A (en) Animation creation device and camera
JP2017080199A (en) Information processing device, information processing method and program
JP6803111B2 (en) Information processing equipment, information processing methods, programs
KR101609861B1 (en) Input control system and method based on users behavior
JP7119995B2 (en) Input devices, measurement systems and programs
JP2020140719A (en) Information processor, information processing method, and program
JP2017080203A (en) Information processing device, information processing method and program
JP2017080201A (en) Information processing device, information processing method and program
JP2017080202A (en) Information processing device, information processing method and program
JP2017085427A (en) Information processing device, information processing method, and program
KR102267688B1 (en) How to run an application that improves the accuracy of hair self-diagnosis
JP2019185188A (en) Information processing method, information processing apparatus, and information processing system
JP2017084194A (en) Information processing device, information processing method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant