CN102724449A - Interactive TV and method for realizing interaction with user by utilizing display device - Google Patents
Interactive TV and method for realizing interaction with user by utilizing display device Download PDFInfo
- Publication number
- CN102724449A CN102724449A CN2011100795768A CN201110079576A CN102724449A CN 102724449 A CN102724449 A CN 102724449A CN 2011100795768 A CN2011100795768 A CN 2011100795768A CN 201110079576 A CN201110079576 A CN 201110079576A CN 102724449 A CN102724449 A CN 102724449A
- Authority
- CN
- China
- Prior art keywords
- image
- human action
- standard operation
- contrast
- convenient
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to an interactive television. The interactive television comprises: an image processing unit used for receiving human motion digital image information which comprises at least one frame of human motion image from an image collection unit, and processing the human motion image into a human motion image convenient for comparison; a storage unit which stores an image frame of a standard action; an action comparison unit used for comparing the human motion image convenient for comparison with a standard action image corresponding to the human motion image convenient for comparison, wherein if a comparison result is larger than a preset tolerance threshold, that the current action is wrong is prompted, and if the comparison result is less than the tolerance threshold, the action comparison unit obtains an image frame of a next standard action compared to a current standard action and transmits the image frame to an image display unit for displaying. The invention also relates to an interactive device and a method for realizing interaction with an exerciser by utilizing a display device.
Description
Technical field
The present invention relates to the computer image processing technology field; Especially relate to a kind of interactive television set; The invention still further relates to a kind of can with display unit, for example television set, notebook computer, display etc., the interactive device of connection and a kind of utilize display unit to realize the method with user interaction.
Background technology
Exercise makes one strong, for suffering from arthritis, the patient of diseases such as scapulohumeral periarthritis; The spinal curvature problem that perhaps causes because of sitting under office environment, the rigid problem of shoulder muscle all has specific exercise motion to instruct people to carry out suitable exercise usually; Thereby alleviate ailing; Realize helping people to overcome the function of disease, and to the sub-health state that generally occurs in the current life of people, suitably exercise all help to alleviate various malaise symptoms targetedly; Yet having distinct issues in the current exercise process is that the text description exercise motion is more, and video instructs less; Perhaps directly temper video (for example callisthenics, Yoga etc.) and follow study through playing, these modes make the person taking exercise to the doing action standard that more not have judgement up to standard whether, can only grope to practise exercises by means of everyone understanding oneself.
The image that has a kind of shooting people body action at present; Then the human action image information that photographs is converted into the accessible data of computer, thus the technical scheme that makes computer processing unit express human action and to show through human 3d model according to aforesaid data through the display part.Be that CN101785927, name are called in a kind of Chinese invention patent application of interactive body building system and can find the information relevant with technique scheme for example at publication number.
In addition; Also there is a kind of seizure human action in the games system, thereby then the human action signal that captures is converted into data message and relatively forms the human-computer interaction information technical scheme of (as player's dancing being moved the information of estimating, giving a mark) with the dancing body data.For example publication number is that CN101908103, name are called with body sensing mode and carry out can finding the information relevant with technique scheme in the Chinese invention patent application of interactive network Dance System.
But above technical scheme only is for increasing the recreational of motion or recreation, do not have when the practitioner carries out exercise action (like body building or rehabilitation exercise) can objective coaching person the exercise action system of standard whether.
Summary of the invention
The purpose of one aspect of the present invention be to provide a kind of can objective guides user or practitioner's the human action interactive television set of standard whether.
For realizing this purpose, a kind of interactive television set provided by the invention comprises:
Graphics processing unit is used to receive the human action image information from image acquisition units, and this human action image information comprises at least one frame human action image, and, the human action image that said human action image processing is become to be convenient to contrast;
Memory cell is used for the picture frame that storage standards is moved;
Action contrast unit; Be used for obtaining the said human action image of being convenient to contrast and obtaining and the corresponding standard operation picture frame of the said human action image of being convenient to contrast from said memory cell from said graphics processing unit; Said human action image of being convenient to contrast and said standard operation image are compared; If comparing result greater than the fault-tolerant threshold value that presets, then points out current human action wrong; If comparing result is less than the said fault-tolerant threshold value that presets, then said action contrast unit obtains than the picture frame of next standard operation of current standard operation and sends image-display units to from said memory cell and shows.
The present invention's purpose on the other hand is to provide a kind of and can be connected with display unit, thus objective coaching person's the exercise action interactive device of standard whether.
For realizing this purpose, a kind of interactive device provided by the invention separates or is connected with display unit, and this interactive device comprises:
Graphics processing unit is used to receive the human action image information from image acquisition units, and this human action image information comprises at least one frame human action image, and, the human action image that said human action image processing is become to be convenient to contrast;
Memory cell is used for the picture frame that storage standards is moved;
Action contrast unit; Be used to obtain the said human action image of being convenient to contrast and obtain and the corresponding standard operation picture frame of the said human action image of being convenient to contrast from said memory cell; Said human action image and said standard operation image are compared; If comparing result greater than the fault-tolerant threshold value that presets, then points out current human action wrong; If comparing result is less than the said fault-tolerant threshold value that presets, then said action contrast unit obtains than the picture frame of next standard operation of current standard operation and when interactive device is connected with display unit, sends the display unit demonstration to from said memory cell.
The purpose of another aspect of the invention is to provide a kind of display unit of utilizing to realize the method with user interaction, so as can objective consumer-oriented human action standard whether.
For implementing this purpose, a kind of display unit of utilizing of the present invention realizes comprising with the method for user interaction:
The human action image information that reception collects, this human action image information comprise at least one frame human action image;
Said human action image is handled and is processed into the human action image of being convenient to contrast;
The standard operation image corresponding with the said human action image of being convenient to contrast and the said human action image of being convenient to contrast of storage are compared,
When comparing result during, point out current human action wrong greater than the fault-tolerant threshold value that presets;
When comparing result during less than the said fault-tolerant threshold value that presets, obtain storage than the picture frame of next standard operation of current standard operation and through said display unit demonstration.
Interactive television set provided by the invention, interactive device; Or the display unit of utilizing provided by the invention realizes the method interactive with the practitioner; Can user's human action and standard operation be carried out objective comparison through certain image processing mode; Thereby accurately point out the part not in place of user's human action; This only carries out can playing good action role of correcting the user of exercise action with text description or video data concerning those, especially concerning the person taking exercise of prevent disease or treatment disease, can play very big help.
Description of drawings
Fig. 1 is the structural representation block diagram of an execution mode of interactive television set of the present invention;
Fig. 2 is the structural representation block diagram of another execution mode of interactive television set of the present invention;
Fig. 3 is the process chart of graphics processing unit of the interactive television set of an embodiment of the present invention;
Fig. 4 is the process chart that the action of the interactive television set of an embodiment of the present invention contrasts the unit;
Fig. 5 is the structural representation block diagram of an execution mode of interactive device of the present invention;
Fig. 6 is that the display unit of utilizing of the present invention realizes the schematic flow sheet with an execution mode of the method for user interaction.
Embodiment
Specify below in conjunction with the Figure of description specific embodiments of the invention.
Embodiment 1
Fig. 1 is the structural representation block diagram of an execution mode of interactive television set of the present invention.As shown in Figure 1, the interactive television set 1 of this execution mode comprises graphics processing unit 12, memory cell 13, action contrast unit 14 and image-display units 15.Be elaborated in the face of each unit module down.
Wherein, when television for play standard operation video, the user follows when carrying out action exercise, and image acquisition units will be gathered the current human action of user, and send the human action image information that collects to graphics processing unit 12.
As a kind of execution mode, image acquisition units comprises image unit, and this image unit can be camera or video camera.Camera or video camera are numeric type, and camera is installed on the interactive television set and with the video inputs of television set and is connected, or camera is built in the interactive television set; Perhaps video camera is connected with interactive television set.
As another kind of execution mode, image acquisition units comprises image unit and video processing unit, and video processing unit can be digitized into digital video information with analog video signal.Video processing unit can be a video frequency collection card.It is inner or outside that image unit and video processing unit can be co-located on interactive television set, and also image unit is arranged on interactive television set outside, and video processing unit is arranged on interactive television set inside.Camera or video camera are connected with video processing unit, and camera or video camera can be numeral and two types of simulations, and its digital signal or analog signal with output sends video processing unit to.
The human action image information can be the video information that the user carries out a certain action, also can be several the images that the continuous user who takes carries out a certain action, and it is the image that the user carries out a certain action at least.
Particularly; Graphics processing unit 12 with the image that the human action image processing becomes to be convenient to contrast is: the human action picture breakdown is personage's part and environment division; Then personage's part is kept as foreground image, and with environment division image removal as a setting.The image that remains like this is for only comprising the image of practitioner or user's human action.
Wherein, Human action video information for the user; Have similitude owing to constitute every frame motion images of this video, the image matching technology during conventional images therefore capable of using is handled is found out several two field pictures the most similar with the standard operation image, and this a few frame practitioners' human action image and standard operation image compared; Thereby can obtain a series of error amounts, can select minimum error amount and the fault-tolerant threshold value that presets to compare corresponding to these several two field pictures.
The user's who obtains for continuous shooting several human action images adopt above-mentioned identical mode to obtain comparing result, and this comparing result and the fault-tolerant threshold value that presets are compared.
In the embodiment of the invention, action contrast unit 14 can be a primary processor, and the data after it is handled can show through outputing to video screen (being image-display units).
Embodiment 2
As another execution mode of interactive television set of the present invention, this interactive TV machine can also carry out image processing to the demonstrator's that takes in advance human action video and be stored in memory cell with standard as a reference.
Fig. 2 is the structural representation block diagram of another execution mode of interactive television set of the present invention.As shown in Figure 2, in this embodiment, interactive television set 1 comprises image acquisition units 11, graphics processing unit 12, memory cell 13, action contrast unit 14 and image-display units 15.Wherein, image acquisition units 11 comprises image unit and video processing unit, and image acquisition units 11 is arranged in the interactive television set.
Output is analog signal types for image unit; Video processing unit is used for: receive the demonstrator's of image unit shooting and transmission human action analog video signal, and said human action analog video signal is digitized into the standard operation digital video information; And/or
Be used to receive the practitioner's that image unit takes and transmit human action analog video signal, and this human action analog video signal is digitized into the human action digital video information.
S301, the image original to a frame carries out preliminary treatment, mainly is to carry out filtering and remove making an uproar.
S302 carries out dividing processing to image, is divided into human action image (demonstrator's character image just) and ambient image as a setting as prospect.
S303 extracts the human action image as target image.
S304 carries out binary conversion treatment to target image, obtains the appearance profile of human action.
For example, can pass through differential operator, Suo Beier (Sobel) operator or Prcwitt operator and realize that what finally obtain is the image that only comprises demonstrator's body limbs edge and do not have background.The purpose of this step mainly is to obtain the moulding of figure action clearly being convenient to discern, reduces unnecessary interfere information.
S305 except that making an uproar, obtains a width of cloth black and white human action image to the image after the binary conversion treatment at last.
Each two field picture in 12 pairs of video informations of graphics processing unit carries out above-mentioned processing successively, and after disposing, deposits memory cell 13 in, with the standard operation reference video as entire exercise.
The practitioner's that 12 pairs of image units of graphics processing unit are taken human action digital image information also is to handle according to above-mentioned flow process.Like this; Behind the black and white human action image that graphics processing unit 12 is convenient to practitioner's human action image processing one-tenth to contrast; As the primary processor of action contrast unit 13 extract this practitioner black and white human action image (as background be black and human body is white) and the standard operation image that this image and corresponding usefulness is for referencial use compare; Its main processing flow chart is as shown in Figure 4, comprising:
S401 extracts practitioner's black and white human action image.
S402 finds the standard operation image corresponding with this black and white human action image.
S403 compares practitioner's black and white human action image and standard operation image, and comparing result is during less than preset fault-tolerant threshold value, and execution in step S304, comparing result be during greater than preset fault-tolerant threshold value, execution in step S305.
S404 obtains the picture frame of next standard operation and passes through the image-display units demonstration.The practitioner can carry out the exercise of next action according to video like this.
S405, the standard operation image that sign is set out to do after the big body part of deviation also will identify in the standard operation image shows through image-display units, and no longer obtains the picture frame of next standard operation.The practitioner can repeat to practise current action like this, and whether consistent with standard operation the repetition exercise action that image unit will be taken the practitioner judge this repetition exercise action (also being that the result that compares with the standard operation image of repetitive operation image is less than preset fault-tolerant threshold value) for primary processor.
In the embodiment of the invention; It is to consider from simplifying to handle that each two field picture is treated to black and white binary image; If consider from angle attractive in appearance; Also can carry out more complex image processing, for example the background of removing in demonstrator's the human action original image kept image behind the personage as the image of standard operation.
In one embodiment; Above-mentioned practitioner's human action picture frame and being embodied as that the standard operation picture frame is compared: the value that every frame human action image and standard operation image subtraction are obtained is error amount, and result and the fault-tolerant threshold ratio that presets be as a comparison to choose minimum error values in a series of error amounts that obtain at last.When minimum error values when presetting fault-tolerant threshold value, action contrast unit identifies the practitioner through image processing techniques in the acceptance of the bid of standard operation image and moves the standard operation image of the big body part of difference after will identify then and show to point out the user current stroke defect through display screen.
In another embodiment, above-mentioned practitioner's human action picture frame and being embodied as that the standard operation picture frame is compared:
With Hausdorff distance as practitioner's action foundation (the Hausdorff distance is a kind of widely used template matches index) whether up to standard; The Hausdorff distance table is shown target function maximizing shown in the formula (1); Wherein point set A comes from the human action contour images that the frame in the human action image information is convenient to contrast, and point set B comes from the frame standard operation image corresponding with the human action contour images.
Given two finite point set A={a1, a2 ..., ap}, B={b1, b2 ..., bq}, A, the Hausdorff distance H between B (A B) is defined as:
H(A，B)＝max(h(A，B)，h(B，A)) (1)
Wherein h (A, B), h (B, A) dividing in addition is A → B, the oriented Hausdorff distance of B → A is defined as:
h(A，B)＝max
a∈Ad(a，B)＝max
a∈Amin
b∈Bd(a，b)
＝max
a∈Amin
b∈B‖a-b‖?(2)
h(B，A)＝max
b∈Bd(b，A)＝max
b∈Bmin
a∈Ad(b，a)
＝max
b∈Bmin
a∈A‖b-a‖?(3)
Wherein, ‖ ` ‖ representes point set A, and last certain of B is apart from norm
When two width of cloth images were identical, the Hausdorff distance was 0.When the difference of two width of cloth images is big more; The value of Hausdorff distance is also just big more; The Hausdorff distance value that therefore can practitioner's motion images and corresponding standard motion images relatively be obtained as error amount and the fault-tolerant threshold ratio that presets when the value of Hausdorff distance during less than this threshold value, thinks that practitioner's action is up to standard; When the value of Hausdorff distance surpasses the fault-tolerant threshold value that presets, think that action is not up to standard.
Because each frame motion images has very big similitude in practitioner's video; Therefore calculate the Hausdorff distance value of each frame motion images and corresponding standard operation image respectively; If the minimum value in these Hausdorff distance values is less than the threshold value of setting up to standard; Just think that practitioner's's this moment action is up to standard, can continue the exercise of subsequent action.When practitioner's action is not up to standard; The demonstration and the action contrast unit that stop the next frame standard operation on the display screen can send information to display screen; This moment, the practitioner repeated the action that makes mistakes, and image unit carries out the video information that collects and identical before processing.
Alternatively; The demonstrator's who plays through video screen standard operation image can be after graphics processing unit 20 is handled and be stored in the standard operation video of being convenient to contrast of memory cell 30; Also can be the original video of handling without graphics processing unit 20, but in action contrast unit, still compare with the standard operation black and white binary image with practitioner's human action black and white binary image.
Alternatively, the standard operation video image of standard also can be to utilize existing video data as a reference.Accordingly; Interactive television set as one embodiment of the present invention; Its video processing unit 11 can also convert the analog video data that comprises demonstrator's standard operation to computer discernible digital information, and the video data after graphics processing unit 12 will adopt mode that embodiment 2 describes to digitlization is like this handled to obtain the whole standard operation videos as normative reference.If the video data of the existing demonstrator's of comprising standard operation is the digital video data certainly, 11 of video processing units read this standard operation digital video information and send graphics processing unit then to so.Therefore the interactive television set scope of application of the present invention is extensive.
Embodiment 3
For realizing the whether purpose of standard of objective consumer-oriented human action, the present invention also provides a kind of interactive device that can be connected with display unit.As shown in Figure 5, interactive device 2 comprises graphics processing unit 22, memory cell 23 and action contrast unit 24.Wherein:
Wherein, In one embodiment; Image acquisition units comprises image unit and video processing unit; Image unit is taken and is transmitted user's human action analog video signal and gives video processing unit, and video processing unit sends graphics processing unit 22 to after user's human action analog video signal is digitized into digital video information.In one embodiment, image acquisition units is an image unit, and image unit sends the user's who takes human action digital image information to graphics processing unit.
Memory cell 23 is used for the picture frame that storage standards is moved.
Execution mode as interactive device of the present invention; The function of the corresponding unit in the function of the graphics processing unit of this interactive device, memory cell and action contrast unit and the interactive television set of the embodiment of the invention 2 descriptions is identical, repeats no more at this.Described display unit can comprise television set, notebook computer or display.
As a kind of execution mode, above-mentioned unit can be integrated on the independent integrated circuit board jointly, and this integrated circuit board can be connected with television set, also can be integrated on the circuit board in the television set.Interactive device can also be connected with computer, perhaps is connected equally with display separately and can realizes the object of the invention.
Embodiment 4
Correspondingly, the present invention also provides a kind of method of utilizing display unit realization and user interaction., said display unit comprises television set, notebook computer or display.Fig. 6 is that the display unit of utilizing of the present invention realizes and the schematic flow sheet of an execution mode of the method for user interaction that with reference to figure 6, this method may further comprise the steps:
S601 receives the human action image information that collects, and this human action image information comprises at least one frame human action image.
S602 handles and is processed into the human action image of being convenient to contrast to said human action image.
S603 compares the standard operation image corresponding with the said human action image of being convenient to contrast and the said human action image of being convenient to contrast of storage, when comparing result during less than the said fault-tolerant threshold value that presets, and execution in step S504; When comparing result during greater than the fault-tolerant threshold value that presets, execution in step S505.
S604, obtain storage than the picture frame of next standard operation of current standard operation and through said display unit demonstration.
S605 points out current human action wrong.
As another execution mode that utilizes the interactive method of display unit realization and practitioner of the present invention, this method can also may further comprise the steps:
, no longer obtain during at comparing result than the picture frame of next standard operation of current standard operation greater than the fault-tolerant threshold value that presets,
The image that the user that shooting is obtained becomes to be convenient to contrast according to current standard operation image repeater body action image processing,
Continue to compare image and the current standard operation image that the user repeats human action,
And can repeat those above-mentioned steps until comparing result during less than the said fault-tolerant threshold value that presets, the user just carries out the exercise of next human action.
In the method for the embodiment of the invention step of the image of being convenient to contrast is handled and be processed into to motion images, comprise human action image and the ambient image as a setting as prospect in the motion images carried out dividing processing; With, the human action image is carried out binary conversion treatment so that the appearance profile image of the human action that obtains being convenient to contrast.The quality of the image that is used to contrast for raising, this method can also be before carrying out the branch hugger to said motion images, and this image is carried out filtering and removes and make an uproar; And/or, the human action image after the binaryzation is carried out filtering and removes making an uproar.
About the concrete realization of these steps, also can be further with reference to the description in the graphics processing unit of the interactive television set of the embodiment of the invention, repeat no more at this.
In addition, the standard operation image as normative reference of storage also can be to adopt above-mentioned processing mode to obtain the standard operation image of being convenient to contrast.Wherein, can obtain a complete set of standard operation image that can be used for contrasting through handling standard operation video that existing standard action video data or shooting obtain.When existing standard action video data is analog video signal with the human action video of taking the demonstrator who obtains, also need earlier this analog video signal mathematics to be changed into the standard operation digital video information., repeat no more also with reference to the description of the embodiment of the invention 2 as the detailed realization of the standard operation image of normative reference at this.Therefore, that describes among the present invention handles motion images, and this motion images comprises the demonstrator's of shooting human action image, the demonstrator's in the standard operation video data human action image and practitioner's human action image.
Use interactive television set provided by the invention, interactive device; Or adopt the display unit of utilizing provided by the invention to realize the method with user interaction; Can with user's human action with carry out objective comparison with standard operation for referencial use; Thereby accurately point out the part not in place of user action; This only carries out can playing good action role of correcting the user of exercise action with text description or video data concerning those, especially concerning the person taking exercise of prevent disease or treatment disease, can play very big help, reaches the purpose of preventing diseases and keeping fit.
One of ordinary skill in the art will appreciate that all or part of step in the method that realizes the foregoing description is to instruct relevant hardware to accomplish through program; Described program can be stored in the computer read/write memory medium; This program comprises the steps: to receive when carrying out to take the human action image information that obtains, and this human action image information comprises at least one frame human action image; Said human action image is handled and is processed into the human action image of being convenient to contrast; The standard operation image corresponding with the said human action image of being convenient to contrast and the said human action image of being convenient to contrast of storage are compared,, point out current human action wrong when comparing result during greater than the fault-tolerant threshold value that presets; When comparing result during, obtain than the picture frame of next standard operation of current standard operation and through said display unit demonstration less than the said fault-tolerant threshold value that presets.Described storage medium is like ROM/RAM, magnetic disc, CD etc.
Protection scope of the present invention is not limited to disclosed specific embodiment in the above-mentioned embodiment, as long as but the combination of satisfying technical characterictic in the claim of the present invention just fall within protection scope of the present invention.
Claims (11)
1. interactive television set comprises:
Graphics processing unit is used to receive the human action image information from image acquisition units, and this human action image information comprises at least one frame human action image, and, the human action image that said human action image processing is become to be convenient to contrast;
Memory cell is used for the picture frame that storage standards is moved;
Action contrast unit; Be used for obtaining the said human action image of being convenient to contrast and obtaining and the corresponding standard operation picture frame of the said human action image of being convenient to contrast from said memory cell from said graphics processing unit; Said human action image of being convenient to contrast and said standard operation image are compared; If comparing result greater than the fault-tolerant threshold value that presets, then points out current human action wrong; If comparing result is less than the said fault-tolerant threshold value that presets, then said action contrast unit obtains than the picture frame of next standard operation of current standard operation and sends image-display units to from said memory cell and shows.
2. interactive television set according to claim 1 is characterized in that, said action contrast unit points out the current human action of user wrong comprising:
Said action contrast unit sends information and shows to image-display units; Or
Said action contrast unit identifies the standard operation image of setting out to do after the big body part of deviation also will identify and sends the image-display units demonstration in said standard operation image.
3. interactive television set according to claim 1 is characterized in that, said action contrast unit also is used at comparing result no longer obtaining the picture frame of next standard operation during greater than the fault-tolerant threshold value that presets.
4. interactive television set according to claim 1 is characterized in that:
Said graphics processing unit; Also be used to receive standard operation digital video information from image acquisition units; And successively each frame motion images of said standard operation digital video information is processed into the standard operation image of being convenient to contrast, and the standard operation picture frame that will be convenient to contrast deposits said memory cell in.
5. interactive television set according to claim 4 is characterized in that said image acquisition units comprises image unit and video processing unit, wherein:
Said video processing unit is used to read demonstrator's standard operation analog video data and this analog video data digitalization is become the standard operation digital video information; And/or
Be used to receive the demonstrator's that image unit takes and transmit standard operation analog video signal, and said standard operation analog video signal is digitized into the standard operation digital video information; And/or
Be used to receive the practitioner's that image unit takes and transmit human action analog video signal, and this human action analog video signal is digitized into the human action digital video information that belongs to said human action image information.
6. according to each described interactive television set of claim 1 to 5, it is characterized in that said graphics processing unit is processed into the motion images of being convenient to contrast to a frame motion images, comprising:
Human action image and ambient image as a setting as prospect in the motion images carried out dividing processing;
The human action image is carried out binary conversion treatment so that the appearance profile image of the human action that obtains being convenient to contrast.
7. according to each described interactive television set of claim 1 to 5, it is characterized in that said interactive television set also comprises the video processing unit of said image acquisition units or said image acquisition units.
8. an interactive device separates or is connected with display unit, and this interactive device comprises:
Graphics processing unit is used to receive the human action image information from image acquisition units, and this human action image information comprises at least one frame human action image, and, the human action image that said human action image processing is become to be convenient to contrast;
Memory cell is used for the picture frame that storage standards is moved;
Action contrast unit; Be used to obtain the said human action image of being convenient to contrast and obtain and the corresponding standard operation picture frame of the said human action image of being convenient to contrast from said memory cell; Said human action image and said standard operation image are compared; If comparing result greater than the fault-tolerant threshold value that presets, then points out current human action wrong; If comparing result is less than the said fault-tolerant threshold value that presets, then said action contrast unit obtains than the picture frame of next standard operation of current standard operation and when interactive device is connected with display unit, sends the display unit demonstration to from said memory cell.
9. one kind is utilized display unit to realize and the method for user interaction that this method comprises:
The human action image information that reception collects, this human action image information comprise at least one frame human action image;
Said human action image is handled and is processed into the human action image of being convenient to contrast;
The standard operation image corresponding with the said human action image of being convenient to contrast and the said human action image of being convenient to contrast of storage are compared,
When comparing result during, point out current human action wrong greater than the fault-tolerant threshold value that presets;
When comparing result during less than the said fault-tolerant threshold value that presets, obtain storage than the picture frame of next standard operation of current standard operation and through said display unit demonstration.
10. method according to claim 9 is characterized in that, said method also comprises:
At comparing result during greater than the fault-tolerant threshold value that presets; No longer obtain the picture frame of next standard operation of storage, so as when the user repeats current human action, to continue human action image that contrast gathers and current standard operation image until comparing result less than the said fault-tolerant threshold value that presets.
11. method according to claim 9 is characterized in that, said method also comprises:
That reception collects or obtain existing standard action digital video information, perhaps, receive collect or obtain existing standard action simulation vision signal and be digitized into the standard operation digital video information;
Motion images sequence in the said standard operation digital video information is handled successively, and is processed into the standard operation image of being convenient to contrast; Wherein:
In the said method motion images of being convenient to contrast is handled and be processed into to motion images comprises:
Human action image and ambient image as a setting as prospect in the motion images carried out dividing processing;
The human action image is carried out binary conversion treatment so that the appearance profile image of the human action that obtains being convenient to contrast.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100795768A CN102724449A (en) | 2011-03-31 | 2011-03-31 | Interactive TV and method for realizing interaction with user by utilizing display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100795768A CN102724449A (en) | 2011-03-31 | 2011-03-31 | Interactive TV and method for realizing interaction with user by utilizing display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102724449A true CN102724449A (en) | 2012-10-10 |
Family
ID=46950100
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100795768A Pending CN102724449A (en) | 2011-03-31 | 2011-03-31 | Interactive TV and method for realizing interaction with user by utilizing display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102724449A (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103713545A (en) * | 2013-12-17 | 2014-04-09 | 华为技术有限公司 | Operation guiding method, device and system |
| CN104539888A (en) * | 2014-12-16 | 2015-04-22 | 广西科技大学 | Video monitoring method for closed-chest cardiac massage in cardio-pulmonary resuscitation first aid training |
| CN104935879A (en) * | 2014-03-19 | 2015-09-23 | 通用汽车环球科技运作有限责任公司 | Multi-View Human Detection Using Semi-Exhaustive Search |
| CN105208422A (en) * | 2014-06-26 | 2015-12-30 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN105451829A (en) * | 2013-06-13 | 2016-03-30 | 生化游戏有限公司 | Personal digital trainer for physiotheraputic and rehabilitative video games |
| CN105451827A (en) * | 2013-06-13 | 2016-03-30 | 生化游戏有限公司 | Rehabilitative posture and gesture recognition |
| CN106228143A (en) * | 2016-08-02 | 2016-12-14 | 王国兴 | A kind of method that instructional video is marked with camera video motion contrast |
| CN106792080A (en) * | 2016-12-07 | 2017-05-31 | 北京小米移动软件有限公司 | Video broadcasting method and device |
| CN107169262A (en) * | 2017-03-31 | 2017-09-15 | 百度在线网络技术（北京）有限公司 | Recommend method, device, equipment and the computer-readable storage medium of body shaping scheme |
| CN107920269A (en) * | 2017-11-23 | 2018-04-17 | 乐蜜有限公司 | Video generation method, device and electronic equipment |
| CN107952238A (en) * | 2017-11-23 | 2018-04-24 | 乐蜜有限公司 | Video generation method, device and electronic equipment |
| CN108121963A (en) * | 2017-12-21 | 2018-06-05 | 北京奇虎科技有限公司 | Processing method, device and the computing device of video data |
| CN108492311A (en) * | 2018-03-15 | 2018-09-04 | 北京小米移动软件有限公司 | The method and device of action correction is carried out by electronic equipment |
| CN108519822A (en) * | 2018-03-29 | 2018-09-11 | 北京微播视界科技有限公司 | Action matching system, method, storage medium and interactive device based on human-computer interaction |
| CN108536293A (en) * | 2018-03-29 | 2018-09-14 | 北京字节跳动网络技术有限公司 | Man-machine interactive system, method, computer readable storage medium and interactive device |
| CN108567565A (en) * | 2018-05-15 | 2018-09-25 | 浙江工业大学 | A kind of flexible normalizing instrument of CPR action |
| CN109145814A (en) * | 2018-08-20 | 2019-01-04 | 贺州学院 | safety evaluation method and device |
| CN109985380A (en) * | 2019-04-09 | 2019-07-09 | 北京马尔马拉科技有限公司 | Internet gaming man-machine interaction method and system |
| WO2019184633A1 (en) * | 2018-03-29 | 2019-10-03 | 北京字节跳动网络技术有限公司 | Human-machine interaction system, method, computer readable storage medium, and interaction device |
| WO2021032092A1 (en) * | 2019-08-18 | 2021-02-25 | 聚好看科技股份有限公司 | Display device |
| CN113591524A (en) * | 2020-04-30 | 2021-11-02 | 聚好看科技股份有限公司 | Display device and interface display method |
| CN113678137A (en) * | 2019-08-18 | 2021-11-19 | 聚好看科技股份有限公司 | Display device |
| CN113944396A (en) * | 2021-10-25 | 2022-01-18 | 上海网车科技有限公司 | System and method for automatically opening front trunk door of vehicle |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1887386A (en) * | 2006-07-24 | 2007-01-03 | 北方工业大学 | Index dial analysis method and device of golf trace |
| CN101202994A (en) * | 2006-12-14 | 2008-06-18 | 北京三星通信技术研究有限公司 | Method and device assistant to user for body-building |
| CN201349264Y (en) * | 2008-12-30 | 2009-11-18 | 深圳市同洲电子股份有限公司 | Motion image processing device and system |
| CN201519460U (en) * | 2009-10-22 | 2010-07-07 | 友声电子有限公司 | Improved equipment for analyzing athlete actions |
-
2011
- 2011-03-31 CN CN2011100795768A patent/CN102724449A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1887386A (en) * | 2006-07-24 | 2007-01-03 | 北方工业大学 | Index dial analysis method and device of golf trace |
| CN101202994A (en) * | 2006-12-14 | 2008-06-18 | 北京三星通信技术研究有限公司 | Method and device assistant to user for body-building |
| CN201349264Y (en) * | 2008-12-30 | 2009-11-18 | 深圳市同洲电子股份有限公司 | Motion image processing device and system |
| CN201519460U (en) * | 2009-10-22 | 2010-07-07 | 友声电子有限公司 | Improved equipment for analyzing athlete actions |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105451827A (en) * | 2013-06-13 | 2016-03-30 | 生化游戏有限公司 | Rehabilitative posture and gesture recognition |
| CN105451829A (en) * | 2013-06-13 | 2016-03-30 | 生化游戏有限公司 | Personal digital trainer for physiotheraputic and rehabilitative video games |
| CN103713545A (en) * | 2013-12-17 | 2014-04-09 | 华为技术有限公司 | Operation guiding method, device and system |
| CN104935879A (en) * | 2014-03-19 | 2015-09-23 | 通用汽车环球科技运作有限责任公司 | Multi-View Human Detection Using Semi-Exhaustive Search |
| CN105208422A (en) * | 2014-06-26 | 2015-12-30 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104539888B (en) * | 2014-12-16 | 2018-06-05 | 广西科技大学 | The video frequency monitoring method of closed cardiac massage art in CPR first aid training |
| CN104539888A (en) * | 2014-12-16 | 2015-04-22 | 广西科技大学 | Video monitoring method for closed-chest cardiac massage in cardio-pulmonary resuscitation first aid training |
| CN106228143A (en) * | 2016-08-02 | 2016-12-14 | 王国兴 | A kind of method that instructional video is marked with camera video motion contrast |
| CN106792080A (en) * | 2016-12-07 | 2017-05-31 | 北京小米移动软件有限公司 | Video broadcasting method and device |
| CN107169262A (en) * | 2017-03-31 | 2017-09-15 | 百度在线网络技术（北京）有限公司 | Recommend method, device, equipment and the computer-readable storage medium of body shaping scheme |
| CN107169262B (en) * | 2017-03-31 | 2021-11-23 | 百度在线网络技术（北京）有限公司 | Method, device, equipment and computer storage medium for recommending body shaping scheme |
| CN107920269A (en) * | 2017-11-23 | 2018-04-17 | 乐蜜有限公司 | Video generation method, device and electronic equipment |
| CN107952238A (en) * | 2017-11-23 | 2018-04-24 | 乐蜜有限公司 | Video generation method, device and electronic equipment |
| WO2019100755A1 (en) * | 2017-11-23 | 2019-05-31 | 乐蜜有限公司 | Video generation method and device, and electronic apparatus |
| CN107952238B (en) * | 2017-11-23 | 2020-11-17 | 香港乐蜜有限公司 | Video generation method and device and electronic equipment |
| CN108121963A (en) * | 2017-12-21 | 2018-06-05 | 北京奇虎科技有限公司 | Processing method, device and the computing device of video data |
| CN108492311A (en) * | 2018-03-15 | 2018-09-04 | 北京小米移动软件有限公司 | The method and device of action correction is carried out by electronic equipment |
| CN108519822A (en) * | 2018-03-29 | 2018-09-11 | 北京微播视界科技有限公司 | Action matching system, method, storage medium and interactive device based on human-computer interaction |
| CN108536293A (en) * | 2018-03-29 | 2018-09-14 | 北京字节跳动网络技术有限公司 | Man-machine interactive system, method, computer readable storage medium and interactive device |
| CN108536293B (en) * | 2018-03-29 | 2020-06-30 | 北京字节跳动网络技术有限公司 | Man-machine interaction system, man-machine interaction method, computer-readable storage medium and interaction device |
| WO2019184634A1 (en) * | 2018-03-29 | 2019-10-03 | 北京字节跳动网络技术有限公司 | Human-machine interaction system, method, computer readable storage medium, and interaction device |
| WO2019184633A1 (en) * | 2018-03-29 | 2019-10-03 | 北京字节跳动网络技术有限公司 | Human-machine interaction system, method, computer readable storage medium, and interaction device |
| CN108567565A (en) * | 2018-05-15 | 2018-09-25 | 浙江工业大学 | A kind of flexible normalizing instrument of CPR action |
| CN109145814A (en) * | 2018-08-20 | 2019-01-04 | 贺州学院 | safety evaluation method and device |
| CN109985380A (en) * | 2019-04-09 | 2019-07-09 | 北京马尔马拉科技有限公司 | Internet gaming man-machine interaction method and system |
| WO2021032092A1 (en) * | 2019-08-18 | 2021-02-25 | 聚好看科技股份有限公司 | Display device |
| CN113678137A (en) * | 2019-08-18 | 2021-11-19 | 聚好看科技股份有限公司 | Display device |
| US11924513B2 (en) | 2019-08-18 | 2024-03-05 | Juhaokan Technology Co., Ltd. | Display apparatus and method for display user interface |
| CN113678137B (en) * | 2019-08-18 | 2024-03-12 | 聚好看科技股份有限公司 | Display apparatus |
| CN113591524A (en) * | 2020-04-30 | 2021-11-02 | 聚好看科技股份有限公司 | Display device and interface display method |
| CN113944396A (en) * | 2021-10-25 | 2022-01-18 | 上海网车科技有限公司 | System and method for automatically opening front trunk door of vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102724449A (en) | Interactive TV and method for realizing interaction with user by utilizing display device | |
| CN105654471B (en) | Augmented reality AR system and method applied to internet video live streaming | |
| CN111368810B (en) | Sit-up detection system and method based on human body and skeleton key point identification | |
| CN107105310B (en) | Human image replacing method and device in video live broadcast and recording and broadcasting system | |
| CN106791485B (en) | Video switching method and device | |
| CN105635669B (en) | The movement comparison system and method for data and real scene shooting video are captured based on three-dimensional motion | |
| CN111444748B (en) | Sitting posture detection method, device, equipment and storage medium | |
| CN108304793A (en) | On-line study analysis system and method | |
| WO2000021065A1 (en) | Method and apparatus for processing, displaying and communicating images | |
| WO2018214520A1 (en) | Method and apparatus for synchronizing video data and exercise effect animation | |
| CN101242474A (en) | A dynamic video browse method for phone on small-size screen | |
| CN109922352A (en) | A kind of data processing method, device, electronic equipment and readable storage medium storing program for executing | |
| CN110751100A (en) | Auxiliary training method and system for stadium | |
| CN112749684A (en) | Cardiopulmonary resuscitation training and evaluating method, device, equipment and storage medium | |
| CN208172727U (en) | Scientific and technological exhibition room motion sensing manipulation polymerize display systems with face recognition | |
| CN110490173B (en) | Intelligent action scoring system based on 3D somatosensory model | |
| CN114100103B (en) | Rope skipping counting detection system and method based on key point identification | |
| CN109472230B (en) | Automatic athlete shooting recommendation system and method based on pedestrian detection and Internet | |
| CN114618142A (en) | Auxiliary training system and method for table tennis sports | |
| US20230166157A1 (en) | Electronic apparatus and control method therefor | |
| CN116913178B (en) | Spliced screen linkage system and video splicing method | |
| CN111312363B (en) | Double-hand coordination enhancement system based on virtual reality | |
| CN116055684B (en) | Online physical education system based on picture monitoring | |
| CN112288876A (en) | Long-distance AR identification server and system | |
| CN103198519A (en) | Virtual character photographic system and virtual character photographic method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20121010 |