CN108882044A - A kind of Digital Media enhancing display interaction method - Google Patents
A kind of Digital Media enhancing display interaction method Download PDFInfo
- Publication number
- CN108882044A CN108882044A CN201810746247.6A CN201810746247A CN108882044A CN 108882044 A CN108882044 A CN 108882044A CN 201810746247 A CN201810746247 A CN 201810746247A CN 108882044 A CN108882044 A CN 108882044A
- Authority
- CN
- China
- Prior art keywords
- content
- video
- frame
- digital media
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Abstract
The present invention proposes that Digital Media enhancing shows interaction method, is related to augmented reality field, is divided into four steps：Video processing, dynamic capture, information superposition, real-time, interactive.It needs to optimize video file processing first, extract interaction required content and relevant information, and setting is easier to the content of camera capture in image information, when the camera using equipment such as plate or mobile phones captures current information, interactive window will be popped up in real time, be selected and be manipulated for experiencer.It realizes the deep observation to product information, understands, and exchanged with other viewers, can also carry out lower single operation according to real time link.The present invention will combine conventional video information and data information, realize human-computer interaction, can operate directly by carry-on mobile phone to video, easy to use, convenient and efficient, the video way of promotion of product, film be become more intuitive, more effectively, experience sense is stronger.
Description
Technical field
The present invention relates to augmented reality field, especially a kind of Digital Media enhancing shows interaction method.
Background technique
AR (augmented reality) phantom be derived from augmented reality, and virtual reality technology be it is a kind of by real world information with
The new technology of virtual world information Seamless integration-, it after analog simulation and is superimposed, by virtual letter by the science and technology such as computer
Breath is applied to real world, to reach the sensory experience of exceeding reality.True environment and virtual information are added in real time
The same picture or space exist simultaneously.
AR phantom belongs to deeper AR technical application, is the vertical field exploitation on video interactive, it, which is utilized, contains
The interactive device (such as ipad, mobile phone etc.) of camera carries out real-time capture to film information and is superimposed, and real in overlapped information
Now go deep into human-computer interaction, it can be achieved that product advertising, film, the autonomous calling of the internal informations such as TV play is consulted, even to view
Favorite product in frequency directly contacts, and AR technology is applied to the level closer to daily life by purchase.
Common video file frame per second is generally between 24fps-60fps at present, the capture to video, in reading speed,
Accordingly, very high standard is needed in accuracy, common AR technology can not also carry out nothing to excessively complicated dynamic menu and prolong
Slow capture, therefore, camera are significantly larger than static images or scene for the capture difficulty of living document.And traditional view
Frequency mode, intake information is more single, and the deep access that cannot achieve information is called and manipulation, and more leisure opinion human-computer interaction cannot
Real-time response according to demand.
Summary of the invention
The present invention is intended to provide a kind of Digital Media enhancing shows interaction method, it will by conventional video information and data information
In conjunction with realization human-computer interaction, experience sense is stronger, to solve the above-mentioned problems of the prior art.For this purpose, the tool that the present invention uses
Body technique scheme is as follows：
A kind of Digital Media enhancing display interaction method, specifically includes following steps：
Step 1, video processing disassemble video before being handled for target video, find in video
Point of interest carries out content superposition；
Step 2, dynamic capture, and current taken content is obtained by video camera, by algorithmic match frame by frame with
Afterwards, judge whether to match with previously stored key frame；
The content of the content and superimposed layer and alternation of bed of video camera shooting is overlapped, presents by step 3, information superposition
To user；
Step 4, real-time, interactive, by augmented reality frame, program main thread and the common reciprocal of interaction response frame,
The common video content cooperated so that entire program can be taken with real-time response of three frames, and it is identified in key frame
To when the corresponding processing logic of triggering.
Preferably, the point of interest is the part for needing to carry out deep processing in video, the interest in the step 1
Point is come out by handmarking, subsequent to carry out interaction content design around each point of interest.
Preferably, the key frame in a program shoots camera to the video extraction key frame of the point of interest
To content be compared, the key frame can be recognized by being matched to after image, and the key frame marker is come out, is submitted to
Program main logic is responded, and described program main logic section interacts response according to the response contents with planning agreement.
Preferably, the content of the video camera shooting directly displays on screen in the step 3, do not need to appoint
What is processed.
Preferably, the content of the superimposed layer is different according to the key frame currently identified, meeting in the step 3
Additive Model and textures information enter in scene.
Preferably, the content of the alternation of bed is believed according to the interaction of current key frame superposition user in the step 3
Breath, it is corresponding that the content of the alternation of bed determines that user's click screen is made.
Preferably, the augmented reality frame is for identifying the content that camera takes and to be matched
Key frame picture library is matched, and after identifying, described program main thread is transferred to be handled.
Preferably, the interaction response frame is used to handle click, the stroke event of user, described program main line is transferred to
Cheng Jinhang processing.
A kind of Digital Media enhancing provided by the invention shows interaction method, the beneficial effect is that：Conventional video is believed
Breath will be combined with data information, be realized human-computer interaction, can be operated directly by carry-on mobile phone to video, easy to use, side
Just quick, the video way of promotion of product, film is become more intuitive, more effectively, experience sense is stronger.
Detailed description of the invention
Fig. 1 is Video Key point label schematic diagram；
Fig. 2 is information superposition schematic diagram；
Fig. 3 is the flow chart of real-time, interactive.
Specific embodiment
To further illustrate that each embodiment, the present invention are provided with attached drawing.These attached drawings are that the invention discloses one of content
Point, mainly to illustrate embodiment, and the associated description of specification can be cooperated to explain the operation principles of embodiment.Cooperation ginseng
These contents are examined, those of ordinary skill in the art will be understood that other possible embodiments and advantages of the present invention.In figure
Component be not necessarily to scale, and similar component symbol is conventionally used to indicate similar component.
Now in conjunction with the drawings and specific embodiments, the present invention is further described.
Digital Media enhancing provided in this embodiment shows interaction method, is divided into four steps：Video processing, dynamically catches
It catches, information superposition, real-time, interactive.It needs to optimize video file processing first, extracts the required content of interaction and related letter
Breath, and setting is easier to the content of camera capture in image information, when the camera using equipment such as plate or mobile phones is caught
When grasping current information, interactive window will be popped up in real time, selects and manipulates for experiencer.Realize the deep sight to product information
It surveys, understands, and exchanged with other viewers, can also carry out lower single operation according to real time link.
Detailed process is as follows for each step：
Step 1, video processing disassemble video before being handled for target video, find in video
Point of interest carries out content superposition.Wherein, point of interest is to need to carry out the part of deep processing in video, for example video is to introduce one
Vehicle, then the place of some vehicle sections features, the as point of interest of the video in video, the point of interest is by handmarking
Out, as shown in Figure 1, subsequent carry out interaction content design around each point of interest, such as some point of interest is to introduce
The accelerating ability of automobile, then just need project staff consider how to introduce this partial content, it is subsequent with interaction content into
Row is realized.To the video extraction key frame for marking point of interest, these key frames will in a program clap camera later
The content taken the photograph is compared, and if there is algorithmic match to image, i.e., can recognize the key frame, algorithm can be by the key frame mark
Note comes out, and submits to program main logic and is responded, and the response contents of program main logic section meeting basis and planning agreement carry out
Interaction response.
Step 2, dynamic capture, and are obtained in currently taken by the video camera of the equipment such as mobile phone or tablet computer
Hold, after algorithmic match frame by frame, judges whether to match with previously stored key frame；
The content of the content and superimposed layer and alternation of bed of video camera shooting is overlapped, presents by step 3, information superposition
To user, as shown in Figure 2.The content of video camera shooting directly displays on screen, does not need to do any processing；Superimposed layer it is interior
Hold, can be different according to the key frame that currently identifies, can be superimposed some models, textures, etc. information enter in scene, this part
Content can determine that the information of superposition is according to the difference of current key frame；The content of alternation of bed is according to current key
Frame is superimposed the interactive information of user, and it is corresponding that the content of the alternation of bed determines that user's click screen is made.
Step 4, real-time, interactive, by augmented reality frame, program main thread and the common reciprocal of interaction response frame,
As shown in Figure 3.Augmented reality frame is used to identify the content that camera takes and key frame picture library to be matched
It is matched, after identifying, described program main thread is transferred to be handled, interaction response frame is used to handle the point of user
It hits, stroke event, described program main thread is transferred to be handled, the common cooperation of three frames allows entire program real-time
The video content taken is responded, and triggers corresponding processing logic when key frame is identified to.
Although specifically showing and describing the present invention in conjunction with preferred embodiment, those skilled in the art should be bright
It is white, it is not departing from the spirit and scope of the present invention defined by the appended claims, it in the form and details can be right
The present invention makes a variety of changes, and is protection scope of the present invention.
Claims (8)
1. a kind of Digital Media enhancing shows interaction method, which is characterized in that specifically include following steps：
Step 1, video processing disassemble video before being handled for target video, find the interest in video
Point carries out content superposition；
Step 2, dynamic capture, and obtain current taken content by video camera and sentence after algorithmic match frame by frame
It is disconnected whether to match with previously stored key frame；
The content of the content and superimposed layer and alternation of bed of video camera shooting is overlapped, is presented to use by step 3, information superposition
Family；
Step 4, real-time, interactive, by augmented reality frame, program main thread and the common reciprocal of interaction response frame, three
The common video content cooperated so that entire program can be taken with real-time response of frame, and be identified in key frame
When the corresponding processing logic of triggering.
2. a kind of Digital Media enhancing as described in claim 1 shows interaction method, which is characterized in that in the step 1, institute
Stating point of interest is the part for needing to carry out deep processing in video, and the point of interest is come out by handmarking, subsequent to surround each institute
It states point of interest and carries out interaction content design.
3. a kind of Digital Media enhancing as claimed in claim 2 shows interaction method, which is characterized in that the point of interest
Video extraction key frame, the key frame are in a program compared the content that camera takes, and are matched to after image i.e.
The key frame can be recognized, the key frame marker is come out, program main logic is submitted to and is responded, described program master patrols
It collects part and interacts response according to the response contents with planning agreement.
4. a kind of Digital Media enhancing as described in claim 1 shows interaction method, which is characterized in that in the step 3, institute
The content for stating video camera shooting directly displays on screen, does not need to do any processing.
5. a kind of Digital Media enhancing as described in claim 1 shows interaction method, which is characterized in that in the step 3, institute
The content for stating superimposed layer, different according to the key frame currently identified, meeting Additive Model and textures information enter in scene.
6. a kind of Digital Media enhancing as described in claim 1 shows interaction method, which is characterized in that in the step 3, institute
The content of alternation of bed is stated according to the interactive information of current key frame superposition user, the content of the alternation of bed determines that user clicks
Screen is made corresponding.
7. a kind of Digital Media enhancing as described in claim 1 shows interaction method, which is characterized in that the augmented reality frame
Frame is used to identify the content that camera takes and key frame picture library to be matched matches, after identifying,
Described program main thread is transferred to be handled.
8. a kind of Digital Media enhancing as described in claim 1 shows interaction method, which is characterized in that the interaction response frame
Frame is used to handle click, the stroke event of user, and described program main thread is transferred to be handled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810746247.6A CN108882044A (en) | 2018-07-09 | 2018-07-09 | A kind of Digital Media enhancing display interaction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810746247.6A CN108882044A (en) | 2018-07-09 | 2018-07-09 | A kind of Digital Media enhancing display interaction method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108882044A true CN108882044A (en) | 2018-11-23 |
Family
ID=64300312
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810746247.6A Pending CN108882044A (en) | 2018-07-09 | 2018-07-09 | A kind of Digital Media enhancing display interaction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108882044A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103929669A (en) * | 2014-04-30 | 2014-07-16 | 成都理想境界科技有限公司 | Interactive video generator, player, generating method and playing method |
| US20150117703A1 (en) * | 2013-10-25 | 2015-04-30 | TCL Research America Inc. | Object identification system and method |
| CN104661101A (en) * | 2013-11-22 | 2015-05-27 | 胜华科技股份有限公司 | System and method for providing augmented reality effect for multimedia data |
| CN105468142A (en) * | 2015-11-16 | 2016-04-06 | 上海璟世数字科技有限公司 | Interaction method and system based on augmented reality technique, and terminal |
| CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
| CN107247510A (en) * | 2017-04-27 | 2017-10-13 | 成都理想境界科技有限公司 | A kind of social contact method based on augmented reality, terminal, server and system |
| CN107484013A (en) * | 2017-08-09 | 2017-12-15 | 北京中视广信科技有限公司 | A kind of method that television program interaction is carried out using mobile device |
| US20180035096A1 (en) * | 2014-03-20 | 2018-02-01 | Ipc Hk Limited | Automated 3d photo booth |
-
2018
- 2018-07-09 CN CN201810746247.6A patent/CN108882044A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150117703A1 (en) * | 2013-10-25 | 2015-04-30 | TCL Research America Inc. | Object identification system and method |
| CN104661101A (en) * | 2013-11-22 | 2015-05-27 | 胜华科技股份有限公司 | System and method for providing augmented reality effect for multimedia data |
| US20180035096A1 (en) * | 2014-03-20 | 2018-02-01 | Ipc Hk Limited | Automated 3d photo booth |
| CN103929669A (en) * | 2014-04-30 | 2014-07-16 | 成都理想境界科技有限公司 | Interactive video generator, player, generating method and playing method |
| CN105468142A (en) * | 2015-11-16 | 2016-04-06 | 上海璟世数字科技有限公司 | Interaction method and system based on augmented reality technique, and terminal |
| CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
| CN107247510A (en) * | 2017-04-27 | 2017-10-13 | 成都理想境界科技有限公司 | A kind of social contact method based on augmented reality, terminal, server and system |
| CN107484013A (en) * | 2017-08-09 | 2017-12-15 | 北京中视广信科技有限公司 | A kind of method that television program interaction is carried out using mobile device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112348969B (en) | Display method and device in augmented reality scene, electronic equipment and storage medium | |
| CN111556278B (en) | Video processing method, video display device and storage medium | |
| CN109902659B (en) | Method and apparatus for processing human body image | |
| CN109727303B (en) | Video display method, system, computer equipment, storage medium and terminal | |
| CN106355153A (en) | Virtual object display method, device and system based on augmented reality | |
| US10671841B2 (en) | Attribute state classification | |
| CN107633441A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
| CN103997687B (en) | For increasing the method and device of interaction feature to video | |
| WO2021098338A1 (en) | Model training method, media information synthesizing method, and related apparatus | |
| JPH08508597A (en) | Information management in endoscopy system | |
| CN108388882A (en) | Based on the gesture identification method that the overall situation-part is multi-modal RGB-D | |
| US20210248788A1 (en) | Virtual and real composite image data generation method, virtual and real images compositing system, trained model generation method, virtual and real composite image data generation device | |
| CN109035415B (en) | Virtual model processing method, device, equipment and computer readable storage medium | |
| CN112927349B (en) | Three-dimensional virtual special effect generation method and device, computer equipment and storage medium | |
| CN109241956A (en) | Method, apparatus, terminal and the storage medium of composograph | |
| WO2022151655A1 (en) | Data set generation method and apparatus, forgery detection method and apparatus, device, medium and program | |
| CN111970557A (en) | Image display method, image display device, electronic device, and storage medium | |
| CN103294803A (en) | Method and system for augmenting product information introduction and realizing man-machine interaction | |
| CN111598996B (en) | Article 3D model display method and system based on AR technology | |
| CN113766296A (en) | Live broadcast picture display method and device | |
| CN114598919B (en) | Video processing method, device, computer equipment and storage medium | |
| KR101642200B1 (en) | Apparatus and method for generating motion effects by analyzing motion of object | |
| CN115170400A (en) | Video repair method, related device, equipment and storage medium | |
| CN104898954B (en) | A kind of interactive browsing method based on augmented reality | |
| CN113163135B (en) | Animation adding method, device, equipment and medium for video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |