CN107452067A - Demenstration method, device and terminal device based on augmented reality - Google Patents
Demenstration method, device and terminal device based on augmented reality Download PDFInfo
- Publication number
- CN107452067A CN107452067A CN201710633384.4A CN201710633384A CN107452067A CN 107452067 A CN107452067 A CN 107452067A CN 201710633384 A CN201710633384 A CN 201710633384A CN 107452067 A CN107452067 A CN 107452067A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- video
- demonstration
- superimposed
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 189
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000000694 effects Effects 0.000 claims abstract description 27
- 230000011218 segmentation Effects 0.000 claims abstract description 21
- 238000004590 computer program Methods 0.000 claims description 21
- 239000000463 material Substances 0.000 claims description 18
- 238000005520 cutting process Methods 0.000 claims description 7
- 238000003860 storage Methods 0.000 claims description 7
- 230000002708 enhancing effect Effects 0.000 claims description 5
- 238000000605 extraction Methods 0.000 claims description 3
- 238000010030 laminating Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 230000002452 interceptive effect Effects 0.000 description 5
- 239000003550 marker Substances 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 235000003181 Panax pseudoginseng Nutrition 0.000 description 1
- 244000131316 Panax pseudoginseng Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005553 drilling Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000004549 pulsed laser deposition Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Tourism & Hospitality (AREA)
- Educational Administration (AREA)
- Economics (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Educational Technology (AREA)
- Computer Graphics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention is applied to augmented reality field, there is provided a kind of demenstration method based on augmented reality, device and terminal device, including：Determine to demonstrate current presentation face in kind when demonstrator is demonstrated, and augmented reality model corresponding with the current presentation face is searched according to the current presentation face；Augmented reality model corresponding to the current presentation face is extracted, and the augmented reality model is superimposed in original video, forms target video；The target video for being superimposed with the augmented reality model is subjected to video pictures segmentation, so as to realize the picture effect of actual situation combination.By the above method spectators can be facilitated to understand viewing demonstration, improve demonstrating effect.
Description
Technical field
The invention belongs to augmented reality field, more particularly to a kind of demenstration method based on augmented reality, device and
Terminal device.
Background technology
Augmented reality (Augmented Reality, abbreviation AR) is the numerous well-known universities of Abroad in Recent Years and research institution
One of study hotspot.AR technologies are emerging technologies developed in recent years, and its core is by virtual content and necessary being
Content carry out real time fusion, the interaction formed between virtual, reality, so as to create brand-new experience.Augmented reality at present
(AR) technology be applied to the industries such as education, medical treatment example it is more and more.With reference to AR technologies, more comprehensively can vivo show
The characteristic of target.
In current teaching demonstration mode, most demonstrators are still more with traditional projection, blackboard, blank or audio-visual teaching materials etc.
The demonstration mode of member.But above-mentioned demonstration mode is although polynary, but when demonstrator will demonstrate the demonstration thing in hand, except
Live front-seat spectators, although from demonstrator farther out and the people outside demonstration classroom can see the demonstration of demonstrator by video,
But demonstration thing can not be clearly visible that, so as to cause demonstrating effect bad.
The content of the invention
In view of this, the embodiments of the invention provide a kind of demenstration method based on augmented reality, device and terminal device,
In kind smaller to solve demonstration in the prior art, spectators can not be clearly visible that the problem of demonstration thing causes demonstrating effect bad.
First aspect of the embodiment of the present invention provides a kind of demenstration method based on augmented reality, described to be based on augmented reality
Demenstration method include：
Determine to demonstrate current presentation face in kind when demonstrator is demonstrated, and according to current presentation face lookup and institute
State augmented reality model corresponding to current presentation face；
Augmented reality model corresponding to the current presentation face is extracted, and the augmented reality model is superimposed to original regard
In frequency, target video is formed；
The target video for being superimposed with the augmented reality model is subjected to video pictures segmentation, so as to realize actual situation combination
Picture effect.
The embodiment of the present invention is preferably based in a first aspect, in the first possible implementation, the determination is demonstrated
Current presentation face in kind is demonstrated when person is demonstrated, and it is corresponding with the current presentation face according to current presentation face lookup
Augmented reality model demonstration it is in kind, specifically include：
Determine the mark in demonstration current presentation face in kind；
In the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind, search real with the demonstration
The current presentation face of thing marks corresponding augmented reality model.
The embodiment of the present invention is preferably based in a first aspect, in second of possible implementation, described in the extraction
Augmented reality model corresponding to current presentation face, and the augmented reality model is superimposed in original video, form target and regard
Frequently, specifically include：
Gather the frame of video with demonstration original background image in kind in original video；
The augmented reality model is superimposed upon the position that the demonstration is in kind in the frame of video, forms target video.
The embodiment of the present invention is preferably based in a first aspect, in the third possible implementation, it is described to be superimposed with
The target video of the augmented reality model carries out video pictures segmentation, so as to realize the picture effect of actual situation combination, specific bag
Include：
It is divided into the first split screen and the second split screen to draw in the target video picture for being superimposed with the augmented reality model
Face, first split screen are shown side by side with second split screen；
Wherein, first split screen shows the target video for being superimposed with the augmented reality model, described second point
Screen picture only shows the augmented reality model.
The embodiment of the present invention is preferably based in a first aspect, in the 4th kind of possible implementation, will be superimposed with described
The target video picture of augmented reality model is divided into the first display picture and the second display picture, and second display picture exists
Among first display picture；
Wherein, first display picture shows the target video for being superimposed with the augmented reality model, and described second is aobvious
Show that picture only shows the augmented reality model, or, second display picture, which is shown, is superimposed with the augmented reality model
Target video, first display picture only shows the augmented reality model.
Second aspect of the present invention provides a kind of apparatus for demonstrating based on augmented reality, the demonstration based on augmented reality
Device includes：
Model determining unit, demonstration current presentation face in kind during for determining that demonstrator is demonstrated, and according to described
Search augmented reality model corresponding with the current presentation face in current presentation face；
Model superpositing unit, for extracting augmented reality model corresponding to the current presentation face, and the enhancing is existing
Real mould is superimposed in original video, forms target video；
Picture cutting unit, for the target video for being superimposed with the augmented reality model to be carried out into video pictures segmentation,
So as to realize the picture effect of actual situation combination.
Second aspect of the embodiment of the present invention is preferably based on, in the first possible implementation, the model determines
Unit specifically includes：
Determining module is marked, for determining the mark in demonstration current presentation face in kind；
Model searching modul, in the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind
In, search the augmented reality model corresponding with the mark in the current presentation face that the demonstration is in kind.
Second aspect of the embodiment of the present invention is preferably based on, in second of possible implementation, the model superposition
Unit specifically includes：
Frame of video acquisition module, for gathering the video with demonstration original background image in kind in original video
Frame；
Model laminating module, for the augmented reality model to be superimposed upon into the position that the demonstration is in kind in the frame of video
Put, form target video.
Second aspect of the embodiment of the present invention is preferably based on, in the third possible implementation, the picture segmentation
Unit specifically includes：
First segmentation module, for the target video picture for being superimposed with the augmented reality model to be divided into the first split screen
Picture and the second split screen, first split screen show side by side with second split screen, wherein, described first point
Screen picture shows the target video for being superimposed with the augmented reality model, and second split screen only shows the augmented reality
Model.
Second aspect of the embodiment of the present invention is preferably based on, in the 4th kind of possible implementation, the picture segmentation
Unit specifically includes：
Second segmentation module, for the target video picture for being superimposed with the augmented reality model to be divided into the first display
Picture and the second display picture, second display picture among first display picture, wherein, it is described first display picture
Face shows the target video for being superimposed with the augmented reality model, and second display picture only shows the augmented reality mould
Type, or, second display picture shows the target video for being superimposed with the augmented reality model, first display picture
Only show the augmented reality model.
Third aspect present invention provides a kind of terminal device, including：Memory, processor and it is stored in the storage
In device and the computer program that can run on the processor, realized as above during computer program described in the computing device
The step of demenstration method.
Fourth aspect present invention provides a kind of computer-readable recording medium, the computer-readable recording medium storage
There is the step of computer program, the computer program realizes demenstration method as described above when being executed by processor.
Existing beneficial effect is the embodiment of the present invention compared with prior art：The embodiment of the present invention is by determining demonstrator
Current presentation face in kind is demonstrated when being demonstrated, and it is corresponding with the current presentation face according to current presentation face lookup
Augmented reality model, and then augmented reality model corresponding to the current presentation face is extracted, and the augmented reality model is folded
Add in original video, form target video, the target video for being superimposed with the augmented reality model is finally subjected to video picture
Face is split, and so as to realize the picture effect of actual situation combination, while increasing interactive, facilitates spectators to understand viewing, so as to improve
Demonstrating effect.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
In the required accompanying drawing used be briefly described, it should be apparent that, drawings in the following description be only the present invention some
Embodiment, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these
Accompanying drawing obtains other accompanying drawings.
Fig. 1 is a kind of implementation process figure of demenstration method based on augmented reality provided in an embodiment of the present invention；
Figure 1A is the implementation process figure of another demenstration method based on augmented reality provided in an embodiment of the present invention；
Figure 1B is the implementation process figure of another demenstration method based on augmented reality provided in an embodiment of the present invention；
Fig. 2 is a kind of structured flowchart of apparatus for demonstrating based on augmented reality provided in an embodiment of the present invention；
Fig. 3 is a kind of schematic diagram of terminal device provided in an embodiment of the present invention.
Embodiment
In describing below, in order to illustrate rather than in order to limit, it is proposed that such as tool of particular system structure, technology etc
Body details, thoroughly to understand the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention can also be realized in the other embodiments of details.In other situations, omit to well-known system, device, electricity
Road and the detailed description of method, in case unnecessary details hinders description of the invention.
In order to smaller in demonstration thing, when spectators can not be clearly visible that demonstration thing, the embodiments of the invention provide one
Demenstration method of the kind based on augmented reality, device and terminal device, demonstrated in fact wherein being mainly to determine when demonstrator is demonstrated
The current presentation face of thing, and augmented reality model corresponding with the current presentation face is searched according to the current presentation face；Carry
Augmented reality model corresponding to the current presentation face is taken, and the augmented reality model is superimposed in original video, is formed
Target video；The target video for being superimposed with the augmented reality model is subjected to video pictures segmentation, so as to realize that actual situation combines
Picture effect.
The solution of the present invention, augmented reality model not only can be easily changed, and can also be drawn in the video of segmentation
The state of augmented reality model is controlled in face, meets the needs of all kinds of demonstrations, facilitates user to watch, while improve demonstrating effect.
In order to illustrate technical solutions according to the invention, illustrated below by specific embodiment.
Embodiment one：
Fig. 1 shows a kind of flow chart of demenstration method based on augmented reality provided in an embodiment of the present invention, is described in detail such as
Under：
Step S101, determine to demonstrate current presentation face in kind when demonstrator is demonstrated, and according to the current presentation
Search augmented reality model corresponding with the current presentation face in face.
Wherein, it is a polyhedron to demonstrate material object, and each face for demonstrating material object corresponds to an augmented reality mould respectively
Type.
Specifically, in order to accurately search the augmented reality model corresponding to demonstration current presentation face in kind, the step
S101 is specifically included：
A1, the mark for determining demonstration current presentation face in kind.
A2, in the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind, lookup is drilled with described
Show the corresponding augmented reality model of the mark in the current presentation face of material object.
Specifically, before demonstration, augmented reality file in kind will be demonstrated in advance and is uploaded to recording and broadcasting system, demonstrator institute
There is a mark in the demonstration of demonstration each face in kind, and each augmented reality model in the augmented reality file also has accordingly
Mark, by determining that the mark in demonstration current presentation face in kind searches demonstration material object in the augmented reality file
Augmented reality model corresponding to face.Because demonstration different faces in kind correspond to a different augmented reality model respectively, when drilling
The person of showing rotates to demonstration demonstration in kind and produces change, and augmented reality model also synchronously changes.
Further, in embodiments of the present invention, demonstrator uses universal model in kind as demonstration, in different demonstrations
Under scene, the universal model can substitute different demonstration material objects, so as to be applied to different demonstration scenes.For example, in commodity
In news conference, the universal model can be that the demonstration of mobile phone is in kind, and in teaching classroom, the universal model can be automobile mould
Type, different demonstrations corresponding different augmented reality file in kind, i.e., under different demonstration scenes, augmented reality file is not
Together, the demonstration scene is numbered including scene, and scene numbering is unique, and scene is demonstrated available for identification, each demonstration field
There is identical scene numbering in augmented reality file corresponding to scape, demonstration scene corresponds with augmented reality file.Now, such as
Shown in Figure 1A, the step A2 is specifically included：
A21, the scene numbering for obtaining demonstration scene.
A22, in the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind, lookup is drilled with described
Show augmented reality file corresponding to the scene numbering of scene.
A23, searched and the current presentation in augmented reality file corresponding with the scene numbering of the demonstration scene
Face marks corresponding augmented reality model.
In embodiments of the present invention, in kind using universal model as demonstration, under different scenes, universal model can be
Arbitrary demonstration is in kind, augmented reality file corresponding to lookup can be numbered by demonstrating the scene of scene, by determining demonstrator
The mark in current presentation face in kind, and then corresponding augmented reality mould in augmented reality file corresponding to determination are demonstrated during demonstration
Type, accurately to realize augmented reality effect.
Step S102, augmented reality model corresponding to the current presentation face is extracted, and the augmented reality model is folded
Add in original video, form target video.
Wherein, the original video includes live video or recorded broadcast video.When the original video is live video,
In step S101, the current presentation face that demonstration is in kind when demonstrator is demonstrated is determined in real time, and currently drilled according to described in real time
Show that augmented reality model corresponding with the current presentation face is searched in face.
In embodiments of the present invention, the augmented reality corresponding with the current presentation face found in extraction step S101
Model, above-mentioned augmented reality model is superimposed to the position that material object is demonstrated in original video.Further, demonstrated in original video
The size for the augmented reality model that position in kind is superimposed can adjust.
Further, in embodiments of the present invention, it is as shown in Figure 1B, described to be accurately superimposed the augmented reality model
Step S102 is specifically included：
Frame of video with demonstration original background image in kind in B1, collection original video.
B2, the augmented reality model is superimposed upon to the position that the demonstration is in kind in the frame of video, formation target regards
Frequently.
Specifically, gather the frame of video with demonstration original background image in kind in original video, will with it is upper
Augmented reality model corresponding to stating the demonstration material object in frame of video is superimposed upon described in above-mentioned frame of video after zooming in or out and drilled
On the position for showing material object, so as to form target video.
Further, to clearly show that rotation or other operation of the demonstrator to demonstration material object in presentation process, control
The result of broadcast of augmented reality, in the embodiment of the present invention, demonstrate and be provided with several size identicals on each face of material object
Marker, wherein, the mark can be stereo identification thing, or plane mark thing, in the same of demonstration material object
On demonstration face, size arranges the marker from top to bottom by number on demonstration face, so as to the mark according to current presentation face
The size of thing determines the angle of inclination in current presentation face.For example, when current presentation is towards top rake, current presentation face in the picture
The mark of top is more than the marker below demonstration face, and current presentation face is determined according to the size of the mark in current presentation face
Angle of inclination.Further according to the angle of inclination in the current presentation face, the augmented reality model that is superimposed in target video is adjusted
Angles of display, so as to preferably show demonstrating effect.
Further, in embodiments of the present invention, under different demonstration scenes, the angle of inclination for demonstrating face corresponds to different show
Show content, numbered according to the angle of inclination in the current presentation face and scene, determine the augmented reality mould being superimposed in target video
The angles of display of type.
Alternatively, in embodiments of the present invention, polytype marker, root are set on demonstration each face in kind
According to the type of marker and the angle of inclination in the current presentation face, the augmented reality model that determines to be superimposed in target video
Angles of display.
Step S103, the target video for being superimposed with the augmented reality model is subjected to video pictures segmentation, so as to realize
The picture effect that actual situation combines.
Specifically, in embodiments of the present invention, it is in kind to focus on demonstration when the demonstration material object of demonstrator is smaller, and demonstrates
Details when, can be seen for convenience of spectators it is clear, will be superimposed with the augmented reality model target video carry out video pictures
Segmentation, the demonstration for being superimposed with augmented reality model picture in kind is split, so as to realize the picture of actual situation combination
Effect.
Alternatively, the S103 is specifically included：
It is divided into the first split screen and the second split screen to draw in the target video picture for being superimposed with the augmented reality model
Face, first split screen are shown side by side with second split screen.
Wherein, first split screen shows the target video for being superimposed with the augmented reality model, described second point
Screen picture only shows the augmented reality model.
In embodiments of the present invention, the size limitation due to example article in itself, may after model superposition in video
Do not seen due to too small it is clear, by the target video for being superimposed with the augmented reality model progress video pictures be divided into first point
Shield picture and the second split screen, the ratio of first split screen and second split screen is adjustable, for example, described the
One split screen and the split screen of the second split screen five or five, or, first split screen and second split screen
Pseudo-ginseng split screen, first split screen show the target video for being superimposed with the augmented reality model, and second split screen is drawn
Face only shows the augmented reality model, and split screen ratio can voluntarily be selected to set by spectators, do not limited herein.After split screen
The first split screen and the second split screen in, be superimposed with the demonstration of augmented reality model rotation in kind, translation etc. and show
All it is synchronous, the demonstration material object for being superimposed with augmented reality model is protruded by divided frame, it is convenient while increasing interactive
Spectators understand viewing, so as to improve demonstrating effect.
Alternatively, the step S103 includes：
It is divided into the first display picture to show picture with second in the target video picture for being superimposed with the augmented reality model
Face, second display picture is among first display picture.
Wherein, first display picture shows the target video for being superimposed with the augmented reality model, and described second is aobvious
Show that picture only shows the augmented reality model, or, second display picture, which is shown, is superimposed with the augmented reality model
Target video, first display picture only shows the augmented reality model.
In embodiments of the present invention, the target video picture for being superimposed with the augmented reality model is divided into picture-in-picture
Form, second display picture is among first display picture, i.e. it is aobvious that second display picture is less than described first
Show picture, the content that two display pictures are shown is different, and display respectively is superimposed with the target video picture of the augmented reality model
Face and the video pictures of the augmented reality model, show as the first display picture and are superimposed with the augmented reality model
Target video, or the video pictures of the display augmented reality model, can be shown, herein by switching command image switching
Do not limit.Demonstration of the first display picture after singulation with the second display picture, being superimposed with augmented reality model is in kind
Rotation, the displaying such as translation be all synchronous, protruded by divided frame be superimposed with augmented reality model demonstration it is in kind, increase
While interactive, spectators are facilitated to understand viewing, so as to improve demonstrating effect.
In first embodiment of the invention, by determining the mark in demonstration current presentation face in kind, in advance
In the augmented reality file of demonstration material object for reaching recording and broadcasting system, the mark in the current presentation face in kind with the demonstration is searched
Remember corresponding augmented reality model, extract augmented reality model corresponding to the current presentation face, and by the augmented reality
Model is superimposed in original video, forms target video, finally carries out the target video for being superimposed with the augmented reality model
Video pictures are split, and the target video picture for being superimposed with the augmented reality model is divided into the first split screen and second point
Shielding picture, first split screen is shown side by side with second split screen, or, the augmented reality mould will be superimposed with
The target video picture of type is divided into the first display picture and the second display picture, and second display picture shows described first
Among showing picture, so as to realize the picture effect of actual situation combination, while increasing interactive by augmented reality, facilitate spectators clear
Chu watches, so as to improve demonstrating effect.
It should be understood that the size of the sequence number of each step is not meant to the priority of execution sequence, each process in above-described embodiment
Execution sequence should determine that the implementation process without tackling the embodiment of the present invention forms any limit with its function and internal logic
It is fixed.
Embodiment two：
Corresponding to a kind of demenstration method based on augmented reality described in foregoing embodiments, Fig. 2 shows implementation of the present invention
A kind of structured flowchart for apparatus for demonstrating based on augmented reality that example provides, the device can be applied to intelligent terminal, and the intelligence is eventually
End can include the user equipment that is communicated through wireless access network RAN with one or more core nets, and the user equipment can be with
It is mobile phone (or being " honeycomb " phone), the computer with mobile device etc..For convenience of description, illustrate only and this
The related part of inventive embodiments.
Reference picture 2, being somebody's turn to do the apparatus for demonstrating based on augmented reality includes：Model determining unit, model superpositing unit, picture point
Unit is cut, wherein：
Model determining unit, demonstration current presentation face in kind during for determining that demonstrator is demonstrated, and according to described
Search augmented reality model corresponding with the current presentation face in current presentation face；
Model superpositing unit, for extracting augmented reality model corresponding to the current presentation face, and the enhancing is existing
Real mould is superimposed in original video, forms target video；
Picture cutting unit, for the target video for being superimposed with the augmented reality model to be carried out into video pictures segmentation,
So as to realize the picture effect of actual situation combination.
Further, the model determining unit specifically includes：
Determining module is marked, for determining the mark in demonstration current presentation face in kind；
Model searching modul, in the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind
In, search the augmented reality model corresponding with the mark in the current presentation face that the demonstration is in kind.
Further, the model superpositing unit specifically includes：
Frame of video acquisition module, for gathering the video with demonstration original background image in kind in original video
Frame；
Model laminating module, for the augmented reality model to be superimposed upon into the position that the demonstration is in kind in the frame of video
Put, form target video.
Alternatively, the picture cutting unit specifically includes：
First segmentation module, for the target video picture for being superimposed with the augmented reality model to be divided into the first split screen
Picture and the second split screen, first split screen show side by side with second split screen, wherein, described first point
Screen picture shows the target video for being superimposed with the augmented reality model, and second split screen only shows the augmented reality
Model.
Alternatively, the picture cutting unit specifically includes：
Second segmentation module, for the target video picture for being superimposed with the augmented reality model to be divided into the first display
Picture and the second display picture, second display picture among first display picture, wherein, it is described first display picture
Face shows the target video for being superimposed with the augmented reality model, and second display picture only shows the augmented reality mould
Type, or, second display picture shows the target video for being superimposed with the augmented reality model, first display picture
Only show the augmented reality model.
In second embodiment of the invention, demonstration current presentation face in kind during by determining that demonstrator is demonstrated, and root
Augmented reality model corresponding with the current presentation face is searched according to the current presentation face, and then extracts the current presentation face
Corresponding augmented reality model, and the augmented reality model is superimposed in original video, target video is formed, finally will be folded
Video pictures segmentation is carried out added with the target video of the augmented reality model, so as to realize the picture effect of actual situation combination, is led to
While crossing augmented reality increases interactive, spectators are facilitated to understand viewing, so as to improve demonstrating effect.
Embodiment three：
Fig. 3 is the schematic diagram for the terminal device that one embodiment of the invention provides.As shown in figure 3, the terminal of the embodiment is set
Standby 3 include：Processor 30, memory 31 and it is stored in the meter that can be run in the memory 31 and on the processor 30
Calculation machine program 32, such as the demonstration program based on augmented reality.The processor 30 is realized when performing the computer program 32
Step in above-mentioned each demenstration method embodiment based on augmented reality, such as step 101 shown in Fig. 1 is to 103.Or
The processor 30 realizes the function of each module/unit in above-mentioned each device embodiment, example when performing the computer program 32
The function of unit 21 to 23 as shown in Figure 2.
Exemplary, the computer program 32 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 31, and are performed by the processor 30, to complete the present invention.Described one
Individual or multiple module/units can be the series of computation machine programmed instruction section that can complete specific function, and the instruction segment is used for
Implementation procedure of the computer program 32 in the terminal device 3 is described.For example, the computer program 32 can be divided
Model determining unit, model superpositing unit, picture cutting unit are cut, each unit concrete function is as follows：
Model determining unit, demonstration current presentation face in kind during for determining that demonstrator is demonstrated, and according to described
Search augmented reality model corresponding with the current presentation face in current presentation face；
Model superpositing unit, for extracting augmented reality model corresponding to the current presentation face, and the enhancing is existing
Real mould is superimposed in original video, forms target video；
Picture cutting unit, for the target video for being superimposed with the augmented reality model to be carried out into video pictures segmentation,
So as to realize the picture effect of actual situation combination.
The terminal device 3 can be that the calculating such as desktop PC, notebook, palm PC and cloud server are set
It is standby.The terminal device 3 may include, but be not limited only to, processor 30, memory 31.It will be understood by those skilled in the art that figure
3 be only the example of terminal device 3, does not form the restriction to terminal device 3, can be included than illustrating more or less portions
Part, some parts or different parts are either combined, such as the terminal device can also include input-output equipment, net
Network access device, bus etc..
Alleged processor 30 can be CPU (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other PLDs, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor can also be any conventional processor
Deng.
The memory 31 can be the internal storage unit of the terminal device 3, such as the hard disk of terminal device 3 or interior
Deposit.The memory 31 can also be the External memory equipment of the terminal device 3, such as be equipped with the terminal device 3
Plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, dodge
Deposit card (Flash Card) etc..Further, the memory 31 can also both include the storage inside list of the terminal device 3
Member also includes External memory equipment.The memory 31 is used to store needed for the computer program and the terminal device
Other programs and data.The memory 31 can be also used for temporarily storing the data that has exported or will export.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device are divided into different functional units or module, more than completion
The all or part of function of description.Each functional unit, module in embodiment can be integrated in a processing unit, also may be used
To be that unit is individually physically present, can also two or more units it is integrated in a unit, it is above-mentioned integrated
Unit can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.In addition, each function list
Member, the specific name of module are not limited to the protection domain of the application also only to facilitate mutually distinguish.Said system
The specific work process of middle unit, module, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and is not described in detail or remembers in some embodiment
The part of load, it may refer to the associated description of other embodiments.
Those of ordinary skill in the art are it is to be appreciated that the list of each example described with reference to the embodiments described herein
Member and algorithm steps, it can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
Performed with hardware or software mode, application-specific and design constraint depending on technical scheme.Professional and technical personnel
Described function can be realized using distinct methods to each specific application, but this realization is it is not considered that exceed
The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed apparatus and method, others can be passed through
Mode is realized.For example, system embodiment described above is only schematical, for example, the division of the module or unit,
Only a kind of division of logic function, can there is an other dividing mode when actually realizing, such as multiple units or component can be with
With reference to or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or discussed
Mutual coupling or direct-coupling or communication connection can be by some interfaces, the INDIRECT COUPLING of device or unit or
Communication connection, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and is used as independent production marketing or use
When, it can be stored in a computer read/write memory medium.Based on such understanding, the present invention realizes above-described embodiment side
All or part of flow in method, by computer program the hardware of correlation can also be instructed to complete, described computer
Program can be stored in a computer-readable recording medium, and the computer program can be achieved above-mentioned each when being executed by processor
The step of individual embodiment of the method.Wherein, the computer program includes computer program code, and the computer program code can
Think source code form, object identification code form, executable file or some intermediate forms etc..The computer-readable medium can be with
Including：Any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disc, the light of the computer program code can be carried
Disk, computer storage, read-only storage (ROM, Read-Only Memory), random access memory (RAM, Random
Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that the computer
The content that computer-readable recording medium includes can carry out appropriate increase and decrease according to legislation in jurisdiction and the requirement of patent practice, such as
In some jurisdictions, according to legislation and patent practice, computer-readable medium does not include being electric carrier signal and telecommunications letter
Number.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to foregoing reality
Example is applied the present invention is described in detail, it will be understood by those within the art that：It still can be to foregoing each
Technical scheme described in embodiment is modified, or carries out equivalent substitution to which part technical characteristic；And these are changed
Or replace, the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical scheme, all should
Within protection scope of the present invention.
Claims (10)
1. a kind of demenstration method based on augmented reality, it is characterised in that the demenstration method includes：
Determine to demonstrate current presentation face in kind when demonstrator is demonstrated, and searched according to the current presentation face and worked as with described
Augmented reality model corresponding to preceding demonstration face；
Augmented reality model corresponding to the current presentation face is extracted, and the augmented reality model is superimposed to original video
In, form target video；
The target video for being superimposed with the augmented reality model is subjected to video pictures segmentation, so as to realize the picture of actual situation combination
Effect.
2. demenstration method as claimed in claim 1, it is characterised in that described to determine demonstration material object when demonstrator is demonstrated
Current presentation face, and augmented reality model corresponding with the current presentation face, specific bag are searched according to the current presentation face
Include：
Determine the mark in demonstration current presentation face in kind；
In the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind, search and the demonstration material object
Current presentation face marks corresponding augmented reality model.
3. demenstration method as claimed in claim 1, it is characterised in that enhancing corresponding to the extraction current presentation face is existing
Real mould, and the augmented reality model is superimposed in original video, target video is formed, is specifically included：
Gather the frame of video with demonstration original background image in kind in original video；
The augmented reality model is superimposed upon to the position that material object is demonstrated described in the frame of video, forms target video.
4. demenstration method as claimed in claim 1, it is characterised in that the target that the augmented reality model will be superimposed with
Video carries out video pictures segmentation, so as to realize the picture effect of actual situation combination, specifically includes：
The target video picture for being superimposed with the augmented reality model is divided into the first split screen and the second split screen, institute
The first split screen is stated to show side by side with second split screen, wherein, first split screen show be superimposed with it is described
The target video of augmented reality model, second split screen only show the augmented reality model.
5. demenstration method as claimed in claim 1, it is characterised in that the target that the augmented reality model will be superimposed with
Video carries out video pictures segmentation, so as to realize the picture effect of actual situation combination, specifically includes：
The target video picture for being superimposed with the augmented reality model is divided into the first display picture and the second display picture, institute
The second display picture is stated among first display picture, wherein, first display picture, which is shown, is superimposed with the enhancing
The target video of real model, second display picture only show the augmented reality model, or, the second display picture
Face shows the target video for being superimposed with the augmented reality model, and first display picture only shows the augmented reality mould
Type.
6. a kind of apparatus for demonstrating based on augmented reality, it is characterised in that the apparatus for demonstrating includes：
Model determining unit, demonstration current presentation face in kind during for determining that demonstrator is demonstrated, and according to described current
Search augmented reality model corresponding with the current presentation face in demonstration face；
Model superpositing unit, for extracting augmented reality model corresponding to the current presentation face, and by the augmented reality mould
Type is superimposed in original video, forms target video；
Picture cutting unit, for the target video for being superimposed with the augmented reality model to be carried out into video pictures segmentation, so as to
Realize the picture effect that actual situation combines.
7. apparatus for demonstrating as claimed in claim 6, it is characterised in that the model determining unit specifically includes：
Determining module is marked, for determining the mark in demonstration current presentation face in kind；
Model searching modul, in the demonstration for being uploaded to recording and broadcasting system in advance augmented reality file in kind, looking into
Look for the augmented reality model corresponding with the mark in the current presentation face that the demonstration is in kind.
8. apparatus for demonstrating as claimed in claim 6, it is characterised in that the model superpositing unit specifically includes：
Frame of video acquisition module, for gathering the frame of video with demonstration original background image in kind in original video；
Model laminating module, for the augmented reality model to be superimposed upon into the position that the demonstration is in kind in the frame of video,
Form target video.
9. a kind of terminal device, including memory, processor and it is stored in the memory and can be on the processor
The computer program of operation, it is characterised in that realize such as claim 1 to 5 described in the computing device during computer program
The step of any one demenstration method.
10. a kind of computer-readable recording medium, the computer-readable recording medium storage has computer program, and its feature exists
In being realized when the computer program is executed by processor as described in any one of claim 1 to 5 the step of demenstration method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710633384.4A CN107452067B (en) | 2017-07-28 | 2017-07-28 | Demonstration method and device based on augmented reality and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710633384.4A CN107452067B (en) | 2017-07-28 | 2017-07-28 | Demonstration method and device based on augmented reality and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107452067A true CN107452067A (en) | 2017-12-08 |
| CN107452067B CN107452067B (en) | 2021-02-05 |
Family
ID=60489645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710633384.4A Active CN107452067B (en) | 2017-07-28 | 2017-07-28 | Demonstration method and device based on augmented reality and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107452067B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110620955A (en) * | 2018-06-19 | 2019-12-27 | 宏正自动科技股份有限公司 | Live broadcasting system and live broadcasting method thereof |
| CN114257875A (en) * | 2021-12-16 | 2022-03-29 | 广州博冠信息科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102893327A (en) * | 2010-03-19 | 2013-01-23 | 数字标记公司 | Intuitive computing methods and systems |
| CN103488711A (en) * | 2013-09-09 | 2014-01-01 | 北京大学 | Method and system for fast making vector font library |
| JP2014160226A (en) * | 2013-01-24 | 2014-09-04 | Panasonic Corp | Imaging apparatus |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| US20160247017A1 (en) * | 2010-06-08 | 2016-08-25 | Raj Sareen | Method and system for body scanning and display of biometric data |
| CN106873768A (en) * | 2016-12-30 | 2017-06-20 | 中兴通讯股份有限公司 | A kind of augmented reality method, apparatus and system |
| US9846972B2 (en) * | 2015-04-06 | 2017-12-19 | Scope Technologies Us Inc. | Method and apparatus for sharing augmented reality applications to multiple clients |
-
2017
- 2017-07-28 CN CN201710633384.4A patent/CN107452067B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102893327A (en) * | 2010-03-19 | 2013-01-23 | 数字标记公司 | Intuitive computing methods and systems |
| US20160247017A1 (en) * | 2010-06-08 | 2016-08-25 | Raj Sareen | Method and system for body scanning and display of biometric data |
| JP2014160226A (en) * | 2013-01-24 | 2014-09-04 | Panasonic Corp | Imaging apparatus |
| CN103488711A (en) * | 2013-09-09 | 2014-01-01 | 北京大学 | Method and system for fast making vector font library |
| US9846972B2 (en) * | 2015-04-06 | 2017-12-19 | Scope Technologies Us Inc. | Method and apparatus for sharing augmented reality applications to multiple clients |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN106873768A (en) * | 2016-12-30 | 2017-06-20 | 中兴通讯股份有限公司 | A kind of augmented reality method, apparatus and system |
Non-Patent Citations (2)
| Title |
|---|
| 汪家杰: "分屏显示在视频中的应用研究", 《新西部》 * |
| 陈向东 等: "基于增强现实的教学演示", 《教学实践与研究》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110620955A (en) * | 2018-06-19 | 2019-12-27 | 宏正自动科技股份有限公司 | Live broadcasting system and live broadcasting method thereof |
| US11082638B2 (en) | 2018-06-19 | 2021-08-03 | Aten International Co., Ltd. | Live streaming system and method for live streaming |
| CN110620955B (en) * | 2018-06-19 | 2022-04-12 | 宏正自动科技股份有限公司 | Live broadcasting system and live broadcasting method thereof |
| CN114257875A (en) * | 2021-12-16 | 2022-03-29 | 广州博冠信息科技有限公司 | Data transmission method and device, electronic equipment and storage medium |
| CN114257875B (en) * | 2021-12-16 | 2024-04-09 | 广州博冠信息科技有限公司 | Data transmission method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107452067B (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109618222B (en) | A kind of splicing video generation method, device, terminal device and storage medium | |
| CN113238650B (en) | Gesture recognition and control method and device and virtual reality equipment | |
| CN109688463A (en) | A kind of editing video generation method, device, terminal device and storage medium | |
| CN106846497B (en) | Method and device for presenting three-dimensional map applied to terminal | |
| US20220237812A1 (en) | Item display method, apparatus, and device, and storage medium | |
| CN107491174A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
| CN111833458B (en) | Image display method and device, equipment and computer readable storage medium | |
| Andersen et al. | Virtual annotations of the surgical field through an augmented reality transparent display | |
| CN106033333A (en) | A visual augmented reality scene making system and method | |
| CN105635712A (en) | Augmented-reality-based real-time video recording method and recording equipment | |
| CN107566793A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
| CN106648098B (en) | AR projection method and system for user-defined scene | |
| CN109685905A (en) | Cell planning method and system based on augmented reality | |
| CN110796712A (en) | Material processing method, device, electronic equipment and storage medium | |
| CN114332374A (en) | Virtual display method, equipment and storage medium | |
| CN108711144A (en) | augmented reality method and device | |
| CN111860252A (en) | Image processing method, apparatus and storage medium | |
| CN110392901A (en) | The providing method of e-book service and computer program for this method | |
| KR20200027093A (en) | Method and system for image automatic classification | |
| CN110084174A (en) | A kind of face identification method, system and electronic equipment and storage medium | |
| CN110120087A (en) | The label for labelling method, apparatus and terminal device of three-dimensional sand table | |
| CN110568934A (en) | Low-error high-efficiency multi-label-graph augmented reality system | |
| CN107066605A (en) | Facility information based on image recognition has access to methods of exhibiting automatically | |
| CN111815782A (en) | Display method, device and equipment of AR scene content and computer storage medium | |
| CN113253842A (en) | Scene editing method and related device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 518000 north of 6th floor and north of 7th floor, building a, tefa infoport building, No.2 Kefeng Road, Science Park community, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province Patentee after: SZ REACH TECH Co.,Ltd. Address before: 518000 Room 601, building B, Kingdee Software Park, No.2, Keji South 12th Road, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SZ REACH TECH Co.,Ltd. |