CN107077216A - Method and mobile terminal that a kind of picture is shown - Google Patents
Method and mobile terminal that a kind of picture is shown Download PDFInfo
- Publication number
- CN107077216A CN107077216A CN201680001968.3A CN201680001968A CN107077216A CN 107077216 A CN107077216 A CN 107077216A CN 201680001968 A CN201680001968 A CN 201680001968A CN 107077216 A CN107077216 A CN 107077216A
- Authority
- CN
- China
- Prior art keywords
- virtual
- dimensional coordinate
- picture
- moving direction
- actual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
A kind of method and mobile terminal shown the embodiment of the invention discloses picture, the display for the mobile control interface according to real-time video transmission device.Present invention method includes：The picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot is obtained, destination object has locomotive function and shoot function；Virtual objects are generated in the virtual three-dimensional coordinate system set up according to actual three-dimensional coordinate, the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction；Virtual identifying thing is set on the moving direction of virtual objects, and the coordinate of virtual identifying thing is the second virtual three-dimensional coordinate；By virtual objects and virtual identifying thing be added to destination object shooting picture, obtain target picture；When the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value, preset picture corresponding with virtual identifying thing is shown on the basis of target picture.
Description
Technical field
The present invention relates to computer augmented reality field, more particularly to a kind of method that shows of picture and mobile terminal.
Background technology
With the development of technology, it can realize that the product of real-time video transmission is widely applied, for example, unmanned plane,
Remote-control car etc. is widely used in taking photo by plane in terms of photography, environmental monitoring, forest fire protection.Part manufacturer releases first person master
Visual angle (FPV, First Person View) transmitting device, it is possible to use virtual reality (VR, Virtual Reality) glasses
Realize the experience of immersion.Existing FPV devices, mainly for the purpose of shooting, carry planar pickup head or full-view camera,
Player can be connected to after FPV products using mobile terminal or dedicated remote control, the picture that viewing FPV devices are shot in real time.
Existing FPV devices, make use of the picture captured by camera, carry out certain Digital Signal Processing, and adaptation VR glasses show
Show, strong playability is brought to player, and the experience of immersion can bring more excitements.FPV devices are with the first person
The world is seen at visual angle, brings certain virtual reality effect.
But, these FPV devices can only all provide the real screen that camera is photographed, with reference to VR glasses or mobile terminal
Most basic virtual reality experience is only provided, in other words, the device of existing display picture can not control to change what is shown
Image content.
The content of the invention
The embodiments of the invention provide a kind of method that picture is shown, for the mobile control according to real-time video transmission device
The display of picture processed.
In view of this, first aspect present invention provides a kind of method that picture is shown, including：Obtain the reality of destination object
The picture that border three-dimensional coordinate, actual moving direction and destination object are shot, the destination object has locomotive function and shoots work(
Energy；Virtual objects are generated in the virtual three-dimensional coordinate system set up according to the actual three-dimensional coordinate, the virtual objects
Coordinate is the first virtual three-dimensional coordinate, and the moving direction of the virtual objects is identical with the actual moving direction；In the void
Intend setting virtual identifying thing on the moving direction of object, the coordinate of the virtual identifying thing is the second virtual three-dimensional coordinate；By institute
State virtual objects and the virtual identifying thing is added to the picture that the destination object shoots, obtain target picture；When described
When the air line distance of one virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value, in the target picture
On the basis of corresponding with the virtual identifying thing preset picture of display.
With reference to the embodiment of the present invention in a first aspect, in the first implementation of first aspect of the embodiment of the present invention,
It is described that virtual objects are set up in the virtual three-dimensional coordinate system set up according to the actual three-dimensional coordinate, the virtual objects
Coordinate be the first virtual three-dimensional coordinate, the moving direction of the virtual objects it is identical with the actual moving direction including：By institute
State actual three-dimensional coordinate and be converted into the first virtual three-dimensional coordinate according to preset proportion；According to the first virtual three-dimensional coordinate
Virtual objects are generated in the virtual three-dimensional coordinate system of foundation, the coordinate of the virtual objects is the first virtual three-dimensional coordinate,
The moving direction of the virtual objects is identical with the actual moving direction.
With reference to the embodiment of the present invention in a first aspect, in second of implementation of first aspect of the embodiment of the present invention,
It is described when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value,
Show that preset picture corresponding with the virtual identifying thing includes on the basis of the target picture：Institute is calculated according to preset formula
State the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate；When the air line distance is less than default threshold
During value, preset picture corresponding with the virtual identifying thing is shown on the basis of the target picture.
With reference to any implementation of the first aspect into second of implementation of first aspect of the embodiment of the present invention,
In the third implementation of first aspect of the embodiment of the present invention, the actual three-dimensional coordinate for obtaining destination object, reality
Before the picture that moving direction and destination object are shot, methods described also includes：Start 3D engines, set up virtual three-dimensional coordinate
System.
With reference to any implementation of the first aspect into second of implementation of first aspect of the embodiment of the present invention,
In the 4th kind of implementation of first aspect of the embodiment of the present invention, the virtual objects and the virtual identifying thing are added to
The picture that the destination object is shot, obtains after target picture, is shown on the basis of the target picture and described virtual
Before the corresponding preset picture of marker, methods described also includes：The virtual objects are adjusted according to the operational order of user
Moving direction.
Second aspect of the present invention provides a kind of mobile terminal, and the mobile terminal includes：Acquiring unit, for obtaining mesh
The picture that the actual three-dimensional coordinate, actual moving direction and destination object of object are shot is marked, the destination object has mobile work(
Energy and shoot function；Generation unit, for being generated according to the actual three-dimensional coordinate in the virtual three-dimensional coordinate system set up
Virtual objects, the coordinate of the virtual objects is the first virtual three-dimensional coordinate, the moving direction of the virtual objects and the reality
Border moving direction is identical；Setting unit, it is described virtual for setting virtual identifying thing on the moving direction of the virtual objects
The coordinate of marker is the second virtual three-dimensional coordinate；Superpositing unit, for the virtual objects and the virtual identifying thing to be folded
The picture that the destination object is shot is added to, target picture is obtained；Display unit, when the first virtual three-dimensional coordinate with it is described
When the air line distance of second virtual three-dimensional coordinate is less than default threshold value, for display and institute on the basis of the target picture
State the corresponding preset picture of virtual identifying thing.
With reference to the second aspect of the embodiment of the present invention, in the first implementation of second aspect of the embodiment of the present invention,
The generation unit includes：Modular converter, for the actual three-dimensional coordinate to be converted into first virtual three according to preset proportion
Dimension coordinate；Generation module, for generating void in the virtual three-dimensional coordinate system set up according to the first virtual three-dimensional coordinate
Intend object, the coordinates of the virtual objects is the first virtual three-dimensional coordinate, the moving direction of the virtual objects with it is described
Actual moving direction is identical.
With reference to the second aspect of the embodiment of the present invention, in second of implementation of second aspect of the embodiment of the present invention,
The display unit includes：Computing module, for calculating the first virtual three-dimensional coordinate and described second according to preset formula
The air line distance of virtual three-dimensional coordinate；Display module, when the air line distance is less than default threshold value, in the target
Preset picture corresponding with the virtual identifying thing is shown on the basis of picture.
With reference to any implementation of the second aspect into second of implementation of second aspect of the embodiment of the present invention,
In the third implementation of second aspect of the embodiment of the present invention, the mobile terminal also includes：Unit is set up, for starting
3D engines, set up virtual three-dimensional coordinate system.
With reference to any implementation of the second aspect into second of implementation of second aspect of the embodiment of the present invention,
In the 4th kind of implementation of second aspect of the embodiment of the present invention, the mobile terminal also includes：Adjustment unit, for basis
The operational order of user adjusts the moving direction of the virtual objects.
As can be seen from the above technical solutions, the embodiment of the present invention has advantages below：
In the embodiment of the present invention, the actual three-dimensional coordinate, actual moving direction and destination object for obtaining destination object are shot
Picture, the destination object has locomotive function and shoot function；It is virtual what is set up according to the actual three-dimensional coordinate
Virtual objects are generated in three-dimensional system of coordinate, the coordinate of the virtual objects is the first virtual three-dimensional coordinate, the virtual objects
Moving direction is identical with the actual moving direction；Virtual identifying thing is set on the moving direction of the virtual objects, it is described
The coordinate of virtual identifying thing is the second virtual three-dimensional coordinate；The virtual objects and the virtual identifying thing are added to the mesh
The picture that object is shot is marked, target picture is obtained；When the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate
When air line distance is less than default threshold value, show corresponding preset with the virtual identifying thing on the basis of the target picture
Picture.The present invention is by setting corresponding virtual identifying thing, when meeting default condition, except display real-time video transmission dress
The real picture of shooting is put, movement and different virtual identifying thing of the mobile terminal always according to real-time video transmission device control empty
Intend the display of picture.
Brief description of the drawings
Fig. 1 be the embodiment of the present invention in a concrete application scene block schematic illustration；
Method one embodiment schematic diagram that Fig. 2 shows for picture in the embodiment of the present invention；
Fig. 3 is method another embodiment schematic diagram that picture is shown in the embodiment of the present invention；
Fig. 4 is one embodiment schematic diagram of mobile terminal in the embodiment of the present invention；
Fig. 5 is another embodiment schematic diagram of mobile terminal in the embodiment of the present invention；
Fig. 6 is another embodiment schematic diagram of mobile terminal in the embodiment of the present invention.
Embodiment
The embodiments of the invention provide a kind of method that picture is shown, for the mobile control according to real-time video transmission device
The display of picture processed.
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, rather than whole embodiments.
Term " first ", " second ", " the 3rd " in description and claims of this specification and above-mentioned accompanying drawing, "
The (if present)s such as four " are for distinguishing similar object, without for describing specific order or precedence.It should manage
The data that solution is so used can be exchanged in the appropriate case, so that the embodiments described herein can be with except illustrating herein
Or the order beyond the content of description is implemented.In addition, term " comprising " or " having " and its any deformation, it is intended that covering is not
Exclusive includes, for example, the process, method, system, product or the equipment that contain series of steps or unit be not necessarily limited to it is clear
Those steps or unit that ground is listed, but may include not list clearly or for these processes, method, product or set
Standby intrinsic other steps or unit.
Existing real-time video transmission device can only carry out the shooting and transmission of video, as shown in figure 1, the embodiment of the present invention
A kind of concrete application scene block schematic illustration, mobile terminal is connected with unmanned plane, mobile terminal and between unmanned plane
Can related transmitting information, set up wireless connection between unmanned plane and satellite, unmanned plane passes through satellite and obtains actual longitude and latitude letter
Breath.
For ease of understanding, the idiographic flow in the embodiment of the present invention is described below, referring to Fig. 2, the present invention is real
Applying method one embodiment that a picture shows includes：
201st, the picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot, target are obtained
Object has locomotive function and shoot function.
Established a connection between mobile terminal and destination object, destination object is to possess locomotive function and shoot function
Real-time video transmission equipment, can carry out data transmission between mobile terminal and destination object.Mobile terminal remote receives mesh
Actual three-dimensional coordinate, actual moving direction and the picture of shooting that object is sent are marked, the actual three-dimensional coordinate includes destination object
Longitude and latitude and elevation information.
202nd, virtual objects are generated in the virtual three-dimensional coordinate system set up according to actual three-dimensional coordinate, virtual objects
Coordinate is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction.
Mobile terminal receives the actual three-dimensional coordinate of destination object transmission, by virtual engine by the actual three-dimensional coordinate
Simulate three-dimensional coordinate and fasten and obtain the first virtual three-dimensional coordinate, and generated according to the coordinate in the virtual three-dimensional system set up
Virtual objects.For example, when real-time video transmission device is unmanned plane, being generated in the virtual coordinate system that mobile terminal has been set up
Corresponding virtual unmanned plane, the moving direction of the virtual unmanned plane is identical with the moving direction of unmanned plane in practice.
The 203rd, virtual identifying thing is set on the moving direction of virtual objects, and the coordinate of virtual identifying thing is second virtual three
Dimension coordinate.
Mobile terminal can obtain the moving direction of virtual objects in real time, be set on the current moving direction of the virtual objects
Virtual identifying thing is put, the coordinate of virtual identifying thing is the second virtual three-dimensional coordinate, and the virtual identifying thing can be gold coin or obstacle
Thing etc., can also be possess the virtual object of other implications, does not limit herein specifically.
204th, by virtual objects and virtual identifying thing be added to destination object shooting picture, obtain target picture.
Mobile terminal extracts the relevant parameter of virtual objects and virtual identifying thing, is given birth to by virtual engine according to relevant parameter
Into corresponding virtual screen, then the picture that the virtual screen is shot with destination object is superimposed, and obtains target picture, should
Target picture has the real picture of destination object shooting and the virtual screen of mobile terminal generation simultaneously.
205th, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value,
Preset picture corresponding with virtual identifying thing is shown on the basis of target picture.
It is mobile whole when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value
Hold except the target picture after display superposition, also corresponding preset picture is shown according to the different of virtual identifying thing, for example, working as
When virtual identifying thing is gold coin, mobile terminal display represents the increased preset picture of gold coin.
The present invention is by setting corresponding virtual identifying thing, when meeting default condition, except display real-time video is passed
The real picture that defeated device is shot, movement and different virtual identifying thing control of the mobile terminal always according to real-time video transmission device
The display of virtual screen processed.
Referring to Fig. 3, method another embodiment that picture of the embodiment of the present invention is shown includes：
301st, start 3D engines, set up virtual three-dimensional coordinate system.
Mobile terminal starts preset 3D engines, sets up virtual three-dimensional coordinate system by the 3D engines, and render corresponding
Virtual world picture.For example, setting up virtual three-dimensional coordinate system by Direct engines, 3D engines can also be that other draw
Hold up, e.g., OpenGL engines etc. are not limited specifically herein.
302nd, the picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot, target are obtained
Object has locomotive function and shoot function.
Established a connection between mobile terminal and destination object, destination object is to possess locomotive function and shoot function
Real-time video transmission equipment, can carry out data transmission between mobile terminal and destination object.Mobile terminal remote receives mesh
Actual three-dimensional coordinate, actual moving direction and the picture of shooting that object is sent are marked, the actual three-dimensional coordinate includes destination object
Longitude and latitude and elevation information.
303rd, actual three-dimensional coordinate is converted into the first virtual three-dimensional coordinate according to preset proportion.
Actual three-dimensional coordinate is converted into the first virtual three-dimensional coordinate according to preset proportion, according to the actual needs to conversion
Ratio be configured, for example, the ratio value of actual three-dimensional coordinate and the first virtual three-dimensional coordinate is set into 100：1.
304th, virtual objects are generated in the virtual three-dimensional coordinate system set up according to the first virtual three-dimensional coordinate, it is virtual right
The coordinate of elephant is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction.
The first virtual three-dimensional coordinate after acquisition for mobile terminal to conversion, by virtual engine by the first virtual three-dimensional coordinate
Simulate three-dimensional coordinate to fasten, and virtual objects are generated in the virtual three-dimensional system set up according to the virtual coordinates.
The 305th, virtual identifying thing is set on the moving direction of virtual objects, and the coordinate of virtual identifying thing is second virtual three
Dimension coordinate.
Mobile terminal can obtain the moving direction of virtual objects in real time, be set on the current moving direction of the virtual objects
Virtual identifying thing is put, the coordinate of virtual identifying thing is the second virtual three-dimensional coordinate, and the virtual identifying thing can be gold coin or obstacle
Thing etc., is not limited specifically herein.
306th, by virtual objects and virtual identifying thing be added to destination object shooting picture, obtain target picture.
Mobile terminal extracts the relevant parameter of virtual objects and virtual identifying thing, is given birth to by virtual engine according to relevant parameter
Into corresponding virtual screen, then the picture that the virtual screen is shot with destination object is superimposed, and obtains target picture, should
Target picture has the real picture of destination object shooting and the virtual screen of mobile terminal generation simultaneously.
307th, the moving direction of virtual objects is adjusted according to the operational order of user.
Mobile terminal receives the operational order of user, and mobile terminal adjusts virtual objects, the operation according to the operational order
Instruct the moving direction for changing virtual objects.
308th, the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is calculated according to preset formula.
Mobile terminal, according to preset formula, is calculated according to the virtual identifying thing and the coordinate information of virtual objects of acquisition
Go out the air line distance of virtual identifying thing and virtual objects.
309th, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value,
Preset picture corresponding with virtual identifying thing is shown on the basis of target picture.
It is mobile whole when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value
Hold except the target picture after display superposition, also corresponding preset picture is shown according to the different of virtual identifying thing, for example, working as
When virtual identifying thing is gold coin, mobile terminal display represents the increased preset picture of gold coin.
The present invention is by setting corresponding virtual identifying thing, when meeting default condition, except display real-time video is passed
The real picture that defeated device is shot, movement and different virtual identifying thing control of the mobile terminal always according to real-time video transmission device
The display of virtual screen processed.
In order to make it easy to understand, being illustrated with reference to concrete application scene：
The preset Direct engines of handset starting, set up virtual three-dimensional coordinate system, and render by the Direct engines
The picture of corresponding virtual world.Establish a connection, can have been carried out between mobile phone and unmanned plane between mobile phone and unmanned plane
Data transfer, mobile phone remote receives actual three-dimensional coordinate, actual moving direction and the picture of shooting that unmanned plane is sent, the reality
Three-dimensional coordinate includes the longitude and latitude and elevation information of unmanned plane.Mobile phone is by actual three-dimensional coordinate according to 10：1 ratio is converted into
One virtual three-dimensional coordinate, for example, actual coordinate is (x：113, y：23, z：100), the first virtual three-dimensional coordinate is (x：11.3, y：
2.3, z：10), unit is rice.According to different application scenarios, mobile phone there are ways to obtain relevant information.For example：Work as nothing
Man-machine to be under open environment, mobile phone can obtain the actual longitude and latitude of unmanned plane according to satellite fix, then by installing
Height-gauge on unmanned plane obtains the real standard height of unmanned plane；When unmanned plane is in indoor or semi-enclosed ring
Under border, mobile phone can by unmanned plane judge apart from detector unmanned plane and surrounding wall or barrier away from
From, then calculate another set of virtual coordinates.Mobile phone is according to the first virtual coordinates (x of acquisition：11.3, y：2.3, z：10) virtual
Virtual unmanned plane is generated in three-dimensional system of coordinate, nobody virtual coordinate is (x：11.3, y：2.3, z：10).Unmanned plane now
It is also from south orientation north from the flight of south orientation northing row, then the moving direction of virtual unmanned plane is consistent with unmanned plane actual flight direction
Flown, set on the preceding line direction of virtual unmanned plane on virtual identifying thing gold coin, mobile phone except display unmanned plane is photographed
Real picture, also show virtual engine set up virtual identifying thing gold coin and virtual unmanned plane.The coordinate of virtual identifying thing is (x：
8.3, y：2.3, z：6), then air line distance is S,S
=5, user is operated on mobile phone, controls virtual unmanned plane to be moved towards virtual identifying thing gold coin, when virtual unmanned plane connects
Nearly gold coin, and when virtually the air line distance S of unmanned plane and gold coin is less than 0.1 meter, is considered as virtual unmanned plane and is collided with gold coin,
On the basis of current display picture, the increased picture of display gold coin of mobile phone additionally.
The method that picture in the embodiment of the present invention is shown is described above, below to the shifting in the embodiment of the present invention
Dynamic terminal is described, referring to Fig. 4, the mobile terminal in the embodiment of the present invention includes：
Acquiring unit 401, actual three-dimensional coordinate, actual moving direction and destination object for obtaining destination object are shot
Picture, destination object has locomotive function and shoot function；
Generation unit 402 is virtual right for being generated according to actual three-dimensional coordinate in the virtual three-dimensional coordinate system set up
As the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction；
Setting unit 403, for setting virtual identifying thing, the coordinate of virtual identifying thing on the moving direction of virtual objects
For the second virtual three-dimensional coordinate；
Superpositing unit 404, for the picture for destination object shooting that virtual objects and virtual identifying thing are added to, obtains mesh
Mark picture；
Display unit 405, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default
During threshold value, for showing preset picture corresponding with virtual identifying thing on the basis of target picture.
In the embodiment of the present invention, acquiring unit 401 obtains actual three-dimensional coordinate, actual moving direction and the mesh of destination object
The picture that object is shot is marked, destination object has locomotive function and shoot function；Generation unit 402 exists according to actual three-dimensional coordinate
Virtual objects are generated in the virtual three-dimensional coordinate system set up, the coordinate of virtual objects is the first virtual three-dimensional coordinate, virtual right
The moving direction of elephant is identical with actual moving direction；Setting unit 403 sets virtual identifying on the moving direction of virtual objects
Thing, the coordinate of virtual identifying thing is the second virtual three-dimensional coordinate；Virtual objects and virtual identifying thing are added to by superpositing unit 404
The picture that destination object is shot, obtains target picture；When the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate straight line away from
During from less than default threshold value, display unit 405 shows preset picture corresponding with virtual identifying thing on the basis of target picture
Face.The present invention is by setting corresponding virtual identifying thing, when the air line distance of virtual identifying thing and virtual objects is less than preset
During value, except the real picture that display real-time video transmission device is shot, mobile terminal is always according to real-time video transmission device
Mobile and different virtual identifying thing controls the display of virtual screen.
Referring to Fig. 5, in the embodiment of the present invention mobile terminal another embodiment, including：
Acquiring unit 401, actual three-dimensional coordinate, actual moving direction and destination object for obtaining destination object are shot
Picture, destination object has locomotive function and shoot function；
Generation unit 402 is virtual right for being generated according to actual three-dimensional coordinate in the virtual three-dimensional coordinate system set up
As the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction；
Setting unit 403, for setting virtual identifying thing, the coordinate of virtual identifying thing on the moving direction of virtual objects
For the second virtual three-dimensional coordinate；
Superpositing unit 404, for the picture for destination object shooting that virtual objects and virtual identifying thing are added to, obtains mesh
Mark picture；
Display unit 405, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default
During threshold value, for showing preset picture corresponding with virtual identifying thing on the basis of target picture.
Wherein, generation unit 402 includes：
Modular converter 4021, for actual three-dimensional coordinate to be converted into the first virtual three-dimensional coordinate according to preset proportion；
Generation module 4022, for generating void in the virtual three-dimensional coordinate system set up according to the first virtual three-dimensional coordinate
Intend object, the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction.
Wherein, display unit 405 can further comprise：
Computing module 4051, for calculating the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to preset formula
Air line distance；
Display module 4052, when air line distance be less than default threshold value when, on the basis of target picture display with
The corresponding preset picture of virtual identifying thing.
In the embodiment of the present invention, acquiring unit 401 obtains actual three-dimensional coordinate, actual moving direction and the mesh of destination object
The picture that object is shot is marked, destination object has locomotive function and shoot function；Modular converter 4021 presses actual three-dimensional coordinate
The first virtual three-dimensional coordinate is converted into according to preset proportion；Generation module 4022 is according to the first virtual three-dimensional coordinate in the void set up
Intend generating virtual objects in three-dimensional system of coordinate, the coordinate of virtual objects is the first virtual three-dimensional coordinate, the mobile side of virtual objects
To identical with actual moving direction；Setting unit 403 sets virtual identifying thing, virtual identifying on the moving direction of virtual objects
The coordinate of thing is the second virtual three-dimensional coordinate；Superpositing unit 404 by virtual objects and virtual identifying thing be added to destination object clap
The picture taken the photograph, obtains target picture；Computing module 4051 is virtual according to preset formula the first virtual three-dimensional coordinate of calculating and second
The air line distance of three-dimensional coordinate；When air line distance is less than default threshold value, display module 4052 is on the basis of target picture
Display preset picture corresponding with virtual identifying thing.The present invention by setting corresponding virtual identifying thing, when virtual identifying thing with
It is mobile except the real picture that display real-time video transmission device is shot when the air line distance of virtual objects is less than preset value
Movement and different virtual identifying thing of the terminal always according to real-time video transmission device control the display of virtual screen.
Referring to Fig. 6, in the embodiment of the present invention mobile terminal another embodiment, including：
Acquiring unit 401, actual three-dimensional coordinate, actual moving direction and destination object for obtaining destination object are shot
Picture, destination object has locomotive function and shoot function；
Generation unit 402 is virtual right for being generated according to actual three-dimensional coordinate in the virtual three-dimensional coordinate system set up
As the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction；
Setting unit 403, for setting virtual identifying thing, the coordinate of virtual identifying thing on the moving direction of virtual objects
For the second virtual three-dimensional coordinate；
Superpositing unit 404, for the picture for destination object shooting that virtual objects and virtual identifying thing are added to, obtains mesh
Mark picture；
Display unit 405, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default
During threshold value, for showing preset picture corresponding with virtual identifying thing on the basis of target picture.
The mobile terminal also includes：
Unit 406 is set up, for starting 3D engines, virtual three-dimensional coordinate system is set up.
The mobile terminal can also further comprise：
Adjustment unit 407, the moving direction for adjusting virtual objects according to the operational order of user.
In the embodiment of the present invention, set up unit 406 and start 3D engines, set up virtual three-dimensional coordinate system.Acquiring unit 401 is obtained
The picture for taking the actual three-dimensional coordinate, actual moving direction and destination object of destination object to shoot, destination object has mobile work(
Energy and shoot function；Generation unit 402 generates in the virtual three-dimensional coordinate system set up virtual right according to actual three-dimensional coordinate
As the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction；Set
Unit 403 sets virtual identifying thing on the moving direction of virtual objects, and the coordinate of virtual identifying thing is sat for the second virtual three-dimensional
Mark；Superpositing unit 404 by virtual objects and virtual identifying thing be added to destination object shooting picture, obtain target picture；Adjust
Whole unit 407 adjusts the moving direction of virtual objects according to the operational order of user.When the first virtual three-dimensional coordinate and the second void
When the air line distance for intending three-dimensional coordinate is less than default threshold value, display unit 405 is shown and virtual on the basis of target picture
The corresponding preset picture of marker.The present invention is by setting corresponding virtual identifying thing, when virtual identifying thing and virtual objects
Air line distance be less than preset value when, except display real-time video transmission device shoot real picture, mobile terminal always according to
The movement of real-time video transmission device and different virtual identifying things control the display of virtual screen.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method can be with
Realize by another way.For example, device embodiment described above is only schematical, for example, the unit
Divide, only a kind of division of logic function there can be other dividing mode when actually realizing, such as multiple units or component
Another system can be combined or be desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or
The coupling each other discussed or direct-coupling or communication connection can be the indirect couplings of device or unit by some interfaces
Close or communicate to connect, can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is realized using in the form of SFU software functional unit and as independent production marketing or used
When, it can be stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially
The part contributed in other words to prior art or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are to cause a computer
Equipment (can be personal computer, server, or network equipment etc.) performs the complete of each embodiment methods described of the invention
Portion or part steps.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journey
The medium of sequence code.
Described above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although with reference to before
Embodiment is stated the present invention is described in detail, it will be understood by those within the art that：It still can be to preceding
State the technical scheme described in each embodiment to modify, or equivalent substitution is carried out to which part technical characteristic；And these
Modification is replaced, and the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (10)
1. a kind of method that picture is shown, it is characterised in that including：
Obtain the picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot, the destination object
With locomotive function and shoot function；
Virtual objects are generated in the virtual three-dimensional coordinate system set up according to the actual three-dimensional coordinate, the virtual objects
Coordinate is the first virtual three-dimensional coordinate, and the moving direction of the virtual objects is identical with the actual moving direction；
Virtual identifying thing is set on the moving direction of the virtual objects, and the coordinate of the virtual identifying thing is second virtual three
Dimension coordinate；
The virtual objects and the virtual identifying thing are added to the picture that the destination object shoots, target picture is obtained；
When the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value,
Preset picture corresponding with the virtual identifying thing is shown on the basis of the target picture.
2. according to the method described in claim 1, it is characterised in that it is described according to the actual three-dimensional coordinate in the void set up
Intend setting up virtual objects in three-dimensional system of coordinate, the coordinate of the virtual objects is the first virtual three-dimensional coordinate, the virtual objects
Moving direction it is identical with the actual moving direction including：
The actual three-dimensional coordinate is converted into the first virtual three-dimensional coordinate according to preset proportion；
Virtual objects are generated in the virtual three-dimensional coordinate system set up according to the first virtual three-dimensional coordinate, it is described virtual right
The coordinate of elephant is the first virtual three-dimensional coordinate, and the moving direction of the virtual objects is identical with the actual moving direction.
3. according to the method described in claim 1, it is characterised in that described to work as the first virtual three-dimensional coordinate and described second
When the air line distance of virtual three-dimensional coordinate is less than default threshold value, display and the virtual mark on the basis of the target picture
Knowing the corresponding preset picture of thing includes：
The air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is calculated according to preset formula；
When the air line distance is less than default threshold value, display and the virtual identifying thing on the basis of the target picture
Corresponding preset picture.
4. according to the method in any one of claims 1 to 3, it is characterised in that described to obtain actual the three of destination object
Before the picture that dimension coordinate, actual moving direction and destination object are shot, methods described also includes：
Start 3D engines, set up virtual three-dimensional coordinate system.
5. according to the method in any one of claims 1 to 3, it is characterised in that by virtual objects and described virtual
Marker is added to the picture that the destination object is shot, and obtains after target picture, shows on the basis of the target picture
Show before preset picture corresponding with the virtual identifying thing, methods described also includes：
The moving direction of the virtual objects is adjusted according to the operational order of user.
6. a kind of mobile terminal, it is characterised in that including：
Acquiring unit, for obtaining the picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot,
The destination object has locomotive function and shoot function；
Generation unit, for generating virtual objects in the virtual three-dimensional coordinate system set up according to the actual three-dimensional coordinate,
The coordinate of the virtual objects is the first virtual three-dimensional coordinate, the moving direction of the virtual objects and the actual moving direction
It is identical；
Setting unit, for setting virtual identifying thing, the seat of the virtual identifying thing on the moving direction of the virtual objects
It is designated as the second virtual three-dimensional coordinate；
Superpositing unit, for the picture for the destination object shooting that the virtual objects and the virtual identifying thing are added to,
Obtain target picture；
Display unit, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default
During threshold value, for showing preset picture corresponding with the virtual identifying thing on the basis of the target picture.
7. mobile terminal according to claim 6, it is characterised in that the generation unit includes：
Modular converter, for the actual three-dimensional coordinate to be converted into the first virtual three-dimensional coordinate according to preset proportion；
Generation module, it is virtual right for being generated according to the first virtual three-dimensional coordinate in the virtual three-dimensional coordinate system set up
As the coordinate of the virtual objects is the first virtual three-dimensional coordinate, the moving direction of the virtual objects and the reality
Moving direction is identical.
8. mobile terminal according to claim 6, it is characterised in that the display unit includes：
Computing module, for calculating the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to preset formula
Air line distance；
Display module, when the air line distance be less than default threshold value when, on the basis of the target picture display with
The corresponding preset picture of the virtual identifying thing.
9. the mobile terminal according to any one of claim 6 to 8, it is characterised in that the mobile terminal also includes：
Unit is set up, for starting 3D engines, virtual three-dimensional coordinate system is set up.
10. the mobile terminal according to any one of claim 6 to 8, it is characterised in that the mobile terminal also includes：
Adjustment unit, the moving direction for adjusting the virtual objects according to the operational order of user.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2016/110740 WO2018112695A1 (en) | 2016-12-19 | 2016-12-19 | Image display method and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107077216A true CN107077216A (en) | 2017-08-18 |
Family
ID=59624331
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201680001968.3A Pending CN107077216A (en) | 2016-12-19 | 2016-12-19 | Method and mobile terminal that a kind of picture is shown |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107077216A (en) |
| WO (1) | WO2018112695A1 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688392A (en) * | 2017-09-01 | 2018-02-13 | 广州励丰文化科技股份有限公司 | A kind of control MR heads show the method and system that equipment shows virtual scene |
| CN109445103A (en) * | 2018-12-10 | 2019-03-08 | 利亚德光电股份有限公司 | Show the update method and device, storage medium, electronic device of picture |
| CN109782901A (en) * | 2018-12-06 | 2019-05-21 | 网易（杭州）网络有限公司 | Augmented reality exchange method, device, computer equipment and storage medium |
| CN110866940A (en) * | 2019-11-05 | 2020-03-06 | 广东虚拟现实科技有限公司 | Virtual picture control method and device, terminal equipment and storage medium |
| CN111179406A (en) * | 2018-11-09 | 2020-05-19 | 上海云绅智能科技有限公司 | Product model display method and system |
| CN111833462A (en) * | 2020-07-14 | 2020-10-27 | 深圳市瑞立视多媒体科技有限公司 | Cutting method, device and equipment based on illusion engine and storage medium |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961423B (en) * | 2018-07-03 | 2023-04-18 | 百度在线网络技术（北京）有限公司 | Virtual information processing method, device, equipment and storage medium |
| CN109360277B (en) * | 2018-11-08 | 2023-10-17 | 北京虚拟动点科技有限公司 | Virtual simulation display control method and device, storage medium and electronic device |
| CN114067071B (en) * | 2021-11-26 | 2022-08-30 | 湖南汽车工程职业学院 | High-precision map making system based on big data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102831401A (en) * | 2012-08-03 | 2012-12-19 | 樊晓东 | Method and system for tracking, three-dimensionally superposing and interacting target object without special mark |
| CN105589466A (en) * | 2016-02-24 | 2016-05-18 | 谭圆圆 | Flight control device of unmanned aircraft and flight control method thereof |
| US20160327946A1 (en) * | 2015-05-08 | 2016-11-10 | Fujitsu Limited | Information processing device, information processing method, terminal device, and setting method |
| CN106228615A (en) * | 2016-08-31 | 2016-12-14 | 陈昊 | Unmanned vehicle experiencing system based on augmented reality and experiential method thereof |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6752720B1 (en) * | 2000-06-15 | 2004-06-22 | Intel Corporation | Mobile remote control video gaming system |
| US20030232649A1 (en) * | 2002-06-18 | 2003-12-18 | Gizis Alexander C.M. | Gaming system and method |
| FR2912318B1 (en) * | 2007-02-13 | 2016-12-30 | Parrot | RECOGNITION OF OBJECTS IN A SHOOTING GAME FOR REMOTE TOYS |
| US9555337B2 (en) * | 2013-09-16 | 2017-01-31 | Disney Enterprises, Inc. | Method for tracking physical play objects by virtual players in online environments |
| CN104029825B (en) * | 2014-06-13 | 2016-01-20 | 中国人民解放军装甲兵工程学院 | On-the-spot actual situation coupling Unmanned Aircraft Systems (UAS) |
| CN105629470A (en) * | 2016-01-15 | 2016-06-01 | 何军 | Headset displayer and display method |
-
2016
- 2016-12-19 CN CN201680001968.3A patent/CN107077216A/en active Pending
- 2016-12-19 WO PCT/CN2016/110740 patent/WO2018112695A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102831401A (en) * | 2012-08-03 | 2012-12-19 | 樊晓东 | Method and system for tracking, three-dimensionally superposing and interacting target object without special mark |
| US20160327946A1 (en) * | 2015-05-08 | 2016-11-10 | Fujitsu Limited | Information processing device, information processing method, terminal device, and setting method |
| CN105589466A (en) * | 2016-02-24 | 2016-05-18 | 谭圆圆 | Flight control device of unmanned aircraft and flight control method thereof |
| CN106228615A (en) * | 2016-08-31 | 2016-12-14 | 陈昊 | Unmanned vehicle experiencing system based on augmented reality and experiential method thereof |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107688392A (en) * | 2017-09-01 | 2018-02-13 | 广州励丰文化科技股份有限公司 | A kind of control MR heads show the method and system that equipment shows virtual scene |
| CN107688392B (en) * | 2017-09-01 | 2020-08-11 | 广州励丰文化科技股份有限公司 | Method and system for controlling MR head display equipment to display virtual scene |
| CN111179406A (en) * | 2018-11-09 | 2020-05-19 | 上海云绅智能科技有限公司 | Product model display method and system |
| CN109782901A (en) * | 2018-12-06 | 2019-05-21 | 网易（杭州）网络有限公司 | Augmented reality exchange method, device, computer equipment and storage medium |
| CN109445103A (en) * | 2018-12-10 | 2019-03-08 | 利亚德光电股份有限公司 | Show the update method and device, storage medium, electronic device of picture |
| CN109445103B (en) * | 2018-12-10 | 2022-03-01 | 北京虚拟动点科技有限公司 | Display picture updating method and device, storage medium and electronic device |
| CN110866940A (en) * | 2019-11-05 | 2020-03-06 | 广东虚拟现实科技有限公司 | Virtual picture control method and device, terminal equipment and storage medium |
| CN110866940B (en) * | 2019-11-05 | 2023-03-10 | 广东虚拟现实科技有限公司 | Virtual picture control method and device, terminal equipment and storage medium |
| CN111833462A (en) * | 2020-07-14 | 2020-10-27 | 深圳市瑞立视多媒体科技有限公司 | Cutting method, device and equipment based on illusion engine and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018112695A1 (en) | 2018-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107077216A (en) | Method and mobile terminal that a kind of picture is shown | |
| US10977865B2 (en) | Augmented reality in vehicle platforms | |
| CN105143907B (en) | Alignment system and method | |
| CN108548300B (en) | Air supply method and device of air conditioner and electronic equipment | |
| WO2017161660A1 (en) | Augmented reality equipment, system, image processing method and device | |
| US11321929B2 (en) | System and method for spatially registering multiple augmented reality devices | |
| CN107507243A (en) | A kind of camera parameters method of adjustment, instructor in broadcasting's video camera and system | |
| CN106454209A (en) | Unmanned aerial vehicle emergency quick action data link system and unmanned aerial vehicle emergency quick action monitoring method based on spatial-temporal information fusion technology | |
| CN104699247A (en) | Virtual reality interactive system and method based on machine vision | |
| JP6348732B2 (en) | Information processing system, information processing apparatus, information processing program, and information processing method | |
| CN107071389A (en) | Take photo by plane method, device and unmanned plane | |
| Krückel et al. | Intuitive visual teleoperation for UGVs using free-look augmented reality displays | |
| US10706634B1 (en) | System for generating augmented reality content from a perspective view of an unmanned aerial vehicle | |
| CN110858414A (en) | Image processing method and device, readable storage medium and augmented reality system | |
| CN109062407A (en) | Remote mobile terminal three-dimensional display & control system and method based on VR technology | |
| CN108053373A (en) | One kind is based on deep learning model fisheye image correcting method | |
| CN107371043A (en) | Unmanned plane view toll collection system | |
| CN105688373A (en) | Intelligent body-building system and device, and intelligent body-building exchange system | |
| CN108430032A (en) | A kind of method and apparatus for realizing that VR/AR device locations are shared | |
| CN112204958B (en) | Method and apparatus for augmented reality for radio simulation | |
| CN109445598A (en) | A kind of augmented reality system and device of view-based access control model | |
| KR101881227B1 (en) | Flight experience method using unmanned aerial vehicle | |
| KR20220005365A (en) | VR, AR based educational platform development contents provision system | |
| JP2021005347A (en) | Spatial reproduction method and spatial reproduction system | |
| TWI788217B (en) | Method for positioning in a three-dimensional space and positioning system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170818 |
|
| RJ01 | Rejection of invention patent application after publication |