WO2018112695A1

WO2018112695A1 - Image display method and mobile terminal

Info

Publication number: WO2018112695A1
Application number: PCT/CN2016/110740
Authority: WO
Inventors: 林日壮
Original assignee: 深圳市阳日电子有限公司
Priority date: 2016-12-19
Filing date: 2016-12-19
Publication date: 2018-06-28
Also published as: CN107077216A

Abstract

An image display method and a mobile terminal for controlling image display according to movements of a real-time video transmission device comprises: acquiring a real three-dimensional coordinate of a target object, an actual moving direction, and an image taken by the target object, the target object having a moving function and a shooting function (201); generating a virtual object in an established virtual three-dimensional coordinate system on the basis of the actual three-dimensional coordinate, the coordinate of the virtual object being a first virtual three-dimensional coordinate, and the moving direction of the virtual object being the same as the actual moving direction (202); setting a virtual marker in the moving direction of the virtual object, the coordinates of the virtual marker being a second virtual three-dimensional coordinate (203); superimposing the virtual object and the virtual marker on the image shot by the target object to obtain a target image (204); displaying a preset image corresponding to the virtual marker on the basis of the target image when a straight line distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold (205).

Description

Method for displaying screen and mobile terminal

Technical field

The present invention relates to the field of computer augmented reality, and in particular, to a method for displaying a picture and a mobile terminal.

Background technique

With the development of technology, products capable of real-time video transmission have been widely used. For example, drones and remote-controlled cars are widely used in aerial photography, environmental monitoring, forest fire prevention and the like. Some vendors have introduced First Person View (FPV) transmission devices that can use VR (Virtual Reality) glasses to achieve an immersive experience. The existing FPV device mainly carries a flat camera or a panoramic camera for the purpose of shooting, and the player can connect to the FPV product by using a mobile terminal or a dedicated remote controller, and watch the picture taken by the FPV device in real time.

The existing FPV device utilizes the picture taken by the camera to perform certain digital processing, adapts the display of the VR glasses, and brings strong playability to the player, and the immersive experience can bring more stimulation. The FPV device sees the world from the perspective of the first person, bringing a certain virtual reality effect.

However, these FPV devices can only provide the actual picture captured by the camera. In combination with VR glasses or mobile terminals, only the most basic virtual reality experience is provided. In other words, the existing display device cannot control the changed display content. .

Summary of the invention

Embodiments of the present invention provide a method for displaying a picture for displaying a picture according to a mobile control device of a real-time video transmission device.

In view of this, the first aspect of the present invention provides a method for displaying a picture, comprising: acquiring an actual three-dimensional coordinate of a target object, an actual moving direction, and a picture captured by the target object, the target object having a moving function and a shooting function; The actual three-dimensional coordinates generate a virtual object in an established virtual three-dimensional coordinate system, the coordinates of the virtual object are first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction; Setting a virtual identifier in a moving direction of the object, the coordinates of the virtual identifier being a second virtual three-dimensional coordinate; superimposing the virtual object and the virtual identifier on a picture captured by the target object to obtain a target image; When the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, in the target image The preset screen corresponding to the virtual identifier is displayed on the basis of the preset.

With reference to the first aspect of the embodiments of the present invention, in a first implementation manner of the first aspect of the embodiments, the virtual object is established in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinate, the virtual The coordinates of the object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction: converting the actual three-dimensional coordinates into a first virtual three-dimensional coordinate according to a preset ratio; according to the first virtual The three-dimensional coordinates generate a virtual object in the established virtual three-dimensional coordinate system, the coordinates of the virtual object being the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction.

With reference to the first aspect of the embodiments of the present invention, in a second implementation manner of the first aspect of the embodiment, the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset Displaying a preset screen corresponding to the virtual identifier on the basis of the target image includes: calculating a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to a preset formula; When the linear distance is less than a preset threshold, a preset screen corresponding to the virtual identifier is displayed on the basis of the target screen.

With reference to any implementation of the first aspect of the embodiment of the present invention to the second implementation of the first aspect, in a third implementation manner of the first aspect of the embodiment of the present invention, the acquiring the actual three-dimensional object Before the coordinates, the actual moving direction, and the picture taken by the target object, the method further includes: starting the 3D engine to establish a virtual three-dimensional coordinate system.

With reference to any implementation of the first aspect of the embodiment of the present invention to the second implementation of the first aspect, in a fourth implementation manner of the first aspect of the embodiment, the virtual object and the virtual object are After the virtual identifier is superimposed on the picture captured by the target object, and after the target picture is obtained, before the preset picture corresponding to the virtual identifier is displayed on the basis of the target picture, the method further includes: according to the operation of the user The instruction adjusts a moving direction of the virtual object.

A second aspect of the present invention provides a mobile terminal, where the mobile terminal includes: an acquiring unit, configured to acquire an actual three-dimensional coordinate of the target object, an actual moving direction, and a picture captured by the target object, where the target object has a mobile function and a shooting a generating unit, configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinate, the coordinate of the virtual object is a first virtual three-dimensional coordinate, and the moving direction of the virtual object is related to the actual The moving direction is the same; the setting unit is configured to set a virtual identifier in a moving direction of the virtual object, where the coordinates of the virtual identifier are second a virtual three-dimensional coordinate; a superimposing unit, configured to superimpose the virtual object and the virtual identifier onto a picture captured by the target object to obtain a target picture; and display unit, when the first virtual three-dimensional coordinate and the second When the linear distance of the virtual three-dimensional coordinates is less than a preset threshold, the preset screen corresponding to the virtual identifier is displayed on the basis of the target image.

With reference to the second aspect of the embodiments of the present invention, in a first implementation manner of the second aspect of the embodiments, the generating unit includes: a converting module, configured to convert the actual three-dimensional coordinates into a preset ratio according to a preset ratio a virtual three-dimensional coordinate; a generating module, configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinate, the coordinate of the virtual object is the first virtual three-dimensional coordinate, the virtual object The moving direction is the same as the actual moving direction.

With reference to the second aspect of the embodiments of the present invention, in a second implementation manner of the second aspect of the embodiments, the display unit includes: a calculation module, configured to calculate the first virtual three-dimensional coordinates according to a preset formula a linear distance of the second virtual three-dimensional coordinate; a display module, configured to display a preset screen corresponding to the virtual identifier on the basis of the target image when the linear distance is less than a preset threshold.

With the implementation of the second aspect of the second aspect of the present invention, the second implementation of the second aspect of the present disclosure, the mobile terminal further includes: establishing The unit is used to start the 3D engine and establish a virtual three-dimensional coordinate system.

With the implementation of the second aspect of the second aspect of the present invention, the second implementation of the second aspect of the present disclosure, the mobile terminal further includes: adjusting And a unit, configured to adjust a moving direction of the virtual object according to an operation instruction of the user.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

In the embodiment of the present invention, an actual three-dimensional coordinate of the target object, an actual moving direction, and a picture captured by the target object are acquired, the target object has a moving function and a shooting function; and the actual three-dimensional coordinate is in the established virtual three-dimensional coordinate system. Generating a virtual object, the coordinates of the virtual object being a first virtual three-dimensional coordinate, the moving direction of the virtual object is the same as the actual moving direction; setting a virtual identifier in the moving direction of the virtual object, the virtual identifier The coordinates of the object are second virtual three-dimensional coordinates; superimposing the virtual object and the virtual identifier on a picture taken by the target object to obtain a target picture; when the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates When the linear distance of the coordinate is less than a preset threshold, displaying the preset drawing corresponding to the virtual identifier on the basis of the target image surface. The invention sets the corresponding virtual identifier, and when the preset condition is met, in addition to displaying the real picture captured by the real-time video transmission device, the mobile terminal controls the display of the virtual picture according to the movement of the real-time video transmission device and different virtual identifiers. .

DRAWINGS

FIG. 1 is a schematic diagram of a framework of a specific application scenario according to an embodiment of the present invention;

2 is a schematic diagram of an embodiment of a method for displaying a screen according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of another embodiment of a method for displaying a screen according to an embodiment of the present invention; FIG.

4 is a schematic diagram of an embodiment of a mobile terminal according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of another embodiment of a mobile terminal according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram of another embodiment of a mobile terminal according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments.

The terms "first", "second", "third", "fourth", etc. (if present) in the specification and claims of the present invention and the above figures are used to distinguish similar objects without having to use To describe a specific order or order. It is to be understood that the data so used may be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than what is illustrated or described herein. In addition, the term "comprises" or "comprises" or any variations thereof, is intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to those that are clearly listed Steps or units, but may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

The existing real-time video transmission device can only perform video capture and transmission. As shown in FIG. 1 , a schematic diagram of a specific application scenario of the embodiment of the present invention, the mobile terminal is connected with the drone, and the mobile terminal is The human-machine can transmit relevant information, and the drone establishes a wireless connection with the satellite, and the drone acquires the actual latitude and longitude information through the satellite.

For ease of understanding, the specific process in the embodiment of the present invention is described below, please refer to FIG. 2, An embodiment of the method for displaying a picture in the embodiment of the present invention includes:

201. Acquire an actual three-dimensional coordinate of the target object, an actual moving direction, and a picture captured by the target object, and the target object has a moving function and a shooting function.

A connection relationship has been established between the mobile terminal and the target object, and the target object is a real-time video transmission device with a mobile function and a shooting function, and data transmission can be performed between the mobile terminal and the target object. The mobile terminal remotely receives the actual three-dimensional coordinates, the actual moving direction, and the captured image transmitted by the target object, and the actual three-dimensional coordinates include the latitude and longitude and height information of the target object.

202. Generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinate. The coordinate of the virtual object is the first virtual three-dimensional coordinate, and the moving direction of the virtual object is the same as the actual moving direction.

The mobile terminal receives the actual three-dimensional coordinates sent by the target object, simulates the actual three-dimensional coordinates on the three-dimensional coordinate system by the virtual engine to obtain the first virtual three-dimensional coordinates, and generates a virtual object in the established virtual three-dimensional system according to the coordinates. For example, when the real-time video transmission device is a drone, a corresponding virtual drone is generated in a virtual coordinate system that has been established by the mobile terminal, and the moving direction of the virtual drone is the same as the moving direction of the actual drone.

203. Set a virtual identifier in a moving direction of the virtual object, where the coordinates of the virtual identifier are second virtual three-dimensional coordinates.

The mobile terminal can acquire the moving direction of the virtual object in real time, and set a virtual identifier in the current moving direction of the virtual object, where the coordinates of the virtual identifier are the second virtual three-dimensional coordinates, and the virtual identifier can be a gold coin or an obstacle, etc. It can be a virtual object with other meanings, which is not limited here.

204. Superimpose the virtual object and the virtual identifier on the screen captured by the target object to obtain a target image.

The mobile terminal extracts relevant parameters of the virtual object and the virtual identifier, generates a corresponding virtual image according to the relevant parameters by the virtual engine, and then superimposes the virtual image with the image captured by the target object to obtain a target image, and the target image has a target at the same time. The real picture taken by the object and the virtual picture generated by the mobile terminal.

205. When a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, displaying a preset image corresponding to the virtual identifier on the basis of the target image.

When the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, the mobile terminal displays the corresponding target image in addition to the virtual identifier, and displays corresponding The preset screen, for example, when the virtual marker is a gold coin, the mobile terminal displays a preset screen indicating the increase of the gold coin.

The invention sets the corresponding virtual identifier, and when the preset condition is met, in addition to displaying the real picture captured by the real-time video transmission device, the mobile terminal controls the display of the virtual picture according to the movement of the real-time video transmission device and different virtual identifiers. .

Referring to FIG. 3, another embodiment of a method for displaying a screen according to an embodiment of the present invention includes:

301. Start a 3D engine and establish a virtual three-dimensional coordinate system.

The mobile terminal starts a preset 3D engine, establishes a virtual three-dimensional coordinate system through the 3D engine, and renders a corresponding virtual world image. For example, the virtual three-dimensional coordinate system is established by the Direct engine, and the 3D engine may be other engines, such as an OpenGL engine, etc., which is not limited herein.

302. Acquire an actual three-dimensional coordinate of the target object, an actual moving direction, and a picture captured by the target object, and the target object has a moving function and a shooting function.

303. Convert the actual three-dimensional coordinates into a first virtual three-dimensional coordinate according to a preset ratio.

The actual three-dimensional coordinates are converted into the first virtual three-dimensional coordinates according to a preset ratio, and the conversion ratio is set according to actual needs, for example, the ratio of the actual three-dimensional coordinates to the first virtual three-dimensional coordinates is set to 100:1.

304. Generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinate. The coordinate of the virtual object is the first virtual three-dimensional coordinate, and the moving direction of the virtual object is the same as the actual moving direction.

The mobile terminal acquires the converted first virtual three-dimensional coordinates, simulates the first virtual three-dimensional coordinates onto the three-dimensional coordinate system by the virtual engine, and generates a virtual object in the established virtual three-dimensional system according to the virtual coordinates.

305. Set a virtual identifier in a moving direction of the virtual object, where the coordinates of the virtual identifier are second virtual three-dimensional coordinates.

The mobile terminal can acquire the moving direction of the virtual object in real time, and the current moving party of the virtual object The virtual identifier is set upwards, and the coordinates of the virtual identifier are the second virtual three-dimensional coordinates, and the virtual identifier may be a gold coin or an obstacle, etc., which is not limited herein.

306. Superimpose the virtual object and the virtual identifier on the screen captured by the target object to obtain a target image.

307. Adjust a moving direction of the virtual object according to a user operation instruction.

The mobile terminal receives an operation instruction of the user, and the mobile terminal adjusts the virtual object according to the operation instruction, and the operation instruction is used to change a moving direction of the virtual object.

308. Calculate a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to the preset formula.

The mobile terminal calculates a linear distance between the virtual identifier and the virtual object according to the preset formula according to the obtained coordinate information of the virtual identifier and the virtual object.

309. When a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, displaying a preset image corresponding to the virtual identifier on the basis of the target image.

When the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, the mobile terminal displays the corresponding preset image according to the difference of the virtual identifier, for example, when displaying the superimposed target image. When the virtual marker is a gold coin, the mobile terminal displays a preset screen indicating the increase of the gold coin.

For ease of understanding, the following describes the specific application scenarios:

The mobile phone starts the preset Direct engine, establishes a virtual three-dimensional coordinate system through the Direct engine, and renders a corresponding virtual world image. A connection relationship has been established between the mobile phone and the drone, and data transmission between the mobile phone and the drone can be performed. The mobile phone remotely receives the actual three-dimensional coordinates, the actual moving direction and the captured image transmitted by the drone, and the actual three-dimensional coordinates include none. Longitude and latitude and altitude information of man-machine. The mobile phone converts the actual three-dimensional coordinates into a first virtual three-dimensional coordinate according to a ratio of 10:1. For example, the actual coordinates are (x: 113, y: 23, z: 100), and the first virtual three-dimensional coordinates are (x: 11.3, y). :2.3,z:10), the unit is meters. According to different application scenarios, mobile phones have multiple ways to obtain relevant information. For example, when the drone is in an open environment, the mobile phone can obtain the actual latitude and longitude of the drone according to the satellite positioning, and then obtain the actual level of the drone through the height measuring instrument installed on the drone; When the man-machine is in an indoor or semi-enclosed environment, the mobile phone can determine the distance between the drone and the surrounding wall or obstacle through the distance detector installed on the drone, and then calculate another set of virtual coordinates. The mobile phone generates a virtual drone in a virtual three-dimensional coordinate system according to the obtained first virtual coordinates (x: 11.3, y: 2.3, z: 10), and the coordinates of the virtual unmanned are (x: 11.3, y: 2.3, z :10). At this time, the drone is flying from south to north, then the moving direction of the virtual drone is the same as the actual flight direction of the drone, and the flight is from south to north, and the virtual logo is set in the forward direction of the virtual drone. In addition to displaying the real picture taken by the drone, the mobile phone displays the virtual logo gold coin and virtual drone created by the virtual engine. The coordinates of the virtual marker are (x: 8.3, y: 2.3, z: 6), and the straight line distance is S.

S=5, the user operates on the mobile phone, and controls the virtual drone to move toward the virtual marker gold coin. When the virtual drone approaches the gold coin, and the linear distance S of the virtual drone and the gold coin is less than 0.1 m, it is regarded as virtual The drone collides with the gold coin. On the basis of the current display screen, the mobile phone additionally displays a picture of the increase of the gold coin.

The mobile terminal in the embodiment of the present invention is described in the following.

The acquiring unit 401 is configured to acquire an actual three-dimensional coordinate of the target object, an actual moving direction, and a picture captured by the target object, where the target object has a moving function and a shooting function;

The generating unit 402 is configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, where the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction;

a setting unit 403, configured to set a virtual identifier in a moving direction of the virtual object, where the coordinates of the virtual identifier are second virtual three-dimensional coordinates;

a superimposing unit 404, configured to superimpose the virtual object and the virtual identifier on the screen captured by the target object to obtain a target image;

The display unit 405, when the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than The preset threshold is used to display a preset screen corresponding to the virtual marker on the basis of the target screen.

In the embodiment of the present invention, the acquiring unit 401 acquires the actual three-dimensional coordinates of the target object, the actual moving direction, and the image captured by the target object, the target object has a moving function and a shooting function; and the generating unit 402 establishes the virtual three-dimensional coordinates according to the actual three-dimensional coordinates. A virtual object is generated, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction; the setting unit 403 sets the virtual identifier in the moving direction of the virtual object, and the coordinates of the virtual identifier are the first Two virtual three-dimensional coordinates; the superimposing unit 404 superimposes the virtual object and the virtual identifier on the image captured by the target object to obtain a target image; when the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, the display is performed. The unit 405 displays a preset screen corresponding to the virtual marker on the basis of the target screen. The invention sets a corresponding virtual identifier. When the linear distance between the virtual identifier and the virtual object is less than a preset value, in addition to displaying the real picture captured by the real-time video transmission device, the mobile terminal is further different according to the movement of the real-time video transmission device. The virtual marker controls the display of the virtual screen.

Referring to FIG. 5, another embodiment of the mobile terminal in the embodiment of the present invention includes:

The display unit 405 is configured to display a preset screen corresponding to the virtual identifier on the basis of the target image when the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold.

The generating unit 402 includes:

The conversion module 4021 is configured to convert the actual three-dimensional coordinates into a first virtual three-dimensional coordinate according to a preset ratio;

The generating module 4022 is configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinate, where the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object Same as the actual moving direction.

The display unit 405 can further include:

a calculation module 4051, configured to calculate a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to the preset formula;

The display module 4052 is configured to display a preset screen corresponding to the virtual identifier on the basis of the target screen when the linear distance is less than a preset threshold.

In the embodiment of the present invention, the acquiring unit 401 acquires the actual three-dimensional coordinates of the target object, the actual moving direction, and the image captured by the target object, and the target object has a moving function and a shooting function; the converting module 4021 converts the actual three-dimensional coordinates into a preset ratio. a virtual three-dimensional coordinate; the generating module 4022 generates a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinate, the coordinate of the virtual object is the first virtual three-dimensional coordinate, and the moving direction of the virtual object is the same as the actual moving direction; The unit 403 sets a virtual identifier in the moving direction of the virtual object, and the coordinates of the virtual identifier are the second virtual three-dimensional coordinates; the superimposing unit 404 superimposes the virtual object and the virtual identifier on the image captured by the target object to obtain a target image; and the calculation module The 4051 calculates a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to the preset formula. When the linear distance is less than the preset threshold, the display module 4052 displays the preset image corresponding to the virtual identifier on the basis of the target image. . The invention sets a corresponding virtual identifier. When the linear distance between the virtual identifier and the virtual object is less than a preset value, in addition to displaying the real picture captured by the real-time video transmission device, the mobile terminal is further different according to the movement of the real-time video transmission device. The virtual marker controls the display of the virtual screen.

Referring to FIG. 6, another embodiment of the mobile terminal in the embodiment of the present invention includes:

The mobile terminal further includes:

The establishing unit 406 is configured to start the 3D engine and establish a virtual three-dimensional coordinate system.

The mobile terminal may further include:

The adjusting unit 407 is configured to adjust a moving direction of the virtual object according to an operation instruction of the user.

In the embodiment of the present invention, the establishing unit 406 starts the 3D engine and establishes a virtual three-dimensional coordinate system. The obtaining unit 401 acquires the actual three-dimensional coordinates of the target object, the actual moving direction, and the image captured by the target object, the target object has a moving function and a shooting function; the generating unit 402 generates a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates. The coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction; the setting unit 403 sets the virtual identifier in the moving direction of the virtual object, and the coordinates of the virtual identifier are the second virtual three-dimensional coordinates; The unit 404 superimposes the virtual object and the virtual marker on the screen shot by the target object to obtain a target screen; the adjusting unit 407 adjusts the moving direction of the virtual object according to the operation instruction of the user. When the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, the display unit 405 displays a preset screen corresponding to the virtual identifier on the basis of the target image. The invention sets a corresponding virtual identifier. When the linear distance between the virtual identifier and the virtual object is less than a preset value, in addition to displaying the real picture captured by the real-time video transmission device, the mobile terminal is further different according to the movement of the real-time video transmission device. The virtual marker controls the display of the virtual screen.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the embodiments are modified, or the equivalents of the technical features are replaced by the equivalents of the technical solutions of the embodiments of the present invention.

Claims

A method for displaying a picture, comprising:

Obtaining an actual three-dimensional coordinate of the target object, an actual moving direction, and a picture taken by the target object, the target object having a moving function and a shooting function;

Generating a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinate, the coordinate of the virtual object is a first virtual three-dimensional coordinate, and the moving direction of the virtual object is the same as the actual moving direction;

Setting a virtual identifier in a moving direction of the virtual object, where coordinates of the virtual identifier are second virtual three-dimensional coordinates;

Superimposing the virtual object and the virtual identifier on a picture taken by the target object to obtain a target picture;

When the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, a preset screen corresponding to the virtual identifier is displayed on the basis of the target image.
The method according to claim 1, wherein the virtual object is established in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinate, and the coordinates of the virtual object are first virtual three-dimensional coordinates, and the virtual The moving direction of the object is the same as the actual moving direction, including:

Converting the actual three-dimensional coordinates into a first virtual three-dimensional coordinate according to a preset ratio;

Generating a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinate, the coordinate of the virtual object is the first virtual three-dimensional coordinate, and the moving direction of the virtual object is the same as the actual moving direction .
The method according to claim 1, wherein when the linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold, displaying on the basis of the target image The preset screen corresponding to the virtual identifier includes:

Calculating a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to a preset formula;

When the linear distance is less than a preset threshold, a preset screen corresponding to the virtual identifier is displayed on the basis of the target screen.
The method according to any one of claims 1 to 3, wherein the method before acquiring the actual three-dimensional coordinates of the target object, the actual moving direction, and the image taken by the target object Also includes:

Start the 3D engine and create a virtual 3D coordinate system.
The method according to any one of claims 1 to 3, wherein the virtual object and the virtual identifier are superimposed on a picture taken by the target object to obtain a target picture, after the target picture Before displaying the preset screen corresponding to the virtual identifier, the method further includes:

Adjusting the moving direction of the virtual object according to an operation instruction of the user.
A mobile terminal, comprising:

An acquiring unit, configured to acquire actual three-dimensional coordinates of the target object, an actual moving direction, and a picture captured by the target object, where the target object has a moving function and a shooting function;

a generating unit, configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinate, the coordinate of the virtual object is a first virtual three-dimensional coordinate, a moving direction of the virtual object and the actual moving direction the same;

a setting unit, configured to set a virtual identifier in a moving direction of the virtual object, where the coordinates of the virtual identifier are second virtual three-dimensional coordinates;

a superimposing unit, configured to superimpose the virtual object and the virtual identifier on a picture taken by the target object to obtain a target picture;

a display unit, configured to display a preset corresponding to the virtual identifier on a basis of the target image when a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than a preset threshold Picture.
The mobile terminal according to claim 6, wherein the generating unit comprises:

a conversion module, configured to convert the actual three-dimensional coordinates into a first virtual three-dimensional coordinate according to a preset ratio;

a generating module, configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinate, where the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object The actual moving direction is the same.
The mobile terminal according to claim 6, wherein the display unit comprises:

a calculation module, configured to calculate a linear distance between the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to a preset formula;

And a display module, configured to display a preset screen corresponding to the virtual identifier on the basis of the target screen when the linear distance is less than a preset threshold.
The mobile terminal according to any one of claims 6 to 8, wherein the mobile terminal further comprises:

A unit is created for starting the 3D engine and establishing a virtual three-dimensional coordinate system.
The mobile terminal according to any one of claims 6 to 8, wherein the mobile terminal further comprises:

And an adjusting unit, configured to adjust a moving direction of the virtual object according to an operation instruction of the user.