WO2018113173A1

WO2018113173A1 - Virtual reality display method and terminal

Info

Publication number: WO2018113173A1
Application number: PCT/CN2017/084370
Authority: WO
Inventors: 陈绍君; 程丽
Original assignee: 华为技术有限公司
Priority date: 2016-12-24
Filing date: 2017-05-15
Publication date: 2018-06-28
Also published as: CN108391445B; CN108391445A

Abstract

Disclosed are a virtual reality display method and a terminal. According to embodiments of the present invention, a terminal obtains external environment data from a real scene, the external environment data comprising at least one of geographic location data, time data, or weather data; 3D image resources are obtained according to the external environment data, and a virtual scene corresponding to the external environment data is displayed according to the 3D image resources. The solution above can remind a user of real situations of an external environment in the case that the user is absorbed in a virtual reality scene that is cut off from the external environment, so that the user can learn about current geographical location, time, and weather.

Description

Virtual reality display method and terminal

This application claims the priority of the Chinese Patent Application filed on Dec. 24, 2016, the Chinese Patent Application No. 201611210214.7, entitled "A Virtual Reality Display Method and Apparatus Combined with Reality Scenes", the entire contents of which is hereby incorporated by reference. This is incorporated herein by reference.

Technical field

The present application relates to the field of virtual reality technologies, and in particular, to a virtual reality display method and terminal.

Background technique

Virtual Reality (VR) technology is a technology that uses a computer to generate a simulation environment, which enables users to enter the environment through various sensing devices, and realizes direct interaction between the user and the environment. It is a kind of technology that can be created and experienced. Computer system technology for virtual environments.

At present, there are many products based on VR technology, such as a personal computer (PC) that needs to be connected to a computer, a mobile terminal that needs to be used with a mobile phone, a stand-alone head display that can be used independently, and VR. Experience the environment, VR wearable devices, and more.

When users use VR products, they are immersed in virtual reality scenes that are isolated from the outside world. They cannot perceive changes in the real environment, such as weather conditions and changes in geographic location.

For example, users use VR products to watch movies. The average movie duration is about 2 hours. When the user starts to watch the movie, he enters the virtual scene from the real environment, and the weather conditions in the real environment are good. One hour after the user watched the movie, the weather changed suddenly and it began to rain. In this case, since the user is completely immersed in the virtual scene, it is impossible to perceive the change of the weather in the real environment. If you want to see the weather changes in the real environment, you need to stop using the VR product and see the real-time weather conditions in the real environment, or exit the application you are using and open the weather app to view the real-time weather conditions. The above method is complicated in operation, and the process of using the VR product by the user is interrupted, and the user experience is poor.

Summary of the invention

The embodiment of the invention provides a virtual reality display method and a terminal, which enable the user to know the real situation of the external environment in real time, including geographical location, time, weather and the like.

In a first aspect, an embodiment of the present invention provides a virtual reality display method, including: acquiring, by a virtual reality terminal, external environment data from a real scene, where the external environment data includes: at least geographical location data, time data, or weather data. And obtaining a three-dimensional (3D) image resource according to the external environment data; and displaying a virtual scene corresponding to the external environment data according to the 3D image resource. The real scene is a scene in which the current virtual reality terminal is actually located, and is a scene corresponding to an actual external environment.

In the embodiment of the present invention, the virtual reality terminal may be configured with a transceiver and a positioning module.

In a specific implementation, the virtual reality terminal may acquire the geographic location data of the virtual reality terminal in real time by using the positioning module, and at least one of time data or weather data may be acquired by the transceiver in real time.

Specifically, the virtual reality terminal may acquire a 3D image resource from a local database or a server according to the obtained external environment parameter. When acquiring a 3D image resource from a local database, the local database is stored in a memory of the virtual reality terminal, and the processor of the virtual reality terminal can directly obtain the 3D image resources. When acquiring the 3D image resource from the server, the server may be a remote server, and the virtual reality terminal may acquire the 3D image resource from the remote server through the transceiver.

The 3D image resource is a picture resource having a 3D visual effect, and may include a static image resource, such as a picture resource, and may also include a dynamic image resource, such as a video resource.

The method of the first aspect can prompt the user to the real situation of the external environment, including the real situation of the external environment such as the geographical location, the time, the weather, and the like, and make up for the drawback that the user is completely immersed in the virtual reality scene and completely unaware of the external environment.

With reference to the first aspect, in some embodiments, the external environment data includes geographic location data; and the acquiring the 3D image resource according to the external environment data includes: acquiring the geographic location data according to the geographic location data Corresponding landmark 3D image resources.

Specifically, the 3D image resource of the landmark corresponding to the geographical location data may be obtained according to the geographic location data by using the following two strategies:

First, from the local landmark database or the server, the 3D image resource corresponding to the nearest landmark is obtained from the local database or the server.

The second highest-accuracy landmark acquisition policy, the virtual reality terminal acquires a 3D image resource corresponding to the hottest landmark corresponding to the geographic location data from the local database or the server according to the geographic location data. Implementing the above steps enables the user to intuitively feel where they are.

With reference to the first aspect, in some embodiments, the external environment data includes geographic location data, and the acquiring the 3D image resource according to the external environment data includes: obtaining the geographic location data indication according to the geographic location data The geographical location of the 3D image resource at the geographic location. Implement the above steps to give the user a visual understanding of where they are physically located.

With reference to the first aspect, in some embodiments, the external environment data includes time data, and the acquiring the 3D image resource according to the external environment data includes: acquiring, according to the time data, a time corresponding to the time data indication 3D image resources for outdoor light.

With reference to the first aspect, in some embodiments, the external environment data includes weather data, and acquiring the 3D image resource according to the external environment data includes: acquiring a weather condition indicated by the weather data according to the weather data Corresponding 3D image resources; wherein the weather data comprises at least one of the following: air quality, temperature, relative humidity, precipitation, wind direction or light intensity.

It can be understood that the 3D image resource of the landmark corresponding to the geographical location data described above, the 3D image resource of the geographical environment at the geographical location indicated by the geographic location data, and the outdoor light corresponding to the time indicated by the time data The 3D image resource and the 3D image resource corresponding to the weather condition indicated by the weather data are stored in the server, and may be stored in different servers or in the same server at the same time, and the present invention does not impose any limitation.

With reference to the first aspect, in some embodiments, displaying the virtual scene corresponding to the external environment data according to the 3D image resource includes: displaying a virtual scene corresponding to the external environment data on a HOME main interface.

In a specific implementation, the virtual reality terminal may be triggered to display the virtual scene corresponding to the external environment data on the HOME main interface by using the following manner:

First, the virtual reality terminal detects that the current page is the HOME main interface, and then displays the main interface of the HOME. A virtual scene corresponding to the external environment data is displayed.

Second, the virtual reality terminal receives user input for understanding an external environment, and in response to the user input, the virtual reality terminal jumps from the current page to the HOME main interface, and displays the external interface on the HOME main interface. The virtual scene corresponding to the environment data.

The user input herein may be preset, and the user input may include, but is not limited to, a gesture input, a voice input, a key input, a touch screen input, and may also be a shake head input, a blink input, or the like. The gesture input may be a specified action, for example, the left hand shake angle exceeds 45 degrees. In a specific implementation, the virtual reality terminal may further determine, according to the time when the user maintains the specified action, whether the user inputs the user input for understanding the external environment, for example, when the user raises the left hand and holds for 3 seconds, The virtual reality terminal can determine that the user inputs the user input for understanding the external environment, and can display the virtual scene corresponding to the external environment on the HOME main interface.

The third type, when the external environment data fluctuates greatly, the virtual reality terminal jumps from the current page to the HOME main interface, and displays the virtual scene corresponding to the external environment data on the HOME main interface.

Specifically, when the external environment data fluctuates greatly, it indicates that the real environment of the outside world has undergone a large change, and can automatically jump to the HOME main interface to prompt the user to change the real environment.

Fourthly, the virtual reality terminal jumps from the current page to the HOME main interface every preset time period, and displays the virtual scene corresponding to the external environment data on the HOME main interface.

It can be understood that, in the foregoing second, third, and fourth triggering manners, in an optional embodiment, the virtual reality terminal may preset a display duration, and the virtual reality device jumps from the current page to The main interface of the HOME, and when the time of displaying the virtual scene corresponding to the external environment data reaches the display duration in the main interface of the HOME, automatically jumping back to the current page does not affect the experience of the user using the virtual reality terminal.

The above steps display the virtual scene on the HOME main interface. When the user sees the HOME main interface, the user can intuitively feel the real situation of the external environment, and make up for the user completely immersed in the virtual reality scene and completely unaware of the external environment. The drawbacks. Further, the manner of displaying the virtual scene on the HOME main interface is not large, and is easy to implement, and increases the interest of the HOME main interface, and provides more effective information to the user.

With reference to the first aspect, in some embodiments, displaying the virtual scene corresponding to the external environment data according to the 3D image resource comprises: displaying, according to the 3D image resource, a virtual scene corresponding to the external environment data and current And displaying a virtual scene corresponding to the external environment data on the current page according to the 3D image resource.

In a specific implementation, the virtual reality terminal may be triggered to display the virtual reality terminal according to the 3D by displaying the second, third, or fourth triggering manner of the virtual scene on the HOME main interface. The image resource screen displays the virtual scene and the current page corresponding to the external environment data, or the virtual scene corresponding to the external environment data is displayed on the current page according to the 3D image resource, and the previous description may be referred to.

The above steps are performed by means of split screen display or floating display, which does not affect the user's use of the virtual reality terminal, and can also prompt the user to the actual situation of the external environment, and make up for the drawback that the user is completely immersed in the virtual reality scene and completely unaware of the external environment.

In an alternative embodiment, the virtual reality terminal may also prompt the user to the real situation of the external environment through a sense of hearing, touch, etc., to give the user a more realistic and intuitive experience. For example, when the external environment data includes weather data, the virtual reality terminal also outputs a real weather condition through various types of sensing devices. For example, weather data includes rainfall, And the rainfall reaches 50 mm, indicating that the current weather condition is heavy rain, then the virtual reality terminal can output the rain sound corresponding to the rainfall of 50 mm through the audio device, so that the user can feel the rainy weather condition immersively. The above steps can make the user feel the real environment of the outside world more intuitively.

In a second aspect, an embodiment of the present invention provides a terminal, including: a processor, a memory, and a 3D display, where:

The memory is for storing instructions and data;

The processor is configured to read instructions and data stored in the memory, and perform the following operations:

Obtaining external environment data from a real scene, the external environment data including: at least one of geographical location data, time data, or weather data;

Obtaining geographic location data in the external environment data from a real scene;

The 3D display is configured to display a virtual scene corresponding to the external environment data according to the 3D image resource.

In the embodiment of the present invention, the user can see the three-dimensional image from the 3D display 123 through the optical lens, and intuitively feel the three-dimensional effect. In a specific implementation, the 3D display can display a virtual reality scene corresponding to an external environment, and the user can view the 3D virtual reality scene from the 3D display through the optical lens.

In the embodiment of the present invention, the processor includes a graphics processing unit (GPU), and the GPU is mainly used for three-dimensional image and special effect processing, and is a core processor dedicated to image data. In some embodiments, the GPU may generate a virtual reality scene corresponding to the external environment data according to the acquired 3D image resource by using a computer 3D graphics processing technology. For example, using particle systems to simulate wind, snow, rain, yin and sunny weather conditions, based on particle systems and using texture mapping dynamic algorithms to achieve 3D frost effect, using volume cloud algorithm to generate sunny, cloudy and rainy 3D weather effects, etc. A virtual reality scene corresponding to the weather data is available. For another example, the outdoor light can be simulated by a preset algorithm to obtain a virtual reality scene corresponding to the time data.

In conjunction with the second aspect, in some embodiments, the external environment data includes geographic location data; the processor is specifically configured to acquire a 3D image resource of a landmark corresponding to the geographic location data according to the geographic location data. The 3D image resource of the landmark corresponding to the geographic location data may be stored in a server or may be stored in a local database.

Specifically, the processor may obtain the 3D image resource of the landmark corresponding to the geographical location data according to the geographic location data by using the following two strategies:

First, from the nearest landmark acquisition strategy, the 3D image resource corresponding to the nearest landmark is obtained from the geographic location indicated by the geographic location data.

In the second type, the hottest landmark acquisition policy is configured to acquire a 3D image resource corresponding to the hottest landmark corresponding to the geographic location data according to the geographic location data.

With reference to the second aspect, in some embodiments, the external environment data includes geographic location data, and the processor is specifically configured to acquire, according to the geographic location data, a geographical environment at a geographic location indicated by the geographic location data. 3D image resources.

With reference to the second aspect, in some embodiments, the external environment data includes time data, and the processor is specifically configured to acquire, according to the time data, a 3D image resource of outdoor light corresponding to the time indicated by the time data.

In conjunction with the second aspect, in some embodiments, the external environment data includes weather data, the processor specific And acquiring, according to the weather data, a 3D image resource corresponding to the weather condition indicated by the weather data; wherein the weather data includes at least one of the following: air quality, temperature, relative humidity, precipitation, wind direction or illumination strength.

With reference to the second aspect and the respective embodiments of the second aspect, the 3D image resource of the landmark corresponding to the geographical location data described above, the 3D image resource of the geographical environment at the geographic location indicated by the geographic location data, the time The 3D image resource corresponding to the outdoor light and the 3D image resource corresponding to the weather condition indicated by the weather data may be stored in the local database or may be stored in the server. When the foregoing various types of 3D image resources are stored in a local database, the processor is specifically configured to directly acquire the various types of 3D image resources from the local database. When the foregoing various types of 3D image resources are stored in the server, the terminal may further include a transceiver, where the processor is specifically configured to instruct the transceiver to acquire the various types of 3D image resources from the server.

In conjunction with the second aspect, in some embodiments, the 3D display is specifically configured to display a virtual scene corresponding to the external environment data on a HOME main interface.

In a specific implementation, the 3D display may be triggered to display the virtual scene corresponding to the external environment data on the HOME main interface by:

The first type detects that the current page is the HOME main interface, and displays the virtual scene corresponding to the external environment data on the HOME main interface.

Second, the virtual reality terminal further includes a user input device, configured to receive a user input for understanding an external environment, and the virtual reality terminal jumps from the current page to the user input in response to the user input The HOME main interface displays the virtual scene corresponding to the external environment data on the HOME main interface. In a specific implementation, the user input device may be the above-mentioned 3D display, or may be a camera, an audio circuit, a gesture sensor, or the like.

With reference to the second aspect, in some embodiments, the 3D display is specifically configured to display a virtual scene and a current page corresponding to the external environment data according to the 3D image resource; or, according to the 3D image resource, The virtual scene corresponding to the external environment data is displayed on the current page.

In a specific implementation, the third, third, or fourth identical triggering manner of the virtual scene may be displayed on the HOME main interface with the 3D display to trigger the 3D display according to the 3D image resource. The virtual scene corresponding to the external environment data and the current page are displayed on the screen, or the virtual scene corresponding to the external environment data is displayed on the current page according to the 3D image resource, and the previous description may be referred to.

In an alternative embodiment, the virtual reality terminal may also prompt the user to the real situation of the external environment through a sense of hearing, touch, etc., to give the user a more realistic and intuitive experience. For example, when the external environment data includes weather data, the virtual reality terminal also outputs a real weather condition through various types of sensing devices. For example, if the weather data includes rainfall and the rainfall reaches 50 mm, indicating that the current weather condition is heavy rain, then the virtual reality terminal can output the rain sound corresponding to the rainfall of 50 mm through the audio device, so that the user is present. The weather conditions of heavy rain are felt. The above steps can make the user feel the real environment of the outside world more intuitively.

It should be noted that the function implementation of the memory, the 3D display, the processor, the transceiver, and the user input device may also refer to the method described in the first aspect, and details are not described herein.

In a third aspect, an embodiment of the present invention provides a terminal, including a functional unit for performing the method of the foregoing first aspect, where the terminal includes:

An acquiring unit, configured to acquire external environment data from a real scene, where the external environment data includes at least one of geographic location data, time data, or weather data;

The obtaining unit is further configured to acquire a 3D image resource according to the external environment data;

a display unit, configured to display a virtual scene corresponding to the external environment data according to the 3D image resource.

In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium storing instructions that, when run on a computer, cause the computer to perform the foregoing first aspect and the first aspect Any of the ways to achieve this.

In a fifth aspect, an embodiment of the present invention provides a computer program product comprising instructions, which, when run on a computer, causes the computer to perform any one of the first aspect and each of the possible implementations of the first aspect.

In the embodiment of the present invention, the external environment data is obtained from the real scene, the 3D image resource is obtained according to the external environment data, and the virtual scene corresponding to the external environment data is displayed according to the 3D image resource. The above solution can prompt the user in the current geographic location, time, and weather in real time when the user is immersed in the virtual reality scene that is separated from the external environment.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the background art, the drawings to be used in the embodiments of the present invention will be described below.

1 is a schematic diagram of a HOME main interface according to an embodiment of the present invention;

2 is a schematic structural diagram of a communication system according to an embodiment of the present invention;

3 is a schematic diagram of a 3D image of a 3D image resource indication according to an embodiment of the present invention;

4 is a structural block diagram of an implementation manner of a virtual reality terminal according to an embodiment of the present invention;

FIG. 5 is a schematic flowchart diagram of a virtual reality display method according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of displaying a virtual scene corresponding to external environment data on a HOME main interface according to an embodiment of the present invention;

FIG. 7 is a schematic flowchart diagram of another virtual reality display method according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a virtual screen and a current page corresponding to the external environment data displayed by a split screen according to an embodiment of the present invention; FIG.

FIG. 9 is a schematic diagram of a virtual display corresponding to the external environment data on the current page according to an embodiment of the present invention. Schematic diagram of the scene;

10 is a schematic diagram of floating display of a current page while displaying a virtual scene corresponding to the external environment data according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of cooperative interaction of various components in a terminal described in the embodiment of FIG. 4 according to an embodiment of the present invention; FIG.

FIG. 12 is a functional block diagram of a terminal according to an embodiment of the present invention.

detailed description

The embodiments of the present invention are described below in conjunction with the accompanying drawings in the embodiments of the present invention.

First, the embodiment of the present invention provides a virtual reality display method, which can be applied to a virtual reality terminal, where the virtual reality terminal can include a mobile phone with a mobile terminal display, an integrated machine display, a VR experience environment, and a VR. Wearable devices, computers that are used in conjunction with PCs, etc.

In order to better understand the embodiment of the present invention, the HOME main interface related to the virtual reality display method of the embodiment of the present invention is first introduced.

The HOME main interface is a graphical user interface that users see when using a virtual reality terminal. In the virtual reality scene, the HOME main interface is displayed by three-dimensional technology, and the user can see the stereoscopic HOME main interface on the display device of the virtual reality terminal through the optical lens, and enjoy the immersive feeling.

Referring to FIG. 1, FIG. 1 is a schematic diagram of a HOME main interface according to an embodiment of the present invention. As shown in Figure 1, the icon or name of each application can be displayed on the HOME main interface, and the icon or name of each folder can also be displayed.

It can be understood that the HOME main interface is an interface for a user to enter a VR application in a virtual reality scenario.

Specifically, the user first sees the HOME main interface when starting to use the virtual reality terminal, and can click on the elements on the HOME main interface (icons or names of various applications, or icons or names of various folders) Enter the corresponding VR application experience. After the user exits a certain VR application, the screen that is seen through the virtual reality terminal is still the home interface of the HOME, and the user can select other applications to perform the experience through the HOME main interface. Here, the HOME main interface can be regarded as a desktop of a computer or a mobile phone. The difference is that the user can enter various common applications through the two-dimensional desktop of the computer or the mobile phone, and the main interface of the HOME displays the virtual reality scene. Three-dimensional stereoscopic screen, users can enter various VR applications through the HOME main interface.

The HOME main interface generally has the following two situations:

First, the HOME main interface is a fixed three-dimensional display scene.

For example, the HOME main interface may be a three-dimensional landscape, a character image, or the like. The HOME main interface that the user sees is fixed and will not change due to changes in the external environment. The HOME main interface here is similar to a normal mobile phone or computer desktop. The difference is that the HOME main interface that the user sees is three-dimensional, and the mobile phone or computer desktop that the user sees is two-dimensional.

The HOME main interface here is displayed in a fixed way, dull and lacking in fun, and can not provide users with more interactive information, such as changes in the real environment. For the user, the HOME main interface has almost no meaning.

Second, the HOME main interface is a mapping of real scenes. Specifically, the virtual three-dimensional scene is constructed based on the real scene by extracting features from objects in the real space.

For example, in a virtual scene, a specific object such as a wall, a table, or a sofa in a real scene is constructed, and objects in the real scene are mapped into the virtual scene to generate a HOME main interface. The HOME main interface here is equivalent to the mapping of the real scene, and the real scene is virtually displayed, which can truly reflect the real environment. Referring to FIG. 1 , FIG. 1 can be regarded as a user using a virtual reality terminal on a road. The virtual reality terminal extracts features such as roads and zebra crossings based on real scenes of the road, and maps them into virtual scenes, and generates The HOME main interface shown in Figure 1.

This home interface based on the real scene requires real-time feature extraction and virtual display of objects in the real space. However, when the user turns or walks, and the real environment in front changes rapidly, the virtual reality terminal is difficult to accurately extract the object features and perform virtual display in real time, and the display screen of the HOME main interface often has a certain hysteresis. For example, the space in front of the user has changed, but the virtual screen displayed on the main interface of HOME is still the picture before the change, which cannot be well integrated with the real environment, and lacks real-time and accuracy. In addition, the HOME main interface based on the real scene has a very high processing performance requirement for the virtual reality terminal, and the calculation amount is very large, and the generally configured virtual reality terminal cannot implement the HOME main interface.

Referring to FIG. 2, FIG. 2 is a schematic structural diagram of a communication system 200 according to an embodiment of the present invention. As shown, the communication system 200 can include a virtual reality terminal 210, a server 220.

The virtual reality terminal 210 is provided with a core processing module, and can be implemented as a mobile phone, an integrated machine head display, and a PC, VR experience environment, etc., which are used in conjunction with the mobile terminal display, and the example in FIG. 2 Two kinds of virtual reality terminals for mobile phones with integrated head-mounted display and mobile terminal display are listed.

The server 220 can store a large number of 3D image resources. The virtual reality terminal 210 and the server 220 communicate via a network.

The virtual reality terminal and server are further described below.

In the embodiment of the present invention, the virtual reality terminal is configured with a transceiver and a positioning module.

In the embodiment of the present invention, the virtual reality terminal can obtain the external environment data in the real scene in real time, and the external environment data can reflect the actual situation of the real scene. The external environment data herein may include geographic location data, time data, weather data, and the like that can characterize the external environment in the real scene.

The virtual reality terminal may acquire the geographic location data of the virtual reality terminal in real time by using the positioning module. The geographic location data may include longitude, latitude, location, country, province, city, and the like of the location where the virtual reality terminal is located.

The virtual reality terminal may also be configured with a Real-Time Clock (RTC), which can acquire accurate system time, and the system time may be Greenwich Mean Time (GMT), and the virtual reality terminal The system time acquired by the RTC can be converted to local time. For example, if the current virtual reality terminal is located in the East 8th district and the RTC acquires the system time as 2017/4/10, 08:57, then the virtual reality terminal converts the system time to the local time: 2017/4/ 10, 16:57. In some embodiments, the virtual reality terminal can also directly acquire local time through the transceiver.

The virtual reality terminal can also install a weather application and can acquire weather data in real time. The virtual reality terminal may acquire weather data in real time on the network through a weather application, and the weather data may include parameters indicating weather conditions such as air quality, temperature, relative humidity, precipitation, wind direction, and light intensity. In a specific implementation, the virtual reality end The weather data acquired by the terminal is not limited to the ones described above, and may also include more detailed information such as air pressure, cloud amount, cloud type, rainfall type, and the like. In an optional embodiment, the virtual reality terminal may further configure a sensing device such as a temperature sensor, a humidity sensor, a light sensor, or the like to acquire weather data such as temperature, relative humidity, and light intensity. In an alternative embodiment, the virtual reality terminal may also acquire weather data from the network, for example, real-time weather data may be acquired from the meteorological data center through a 3G module in the transceiver.

It can be understood that different weather data correspondingly indicate different weather conditions, and the weather conditions here include wind, frost, rain, snow, yin, clear, cloud, and the like. For example, if the wind direction in the weather data is 8 for the southeast wind, then the weather condition corresponding to the indication should be a strong wind. In the weather data, the 24-hour rainfall reaches 20 mm, and the weather conditions indicated are moderate rain. The 24-hour rainfall reaches 50 mm or more, and the weather conditions indicated are rainstorms.

In the embodiment of the present invention, the virtual reality terminal may acquire a 3D image resource from a local database or a server according to the obtained external environment parameter, which is described in detail below.

When acquiring a 3D image resource from a local database, the local database is stored in a memory of the virtual reality terminal. The virtual reality terminal may directly acquire the 3D image resource from the local database through an internal processor.

When acquiring the 3D image resource from the server, the server may be a remote server, and the virtual reality terminal may acquire the 3D image resource from the remote server through a transceiver.

In the embodiment of the present invention, the virtual reality terminal may acquire a 3D image resource of the landmark corresponding to the geographical location data from a local database or a server according to the geographic location data. A landmark here refers to a building or a natural object having a unique geographical feature at a geographical location indicated by the geographic location data. For example, the building may include the Great Wall of Beijing, Tiananmen Square, the Forbidden City, the Temple of Heaven, the Oriental Pearl TV Tower of Shanghai, the Jinmao Tower, etc., and the natural objects may include Mount Everest, Hulunbuir Prairie, Wudang Mountain, and the like. The user can directly know where he is by the 3D image resource of the landmark. It can be understood that a large number of landmark 3D image resources are stored in the local database or the server, and the mapping relationship between the 3D image resources of the plurality of landmarks and the geographic location data is reflected, and the geographic location data corresponds to the 3D image resources of the landmarks. .

In a specific implementation, when the virtual reality terminal acquires the corresponding 3D image resource of the landmark according to the geographic location, the virtual land terminal has the following two landmark acquisition strategies:

The first is to get the strategy from the nearest landmark. Specifically, the virtual reality terminal acquires, from the local database or the server, a 3D image resource corresponding to the landmark closest to the geographic location indicated by the geographic location data according to the geographic location data. For example, the distance between the geographic location and each landmark may be calculated according to the latitude and longitude of the geographic location, and the 3D image resource corresponding to the landmark closest to the geographical location may be obtained from a local database or a server.

When acquiring the 3D image resource from the server, the server parses the specific geographic location represented by the geographic location data according to the received geographic location data sent by the virtual reality terminal, and searches for the distance in the stored 3D image resource. The 3D image resource of the geographically nearest landmark is sent to the virtual reality terminal.

For example, if the user uses the virtual reality terminal in Beijing, the geographic location data obtained by the virtual reality terminal indicates that the actual geographical location of the user is surrounded by the Forbidden City and the Temple of Heaven, but the distance between the user and the Forbidden City and the Temple of Heaven. The distance between the virtual reality terminals is obtained from the server according to the acquired geographical location data, which is a 3D image resource of the Temple of Heaven.

Second, the hottest landmarks get the strategy. Specifically, the virtual reality terminal acquires a 3D image resource corresponding to the hottest landmark corresponding to the geographical location data from the local database or the server according to the geographic location data. For example, the heat index can be used to measure the heat level of each landmark. The heat index can be related to the number of times people search for various landmarks. The more times a landmark is searched, the higher the heat index. The heat index can also be related to the real-time human flow of each landmark. The more real-time human traffic of a landmark, the higher the heat index. The heat index here may be obtained from the network data periodically and updated in real time, or may be preset.

When the server obtains the 3D image resource corresponding to the hottest landmark corresponding to the geographical location data, the server parses the specific geographic location represented by the geographical location data according to the received geographical location data of the virtual reality terminal. And searching for the 3D image resource of the landmark with the highest heat within the geographical distance distance threshold in the stored 3D image resource. The distance threshold here can be set in advance.

For example, assuming that the user uses the virtual reality terminal in Beijing, the geographic location data obtained by the virtual reality terminal indicates that the actual geographic location distance of the user is within the threshold of the Forbidden City and the Temple of Heaven, although the distance ratio between the user and the Forbidden City is The distance between the Temple of Heaven is long, but the heat index obtained by the server indicates that the real-time heat of the Forbidden City is higher. Then, the virtual reality terminal obtains the 3D image resource of the Forbidden City from the server according to the acquired geographical location data.

In some optional embodiments, the virtual reality terminal may further acquire a 3D image resource of a geographical environment at a geographic location indicated by the geographic location data from a local database or a server according to geographic location data. The 3D image resource acquired by the virtual reality terminal directly reflects the actual geographical environment at the location where the virtual reality terminal is located. It can be understood that a large amount of geographical location data and a 3D image resource of a geographical environment at a geographical location indicated by the geographical location data are stored in a local database or a server, and the geographical location data and the geographical location indicated by the geographical location data The 3D image resources of the geographical environment at the location correspond.

For example, the virtual reality terminal is located in an office building and is obtained as an actual 3D image resource of the office building. The virtual reality terminal acquires the 3D image resource of the train on the speeding train. The virtual reality terminal acquires the 3D image resource of the grassland on the open grassland. It should be noted that, in a specific implementation, the 3D image indicated by the 3D image resource may be colored, which enables the user to more intuitively perceive the current geographic location.

When the 3D image resource of the geographical environment at the geographic location indicated by the geographic location data is obtained from the server, the server parses the specific geographic location represented by the geographic location data according to the received geographical location data of the virtual reality terminal. And searching for the 3D image resource of the geographical environment corresponding to the geographical location in the stored 3D image resource. Here, the user can intuitively know the actual location of the 3D image resource of the geographical environment at the geographic location indicated by the geographic location data acquired by the virtual reality terminal.

In the embodiment of the present invention, the virtual reality terminal may also be based on time data from a local database or a server. Obtaining a 3D image resource of the outdoor light corresponding to the time indicated by the time data. The angles, hue, and intensity of the outdoor light corresponding to different time periods in a day are different, and the outdoor light can prompt the user to be in the current time period. For example, in the morning, the angle between the sun and the ground plane rises from 15 degrees to 60 degrees, and the angle of illumination of the light gradually changes. The outdoor light in the morning is soft and warm. At noon, the sun shines almost vertically, and the outdoor light is glaring and bright. In the evening, the outdoor light is mild and cool. In the specific implementation, each time period of the day has a corresponding outdoor light, and the angle of the outdoor light, the color tone or other elements can be changed, so that the user can intuitively perceive the approximate time period.

It can be understood that each time period in a day can be enumerated one by one, and a 3D image resource of outdoor light corresponding to the time period corresponding to different time segments can be stored in the local database or the server.

When the 3D image resource of the outdoor light corresponding to the time indicated by the time data is acquired from the server, the server parses the specific time represented by the time data according to the time data sent by the received virtual reality terminal, and stores the A 3D image resource corresponding to the time is searched for in the 3D image resource to be sent to the virtual reality terminal.

Referring to FIG. 3, the left side of FIG. 3 shows a schematic diagram of a 3D image of a 3D image resource corresponding to a possible morning sunrise, and the right drawing shows a possible noon corresponding 3D. The scene diagram of the 3D image indicated by the image resource, as shown in the figure, the angle and intensity of the light are different in different time periods, and the user can be prompted to approximate the time period through the 3D image. It should be noted that, in a specific implementation, the 3D image indicated by the 3D image resource may be colored, which enables the user to more intuitively feel the current time.

In some optional embodiments, the virtual reality terminal may further acquire a 3D image resource containing more rich information from a local database or a server according to the time data. For example, a 3D image resource of the sun, the moon, the location of the star, and the motion trajectory corresponding to the time indicated by the time data may be acquired. Here, the position of the sun, the moon, and the stars and the motion trajectory are all regularly ruled. The local database or server can be calculated according to the physical theorem, and pre-store the position, and the trajectory of the sun, moon, and stars corresponding to different time periods. 3D image resources.

In the embodiment of the present invention, the virtual reality terminal may further acquire a 3D image resource corresponding to the weather condition indicated by the weather data from a local database or a server according to weather data.

For example, the real-time weather data obtained by the virtual reality terminal at 09:00 on April 11, 2017 is as follows: air quality 35, temperature 26 degrees Celsius, relative humidity 91%, 24-hour precipitation is 0 mm, wind wind direction is southeast wind Level 8. The weather conditions indicated by the real-time weather data are cloudy. The 3D image resource acquired by the virtual reality terminal according to the weather data can intuitively make the user feel that the real-time weather condition is cloudy.

It can be understood that 3D image resources corresponding to different weather conditions are stored in the local database or the server. Specifically, the 3D image resource may represent different weather conditions in various forms, depending on the fineness of the 3D image resource stored in the local database or the server. For example, at different temperatures, the user is prompted by the different dressing states of the characters in the 3D image. When it rains, the user is prompted for different rainfall levels by the difference in rainfall in the 3D image. When there is wind, the wind direction can be prompted by the bending direction and bending degree of the flowers and trees in the 3D image. It should be noted that the foregoing examples are merely exemplary. In a specific implementation, the 3D image resource may also represent a corresponding weather condition through other richer forms. In a specific implementation, the 3D image indicated by the 3D image resource may be colored, which enables the user to more intuitively feel the real-time weather condition of the external environment.

When the virtual reality terminal acquires the 3D image resource from the server, the server parses the specific weather condition indicated by the time data according to the received weather data sent by the virtual reality terminal, and stores the 3D image resource. Searching for a 3D image resource corresponding to the weather condition to be sent to the virtual reality terminal.

In a specific implementation, the virtual reality terminal may acquire the 3D image resource of the landmark corresponding to the geographical location data or the geographical environment of the geographical location indicated by the geographical location data by using the geographic location data in the local database or the server respectively. a 3D image resource, the 3D image resource of the outdoor light corresponding to the time indicated by the time data is obtained by using the time data, and the 3D image resource corresponding to the weather condition indicated by the weather data is acquired by the weather data, and the virtual reality terminal may simultaneously Corresponding 3D image resources are acquired according to any two or all of the geographic location data, the time data, and the weather data. For example, the virtual reality terminal may simultaneously acquire, through the geographic location data and the time data, a 3D image resource that simultaneously indicates a landmark corresponding to the geographic location data and an outdoor light corresponding to the time indicated by the time data. It can be understood that a richer 3D image resource can be stored in the local database or the server, for example, the geographic location data, the time data, and the outdoor location corresponding to the time indicated by the geographic data and the time indicated by the time data are simultaneously stored. 3D image resources for light.

It can be understood that the 3D image resource of the landmark corresponding to the geographical location data described above, the 3D image resource of the geographical environment at the geographical location indicated by the geographic location data, and the outdoor light corresponding to the time indicated by the time data The 3D image resource and the 3D image resource corresponding to the weather condition indicated by the weather data may be stored in different servers or may be stored in the same server at the same time. The present application does not impose any limitation.

An implementation manner of the virtual reality terminal according to the embodiment of the present invention is described below.

FIG. 4 is a structural block diagram of an implementation manner of a virtual reality terminal 100 according to an embodiment of the present invention. As shown in FIG. 4, the virtual reality terminal 100 may include a baseband chip 110, a memory 115 (one or more computer readable storage media), a transceiver 116, a peripheral system 117, and a positioning module 122. These components can communicate over one or more communication buses 114.

The baseband chip 110 can be integrated to include one or more processors 111, a clock module 112, and a power management module 113. The clock module 112 integrated in the baseband chip 110 is primarily used to generate the clocks required for data transfer and timing control for the processor 111. In the embodiment of the present invention, the clock module may be an RTC, and the system time can be acquired. The power management module 113 integrated in the baseband chip 110 is primarily used to provide a stable, high accuracy voltage to the processor 111, the transceiver 116, and the peripheral system 117. In the embodiment of the present invention, the processor 111 includes a graphics processing unit (GPU). The GPU is mainly used for three-dimensional image and special effect processing, and is a core processor dedicated to image data. In some embodiments, the GPU may generate a virtual reality scene corresponding to the external environment data according to the acquired 3D image resource by using a computer 3D graphics processing technology. For example, using particle systems to simulate wind, snow, rain, yin and sunny weather conditions, based on particle systems and using texture mapping dynamic algorithms to achieve 3D frost effect, using volume cloud algorithm to generate sunny, cloudy and rainy 3D weather effects, etc. A virtual reality scene corresponding to the weather data is available. For another example, the outdoor light can be simulated by a preset algorithm to obtain a virtual reality scene corresponding to the time data.

The peripheral system 117 is mainly used to implement the interaction function between the terminal 100 and the user/external environment, and mainly includes the input and output devices of the terminal 100. In a specific implementation, the peripheral system 117 may include: a 3D display controller 118, a camera controller 119, an audio controller 120, and a sensor management module 121. Wherein, each controller can correspond to each Peripherals such as 3D display 123, camera 124, audio circuitry 125, and sensor 126 are coupled. In some embodiments, camera 124 can be a 3D camera.

The sensor 126 may include an accelerometer, a gyroscope, a geomagnetic sensor, a distance sensor, a gesture sensor, and the like. The acceleration sensor knows the state of the terminal by measuring the acceleration of the terminal. The gyro sensor can accurately measure the orientation of the terminal. The geomagnetic sensor and the geomagnetic sensor measure the physical parameters such as current, position and direction by sensing the magnetic field strength. The distance sensor can measure the distance of the object from the terminal. The distance sensor can recognize the user's operating gesture. In alternative embodiments, the sensor may also include more sensors, such as an eye tracking sensor, an infrared sensor, a displacement sensor, a fingerprint sensor, a gravity sensor, a light sensor, a heart rate sensor, and the like.

The 3D display 123 is capable of receiving a three-dimensional image output by the GPU and displaying it. In the embodiment of the present invention, the user can see the three-dimensional image from the 3D display 123 through the optical lens, and intuitively feel the three-dimensional effect. In a specific implementation, the 3D display 123 can display a virtual reality scene corresponding to the external environment, and the user can view the 3D virtual reality scene from the 3D display 123 through the optical lens.

In an alternative embodiment, the 3D display 123 can also be a touch display.

In an embodiment of the invention, the peripheral device can also function as a user input device. For example, when the 3D display 123 is a touch display screen, the 3D display 123 can receive the user's touch screen input, the camera 114 can receive the user's blink input, the audio circuit 125 can receive the user's voice input, and the gesture sensor can receive the user's hand-in input. Wait.

It should be noted that the peripheral system 117 may also include other I/O peripherals.

The transceiver 116 is configured to receive and transmit wireless signals and can be used to communicate with an external network to obtain related data or resources. The transceiver 116 can include a Wireless Wide Area Network (WWAN) communication module and a Wireless Local Area Networks (WLAN) communication module. The WWAN communication module can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), and code division. Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like. In a specific implementation, the WWAN communication module may be any one of a 3G module, a 4G module, or a 5G module. The WLAN communication module may include a Bluetooth module, a WIreless-Fidelity (WIFI) module, a Near Field Communication (NFC) module, and the like.

In the embodiment of the present invention, the transceiver 116 is configured to acquire at least one of time data or weather data of the virtual reality terminal in real time. The transceiver 116 can also be configured to acquire a 3D image resource corresponding to external environment data from a server. For example, acquiring a 3D image resource of a landmark corresponding to the geographic location data or acquiring a 3D image resource of a geographical environment at a geographical location indicated by the geographic location data according to the geographic location data, and acquiring the time data indication according to the time data. The 3D image resource of the outdoor light corresponding to the time acquires the 3D image resource corresponding to the weather condition indicated by the weather data according to the weather data.

The positioning module 122 can acquire the current geographic location of the virtual reality terminal by using a satellite navigation and positioning system. The positioning module may include a GPS module, a GLONASS module, a BDS module, and a Galileo positioning system module. In a specific implementation, the positioning module 122 can directly acquire the geographic location of the terminal 100 through the satellite positioning system. It should be understood that the positioning result of the positioning module 122 is high precision and reliable.

The memory 115 is coupled to the processor 111 for storing various software programs and/or sets of instructions. In particular implementations, memory 115 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state storage devices. The memory 115 can store an operating system (hereinafter referred to as a system) such as an embedded operating system such as ANDROID, IOS, WINDOWS, or LINUX. The memory 115 can also store a network communication program that can be used to communicate with one or more additional devices, one or more terminal devices, one or more network devices. The memory 115 can also store a user interface program, which can realistically display the content of the application through a graphical operation interface, and receive user control operations on the application through input controls such as menus, dialog boxes, and keys. .

In the embodiment of the present invention, the memory 115 is configured to store a local database, where the local database includes various types of 3D image resources. The processor is specifically configured to acquire various types of 3D image resources from the memory.

The memory 115 can also store one or more applications. As shown in FIG. 4, these applications may include: a weather application (such as ink weather), a social application (such as Facebook), an image management application (such as an album), a map application (such as Google Maps), a browser. (eg Safari, Google Chrome) and more. In some embodiments, the terminal 100 may acquire real-time weather data from a server corresponding to the weather application through a weather application.

It should be understood that the terminal 100 is only an example provided by an embodiment of the present invention, and that the terminal 100 may have more or less components than the illustrated components, may combine two or more components, or may have components. Different configurations are implemented.

When the user uses the virtual reality device, he is completely immersed in the virtual reality scene that is separated from the external environment, and has little perception of the real external environment. In order to prompt the user to the real environment, the embodiment of the present invention provides a virtual reality display method, which can obtain external environment data from a real scene and display a corresponding virtual scene according to the external environment data.

The main principles of the embodiment of the present invention include: acquiring external environment data by using a virtual reality terminal, and acquiring corresponding 3D image resources from the server according to the external environment data, and displaying corresponding to the external environment data according to the 3D image resource. Virtual scene. The virtual scene here is a virtual representation of the real scene.

The virtual reality display method provided by the embodiment of the present invention is described in detail below with reference to the accompanying drawings.

FIG. 5 is a schematic flowchart diagram of a virtual reality display method according to an embodiment of the present invention. In the embodiment of FIG. 5, the virtual reality terminal is capable of acquiring external environment data from a real environment, and can acquire 3D image resources from a local database or a server according to the external environment data, according to the 3D image in the HOME main interface. The resource displays a virtual scene corresponding to the external environment data. The method embodiment shown in FIG. 5 is an example in which the virtual reality terminal acquires a 3D image resource from a server, and the following description is expanded:

S101. Acquire external environment data from a real scene, where the external environment data includes at least one of geographic location data, time data, and weather data.

Specifically, referring to the foregoing, the virtual reality terminal can obtain time data through a transceiver or an RTC, obtain weather data through a transceiver or various types of sensors, and obtain geographic location data through the positioning module.

In the embodiment of the present invention, it is not limited to the geographical location data, the time data, and the weather data mentioned above, and the external environment data may further include more abundant data, such as external human traffic data, traffic data, noise data, and the like. The above external environment data can be obtained through the transceiver.

S102. Send a request for acquiring a 3D image resource corresponding to the external environment data to a server.

S103. The server sends the 3D image resource corresponding to the external environment data to the virtual reality terminal.

Referring to the foregoing, the virtual reality terminal may acquire corresponding 3D image resources from the server according to the acquired external environment data.

Specifically, the virtual reality terminal may acquire the 3D image resource of the landmark corresponding to the geographic location data by using the server according to the geographic location data, and obtain the geographic location indicated by the geographic location data by using the server according to the geographic location data. The 3D image resource of the geographical environment may be obtained by the server according to the time data, and the 3D image resource of the outdoor light corresponding to the time indicated by the time data may be acquired by the server, and the weather condition indicated by the weather data may be acquired according to the weather data. 3D image resources.

It can be understood that the external environment data and the corresponding 3D image resource can be stored in the server, and when the virtual reality terminal requests to acquire the 3D image resource, the corresponding 3D image resource is sent to the virtual reality terminal.

S104. Display a virtual scene corresponding to the external environment data on the HOME main interface according to the 3D image resource.

Specifically, the virtual scene is displayed according to the 3D image resource, where the virtual scene is a 3D virtual representation of the external environment in the real scene. In the embodiment of the present invention, the virtual scene is equivalent to displaying the geographic location, time, and weather of the external environment according to the acquired 3D image resource. The user can intuitively feel the real situation of the external environment through the virtual scene.

In the embodiment of the present invention, the virtual reality terminal may display the virtual reality scene corresponding to the external environment data according to the acquired 3D image resource by using a computer 3D graphics processing technology. For example, using particle systems to simulate wind, snow, rain, yin and sunny weather conditions, based on particle systems and using texture mapping dynamic algorithms to achieve 3D frost effect, using volume cloud algorithm to generate sunny, cloudy and rainy 3D weather effects, etc. A virtual reality scene corresponding to the weather data can be obtained and displayed. For another example, the outdoor light can be simulated by a preset algorithm, and a virtual reality scene corresponding to the time data is obtained and displayed.

In the embodiment of the present invention, the 3D image resource may include a landmark corresponding to the geographic location data or a 3D image resource of the geographical environment at the geographic location indicated by the geographic location data, and a 3D of outdoor light corresponding to the time indicated by the time data. Any one or more of the 3D image resources corresponding to the weather conditions indicated by the image resource and the weather data. When the virtual scene corresponding to the external environment is displayed according to the 3D image resource, any one of the virtual scene corresponding to the geographical location data, the virtual scene corresponding to the time data, and the virtual scene corresponding to the weather data may be separately calculated or The plurality of virtual scenes are superimposed and displayed, and the virtual scene corresponding to the external environment is presented. In an optional embodiment, the 3D image resource of the geographical environment and the 3D image resource of the outdoor light corresponding to the time indicated by the time data may be simultaneously determined according to the landmark corresponding to the geographical location data or the geographical location indicated by the geographical location data, The 3D image resource corresponding to the weather condition indicated by the weather data is calculated and processed to obtain a fused virtual scene and displayed.

In the embodiment of FIG. 5, the virtual reality terminal displays the virtual scene corresponding to the external environment data on the HOME main interface according to the 3D image resource. Referring to the foregoing, the HOME main interface is a graphical user interface that a user sees when using a virtual reality terminal.

Referring to FIG. 6, FIG. 6 is a schematic diagram of a possible virtual scene corresponding to external environment data displayed on the HOME main interface according to an embodiment of the present invention. As shown in the figure, assume the current geographic location data table obtained by the virtual reality terminal. Ming's current location is near the Great Wall, so users can intuitively view the virtual scene displayed in the HOME main interface, and understand that the current geographical location is near the Great Wall of Beijing.

It should be noted that, in a specific implementation, the virtual scene displayed by the HOME main interface may be colored, and the real situation of the external environment may be better represented.

The first type, the virtual reality terminal detects that the current page is the HOME main interface, and displays the virtual scene corresponding to the external environment data on the HOME main interface.

For example, when the user starts to use the virtual reality terminal, the HOME main interface is first entered, and the HOME main interface displays the virtual scene corresponding to the external environment data. When the user uses the virtual reality terminal, after exiting a VR application and returning to the HOME main interface, the HOME main interface displays the virtual scene corresponding to the external environment data.

Specifically, when the user uses the virtual reality terminal, the current page is the page that the user currently sees, and may be any page, for example, may be a game page, a movie page, or the like. Upon receiving the user input, the virtual reality terminal jumps from the current page to the HOME main interface in response to the user input, and displays the virtual scene corresponding to the external environment data on the HOME main interface.

Here, it can be judged that the weather data in the external environment data fluctuates greatly by the following means. In some embodiments, the virtual reality terminal may determine that the weather in the outside world fluctuates greatly when receiving the weather warning message. In some embodiments, the virtual reality terminal may periodically acquire weather data, and compare the acquired weather data with the last acquired weather data. If the difference between the parameters in the weather data exceeds a preset range, It can be determined that the outside weather has a large fluctuation. For example, when a user uses a virtual reality terminal to watch a movie, when the movie is started, the 24-hour precipitation in the weather data is 0 mm, and after one hour of watching the movie, the 24-hour precipitation in the weather data is 50 mm, at which time the weather can be determined. The data fluctuated greatly and the weather conditions were abrupt.

Here, in some embodiments, the virtual reality terminal may periodically acquire geographic location data, and compare the acquired geographic location data with the last acquired geographic location data, if the geographic location data indicates the virtual The distance between the front and rear geographical locations of the real terminal exceeds the preset range, and the number of geographical locations in the external environmental data can be determined. According to the occurrence of large fluctuations. For example, the user uses a virtual reality terminal to watch a movie on a train. After one hour of watching the movie, the geographic location data indicates that the user has moved from one city to another, and it can be concluded that the geographic location data fluctuates greatly.

Specifically, in order to prevent the user from being immersed in the virtual reality scene for a long time when using the virtual reality terminal, and having no perception of the real environment, the preset duration may be set, for example, one hour, two hours, etc., and the virtual reality terminal is preset every time. The duration jumps from the current page to the HOME main interface, and displays the virtual scene corresponding to the external environment data on the HOME main interface.

In still other optional embodiments, the virtual terminal may further receive a user input for jumping back to the current page, and jumping to the user in response to the user input for jumping back to the current page The current page. The user input here can be preset, and can include various input forms as described above. In a specific implementation, the virtual reality terminal may further determine, according to the time when the user maintains the specified action, whether the user inputs the user input for jumping back to the current page, for example, when the user raises the left hand and holds for 3 seconds. The virtual reality terminal may determine that the user inputs the user input for jumping back to the current page, and may jump back to the current page from the HOME main interface.

It can be understood that the virtual reality terminal can also display the virtual scene corresponding to the external environment data on the HOME main interface in other preset situations.

In a specific implementation, when the virtual reality terminal is a mobile phone, an integrated machine head display, a VR experience environment, and the like, and the device has a core processing module and a 3D display module, the virtual reality terminal may perform the foregoing. The step of displaying the virtual scene corresponding to the external environment data on the HOME main interface in step S104. When the virtual reality terminal is a device that only has a core processing module and does not have a 3D display module, for example, when a computer that is used in conjunction with a PC terminal is required, the above step S104 needs to be used by the virtual reality terminal. A device with a 3D display module is executed, such as a PC terminal.

In the embodiment shown in FIG. 5, by displaying the virtual scene on the HOME main interface, the user can intuitively feel the real situation of the external environment while seeing the HOME main interface, and make up for the user to completely immerse in the virtual reality. The drawbacks of the scene that are completely unperceived to the external environment. Further, the manner of displaying the virtual scene on the HOME main interface is not large, and is easy to implement, and increases the interest of the HOME main interface, and provides more effective information to the user.

Referring to FIG. 7, FIG. 7 is a schematic flowchart diagram of another virtual reality display method according to an embodiment of the present invention. The main difference between the embodiment of FIG. 7 and the embodiment of FIG. 5 is that, in the embodiment of FIG. 7 , the virtual reality terminal displays the virtual scene corresponding to the external environment data according to the 3D image resource, and is not displayed on the HOME main interface, but It is displayed on the current page. The embodiment of FIG. 7 is more suitable for a scenario in which the user is prompted to use the virtual reality terminal to prompt the user of the real environment. The following expands the description:

S201. Acquire external environment data from a real scene, where the external environment data includes: geographic location data, time At least one of data and weather data.

S202. Send a request for acquiring a 3D image resource corresponding to the external environment data to a server.

S203. The server sends the 3D image resource corresponding to the external environment data to the virtual reality terminal.

It is to be understood that the implementation of the steps S201-S203 can be referred to the specific description of the steps S101-S103 in the embodiment of FIG. 5, and details are not described herein.

S204: Display a virtual scene corresponding to the external environment data and a current page according to the 3D image resource, or display a virtual scene corresponding to the external environment data on the current page according to the 3D image resource.

Specifically, when the user uses the virtual reality terminal, the current page is the page that the user currently sees, and may be any page, for example, may be a game page, a movie page, or the like.

In the embodiment of FIG. 7 , the virtual reality terminal may be triggered to display the virtual scene and the current page corresponding to the external environment data according to the 3D image resource split screen, or according to the 3D image resource on the current page. The virtual scene corresponding to the external environment data is displayed on the floating:

First, the virtual reality terminal receives a user input for understanding an external environment, and in response to the user input, displays a virtual scene and a current page corresponding to the external environment data, or displays a floating page on the current page. The virtual environment corresponding to the external environment data.

In the second embodiment, when the external environment data fluctuates greatly, the virtual reality terminal displays the virtual scene corresponding to the external environment data and the current page, or displays the virtual scene corresponding to the external environment data on the current page. .

The third type, the virtual reality terminal displays the virtual scene corresponding to the external environment data and the current page in a split screen, or displays the virtual scene corresponding to the external environment data on the current page.

It is to be understood that the above three triggering manners may be referred to the related description in the method embodiment of FIG. 5, and details are not described herein.

The following describes in detail how the virtual reality terminal displays the virtual scene and the current page corresponding to the external environment data according to the 3D image resource.

In a specific implementation, the virtual reality terminal displays a virtual scene corresponding to the external environment in a first area of the 3D display, and displays the current page in a second area in the 3D display. The first area and the second area do not overlap, and the specific positions and shapes of the first area and the second area are not limited. For example, the virtual reality terminal may display the current page in a left area of the 3D display, and display the virtual scene in a right area, or may display the current page in an upper area of the 3D display, in the lower area. The virtual scene is displayed.

Referring to FIG. 8, FIG. 8 is a schematic diagram of a virtual screen and a current page corresponding to the external environment data displayed by a split screen according to an embodiment of the present invention. For example, the user is viewing the landscape picture using the virtual reality terminal, that is, the current page is a landscape picture. The geographic location data obtained by the virtual reality terminal indicates that the current geographic location is near the Great Wall, and the reduced current page is displayed in the right region, and the virtual environment corresponding to the external environment data, such as the image of the Great Wall, is displayed in the left region.

The virtual reality terminal, in detail, according to the 3D image resource, how to display the virtual scene corresponding to the external environment data on the current page.

In a specific implementation, the virtual reality terminal displays the current page in a 3D display, and is in the current page. The virtual scene is displayed in a floating manner on the surface. In the floating display, the display shape and specific position of the virtual scene are not limited.

Referring to FIG. 9, FIG. 9 is a schematic diagram of a virtual scene corresponding to the external environment data floating on the current page according to an embodiment of the present invention. For example, the user is viewing the landscape picture using the virtual reality terminal, that is, the current page is a landscape picture. The geographic location data obtained by the virtual reality terminal indicates that the current geographic location is near the Great Wall. As shown in FIG. 9 , the virtual reality terminal displays a virtual scene corresponding to the external environment data on the current page.

In an optional embodiment, the virtual reality terminal may further display the current page while displaying the virtual scene corresponding to the external environment data. Referring to FIG. 10, FIG. 10 is a schematic diagram of a floating display of the current page while displaying a virtual scene corresponding to the external environment data according to an embodiment of the present invention. For example, the user is viewing the landscape picture using the virtual reality terminal, that is, the current page is a landscape picture. The geographic location data obtained by the virtual reality terminal indicates that the current geographic location is near the Great Wall. As shown in FIG. 10, the virtual reality terminal floats and displays the current page on a virtual scene corresponding to an external environment.

In the embodiment of the present invention, when the virtual reality terminal is a mobile phone, an integrated machine head display, a VR experience environment, and the like, which are equipped with a core processing module and a 3D display module, the virtual reality terminal is a virtual reality terminal. The step of displaying the virtual scene corresponding to the external environment data and the current page in the above-mentioned step S204, or the step of floatingly displaying the virtual scene corresponding to the external environment data on the current page.

When the virtual reality terminal is a device that only has a core processing module and does not have a 3D display module, for example, when a computer that is used in conjunction with a PC terminal is required, the above step S204 needs to be used by the virtual reality terminal. A device with a 3D display module is executed, such as a PC terminal.

In the embodiment of FIG. 7 , the current page and the virtual scene are displayed by a split screen, or the virtual scene is suspended and displayed on the current page, which does not affect the user using the virtual reality terminal, and may also prompt the user to externally The real situation of the environment makes up for the drawbacks that the user is completely immersed in the virtual reality scene and completely unaware of the external environment.

In the embodiment of FIG. 5 and FIG. 7 , the virtual reality terminal displays the virtual scene corresponding to the external environment according to the 3D image resource, and visually prompts the user about the real situation of the external environment, so that the user can intuitively feel External environment, including geographic location, weather, time, etc.

In the embodiment of the present invention, the virtual reality terminal mainly visually prompts the user of the real situation of the external environment.

In an alternative embodiment, the virtual reality terminal may also prompt the user to the real situation of the external environment through a sense of hearing, touch, etc., to give the user a more realistic and intuitive experience. The details will be described below.

Specifically, when the external environment data includes weather data, the virtual reality terminal further outputs a real weather condition through various types of sensing devices. For example, if the weather data includes rainfall and the 24-hour rainfall reaches 50 mm, indicating that the current weather conditions are heavy rain, then the virtual reality terminal can output sound and sound corresponding to a 24-hour rainfall of 50 mm through the audio device. The user is immersive in the weather conditions of heavy rain. For another example, the weather data includes a wind direction, and if the wind direction is a southeast wind level 2, the virtual reality device can simulate the southeast wind level 2 through the wind wind direction simulation device, and can also simulate the wind sound corresponding to the southeast wind level 2 through the audio device simulation. , so that the user truly feels the wind direction.

The cooperation relationship between the components in the virtual reality terminal 100 in the embodiment of the present invention is described in detail with reference to FIG. 11 in conjunction with the virtual reality terminal 100 shown in FIG. It should be noted that the method embodiment shown in FIG. 11 is in the virtual state. The real terminal obtains the weather data and the time data through the transceiver, acquires the geographical location data through the positioning module, and obtains the application scenario of the 3D image resource from the server for description.

1. The processor 111 receives the event drive.

The event drivers here can be the following two:

The first type detects user input. In the embodiment of the present invention, the event drive (user input) may be received by the peripheral device, and the peripheral device transmits the received event drive (user input) to the processor 111. For example, the event driver may be a touch screen input of the user received by the 3D display 123, may be a blink input of the user received by the camera 114, may be a voice input of the user received by the audio circuit 125, or may be a gesture sensor receiving The user's hand-in input to the user.

Second, the preset duration is reached. In the embodiment of the present invention, the preset duration is calculated by the clock module 112, and the clock module 112 sends an event drive to the processor 111 every time the interval is preset.

2. The processor 111 can notify the transceiver 116 to acquire time data and weather data, and notify the positioning module 122 to acquire geographic location data.

3. The transceiver 116 acquires time data and weather data, and the positioning module 122 acquires geographic location data.

The transceiver 116 sends the acquired time data and weather data to the processor 111, and the geographical location data obtained by the positioning module 122 is sent to the processor 111.

5. The processor 111 notifies the transceiver 116 to acquire a 3D image resource corresponding to the external environment data from the server.

6. The transceiver 116 acquires a 3D image resource corresponding to the external environment data from a server.

Specifically, the transceiver 116 may acquire, from a server that stores the 3D image resource of the outdoor light, a 3D image resource of the outdoor light corresponding to the time indicated by the time data, and obtain the same from a server that stores the 3D image resource corresponding to the weather condition. The 3D image resource corresponding to the weather condition indicated by the weather data, the 3D image resource of the geographical environment at the geographical location indicated by the geographical location data is obtained from the server storing the 3D image resource of the geographical environment, or the 3D image resource from the stored landmark Obtaining a 3D image resource of the landmark corresponding to the geographical location data in the server.

The transceiver 116 sends the acquired 3D image resource corresponding to the external environment data to the processor 111.

8. The processor 111 performs 3D processing on the 3D image resource.

Specifically, the GPU in the processor performs 3D processing on the 3D image resource.

9. The processor 111 transmits the 3D processed 3D image resource to the 3D display 114.

10. The 3D display 114 displays a virtual scene corresponding to the external environment data according to the 3D image resource.

Specifically, the 3D display displays the virtual scene corresponding to the external environment data and the current page according to the 3D image resource, or displays the virtual corresponding to the external environment data on the current page according to the 3D image resource. Scenes.

FIG. 12 is a functional block diagram of a virtual reality terminal 120 according to an embodiment of the present invention. The function block of the terminal may implement the solution of the present invention by hardware, software, or a combination of hardware and software. Those skilled in the art will appreciate that the functional blocks depicted in Figure 12 can be combined or separated into several sub-blocks to implement the inventive arrangements. Accordingly, the above description of the invention may support any possible combination or separation or further definition of the functional modules described below. The description is expanded below.

As shown in FIG. 12, the virtual reality terminal 120 may include an acquisition unit 121, a processing unit 122, and a display unit 123. among them:

The obtaining unit 121 is configured to acquire external environment data from a real scene, and the external environment data may include at least one of geographic location data, time data, or weather data.

In a specific implementation, the obtaining unit 121 may be a transceiver, configured to acquire at least one of time data or weather data. In a specific implementation, the transceiver may be a positioning module, configured to acquire geographic location data.

The obtaining unit 121 is further configured to acquire a 3D image resource from the server according to the external environment data.

The processing unit 122 is configured to instruct the display unit 123 to display the virtual scene corresponding to the external environment according to the 3D image resource. In a specific implementation, the processing unit may be the processor 111 in FIG. 4, including a graphics processor GPU.

The display unit 123 is configured to display a virtual scene corresponding to the external environment data. Specifically, the display unit may be a display screen, such as the 3D display 123 in FIG.

In the embodiment of the present invention, the acquiring unit is configured to acquire a 3D image resource of a landmark corresponding to the geographical location data according to the geographic location data, and acquire a geographical environment at a geographical location indicated by the geographic location data according to the geographic location data. The 3D image resource obtains the 3D image resource of the outdoor light corresponding to the time indicated by the time data according to the time data, and acquires the 3D image resource corresponding to the weather condition indicated by the weather data according to the weather data.

In the embodiment of the present invention, the display unit is specifically configured to display a virtual scene corresponding to the external environment data according to the 3D image resource in the HOME main interface.

In some embodiments, the display unit may be further configured to display, according to the 3D image resource, a virtual scene and a current page corresponding to the external environment data, or to pause on the current page according to the 3D image resource. Displaying a virtual scene corresponding to the external environment data.

In an alternative embodiment, the terminal 120 may further include a receiving unit 124 for receiving user input for understanding an external environment. Further, the display unit is specifically configured to: in response to the user input received by the receiving unit for understanding an external environment, displaying the external image according to the 3D image resource acquired by the second acquiring unit in the HOME main interface The virtual scene corresponding to the environment data, or the virtual scene corresponding to the external environment data and the current page are displayed on the screen, or the virtual scene corresponding to the external environment data is floatingly displayed on the current page. In a specific implementation, the receiving unit 124 may be the user input device involved in the embodiment of FIG. 4.

For a specific implementation manner of the functional blocks included in the virtual reality terminal 120 of FIG. 12, reference may be made to the foregoing embodiments, and details are not described herein.

An embodiment of the method of the present invention is configured to obtain external environment data from a real scene, acquire a 3D image resource according to the external environment data, and display a virtual scene corresponding to the external environment data according to the 3D image resource. The above solution can prompt the user to the real situation of the external environment when the user is immersed in the virtual reality scene that is separated from the external environment, so that the user can know the current geographical location, time, and weather.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with the present application are generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center By wire (eg coaxial cable, fiber, digital User line) or wireless (eg infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media. The usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state hard disk).

The objects, technical solutions and advantageous effects of the present invention are further described in detail in the specific embodiments described above. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A virtual reality display method, comprising:

Obtaining external environment data from a real scene, the external environment data including: at least one of geographical location data, time data, or weather data;

Obtaining a 3D image resource according to the external environment data;

Displaying a virtual scene corresponding to the external environment data according to the 3D image resource.
The method of claim 1, wherein the external environment data comprises geographic location data; and the acquiring the 3D image resource according to the external environment data comprises:

Obtaining a 3D image resource of the landmark corresponding to the geographical location data according to the geographic location data.
The method according to claim 2, wherein the acquiring the 3D image resource of the landmark corresponding to the geographical location data according to the geographic location data comprises:

Obtaining, according to the geographic location data, a 3D image resource corresponding to a geographic location indicated by the geographic location data from a nearest landmark;

or,

And acquiring, according to the geographic location data, a 3D image resource corresponding to the hottest landmark corresponding to the geographic location data.
The method according to claim 1, wherein the external environment data comprises geographical location data, and the acquiring the 3D image resource according to the external environment data comprises:

Obtaining a 3D image resource of a geographical environment at a geographic location indicated by the geographic location data according to the geographic location data.
The method according to any one of claims 1 to 4, wherein the external environment data includes time data, and the acquiring the 3D image resource according to the external environment data comprises:

And acquiring, according to the time data, a 3D image resource of the outdoor light corresponding to the time indicated by the time data.
The method of any one of the preceding claims, wherein the external environment data comprises weather data, and the acquiring the 3D image resource according to the external environment data comprises:

Obtaining, according to the weather data, a 3D image resource corresponding to a weather condition indicated by the weather data;

The weather data includes at least one of the following: air quality, temperature, relative humidity, precipitation, wind direction or light intensity.
The method of any of claims 1-6, further comprising: receiving user input for understanding an external environment.
The method according to any one of claims 1 to 7, wherein said displaying according to said 3D image resource The virtual scenario corresponding to the external environment data includes:

Displaying the virtual scene corresponding to the external environment data on the HOME main interface; or

Displaying, according to the 3D image resource, a virtual scene and a current page corresponding to the external environment data; or

And displaying, according to the 3D image resource, a virtual scene corresponding to the external environment data on a current page.
A terminal, comprising: a processor, a memory, and a 3D display, wherein

The memory is for storing instructions and data;

The processor is configured to read instructions and data stored in the memory, and perform the following operations:

Obtaining external environment data from a real scene, the external environment data including: at least one of geographical location data, time data, or weather data;

Obtaining geographic location data in the external environment data from a real scene;

The 3D display is configured to display a virtual scene corresponding to the external environment data according to the 3D image resource.
The terminal according to claim 9, wherein said external environment data includes geographical location data;

The processor is specifically configured to acquire, according to the geographic location data, a 3D image resource of a landmark corresponding to the geographic location data.
The terminal of claim 10, wherein

The processor is specifically configured to acquire, according to the geographic location data, a 3D image resource corresponding to a landmark that is closest to a geographic location indicated by the geographic location data;

or,

The processor is specifically configured to acquire, according to the geographic location data, a 3D image resource corresponding to a landmark with the highest heat corresponding to the geographic location data.
The terminal according to claim 9, wherein said external environment data includes geographical location data;

The processor is specifically configured to acquire, according to the geographic location data, a 3D image resource of a geographic environment at a geographic location indicated by the geographic location data.
The terminal according to any one of claims 9 to 12, wherein the external environment data includes time data;

The processor is specifically configured to acquire, according to the time data, a 3D image resource of outdoor light corresponding to the time indicated by the time data.
The terminal according to any one of claims 9 to 13, wherein the external environment data includes weather data;

The processor is specifically configured to acquire, according to the weather data, a 3D corresponding to a weather condition indicated by the weather data. Image resource

The weather data includes at least one of the following: air quality, temperature, relative humidity, precipitation, wind direction or light intensity.
The terminal according to any one of claims 9 to 14, further comprising:

A user input device for receiving user input for understanding an external environment.
A terminal according to any of claims 9-15, characterized in that

The 3D display is specifically configured to display a virtual scene corresponding to the external environment data on a HOME main interface; or

The 3D display is specifically configured to display a virtual scene corresponding to the external environment data and a current page according to the 3D image resource; or

The 3D display is specifically configured to hover display the virtual scene corresponding to the external environment data on the current page according to the 3D image resource.
A terminal, comprising:

An acquiring unit, configured to acquire external environment data from a real scene, where the external environment data includes at least one of geographic location data, time data, or weather data;

The obtaining unit is further configured to acquire a 3D image resource according to the external environment data;

a display unit, configured to display a virtual scene corresponding to the external environment data according to the 3D image resource.
The terminal according to claim 17, wherein said external environment data includes geographical location data;

The acquiring unit is specifically configured to acquire, according to the geographic location data, a 3D image resource of a landmark corresponding to the geographic location data.
The terminal according to claim 18, wherein the acquiring unit is configured to acquire, according to the geographic location data, a 3D image resource corresponding to a landmark that is closest to a geographical location indicated by the geographic location data;

or,

The acquiring unit is configured to acquire, according to the geographic location data, a 3D image resource corresponding to a landmark with the highest heat corresponding to the geographic location data.
The terminal according to claim 17, wherein said external environment data includes geographical location data.

The acquiring unit is specifically configured to acquire, according to the geographic location data, a 3D image resource of a geographical environment at a geographic location indicated by the geographic location data.
The terminal according to any one of claims 17 to 20, wherein the external environment data includes time data,

The acquiring unit is configured to acquire, according to the time data, a 3D image resource of outdoor light corresponding to the time indicated by the time data.
The terminal according to any one of claims 17 to 21, wherein the external environment data includes weather data.

The acquiring unit is specifically configured to acquire, according to the weather data, a 3D image resource corresponding to a weather condition indicated by the weather data;

The weather data includes at least one of the following: air quality, temperature, relative humidity, precipitation, wind direction or light intensity.
The terminal according to any one of claims 17 to 22, further comprising:

A receiving unit for receiving user input for understanding an external environment.
The terminal according to any one of claims 17 to 23, wherein the display unit is specifically configured to display a virtual scene corresponding to the external environment data on a HOME main interface; or

The display unit is specifically configured to display, according to the 3D image resource, a virtual scene and a current page corresponding to the external environment data by using a screen; or

The display unit is specifically configured to: hover the virtual scene corresponding to the external environment data on the current page according to the 3D image resource.
A computer readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the method of claims 1-8.
A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of claims 1-8.