WO2018086224A1

WO2018086224A1 - Method and apparatus for generating virtual reality scene, and virtual reality system

Info

Publication number: WO2018086224A1
Application number: PCT/CN2016/113087
Authority: WO
Inventors: 高进宝
Original assignee: 歌尔科技有限公司
Priority date: 2016-11-11
Filing date: 2016-12-29
Publication date: 2018-05-17
Also published as: CN106598229A; CN106598229B

Abstract

A method and apparatus for generating a virtual reality scene, and virtual reality system. The method for generating a virtual reality scene comprises: in response to a request for a target remote reality scene from a user, acquiring, according to real scene information of the user, target scene information (S2100); and generating, according to the target scene information, a corresponding target virtual reality scene to display the same to the user (S2200). The generation method of the present invention can provide to a user a novel real-time virtual reality experience of being in a remote reality scene.

Description

Method, device and virtual reality system for generating virtual reality scene

Technical field

The present invention relates to a virtual display technology, and more particularly to a method, device, and virtual reality system for generating a virtual reality scene.

Background technique

Virtual Reality (VR) is an important direction of simulation technology. It is a collection of simulation technology and computer graphics, human-machine interface technology, multimedia technology, sensing technology, network technology, etc., mainly including simulation environment. , perception, natural skills and sensing equipment. The simulation environment is a computer-generated, real-time, dynamic, three-dimensional, realistic image. In addition to the visual perception generated by computer graphics technology, there are also perceptions such as hearing, touch, force, and motion, and even smell and taste, also known as multi-perception. Natural skills refer to the rotation of the person's head, eyes, gestures, or other human behaviors. The computer processes the data that is appropriate to the actions of the participants, responds to the user's input in real time, and feeds back to the user's facial features. . Through virtual reality technology, a computer can be used to generate a simulation environment, and the user can immerse the user in the environment through the interactive 3D dynamic view and entity behavior simulation of multi-source information fusion to obtain the virtual reality experience.

At present, many companies in the industry have launched virtual reality products, such as virtual reality glasses and virtual reality helmets. However, most of the current virtual reality devices are used in games or video viewing. The virtual scenes are preset scenes in the game or scenes involved in preset movies and videos, and are not really virtual reality. Scenes. Unable to provide users with a virtual reality experience that is placed in real-time reality scenes.

Therefore, the inventors believe that it is necessary to improve the technical problems existing in the above prior art.

Summary of the invention

It is an object of the present invention to provide a new technical solution for generating a virtual reality scene.

According to a first aspect of the present invention, a method for generating a virtual reality scene is provided that does not include:

And acquiring the target scene information according to the real scene information of the user, where the real scene information includes at least location information and body posture information of the user in the local real scene, where the target scene information is at least Include real-time picture information in the target reality scene;

And generating, according to the target scenario information, a corresponding target virtual reality scenario for presentation to the user.

Optionally, the step of acquiring target scenario information includes:

Setting a target scene coordinate of the user in the scene coordinate system according to the current scene information of the user;

Positioning the target remote reality scene according to the target scene coordinates;

The target scene information is generated according to the real-time panoramic video of the target remote reality scene acquired by the panoramic camera.

Optionally, the generating method of the virtual reality scenario further includes:

When the real scene information changes, the target scene information is re-acquired according to the changed real scene information to generate a changed target virtual reality scene.

The real scene information is acquired by a positioning sensor.

Optionally, the target scenario information further includes at least one of real-time sound information, real-time temperature information, real-time humidity information, and real-time odor information in the target remote reality scene.

According to a second aspect of the present invention, a device for generating a virtual reality scenario includes:

The scene information acquiring unit is configured to acquire the target scene information according to the real scene information of the user, wherein the real scene information includes at least the location information and the body posture information of the user in the local real scene in response to the user's request for the target remote reality scene. The target scene information includes at least real-time screen information in the target real-life scene;

The target scene generating unit is configured to generate a corresponding target virtual reality scene for displaying to the user according to the target scene information.

Optionally, the scenario information acquiring unit includes:

a coordinate setting unit, configured to set a target scene coordinate of the user in the scene coordinate system according to the current scene information of the user;

a scene positioning unit, configured to locate a target remote real-life scene according to the target scene coordinate;

And an information generating unit, configured to generate target scene information according to the real-time panoramic video of the target remote real-life scene acquired by the panoramic camera.

Optionally, the generating device of the virtual reality scenario further includes:

The change control unit is configured to re-acquire the target scene information to generate the changed target virtual reality scene according to the changed real scene information when the real scene information changes.

The real information acquiring unit is configured to acquire the real scene information by using a positioning sensor.

According to a third aspect of the present invention, a virtual reality system is provided, comprising the device for generating a virtual reality scene according to the second aspect of the present invention.

The inventor of the present invention has found that in the prior art, there is no method and device for generating a virtual reality scene that can generate a virtual reality scene according to a remote reality scene to provide a new virtual reality experience like a real-time remote reality scene to the user. And virtual reality systems. Therefore, the technical task to be achieved by the present invention or the technical problem to be solved is not thought of or expected by those skilled in the art, so the present invention is a new technical solution.

Other features and advantages of the present invention will become apparent from the Detailed Description of the <RTIgt;

DRAWINGS

The accompanying drawings, which are incorporated in FIG

1 is a block diagram showing an example of a hardware configuration of a computing system that can be used to implement an embodiment of the present invention;

2 is a flow chart showing a method of generating a virtual reality scene according to an embodiment of the present invention;

FIG. 3 is a flow chart showing the steps of acquiring target scene information according to an embodiment of the present invention; FIG.

FIG. 4 is a schematic block diagram of a generating device of a virtual reality scene according to an embodiment of the present invention; FIG.

FIG. 5 is a schematic diagram showing a virtual reality system of an embodiment of the present invention; FIG.

FIG. 6 shows an example flow of a method of generating a virtual reality scene of an embodiment of the present invention.

detailed description

Various exemplary embodiments of the present invention will now be described in detail with reference to the drawings. It should be noted that the relative arrangement of the components and steps, numerical expressions and numerical values set forth in the embodiments are not intended to limit the scope of the invention unless otherwise specified.

The following description of the at least one exemplary embodiment is merely illustrative and is in no way

Techniques, methods and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but the techniques, methods and apparatus should be considered as part of the specification, where appropriate.

In all of the examples shown and discussed herein, any specific values are to be construed as illustrative only and not as a limitation. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that similar reference numerals and letters indicate similar items in the following figures, and therefore, once an item is defined in one figure, it is not required to be further discussed in the subsequent figures.

FIG. 1 is a block diagram showing a hardware configuration of a computer system 1000 in which an embodiment of the present invention can be implemented.

As shown in FIG. 1, computer system 1000 includes a computer 1110. The computer 1110 includes a processing unit 1120, a system memory 1130, a fixed non-volatile memory interface 1140, a mobile non-volatile memory interface 1150, a user input interface 1160, a network interface 1170, a video interface 1190, and an output peripheral connected via a system bus 1121. Interface 1195.

The system memory 1130 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The BIOS (Basic Input Output System) resides in the ROM. Operating systems, applications, other program modules, and certain program data reside in RAM.

A fixed non-volatile memory such as a hard disk is connected to a fixed non-volatile memory interface 1140. A fixed non-volatile memory can store, for example, an operating system, applications, other program modules, and certain program data.

A mobile non-volatile memory such as a floppy disk drive and a CD-ROM drive is connected to the mobile non-volatile memory interface 1150. For example, a floppy disk can be inserted into a floppy disk drive, and a CD (disc) can be inserted into the CD-ROM drive.

Input devices such as a mouse and keyboard are connected to the user input interface 1160.

Computer 1110 can be coupled to remote computer 1180 via network interface 1170. For example, network interface 1170 can be connected to a remote computer via a local area network. Alternatively, network interface 1170 can be coupled to a modem (modulator-demodulator) and the modem connected to remote computer 1180 via a wide area network.

Remote computer 1180 can include a memory, such as a hard disk, that can store remote applications.

Video interface 1190 is connected to the monitor.

The output peripheral interface 1195 is connected to the printer and the speaker.

The computer system shown in Figure 1 is merely illustrative and is in no way meant to limit the invention, its application or use. In the embodiment of the present invention, the system memory 1130 is configured to store an instruction, and the instruction is used to control the processing unit 1120 to perform any one of the virtual reality scene generation methods provided by the embodiments of the present invention. It will be understood by those skilled in the art that although a plurality of devices are illustrated for computer 1100 in FIG. 1, the present invention may relate only to some of the devices therein, for example, computer 1100 only relates to processing unit 1120 and system memory 1130, and the like. A technician can design instructions in accordance with the disclosed aspects of the present invention. How the instructions control the processor for operation is well known in the art and will not be described in detail herein.

The overall concept of the present invention is a new technical solution that can generate a virtual reality scene according to a remote reality scenario requested by a user, so that the user can acquire a brand new virtual reality experience that is placed in a remote real-time scene in real time.

In this embodiment, a virtual reality scene generation method is first provided, as shown in FIG. 2, including:

Step S2100, in response to the user's request for the target remote reality scenario, according to the user's current The real scene information acquires target scene information, where the real scene information includes at least location information and body posture information of the user in the local real scene, and the target scene information includes at least real-time screen information in the target real scene.

In this embodiment, the target remote reality scene is a remote scene that exists in reality, which is different from the preset scene in the game used in the virtual reality field frequency in the prior art or in a preset movie or video. The scene, for example, the user is in China, and the target remote scene of the request is the current Egyptian pyramid.

The user can request any target remote real-world scene that he or she wants to place on the device (for example, the virtual reality device or the main sending device connected to the virtual reality product) that implements the method for generating the virtual reality scene of the present embodiment. The device that implements the method for generating the virtual reality scene in the embodiment, obtains the target scene information according to the real scene information of the user, in response to the user's request for the target remote reality scenario.

The real scene information is obtained from a real scene that the user actually is in, and the information for generating the target virtual reality scene includes at least location information and body posture information of the user in the local real scene. The real scene information may be acquired by a positioning sensor, which may be, for example, a nine-axis motion sensor (including a three-axis accelerometer, a three-axis gyroscope, a three-axis magnetometer), or using the virtual reality product implementing the embodiment. The existing sensors are equipped with auxiliary sense sensors for peripherals. Therefore, in one example, the method for generating a virtual reality scene provided in this embodiment further includes: acquiring the real scene information by using a positioning sensor.

The target scenario information is obtained from the target remote reality scenario, and is used to generate information about the target virtual reality scenario, and includes at least real-time image information in the target remote reality scenario. Through the real-time picture information of the target real scene, the target virtual reality scene can be generated and presented to the user, so that the user gets a new virtual reality experience as if he is in the real-time target scene.

Specifically, the step S2100 of acquiring the target scenario information includes:

S2101: Set a target scene coordinate of the user in the scene coordinate system according to the current scene information of the user.

The scene coordinate system is the target remote reality scene, the real scene where the user is located, and the The coordinate system shared by the virtual reality scene is such that when the user moves or changes the angle of view in the real scene, the real scene information and the target scene information acquired from the target remote real scene can be combined to simulate the real experience of the user. Generate a target realistic virtual scene.

Specifically, the coordinate origin of the scene coordinate system may be set according to the needs of the user, for example, providing an interface for the user to input or select to configure which point in all the scenes is used as the coordinate origin; or, by default, the center of all scenes is used as the scene coordinate. The coordinate origin of the system is OK. In an example, when a movable panoramic camera is provided in a real scene including a target remote real scene (for example, a panoramic camera carried by a drone or a robot), the movable panoramic camera can be in a real scene. The position is taken as the coordinate origin. In addition, the coordinate axis direction of the scene coordinate system may be the direction of the existing three-dimensional map coordinate axis after the selected coordinate origin.

Set the target scene coordinates of the user in the scene coordinate system according to the current scene information of the user. Specifically, in response to the initial request of the user's remote reality scene, an interface may be provided for the user to input or select to configure which point in the scene coordinate system as its initial target scene coordinate, or the user's scene coordinate may be defaulted. Set to the coordinate corresponding to the center of the scene, or the initial target scene coordinate of the default user is the coordinate origin (0, 0, 0); and when the user moves in the real scene or the body posture changes, the user's real scene information changes. Set the target scene coordinates of the user in the scene coordinate system according to the current scene information of the user. For example, the user is initially located at the coordinate origin (0, 0, 0) of the scene coordinate system, and after shifting 10 meters in the local real scene, The corresponding location information of the local reality scene changes, and according to the changed real scene information, the target scene coordinate of the set user of the user in the scene coordinate system is (10, 0, 0).

After the target scene coordinates are set in step S2102, the process proceeds to S2102, and the target remote reality scene is located according to the target scene coordinates.

There are many ways to locate a target remote reality scene based on the target scene coordinates.

For example, in a real scene including a target remote reality scene, a plurality of panoramic cameras are disposed, and by calculating a coordinate range controlled by each panoramic camera, it is determined that the target scene coordinate of the user falls within a range of scene coordinates controlled by the panoramic camera, and the panorama is The scene corresponding to the target scene coordinate in the scene coordinate range controlled by the camera is positioned as the target remote real scene, and further, when the movement change in the local real scene exceeds the scene coordinate range controlled by the previous panoramic camera, User's changed target scene coordinates, repositioning the target far The realistic scene, assuming that the user translates 10 meters, correspondingly, the target scene coordinate changed by the initial position coordinate origin (0, 0, 0) is (10, 0, 0), and the user's target scene coordinate has been exceeded. The scene coordinate range controlled by the previous panoramic camera, correspondingly, switches to the panoramic camera including the changed target scene coordinate within the scene coordinate control range, and corresponds to the target scene coordinate within the scene coordinate range controlled by the panoramic camera The scene is positioned as a target remote reality scene. For example, the user's initial target remote reality scene is a living room, and the target is a distance of 10 meters, and the target remote reality scene obtained by the positioning is a master bedroom.

For another example, the real scene including the target remote reality scene is provided with a movable panoramic camera, such as a panoramic camera mounted by a drone or a robot, when it is determined that the target scene coordinate is not within the range of the scene coordinate controlled by the movable panoramic camera. The panoramic camera is driven to move (for example, driving the drone) to ensure that the scene coordinate range controlled by the panoramic camera includes the target scene coordinate, and the scene corresponding to the target scene coordinate is positioned as the target remote real scene.

Further, in response to the user's initial request for the target remote reality scene, the target remote reality scene may be located at a scene of the first scene space associated with the target remote reality scene. The first scene space may be set by the user, or may be set by default. For example, the target remote reality scenario requested by the user is Egypt. The first scene space may be set by the user to be an Egyptian airport, or the first scene space may be set to an Egyptian airport by default. For example, the target remote real-time scenario requested by the user is his own home. The first scene space can be set by the user as the living room, or the first scene space can be set as the living room by default.

After the target remote reality scene is located in step S2202, the process proceeds to step S2203, and the target scene information is generated according to the real-time panoramic video of the target remote reality scene acquired by the panoramic camera.

The panoramic camera is a camera that can independently realize a wide range of no dead angle monitoring, and can cover the scene without blind spots. In this embodiment, the panoramic camera may be a panoramic camera having a 360 degree angle of view. The panoramic camera may be a movable panoramic camera initially set in a target remote real-life scene or in a real scene related to the target remote real-life scene, for example, a panoramic camera carried by a drone or a robot; or may be fixed It is disposed in a target remote real scene that is requested by the user, and a plurality of such panoramic settings of the panoramic camera may also be distributed in a real scene related to the target remote real scene.

After the step S2202, the target remote real-time scene that is located is a scene corresponding to the target scene coordinate and falls within the scene coordinate control range of a panoramic camera. Therefore, the real-time panoramic video of the target remote real-life scene can be acquired by the panoramic camera. According to the target scene information generated by the real-time panoramic video, at least real-time image information may be extracted from the real-time panoramic video, or may be real-time panoramic video information corresponding to the real-time panoramic video. In an example, the device that implements the virtual reality scene generation method and the virtual display device (eg, virtual reality glasses) that exhibits the target virtual reality scene are connected through a wireless or wired network, and in some application scenarios with small transmission bandwidth, The real-time panoramic video can be simplified and compressed to generate the target scene information to facilitate transmission. In some application scenarios with sufficient transmission bandwidth, the real-time panoramic video can be transmitted without being compressed.

In addition, the target scene information may further include: the target scene information further includes real-time sound information, real-time temperature information, real-time humidity information, real-time scent information, and the like in the target remote real-life scene, for example, may be set to target remotely. The temperature sensor in the real scene acquires the real-time temperature information of the target remote reality scene, and sets the corresponding real-time temperature according to the real-time temperature information in the generated target virtual reality scene, and the user experiences the real-time temperature experience through the adjustable temperature space bin. The real-time humidity information of the target remote reality scene can also be obtained by the humidity sensor set in the target remote reality scene, and the corresponding real-time humidity is set according to the real-time humidity information in the generated target virtual reality scene, and the space is experienced through the adjustable humidity. The user can obtain the real-time humidity experience; the real-time scent information of the target remote real-world scene can also be obtained through the scent sensor set in the target remote real-life scene, and the real-time odor information is set according to the generated target virtual reality scene. Flavor generator produces a corresponding odor, so that users get real-time experience humidity. In this way, the virtual reality experience that the user obtains in the virtual reality scene can be enriched.

After the step S2100 is completed by the example described above, the process proceeds to step S2200, and the target virtual reality scene is generated for presentation to the user according to the target scene information.

In this embodiment, the target scene information includes at least real-time screen information in the target remote real-world scene, and correspondingly, the generated target virtual reality scene may be in a target remote real-life scene displayed by, for example, virtual display glasses. The real-time picture gives the user a new virtual reality experience as if they were in real-time in a remote target reality scene.

Further, the target scene information may further include: the target scene information further includes real-time sound information, real-time temperature information, real-time humidity information, real-time scent information, and the like in the target remote real-life scene, and correspondingly, the generated target virtual In a real-life scenario, not only real-time images in a target remote real-life scene that can be presented through, for example, virtual display glasses, but also sounds that can be synchronized with the target remote real-world scene through headphones or audio, by setting an adjustable temperature The temperature and humidity experience provided by the tunable humidity virtual space experience bin is synchronized with the target remote current scene, and the scent generated by the scent generator synchronized with the target remote current scene, so that the user gets richer as if he is at a remote target. A new virtual reality experience in a real-life scenario.

Through the above embodiment, with the virtual reality scene generation method as shown in FIG. 2 or FIG. 3, the user can obtain a new virtual reality experience like being placed in a remote target real scene. When the user's actual scene information changes, for example, when the user moves or performs an action, when the location information or the body posture information of the local real scene changes, the target scene may be reacquired according to the changed real scene information. Information to generate a changed target virtual reality scene. Specifically, the step of acquiring the target scene information in the virtual reality scene generating method shown in FIG. 2 or FIG. 3 is not described herein. In this manner, the virtual reality scene generating method in the embodiment may further include: when the real scene information changes, the virtual reality scene generating method in the embodiment may be obtained by merging the real scene information of the user into the target virtual reality scene. And acquiring the target scene information to generate the changed target virtual reality scene according to the changed real scene information.

In this embodiment, a generating device 4000 for a virtual reality scene, as shown in FIG. 4, includes a scene information acquiring unit 4100 and a target scene generating unit 4200. Optionally, the method further includes a coordinate setting unit 4300 and a scene positioning. The unit 4400, the information generating unit 4500, the change control unit 4600, and the real information acquiring unit 4700 are used to implement any of the virtual reality scene generating methods provided in this embodiment, and details are not described herein again.

The generating device 4000 of the virtual reality scenario includes:

The scene information obtaining unit 4100 is configured to acquire target scene information according to the real scene information of the user, in response to the user's request for the target remote real scene, where the real scene information includes at least the location information and the body posture of the user in the local real scene. Information, the target field The scene information includes at least real-time screen information in the target real-life scene;

The target scenario generating unit 4200 is configured to generate a corresponding target virtual reality scenario for displaying to the user according to the target scenario information.

Optionally, the scenario information obtaining unit 4100 includes:

The coordinate setting unit 4300 is configured to set a target scene coordinate of the user in the scene coordinate system according to the current scene information of the user;

a scene positioning unit 4400, configured to locate a target remote real-life scene according to the target scene coordinate;

The information generating unit 4500 is configured to generate target scene information according to the real-time panoramic video of the target remote real-life scene acquired by the panoramic camera.

Optionally, the generating device 4000 of the virtual reality scenario further includes:

The change control unit 4600 is configured to re-acquire the target scene information to generate the changed target virtual reality scene according to the changed real scene information when the real scene information changes.

The real information acquiring unit 4700 is configured to acquire the real scene information by using a positioning sensor.

In this embodiment, a virtual reality system 5000 is further provided, including any one of the virtual reality scene generating devices 4000 provided in this embodiment.

For example, as shown in FIG. 5, the virtual reality system 5000 includes a virtual reality device 5100, a virtual reality scene generation device 4000, a plurality of panoramic cameras 5200 disposed in a remote reality scene, and networks 5301, 5302, wherein:

a virtual reality device 5100, configured to present a target virtual reality scene generated by the generating device 4000 of the virtual reality scene to the user, for example, the virtual reality device 5100 may be a virtual reality glasses, a virtual reality helmet, or the like;

The generating device 4000 of the virtual reality scenario is used to implement the method for generating the virtual reality scenario provided by any one of the embodiments in the present embodiment, and details are not described herein again;

The network 5301 is configured to connect the generating device 4000 of the virtual reality scenario with the virtual reality device 5100. According to the application scenario, the network may be a wireless network or a wired network, and may be a wide area network. It can also be a local area network;

The network 5302 is configured to connect the generating device 4000 and the panoramic camera 5200 of the virtual reality scenario. According to the application scenario, the network may be a wireless network or a wired network, and may be a wide area network or a local area network.

The panoramic camera 5200 is configured to acquire real-time video of the remote reality scene to generate target scene information. The panoramic camera 5200 may be fixedly disposed in the remote real-world scene, or may be movably located in the target remote real-life scene, for example, located A drone or robotic bearer of a remote reality scene.

In addition, in this embodiment, the specific implementation form of the virtual reality scene generating device 4000 is not limited, and the virtual reality scene generating device 4000 may be a physical device other than the virtual reality device 5100, for example, as shown in FIG. 1 . The illustrated computer 1100, the virtual reality scene generating device 4000 may also be a partial functional unit included in the virtual reality device 5100, and some of the functional units are included in the physical device independent of the virtual reality device 5100. As long as the device that implements the function of the virtual reality scenario generating device 4000 is implemented in the form of an independent physical device or a plurality of separate physical devices, the protection scope of the embodiment cannot be avoided.

The virtual reality scene generation method provided in this embodiment will be further described below with reference to FIG. 6. In this example, the method for generating a virtual reality scene is implemented by using the virtual reality system shown in FIG. 5. Specifically, in this example, the virtual reality device 5100 is a virtual reality glasses, and the local reality scene of the user is at home, requesting The target remote reality scene is the botanical garden, and the method of generating the virtual reality scene includes:

Step S601, in response to the user's request for the real-time scene of the botanical garden, set the initial coordinates of the user to the center of all the scenes, consistent with the origin of the scene coordinate system, and proceed to step S602.

In step S602, the default first scene space is the entrance of the botanical garden, and the real-time video of the entrance of the botanical garden is obtained through the panoramic camera set at the entrance of the botanical garden, and transmitted to the generating device 4000 of the virtual reality scene through the network 5302, and is transmitted through the network 5301 after being simplified and compressed. The virtual reality glasses worn by the user are presented to the initial virtual reality scene of the user entrance of the botanical garden, and then proceeds to step S603;

Step S603, according to the real-time scene information of the user acquired by the positioning sensor in real time, including the location information and the body posture information of the user in the local real scene, and setting the target scene coordinates of the user in the scene coordinate system according to the real-time acquired real scene information, for example, The user walks 10 meters along the X-axis direction of the scene coordinate system in the local reality scene, and the scene coordinate of the user is (10, 0, 0), and then proceeds to step S604;

Step S604: Locating a target remote reality scene according to the target scene coordinate of the user, for example, the target scene coordinate of the user is (10, 0, 0), which is changed compared with the initial scene coordinate, if the panoramic camera of the current remote target real-time scene is not exceeded. The scene coordinate control range, the positioning target remote reality scene does not change, otherwise, if the target scene coordinate has exceeded the scene coordinate control range of the panoramic camera of the current remote target real-time scene, if the panoramic camera is fixedly set, then the switch The panoramic camera causes the target scene coordinate to fall within the scene coordinate control range of the panoramic camera; if the panoramic camera is movable, for example, carried by a drone or a robot, the control drives the drone or the robot performs corresponding movement, so that The target scene coordinates fall within the scene coordinate control range of the panoramic camera. The retargeted target remote reality scene is a remote reality scene corresponding to the target scene coordinates. For example, if the target scene coordinate is (10, 0, 0), the corresponding scene is the center square of the botanical garden seen from the entrance of the botanical garden 10 meters in the X-axis direction, and then proceeds to step S605;

Step S605, generating target scene information according to the real-time panoramic video of the target remote real-life scene acquired by the panoramic camera, for example, acquiring a real-time video of the central square of the botanical garden through a panoramic camera set in a central square of the botanical garden, through the network 5302 The generating device 4000 transmitted to the virtual reality scene, simplifying the processing and compressing the real-time video information to be transmitted to the virtual reality glasses worn by the user through the network 5301, and proceeding to step S606;

Step S606, generating a corresponding target virtual reality scene according to the received real-time video information, for example, generating a scene of the central square of the botanical garden, presenting to the user through the virtual reality glasses, and proceeding to step S607;

Step S607, in response to the user's request to terminate the acquisition of the virtual reality scene, ending the generation of the virtual reality scene. Otherwise, after presenting the target virtual reality scene corresponding to the target real scene to the user, the process returns to step S603, and the real-time through the positioning sensor is performed. Obtaining the actual scene information, and continuing to perform steps S603 to S604, so that when the actual scene information changes, for example, When the user's movement or action causes the user to change the location information or the body posture information in the local reality scene, correspondingly, according to the changed real scene information, the target scene information is re-acquired to generate the changed target virtual reality scene. .

The embodiment of the present invention has been described above with reference to the accompanying drawings. According to the embodiment, the target scene information may be acquired according to the real scene information of the user in response to the user's request for the target remote real scene, and the target remote information is generated according to the target scene information. The virtual reality scene corresponding to the real scene enables the user to obtain a brand new virtual reality experience in real time in the remote real scene.

Those skilled in the art will appreciate that the generating device 4000 of the virtual reality scene can be implemented in various ways. For example, the generating device 4000 of the virtual reality scene can be implemented by an instruction configuration processor. For example, the instructions may be stored in the ROM, and when the device is booted, the instructions are read from the ROM into the programmable device to implement the virtual reality scene generation device 4000. For example, the virtual reality scene generation device 4000 can be cured into a dedicated device (eg, an ASIC). The generating device 4000 of the virtual reality scene may be divided into mutually independent units, or they may be combined and implemented. The generating device 4000 of the virtual reality scene may be implemented by one of the various implementations described above, or may be implemented by a combination of two or more of the various implementations described above.

While the invention has been described in detail with reference to the preferred embodiments of the present invention, it is understood that It will be appreciated by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.

Claims

A method for generating a virtual reality scene, comprising:

And acquiring the target scene information according to the real scene information of the user, where the real scene information includes at least location information and body posture information of the user in the local real scene, where the target scene information is at least Include real-time picture information in the target reality scene;

And generating, according to the target scenario information, a corresponding target virtual reality scenario for presentation to the user.
The generating method according to claim 1, wherein the step of acquiring target scene information comprises:

Setting a target scene coordinate of the user in the scene coordinate system according to the current scene information of the user;

Positioning the target remote reality scene according to the target scene coordinates;

The target scene information is generated according to the real-time panoramic video of the target remote reality scene acquired by the panoramic camera.
The generating method according to claim 1 or 2, further comprising:

When the real scene information changes, the target scene information is re-acquired according to the changed real scene information to generate a changed target virtual reality scene.
The generating method according to any one of claims 1 to 3, further comprising:

The real scene information is acquired by a positioning sensor.
The generating method according to any one of claims 1 to 4, characterized in that

The target scene information further includes at least one of real-time sound information, real-time temperature information, real-time humidity information, and real-time odor information in the target remote reality scene.
A device for generating a virtual reality scene, comprising:

The scene information acquiring unit is configured to acquire the target scene information according to the real scene information of the user, wherein the real scene information includes at least the location information and the body posture information of the user in the local real scene in response to the user's request for the target remote reality scene. The target scene information includes at least real-time screen information in the target real-life scene;

a target scene generating unit, configured to generate a corresponding target virtual image according to the target scene information The realistic scene is intended to be presented to the user.
The generating device according to claim 6, wherein the scene information acquiring unit comprises:

a coordinate setting unit, configured to set a target scene coordinate of the user in the scene coordinate system according to the current scene information of the user;

a scene positioning unit, configured to locate a target remote real-life scene according to the target scene coordinate;

And an information generating unit, configured to generate target scene information according to the real-time panoramic video of the target remote real-life scene acquired by the panoramic camera.
The generating device according to claim 6 or 7, further comprising:

The change control unit is configured to re-acquire the target scene information to generate the changed target virtual reality scene according to the changed real scene information when the real scene information changes.
The generating device according to any one of claims 6-8, further comprising:

The real information acquiring unit is configured to acquire the real scene information by using a positioning sensor.
A virtual reality system, comprising: a generating device of a virtual reality scene according to any one of claims 6-9.