TWI715026B - Network virtual reality control method and host using the same - Google Patents

Abstract

A network virtual reality (WebVR) control method and a host using the same are provided. The host is used to control the WebVR. The host includes a browser extension, a shadow instance, an art style engine and a Universal Windows Platform Bridge (UWP bridge). The browser extension is configured to receive an art style information via a browser. The shadow instance is used to download a virtual reality content. The style engine is used to modify a virtual reality content based on the art style information. The UWP bridge is used to deliver the modified virtual reality content to a head mounted display.

Description

Control method of network virtual reality and host using it

This disclosure relates to a control method and a host using it, and in particular, it relates to a control method of a network virtual reality and a host using it.

With the advancement of display technology, a virtual reality technology has been developed. Through virtual reality technology, users can use head-mounted displays to watch stereo images in front of their eyes. Users can place themselves in a virtual three-dimensional environment for games, teaching or various activities.

Currently, Web VR (WebVR) technology has also been developed on the Internet. When users browse certain web pages, they can use the web pages to display virtual reality content and enjoy the virtual reality content through the head-mounted display.

However, in the current devices that can enjoy network virtual reality, the virtual reality content seen is based on the design of the web page, and does not differ with reference to the device currently worn by the user. Even if you use different helmets or different mobile phones, the user sees the same content. In order for users to be more interactive, some elements need to be added to the virtual reality content so that users can have a different experience.

This disclosure relates to a control method for network virtual reality and a host using it. It uses artificial intelligence (Artificial intelligence) technology to implement art style information in the virtual reality content so that users can Have a different experience.

According to the first aspect of this disclosure, a control method for Web Virtual Reality (WebVR) is proposed. The control method of network virtual reality includes the following steps. Receive art style information in a browser through a browser extension. Download a virtual reality content through a shadow instance unit (shadow instance). Based on the style information, an art style engine modifies the virtual reality content. Transmit the modified virtual reality content to a head-mounted display through a Universal Windows Platform Bridge (UWP Bridge).

According to the second aspect of this disclosure, a host is proposed. The host is used to control WebVR. The host includes a browser extension unit, a shadow instance unit, an art style engine, and a Universal Windows Platform Bridge (UWP Bridge). The browser extension unit is used for receiving art style information in a browser. The masked instance unit is used to download a virtual reality content. The art style engine is used to modify the virtual reality content based on style information. The universal window platform bridge is used to transfer the modified virtual reality content to a head-mounted display.

In order to have a better understanding of the above and other aspects of the present disclosure, the following embodiments are specially cited, and the accompanying drawings are described in detail as follows:

Please refer to FIG. 1, which shows a schematic diagram of a host 100 and a head-mounted display 300 according to an embodiment. In the web virtual reality (WebVR) technology, after the host 100 connects to a WebVR context Website 200, the virtual reality content VR1 is downloaded and delivered to the head-mounted display 300. Generally speaking, the virtual reality content VR1 contains a left-eye image VR_1 and a right-eye image VR_r. The left-eye image VR_1 and the right-eye image VR_r of the virtual reality content VR1 are directly projected to the left and right eyes of the user through the head-mounted display 300 to generate stereo vision.

The host 100 of this example uses artificial intelligence (Artificial intelligence) technology to implement art style information in the virtual reality content VR1, so that users can have a different experience. The following describes the operation of this embodiment in detail through block diagrams and flowcharts.

Please refer to FIGS. 2 and 3. FIG. 2 is a block diagram of a host 100 according to an embodiment, and FIG. 3 is a flowchart of a method for controlling network virtual reality according to an embodiment. The host 100 includes a browser extension unit 110, a browser 120, a shadow instance unit 130, an art style engine 140, and a Universal Windows Platform Bridge (Universal Windows Platform Bridge). , UWP Bridge) 150. The browser extension unit 110, the mask instance unit 130, the style engine 140, and the universal window platform bridge 150 are, for example, a program module, a chip, a circuit board, a circuit, and a storage device that stores an array of program codes. The browser 120 is, for example, Chrome ^® , Internet Explorer ^® , Firefox ^® , Safari ^® , Opera ^® and the like. In order to realize the control method of the network virtual reality of this embodiment, the browser extension unit 110, the shadow instance unit 130, the style engine 140, and the universal window platform bridge 150 are all newly added components in this disclosure.

As shown in Figures 2 and 3, in step S101, the browser 120 determines whether to browse to a webpage with virtual reality content. If the browser 120 browses to a web page with virtual reality content, step S103 is entered; if the browser 120 does not browse to a web page with virtual reality content, then returns to step S101.

Please refer to FIG. 4, which illustrates an example of a web page 900 with virtual reality content according to an embodiment. Generally, the web page 900 with virtual reality content provides a virtual reality entry button B1 for the user to click. Once the user clicks the virtual reality enter button B1, the virtual reality content VR1 can be provided.

In step S103, the browser extension unit 110 provides a style selection key B2 (shown in Figure 4).

In step S105, the browser 120 displays the style selection key B2 for the user to click. In this embodiment, the style selection key B2 is additionally displayed on the web page 900 instead of the original content of the web page 900. The content of the web page 900 has not been changed, and the style selection key B2 is superimposed on the web page 900 and displayed together. As shown in Figure 4, the style selection key B2 provides options such as natural, cartoon, and sketch for the user to select.

In step S107, the style information ST1 is received from the browser 120 through the browser extension unit 110.

In step S109, the virtual reality content VR1 is downloaded through the shielding instance unit 130. In this embodiment, the host 100 outputs a download command CM1 to the virtual reality website 200 through the newly added shielding instance unit 130 to download the virtual reality content VR1 instead of through the browser 120.

In step S111, the style engine 140 modifies the virtual reality content VR1 according to the style information ST1. In this embodiment, the style engine 140 uses a machine learning algorithm to modify the virtual reality content VR1.

In step S113, a spherical panorama process is performed on the modified virtual reality content VR1 through the universal window platform bridge 150.

In step S115, an interpupillary distance adjustment (IPD adjustment) is performed on the modified virtual reality content VR1 through the universal window platform bridge 150.

In step S117, the modified virtual reality content VR1 is delivered.

In step S119, the head mounted display 300 receives the modified virtual reality content VR1.

In step S121, the head mounted display 300 detects a piece of rotation information RT1.

In step S123, the rotation information RT1 of the head mounted display 300 is received through the universal window platform bridge 150.

Then, returning to step S109, the shielding example unit 130 changes the download command CM1 according to the rotation information RT1 to download the virtual reality content VR1 corresponding to the rotation information RT1.

Through the above embodiment, when the user browses to the web page 900 with virtual reality content, the virtual reality entry button B1 and the style selection button B2 will be displayed immediately. Once the user clicks the virtual reality entry button B1 and selects the style selection button B2, the shadow instance unit 130, the style engine 140 and the universal window platform bridge 150 will execute the style adjustment program in the background, making it unique The virtual reality content VR1 with a special style can be presented on the head-mounted display 300.

The style adjustment procedure performed in this embodiment is executed on the host 100, and the virtual reality content VR1 stored in the virtual reality website 200 has not been changed, and the experience of other users will not be affected.

To sum up, although the present disclosure has been disclosed as above by embodiments, it is not intended to limit the present disclosure. Those with ordinary knowledge in the technical field to which this disclosure belongs can make various changes and modifications without departing from the spirit and scope of this disclosure. Therefore, the protection scope of this disclosure shall be subject to the scope of the attached patent application.

100: host 110: Browser extension unit 120: Browser 130: Shading instance unit 140: Style Engine 150: Universal Windows Platform Bridge 200: Virtual Reality Website 300: Head-mounted display 900: Web page B1: Virtual reality entry button B2: Style selection button CM1: Download instruction RT1: Rotate information S101, S103, S105, S107, S109, S111, S113, S115, S117, S119, S121, S123: steps ST1: Style Information VR1: Virtual reality content VR_l: Left eye image VR_r: Right eye image

FIG. 1 shows a schematic diagram of a host and a head-mounted display according to an embodiment. Figure 2 shows a block diagram of a host according to an embodiment. Figure 3 shows a flowchart of a method for controlling network virtual reality according to an embodiment. Figure 4 illustrates a web page with virtual reality content according to an embodiment.

100: host 110: Browser extension unit 120: Browser 130: Shading instance unit 140: Style Engine 150: Universal Windows Platform Bridge 200: Virtual Reality Website 300: Head-mounted display B2: Style selection button CM1: Download instruction RT1: Rotate information ST1: Style Information VR1: Virtual reality content VR_l: Left eye image VR_r: Right eye image

Claims (12)

A control method of Web Virtual Reality (WebVR), including: Receive a style information (art style information) in a browser through a browser extension (browser extension); Download a virtual reality content through a shadow instance; Based on the style information, a style engine (art style engine) modifies the virtual reality content; and Transmit the modified virtual reality content to a head-mounted display through a Universal Windows Platform Bridge (UWP Bridge). For example, the control method of network virtual reality described in item 1 of the scope of patent application includes: A spherical panorama process is performed on the modified virtual reality content through the universal window platform bridge. For example, the control method of network virtual reality described in item 1 of the scope of patent application includes: Perform an interpupillary distance adjustment (IPD adjustment) procedure on the modified virtual reality content through the universal window platform bridge. For example, the control method of network virtual reality described in item 1 of the scope of patent application includes: The rotation information of one of the head-mounted displays is received through a universal window platform bridge, wherein the shielding instance unit downloads the virtual reality content according to the rotation information. According to the control method of the network virtual reality described in the first item of the scope of patent application, the browser extension unit displays a style selection key in the browser to obtain the style information according to the click situation of the style selection key. For example, the control method of network virtual reality described in the scope of patent application, wherein the style engine uses a machine learning algorithm to modify the virtual reality content. A host for controlling WebVR. The host includes: A browser extension for receiving art style information in a browser; A shadow instance unit (shadow instance) for downloading a virtual reality content; An art style engine for modifying the virtual reality content based on the style information; and A Universal Windows Platform Bridge (UWP Bridge) is used to transfer the modified virtual reality content to a head-mounted display. Such as the host described in item 7 of the scope of patent application, wherein the universal window platform bridge is further used to perform a spherical panorama program on the modified virtual reality content. For the host described in item 7 of the scope of the patent application, the universal window platform bridge is further used to perform an interpupillary distance adjustment (IPD adjustment) on the modified virtual reality content. For example, the host described in item 7 of the scope of patent application, wherein the universal window platform bridge is further used for receiving a rotation information of the head-mounted display, and the shielding instance unit is further used for downloading the virtual reality content according to the rotation information . For example, in the host described in item 7 of the scope of patent application, the browser extension unit displays a style selection button on the browser to obtain the style information according to the click of the style selection button. For example, in the host described in item 7 of the scope of patent application, the style engine uses a machine learning algorithm to modify the virtual reality content.

Images