TWI621034B - Methods and systems for displaying reality information in a virtual reality environment, and related computer program products - Google Patents

Abstract

A method and system for displaying real-world information in a virtual reality environment. First, the real-world information of the corresponding environment is displayed by an electronic device, wherein the real-world information defines one entry point of the candidate real-world information corresponding to one of the at least one candidate environment. When receiving the trigger of one of the corresponding entry points, the candidate real-world information is displayed within a predetermined range in the real-world information of the corresponding environment, wherein the predetermined range is smaller than the range of the real-world information corresponding to the electronic device displaying the corresponding environment. . When one of the corresponding candidate reality information confirmation signals is received, the candidate real-world information of the corresponding candidate environment is displayed by the electronic device to replace the real-world information of the corresponding environment displayed in the electronic device.

Description

Method and system for displaying real-world information in a virtual reality environment, And related computer program products

The present invention relates to a method and system for displaying a real-world information, and particularly relates to a two-stage switching operation that can provide a user to preview a real-world information when browsing between real-world information in different environments. And methods and systems for confirmation.

In recent years, portable devices, such as smart phones or notebook computers, have become more sophisticated and powerful. For example, a portable device can have network connectivity. Users can use the portable device to connect to the Internet anytime, anywhere to browse the Internet. Thanks to the convenience of these devices and their functions, these devices have become one of the must-have items for modern people, and they are frequently used in life anytime and anywhere.

On the other hand, Virtual Reality technology has been widely used in teaching, environmental navigation, and flight training. Virtual reality is the use of 3D technology to simulate a 3D virtual environment. Users can use electronic devices, such as computers or portable devices, to interact with virtual objects in the environment. Generally speaking, the user can view the actual information of the corresponding environment through a screen or wearing a specific device. Traditionally, real-world information is presented on the screen in a single screen. The user can use the mouse or keyboard to control the environment of the corresponding reality information. In addition, in some cases, once the user wears a particular device, such as a head-mounted display, the reality information is displayed directly on the display. Users can view the environment of the corresponding reality information through a specific device.

Virtual reality emphasizes the need to give users the feeling of being immersed. In addition to the establishment and interaction of the virtual environment, the presentation of the information in the real world will seriously affect the user's feelings. As mentioned above, the conventional method of using virtual reality technology and presenting real-world information directly displays the real-world information on the screen for the user to view. Real-world information in different environments When switching between, the user cannot preview the real-world information to be switched in advance. Once the switch is selected, the electronic device takes time and resources to load the complete reality information. Therefore, providing a flexible and efficient switching mechanism between virtual environments will improve the user experience and improve the performance of related systems.

In view of the above, the present invention provides a method and system for displaying real-world information in a virtual reality environment, wherein when browsing between real-world information of different environments, a two-stage switching operation can be provided to provide a user to preview the reality. Information and confirmation.

A method for displaying real-world information in a virtual reality environment according to an embodiment of the present invention. Firstly, one of the environment information is provided, wherein the reality information defines one entry point of the candidate reality information corresponding to at least one candidate environment, and displays the reality information through an electronic device. When receiving the trigger of one of the corresponding entry points, the candidate real-world information is displayed within a predetermined range in the real-world information of the corresponding environment, wherein the predetermined range is smaller than one of the real-world information displayed by the electronic device corresponding to the environment. range. Next, it is determined whether a confirmation signal of one of the corresponding candidate reality information is received. When the confirmation signal of the corresponding candidate reality information is received, the candidate reality information of the corresponding candidate environment is displayed by the electronic device to replace the real information of the corresponding environment displayed in the electronic device.

A display system for real-world information in a virtual reality environment according to an embodiment of the present invention includes a display unit, a storage unit, and a processing unit. The storage unit includes one of the environment information of the corresponding environment, wherein the reality information defines one entry point of the candidate reality information corresponding to one of the at least one candidate environment. The processing unit displays the reality information through the display unit. When receiving the trigger of one of the corresponding entry points, the processing unit displays the candidate real-world information within a predetermined range in the real-world information corresponding to the environment, wherein the predetermined range is smaller than the display unit displays the real-world information corresponding to the environment. One of the ranges. The processing unit determines whether a confirmation signal of the corresponding candidate reality information is received. When receiving the confirmation signal of the corresponding candidate reality information, the processing unit displays the candidate reality information of the corresponding candidate environment through the display unit, instead of the real environment information of the corresponding environment displayed in the display unit.

In some embodiments, after the electronic device displays the candidate reality information within a predetermined range, a time is accumulated, and it is determined whether the accumulated time is equal to a predetermined time. When the accumulated time is equal to the predetermined time, it is determined whether the confirmation signal of the corresponding candidate reality information is received.

In some embodiments, when the confirmation signal of the corresponding candidate reality information is not received, the candidate reality information displayed within the predetermined range of the electronic device is cancelled.

In some embodiments, when the electronic device displays the candidate reality information within a predetermined range, the at least one sensing unit detects the posture of the electronic device, and determines whether the posture of the electronic device is oriented or substantially oriented toward the electronic device. The direction of candidate reality information in the corresponding candidate environment. An acknowledgment signal is generated when the attitude of the electronic device is oriented toward or generally toward the direction of candidate reality information for the respective candidate environment in the electronic device.

In some embodiments, an acknowledgment signal is not generated when the gesture of the electronic device is not toward or generally toward the direction of candidate reality information for the respective candidate environment in the electronic device.

In some embodiments, after the electronic device displays the candidate reality information within a predetermined range, a time is accumulated, and it is determined whether the accumulated time is equal to a predetermined time. When the accumulated time is equal to the predetermined time, it is determined whether the posture of the electronic device is oriented toward or substantially toward the direction of the candidate reality information of the corresponding candidate environment in the electronic device.

A method for displaying real-world information in a virtual reality environment according to an embodiment of the present invention. First, the reality information of one of the corresponding environments is displayed through an electronic device. When receiving a first indication, in the real-world information corresponding to the environment, one candidate environment information of the candidate environment is displayed within a predetermined range, wherein the predetermined range is smaller than the electronic device displays the corresponding environment A range of information. When the electronic device displays the candidate reality information within a predetermined range, it is determined whether a second indication is received. When the second indication is received, the candidate real-world information of the corresponding candidate environment is displayed by the electronic device to replace the real-world information of the corresponding environment displayed in the electronic device.

A display system for real-world information in a virtual reality environment according to an embodiment of the present invention includes a display unit, a storage unit, and a processing unit. The storage unit includes one of the corresponding environment and the candidate reality information of the at least one candidate environment. The processing unit displays the reality information of the environment through the display unit. When receiving a first indication, the processing unit displays the candidate reality information of the corresponding candidate environment within a predetermined range in the real-world information corresponding to the environment, where the predetermined range is smaller than the display unit displays the corresponding environment A range of information. When the display unit displays the candidate reality information within a predetermined range, the processing unit judges Whether a second indication is received. When receiving the second indication, the processing unit displays the candidate reality information of the corresponding candidate environment through the display unit, instead of the real information of the corresponding environment displayed in the display unit.

The above method of the present invention can exist in a coded manner. When the code is loaded and executed by the machine, the machine becomes the means for practicing the invention.

The above described objects, features, and advantages of the invention will be apparent from the description and appended claims appended claims

100‧‧‧Driving information display system in virtual reality environment

110‧‧‧Display unit

120‧‧‧ storage unit

122‧‧‧Reality information

122a‧‧‧Deep information section

124‧‧‧Candidate reality information

130‧‧‧Processing unit

140‧‧‧Sensor unit

S310, S320, ..., S350‧‧‧ steps

400‧‧‧Electronic devices

EP‧‧‧ entry point

PR‧‧‧established range

S510, S520, ..., S570‧‧‧ steps

S610, S620, S630‧‧‧ steps

S710, S720, ..., S750‧‧ steps

1 is a schematic diagram showing a display system of real-world information in a virtual reality environment according to an embodiment of the present invention.

FIG. 2 is a schematic diagram showing a display system of real-world information in a virtual reality environment according to another embodiment of the present invention.

FIG. 3 is a flow chart showing a method for displaying the reality information in a virtual reality environment according to an embodiment of the present invention.

Figure 4A is a schematic diagram showing an environment in which the reality information is constructed in accordance with an embodiment of the present invention.

FIG. 4B is a schematic diagram showing an electronic device displaying an entry point including the environment information of the corresponding environment and the corresponding candidate environment according to an embodiment of the present invention.

Figure 4C is a schematic diagram showing an electronic device displaying candidate reality information within a predetermined range in accordance with an embodiment of the present invention.

Figure 4D is a schematic diagram showing an electronic device displaying candidate reality information in accordance with an embodiment of the present invention.

Figure 5 is a flow chart showing a method of displaying real-world information in a virtual reality environment according to another embodiment of the present invention.

Figure 6 is a flow chart showing a method of generating an acknowledgment signal in accordance with an embodiment of the present invention.

Figure 7 is a flow chart showing a method of displaying real-world information in a virtual reality environment according to another embodiment of the present invention.

FIG. 1 shows a display system of real-world information in a virtual reality environment according to an embodiment of the present invention. The display system of the reality information in the virtual reality environment according to the embodiment of the present invention is applicable to an electronic device such as a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Portable device.

The display system 100 for the reality information in the virtual reality environment according to the embodiment of the present invention includes a display unit 110, a storage unit 120, and a processing unit 130. The display unit 110 can display related materials such as images, interfaces, and/or materials. The storage unit 120 may store related data, such as one of the corresponding environments, the reality information 122, and one of the corresponding at least one candidate environment, the candidate reality information 124. It is noted that the environment information 122 can be used to construct a corresponding environment, and the candidate reality information 124 can be used to construct a corresponding candidate environment. It should be noted that in some embodiments, the reality information 122 or the candidate reality information 124 may be a graphic composed of at least one static image or at least one streaming image. It is to be noted that in some embodiments, the reality information 122 or the candidate reality information 124 may be composed of different orientation maps of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. It should be noted that in some embodiments, the reality information 122 may define an entry point to one of the candidate reality information 124 corresponding to the candidate environment. In other words, when the user views the reality information 122 through the electronic device, the user can switch to the candidate reality information 124 for viewing. The processing unit 130 can control the operations of the related software and hardware in the display system 100 of the real-world information in the virtual reality environment, and execute the display method of the real-world information in the virtual reality environment of the present case. It should be noted that in some embodiments, the display system 100 of the reality information in the virtual reality environment may have a network connection unit (not shown in FIG. 1). The network connection unit can be connected to a network such as a wired network, a telecommunications network, and a wireless network. The display system 100 for real-world information in the virtual reality environment can have a network access capability by means of the network connection unit. It is noted that in some embodiments, the reality information 122 and/or the candidate reality information 124 may be obtained by a network through the network connection unit.

2 is a view showing a reality in a virtual reality environment according to another embodiment of the present invention. Information display system. The display system of the reality information in the virtual reality environment according to the embodiment of the present invention is applicable to an electronic device such as a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Portable device.

The display system 100 for the reality information in the virtual reality environment according to the embodiment of the present invention includes a display unit 110, a storage unit 120, a sensing unit 140, and a processing unit 130. The display unit 110 can display related materials such as images, interfaces, and/or materials. The storage unit 120 may store related data, such as one of the corresponding environments, the reality information 122, and one of the corresponding at least one candidate environment, the candidate reality information 124. It is noted that the environment information 122 can be used to construct a corresponding environment, and the candidate reality information 124 can be used to construct a corresponding candidate environment. Similarly, in some embodiments, the reality information 122 or the candidate reality information 124 may be a graphic composed of at least one static image or at least one streaming image. It is to be noted that in some embodiments, the reality information 122 or the candidate reality information 124 may be composed of different orientation maps of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. It is noted that in some embodiments, the reality information 122 may define one of the candidate reality information 124 entry points for the candidate environment. In other words, when the user views the reality information 122 through the electronic device, the user can switch to the candidate reality information 124 for viewing. The sensing unit 140 can detect the posture of one of the electronic devices. It should be noted that in some embodiments, the gesture may include azimuth information of one of the electronic devices, an elevation angle or a depression angle of the electronic device, and/or a horizontal state of one of the electronic devices. It is to be noted that in some embodiments, the sensing unit 140 can be an Accelerometer, and/or a Gyro. It should be noted that the foregoing sensing unit is only an example of the present invention, and the present invention is not limited thereto. The processing unit 130 can control the operations of the related software and hardware in the display system 100 of the real-world information in the virtual reality environment, and execute the display method of the real-world information in the virtual reality environment of the present case. Similarly, in some embodiments, the display system 100 of the reality information in the virtual reality environment may have a network connection unit (not shown in FIG. 2). The network connection unit can be connected to a network such as a wired network, a telecommunications network, and a wireless network. The display system 100 for real-world information in the virtual reality environment can have a network access capability by means of the network connection unit. It is noted that in some embodiments, the reality information 122 and/or the candidate reality information 124 may be obtained by a network through the network connection unit.

Figure 3 is a diagram showing the reality information in a virtual reality environment according to an embodiment of the present invention. The display method. The method for displaying the reality information in the virtual reality environment according to the embodiment of the present invention is applicable to an electronic device such as a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Portable device.

First, in step S310, one of the corresponding environments is displayed through an electronic device. It is reminded that the user can cause the posture of the electronic device to change to view/browse the reality information corresponding to the environment. It is noted that the reality information may define an entry point of one of the at least one candidate environment candidate candidate information. It should be noted that, in some embodiments, the reality information of the corresponding environment may be a picture composed of at least one static image or at least one streaming image. It is reminded that in some embodiments, the reality information may consist of different orientations of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. In step S320, it is determined whether one of the corresponding entry points is triggered. It should be noted that in some embodiments, the user can tap the electronic device to cause the electronic device to generate a specific vibration to generate a trigger corresponding to the entry point. In some embodiments, the user can press a physical or virtual button of the electronic device to cause the electronic device to generate a trigger corresponding to the entry point. In some embodiments, the user can cause the gesture of the electronic device to face or generally face the direction of the corresponding entry point in the electronic device for a specific period of time to cause the electronic device to generate a trigger for the corresponding entry point. In some embodiments, the electronic device can detect an object, such as a user's hand, through an image capturing unit, and determine whether the object overlaps with an entry point displayed in the electronic device (whether the user selects/catches through the hand) Take the entry point). When the object overlaps with the entry point displayed in the electronic device, the electronic device can generate a trigger corresponding to the entry point. It should be noted that the foregoing method of generating a trigger for the corresponding entry point is merely an example of the present case, and the present invention is not limited thereto. When the trigger of the corresponding entry point is not received (NO in step S320), the flow returns to step S310. When the trigger of the corresponding entry point is received (YES in step S320), in step S330, the candidate reality information is displayed within a predetermined range in the reality information of the corresponding environment. It is noted that the predetermined range is smaller than the range of the real information of the electronic device corresponding to the environment. In some cases, the user can preview the corresponding candidate environment through the candidate reality information displayed in the predetermined range. In step S340, it is determined whether a confirmation signal corresponding to one of the candidate reality information is received. Similarly, in some embodiments, the user can generate an acknowledgment signal by tapping the electronic device to cause the electronic device to generate a particular shock. In some embodiments, the user can press one of the physical or virtual buttons of the electronic device to The electronic device is caused to generate an acknowledgment signal. In some embodiments, the user may cause the orientation of the electronic device to face or generally face the direction of the corresponding candidate reality information in the electronic device for a specific period of time to cause the electronic device to generate an acknowledgment signal. In some embodiments, the electronic device can detect an object, such as a user's hand, through an image capturing unit, and determine whether the object overlaps with the candidate reality information displayed in the electronic device (whether the user selects the hand through the hand) / Grab candidate real-world information). The electronic device may generate an acknowledgment signal when the object overlaps with the candidate reality information displayed in the electronic device. In some embodiments, when the candidate reality information is displayed within a predetermined range, an acknowledgment signal is generated if no indication is received within a predetermined period. It should be noted that the foregoing method of generating the confirmation signal is merely an example of the present invention, and the present invention is not limited thereto. When the confirmation signal is not received (NO in step S340), the flow returns to step S310. It should be noted that in some embodiments, when the confirmation signal of the corresponding candidate reality information is not received, the candidate reality information displayed within the predetermined range of the electronic device will be cancelled. When the acknowledgment signal is received (YES in step S340), in step S350, the candidate real-world information of the corresponding candidate environment is displayed by the electronic device to replace the real-world information of the corresponding environment originally displayed in the electronic device.

4A to 4D are diagrams showing examples of display of the reality information in the virtual reality environment according to the embodiment of the present invention. An environment can be constructed based on the reality information 122, as shown in FIG. 4A. The display unit of the electronic device 400 can display a portion 122a of the real information 122. The real information portion 122a displayed in the display unit can be adjusted according to the field of view of the electronic device 400. It is noted that the field of view of the electronic device can be determined according to the attitude of the electronic device. As previously mentioned, in some embodiments, the gesture may include azimuth information of one of the electronic devices, an elevation angle or a depression angle of the electronic device, and/or a horizontal state of one of the electronic devices. The real information portion 122a displayed in the electronic device 400 may include one of the candidate real environment information 124 of the candidate environment to enter the point EP, as shown in FIG. 4B. When receiving the trigger of the corresponding entry point EP, the electronic device 400 may display the candidate reality information 124 in a predetermined range PR in the real-world information 122 (reality information portion 122a) of the corresponding environment, such as Figure 4C shows. In some cases, candidate reality information 124 is displayed in an enlarged manner in the context information 122 (reality information portion 122a) corresponding to the environment. The user can preview the candidate reality information 124 by zooming in on the displayed candidate reality information 124. When the confirmation signal corresponding to the candidate reality information 124 is received, the display unit of the electronic device 400 may display the candidate reality information 124 or a part thereof instead of the original The real information 122 displayed in the display unit of the electronic device 400 is as shown in FIG. 4D.

Figure 5 is a diagram showing a method of displaying real-world information in a virtual reality environment according to another embodiment of the present invention. The method for displaying the reality information in the virtual reality environment according to the embodiment of the present invention is applicable to an electronic device such as a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Portable device.

First, in step S510, one of the corresponding environments is displayed through an electronic device. It is reminded that the user can cause the posture of the electronic device to change to view/browse the reality information corresponding to the environment. It is noted that the reality information may define an entry point of one of the at least one candidate environment candidate candidate information. Similarly, in some embodiments, the reality information of the corresponding environment may be a picture composed of at least one still image or at least one stream of images. It is reminded that in some embodiments, the reality information may consist of different orientations of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. In step S520, it is determined whether one of the corresponding entry points is triggered. Similarly, in some embodiments, the user can tap the electronic device to cause the electronic device to generate a specific vibration to generate a trigger corresponding to the entry point. In some embodiments, the user can press a physical or virtual button of the electronic device to cause the electronic device to generate a trigger corresponding to the entry point. In some embodiments, the user can cause the gesture of the electronic device to face or generally face the direction of the corresponding entry point in the electronic device for a specific period of time to cause the electronic device to generate a trigger for the corresponding entry point. In some embodiments, the electronic device can detect an object, such as a user's hand, through an image capturing unit, and determine whether the object overlaps with an entry point displayed in the electronic device (whether the user selects/catches through the hand) Take the entry point). When the object overlaps with the entry point displayed in the electronic device, the electronic device can generate a trigger corresponding to the entry point. It should be noted that the foregoing method of generating a trigger for the corresponding entry point is merely an example of the present case, and the present invention is not limited thereto. When the trigger of the corresponding entry point is not received (NO at step S520), the flow returns to step S510. When the trigger of the corresponding entry point is received (YES in step S520), in step S530, the candidate reality information is displayed within a predetermined range in the reality information of the corresponding environment. It is noted that the predetermined range is smaller than the range of the real information of the electronic device corresponding to the environment. In some cases, the user can preview the corresponding candidate environment through the candidate reality information displayed in the predetermined range. After the candidate reality information is displayed within the predetermined range, as in step S540, a time is accumulated, and in step S550, it is determined whether the accumulated time is equal to An established time. When the accumulated time is not equal to the predetermined time (NO in step S550), the flow returns to step S540. When the accumulated time is equal to the predetermined time (YES in step S550), in step S560, it is determined whether a confirmation signal corresponding to one of the candidate reality information is received. Similarly, in some embodiments, the user can generate an acknowledgment signal by tapping the electronic device to cause the electronic device to generate a particular shock. In some embodiments, the user can cause the electronic device to generate an acknowledgment signal by pressing one of the physical or virtual buttons of the electronic device. In some embodiments, the user may cause the orientation of the electronic device to face or generally face the direction of the corresponding candidate reality information in the electronic device for a specific period of time to cause the electronic device to generate an acknowledgment signal. In some embodiments, the electronic device can detect an object, such as a user's hand, through an image capturing unit, and determine whether the object overlaps with the candidate reality information displayed in the electronic device (whether the user selects the hand through the hand) / Grab candidate real-world information). The electronic device may generate an acknowledgment signal when the object overlaps with the candidate reality information displayed in the electronic device. In some embodiments, when the candidate reality information is displayed within a predetermined range, an acknowledgment signal is generated if no indication is received within a predetermined period. It should be noted that the foregoing method of generating the confirmation signal is merely an example of the present invention, and the present invention is not limited thereto. When the confirmation signal is not received (NO in step S560), the flow returns to step S510. It should be noted that in some embodiments, when the confirmation signal of the corresponding candidate reality information is not received, the candidate reality information displayed within the predetermined range of the electronic device will be cancelled. When the acknowledgment signal is received (YES in step S560), in step S570, the candidate real-world information of the corresponding candidate environment is displayed by the electronic device to replace the real-world information of the corresponding environment originally displayed in the electronic device.

As stated previously, the invention is not limited to any method of generating an acknowledgment signal.

Figure 6 shows a method of generating an acknowledgment signal in accordance with an embodiment of the present invention. When the electronic device displays the candidate reality information within a predetermined range, in step S610, the at least one sensing unit detects the posture of the electronic device. Similarly, in some embodiments, the gesture may include azimuth information of one of the electronic devices, an elevation angle or a depression angle of the electronic device, and/or a horizontal state of one of the electronic devices. It is noted that in some embodiments, the sensing unit can be an acceleration sensor, and/or a gyroscope. It should be noted that the foregoing sensing unit is only an example of the present invention, and the present invention is not limited thereto. Next, in step S620, it is determined whether the posture of the electronic device is oriented toward or substantially toward the direction of the candidate reality information of the corresponding candidate environment in the electronic device. When the posture of the electronic device is not toward or substantially toward the candidate reality of the corresponding candidate environment in the electronic device When the direction of the information is no (NO in step S620), the flow ends. In other words, an acknowledgment signal is not generated when the gesture of the electronic device is not toward or substantially toward the direction of the candidate reality information of the corresponding candidate environment in the electronic device. When the attitude of the electronic device is toward or substantially toward the direction of the candidate reality information of the corresponding candidate environment in the electronic device (YES in step S620), in step S630, an acknowledgment signal is generated.

It is reminded that, in some embodiments, after the electronic device displays the candidate reality information within a predetermined range, it may accumulate a time and determine whether the accumulated time is equal to a predetermined time. When the accumulated time is equal to the predetermined time, it is determined whether the posture of the electronic device is oriented toward or substantially toward the direction of the candidate reality information of the corresponding candidate environment in the electronic device. Again, the invention is not limited to any method of generating an acknowledgment signal.

Figure 7 is a diagram showing a method of displaying real-world information in a virtual reality environment according to another embodiment of the present invention. The method for displaying the reality information in the virtual reality environment according to the embodiment of the present invention is applicable to an electronic device such as a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Portable device.

First, in step S710, one of the corresponding environments is displayed through an electronic device. It is reminded that the user can cause the posture of the electronic device to change to view/browse the reality information corresponding to the environment. It should be noted that, in some embodiments, the reality information of the corresponding environment may be a picture composed of at least one static image or at least one streaming image. It is reminded that in some embodiments, the reality information may consist of different orientations of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. In step S720, it is determined whether a first indication is received. Similarly, in some embodiments, the user can generate a first indication by tapping the electronic device to cause the electronic device to generate a particular shock. In some embodiments, the user can cause the electronic device to generate the first indication by pressing one of the physical or virtual buttons of the electronic device. In some embodiments, the user may cause the orientation of the electronic device to face or generally face a particular location in the electronic device, such as the bottom of the environment, for a specific period of time to cause the electronic device to generate a first indication. In some embodiments, the electronic device can detect an object, such as a user's foot, through an image capturing unit, and determine whether the object overlaps with a specific position in the electronic device such that the bottom of the environment. The electronic device can generate a first indication when the object overlaps with a particular location in the electronic device. It should be noted that the foregoing method for generating the first indication is only an example of the present case, and the present invention Not limited to this. When the first indication has not been received (NO in step S720), the flow returns to step S710. When the first indication is received (YES in step S720), in step S730, the candidate reality information is displayed within a predetermined range in the reality information of the corresponding environment. It is noted that the predetermined range is smaller than the range of the real information of the electronic device corresponding to the environment. In some cases, the user can preview the corresponding candidate environment through the candidate reality information displayed in the predetermined range. In step S740, it is determined whether a second indication is received. Similarly, in some embodiments, the user can generate a second indication by tapping the electronic device to cause the electronic device to generate a particular shock. In some embodiments, the user can press a physical or virtual button of the electronic device to cause the electronic device to generate a second indication. In some embodiments, the user may cause the orientation of the electronic device to face or generally face the direction of the corresponding candidate reality information in the electronic device for a specific period of time to cause the electronic device to generate a second indication. In some embodiments, the electronic device can detect an object, such as a user's hand, through an image capturing unit, and determine whether the object overlaps with the candidate reality information displayed in the electronic device (whether the user selects the hand through the hand) / Grab candidate real-world information). The electronic device may generate a second indication when the object overlaps with the candidate reality information displayed in the electronic device. In some embodiments, when the candidate reality information is displayed within a predetermined range, if no indication is received within a predetermined period, a second indication is generated. It should be noted that the foregoing method of generating the second indication is merely an example of the present invention, and the present invention is not limited thereto. When the second indication has not been received (NO at step S740), the flow returns to step S710. It should be noted that in some embodiments, when the second indication is not received, the candidate reality information displayed within the predetermined range of the electronic device will be cancelled. When the second indication is received (YES in step S740), in step S750, candidate real-world information of the corresponding candidate environment is displayed by the electronic device to replace the real-world information of the corresponding environment originally displayed in the electronic device. Similarly, in some embodiments, when the candidate reality information is displayed within a predetermined range, a time may be accumulated, and when the accumulated time is equal to the predetermined time, it is determined whether the second indication is received.

Therefore, through the display method and system of the real-world information in the virtual reality environment of the case, a two-stage switching operation can be provided when the real-world information of the different environments is viewed, so as to provide the user with a preview of the real-world information and confirmation. To provide a flexible and efficient switching mechanism to further improve the user experience and improve the performance of related systems.

The method of the present invention, or a specific type or part thereof, may be in the form of a code State exists. The code may be included in a physical medium such as a floppy disk, a CD, a hard disk, or any other machine readable (such as computer readable) storage medium, or is not limited to an external computer program product, wherein When the code is loaded and executed by a machine, such as a computer, the machine becomes a device for participating in the present invention. The code can also be transmitted via some transmission medium, such as a wire or cable, fiber optics, or any transmission type, where the machine becomes part of the program when it is received, loaded, and executed by a machine, such as a computer. Invented device. When implemented in a general purpose processing unit, the code combination processing unit provides a unique means of operation similar to application specific logic.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

Claims (11)

A method for displaying a real-world information in a virtual reality environment, which is applicable to an electronic device, comprising the steps of: providing a real-world information of a corresponding environment, wherein the real-world information defines a candidate real-world information corresponding to at least one candidate environment. One of the entry points; displaying the real-world information through the electronic device; and when the receiving one of the corresponding entry points is triggered, displaying the candidate real-world information within a predetermined range in the real-world information corresponding to the environment And previewing the candidate environment, wherein the predetermined range is smaller than a range of the real information that the electronic device displays the corresponding environment; determining whether a confirmation signal corresponding to the candidate reality information is received; and when the corresponding candidate is received And the real-time information corresponding to the candidate environment is displayed in the range by the electronic device to replace the real-world information of the corresponding environment displayed in the electronic device. According to the method for displaying the reality information in the virtual reality environment according to the first application of the patent scope, the method further includes the following steps: after the electronic device displays the candidate reality information within the predetermined range, accumulating a time; Whether the time is equal to a predetermined time; and when the accumulated time is equal to the predetermined time, determining whether the acknowledgement signal corresponding to the candidate reality information is received. According to the method for displaying the reality information in the virtual reality environment of claim 1, the method further includes canceling the predetermined range of the electronic device when the confirmation signal corresponding to the candidate reality information is not received. The candidate reality information is displayed. According to the method for displaying the reality information in the virtual reality environment of claim 1, the method further includes the following steps: when the electronic device displays the candidate reality information within the predetermined range, using at least one sensing unit Detecting a posture of the electronic device; determining whether the posture of the electronic device is oriented toward or substantially toward a direction of the candidate reality information of the candidate environment in the electronic device; and when the posture of the electronic device is oriented or The acknowledgment signal is generated when the direction of the candidate reality information corresponding to the candidate environment in the electronic device is generally oriented. According to the method for displaying the reality information in the virtual reality environment of claim 4, the method further includes: when the gesture of the electronic device is not toward or substantially facing the candidate reality information of the candidate environment in the electronic device; This confirmation signal is not generated when the direction is in progress. According to the method for displaying the reality information in the virtual reality environment of claim 4, the method further includes the following steps: after the electronic device displays the candidate reality information within the predetermined range, accumulating a time; Whether the time is equal to a predetermined time; When the accumulated time is equal to the predetermined time, it is determined whether the posture of the electronic device is oriented or substantially oriented toward the direction of the candidate reality information of the corresponding candidate environment in the electronic device. A method for displaying a real-world information in a virtual reality environment, which is applicable to an electronic device, comprising the steps of: displaying, by the electronic device, one of the corresponding environments; and receiving a first indication, corresponding to the environment; In the real information, the candidate reality information of the at least one candidate environment is displayed in a predetermined range to preview the candidate environment, wherein the predetermined range is smaller than the real information of the electronic device corresponding to the environment. a range; when the electronic device displays the candidate reality information within the predetermined range, determining whether a second indication is received; and when receiving the second indication, displaying the range in the range through the electronic device The candidate real-world information of the candidate environment is replaced by the real-world information of the corresponding environment originally displayed in the electronic device. A display system for real-world information in a virtual reality environment, which is applicable to an electronic device, comprising: a display unit; a storage unit, including one of the corresponding environments, wherein the real-world information defines at least one candidate environment One of the candidate reality information entry points; and a processing unit for displaying the real-world information through the display unit, and when the receiving one of the corresponding entry points is triggered, in the real-world information corresponding to the environment, Displaying the candidate reality information within a predetermined range to preview the a candidate environment, wherein the predetermined range is smaller than a range of the real-world information corresponding to the environment, the electronic device determines whether an acknowledgement signal corresponding to the candidate reality information is received, and when the candidate real-world information is received In the confirmation signal, the candidate real-world information corresponding to the candidate environment is displayed in the range through the display unit, instead of the real-world information of the corresponding environment displayed in the display unit. A display system for real-world information in a virtual reality environment, which is applicable to an electronic device, comprising: a display unit; a storage unit, including one of the corresponding environment and one candidate environment of the at least one candidate environment And a processing unit configured to display the real-world information through the display unit, and when receiving a first indication, in the real-world information corresponding to the environment, the candidate corresponding to the candidate environment is within a predetermined range The reality information is displayed to preview the candidate environment, wherein the predetermined range is smaller than the range of the real information displayed by the electronic device corresponding to the environment, and the candidate unit displays the candidate reality information within the predetermined range. Determining whether a second indication is received, and when the second indication is received, displaying, by the display unit, the candidate reality information corresponding to the candidate environment in the range, instead of displaying the information in the display unit The real-world information corresponding to the environment. A computer program product for loading and executing a virtual reality information display method in a virtual reality environment, the computer program product comprising: a first code for displaying an environment information of a corresponding environment through an electronic device, wherein the reality information defines one entry point of candidate reality information corresponding to at least one candidate environment; a second code, When the one of the corresponding entry points is triggered, the candidate reality information is displayed within a predetermined range in the real-world information of the corresponding environment to preview the candidate environment, wherein the predetermined range is smaller than the The electronic device displays a range of the real-world information corresponding to the environment; and a third code for displaying, by the electronic device, the corresponding information in the range when the confirmation signal corresponding to the candidate real-world information is received The candidate real-world information of the candidate environment to replace the real-world information of the corresponding environment originally displayed in the electronic device. A computer program product for loading and executing a virtual reality information display method in a virtual reality environment, the computer program product comprising: a first code for displaying an environment through an electronic device a second piece of code for displaying a candidate reality information in a corresponding candidate environment within a predetermined range when the first instruction is received, in the real world information corresponding to the environment And previewing the candidate environment, wherein the predetermined range is smaller than a range of the real information that the electronic device displays the corresponding environment; and a third code is used to select the candidate when the electronic device is within the predetermined range When the environment information is displayed and a second indication is received, the candidate device corresponding to the candidate environment is displayed in the range by the electronic device Information to replace the real-world information of the corresponding environment originally displayed in the electronic device.