TWI596568B - Methods and systems for presenting data in a virtual environment, and related computer program products - Google Patents

Description

Data presentation method and system in virtual environment, and related Computer program product

The present invention relates to the management and application of a virtual reality, and particularly relates to a method and system for presenting data in a virtual environment.

In recent years, portable devices, such as smart phones or notebook computers, have become more sophisticated and powerful. For example, a portable device can have network connectivity. Users can use the portable device to connect to the Internet anytime, anywhere to browse the Internet. Thanks to the convenience of these devices and their functions, these devices have become one of the must-have items for modern people, and they are frequently used in life anytime and anywhere.

On the other hand, Virtual Reality technology has been widely used in teaching, environmental navigation, and flight training. Virtual reality is the use of 3D technology to simulate a 3D virtual environment. Users can use electronic devices, such as computers or portable devices, to interact with virtual objects in the environment. Generally speaking, the user can view the actual information of the corresponding environment through a screen or wearing a specific device.

In general, the method of establishing the real-world information can be rotated at a fixed position by taking a camera mounted on a circle of Jingyuntai, and taking multiple photos. These photos can be image processing operations using an image seaming software to generate realistic information about the environment. Conventionally, the ground (bottom) and/or sky (top) of an environment cannot be captured. Traditionally, the ground and/or sky of one of the corresponding real-world information is displayed in a specific pattern, such as a representative image of a business or environment. These representative images often cause a sudden feeling when the user views the environment. In addition, the actual information of the corresponding environment must be established in advance. In other words, the virtual environment viewed by the user is a static environment, and the user can only interact with the environment defined in advance. Users are not aware of the dynamics of this environment.

Therefore, if the ground and/or sky in the virtual environment can be properly handled, it will provide users with a more integrated feeling. In addition, if the dynamic information of the corresponding environment is provided to the users of the viewing environment, the application of the virtual reality can be improved.

In view of this, the present invention provides a data presentation method and system in a virtual environment.

A data presentation method in a virtual environment according to an embodiment of the present invention. Firstly, a real-world information is provided, and an environment of the corresponding reality information is displayed through one of the display units of the electronic device according to the reality information. Next, at least one option is presented at the bottom or at the top of one of the environments.

A data presentation system in a virtual environment according to an embodiment of the present invention includes a display unit, a storage unit, and a processing unit. The storage unit includes a real-world information. The processing unit displays an environment of the corresponding reality information through the display unit according to the reality information, and presents at least one option at the bottom or a top of one of the environments.

In some embodiments, the at least one option can be determined based on one of the environment viewing states. In some embodiments, the viewing state may include a particular location being viewed by the respective environment, a particular angle, and/or a particular distance.

In some embodiments, one of the specific ones of the at least one of the options may be triggered and the job corresponding to the particular option may be executed in accordance with the trigger. In some embodiments, at least one image may be captured by an image capturing unit, and whether a specific object in the at least one image generates a specific motion is determined. When a particular object produces a particular action, a trigger is generated for that particular option. In some embodiments, the at least one option and the particular item can be displayed through the display unit. When the position of a particular object overlaps with the location of a particular option, and a particular object produces a particular action, a trigger for the particular option is generated.

In some embodiments, when a material is received during the viewing of the environment, a virtual object is dynamically generated in the environment to present the material.

A data presentation method in a virtual environment according to an embodiment of the present invention. Firstly, a real-world information is provided, and an environment of the corresponding reality information is displayed through one of the display units of the electronic device according to the reality information. Then, when a material is received during the inspection of the environment, a virtual object is dynamically generated in the environment to present the data.

A data presentation system in a virtual environment according to an embodiment of the present invention includes a display unit, a storage unit, and a processing unit. The storage unit includes a real-world information. The processing unit displays an environment of the corresponding reality information through the display unit according to the reality information. When a material is received during the inspection of the environment, the processing unit dynamically generates a virtual object in the environment for presenting the data.

The effect of the data presentation method and system in the virtual environment of the present invention can dynamically present data/options in a virtual reality environment, thereby increasing the applicability of the virtual reality.

The above method of the present invention can exist in a coded manner. When the code is loaded and executed by the machine, the machine becomes the means for practicing the invention.

The above described objects, features, and advantages of the invention will be apparent from the description and appended claims appended claims

100‧‧‧Data presentation system in virtual environment

110‧‧‧Display unit

120‧‧‧ storage unit

122‧‧‧Reality information

130‧‧‧Processing unit

200‧‧‧Environmental Information Architecture Environment

210‧‧‧The bottom of the environment

220‧‧‧Virtual Data Cabinet

D1, D2, ..., D8‧‧ ‧ cells

S310, S320, S330‧‧‧ steps

400‧‧‧Option interface

S1, S2, ..., S7‧‧‧ options

S610, S620, S630, S640‧‧‧ steps

S710, S720‧‧‧ steps

S810, S820, S830‧‧ steps

S910, S920, ..., S950‧‧ steps

S1010, S1020, S1030, S1040‧‧‧ steps

V1, V2‧‧‧ virtual objects

1 is a schematic diagram showing a data presentation system in a virtual environment in accordance with an embodiment of the present invention.

Figure 2 is a schematic diagram showing an environment in which the reality information is constructed in accordance with an embodiment of the present invention.

Figure 3 is a flow chart showing a method of presenting data in a virtual environment in accordance with an embodiment of the present invention.

Figure 4 is a schematic diagram showing an example of an option interface in accordance with an embodiment of the present invention.

Figure 5 is a schematic diagram showing an example of an environment in which an option interface is presented at the bottom in accordance with an embodiment of the present invention.

Figure 6 is a flow chart showing a method of presenting data in a virtual environment in accordance with another embodiment of the present invention.

Figure 7 is a flow chart showing a method of data management in a virtual environment in accordance with an embodiment of the present invention.

Figure 8 is a flow chart showing the trigger generation of corresponding options in accordance with an embodiment of the present invention. law.

Figure 9 is a flow chart showing a method for generating a trigger of a corresponding option according to another embodiment of the present invention.

Figure 10 is a flow chart showing a method of presenting data in a virtual environment in accordance with another embodiment of the present invention.

Figure 11 is a diagram showing an example of data presentation in a virtual environment in accordance with an embodiment of the present invention.

Figure 12 is a schematic diagram showing another example of data presentation in a virtual environment in accordance with an embodiment of the present invention.

Figure 1 shows a data presentation system in a virtual environment in accordance with an embodiment of the present invention. The data presentation system in the virtual environment according to the embodiment of the present invention is applicable to an electronic device such as a computer or a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Device.

The data presentation system 100 in the virtual environment according to the embodiment of the present invention includes at least one display unit 110, a storage unit 120, and a processing unit 130. The display unit 110 can display related materials such as images, interfaces, and/or materials. The storage unit 120 can store related information, such as a real information 122. The use of the reality information 122 can construct a corresponding environment, such as the environment 200 shown in FIG. It should be noted that in some embodiments, the real environment information 122 of the corresponding environment may be a graphic composed of at least one static image or at least one streaming image. It is to be noted that in some embodiments, the reality information 122 may be composed of different orientation maps of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. Note that in some cases, the bottom and/or top of the environment cannot be captured. In the example of Figure 2, the bottom 210 of the environment 200 can be empty or a black screen. The processing unit 130 can control the operations of related software and hardware in the data presentation system 100 in the virtual environment, and execute the data presentation method in the virtual environment of the present case.

It is worth noting that in some embodiments, data presentation in a virtual environment The system 100 can include at least one sensing unit (not shown in FIG. 1) for detecting a gesture of the electronic device. It is noted that in some embodiments, the gesture may include azimuth information of one of the electronic devices, an elevation angle or a depression angle of the electronic device, and/or a horizontal state of one of the electronic devices. It is to be noted that in some embodiments, the sensing unit 130 can be an Accelerometer, and/or a Gyro. It should be noted that the foregoing sensing unit is only an example of the present invention, and the present invention is not limited thereto. The pose of the electronic device can determine a portion of the environment for presentation in display unit 110. Additionally, in some embodiments, the data presentation system 100 in a virtual environment can have a network connection unit (not shown in FIG. 1). The network connection unit can be connected to a network such as a wired network, a telecommunications network, and a wireless network. With the network connection unit, the data presentation system 100 in the virtual environment can have a network access capability. It is noted that in some embodiments, the reality information 122 may be obtained by a network through the network connection unit.

Figure 3 shows a method of presenting data in a virtual environment in accordance with an embodiment of the present invention. The data presentation method in the virtual environment according to the embodiment of the present invention is applicable to an electronic device, such as a computer or a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Device.

First, as step S310, a real-world information is provided. It should be noted that in some embodiments, the reality information may be a picture composed of at least one still image or at least one stream of images. It is reminded that in some embodiments, the reality information may consist of different orientations of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. Then, in step S320, the environment of one of the corresponding reality information is displayed by the display unit of the electronic device according to the reality information. Thereafter, in step S330, at least one option is presented at the bottom and/or a top of one of the environments. It must be noted that in some embodiments, only one portion of the environment will be displayed in the display unit, and the attitude of the electronic device can determine the portion. Therefore, when the attitude of the electronic device is facing downward, such as when viewing the bottom of the environment, the at least one option is presented in the display unit. This option can be used to make related settings and/or controls.

It should be noted that in some embodiments, when a material is received during the environment being viewed, a virtual object can be dynamically generated in the environment to present the material. In some embodiments, the aforementioned data can be received through a network routing server.

Figure 4 shows an example of an option interface in accordance with an embodiment of the present invention. As shown in FIG. 4, the option interface 400 can include a plurality of options S1~S7. As mentioned earlier, the options can be used to make related settings and/or controls. In some embodiments, the options may be a function of a respective content control dashboard, a photo, a camera, a departure, a particular virtual environment, or a particular interface. It should be noted that the foregoing options are merely examples of the present invention, and the present invention is not limited thereto. Options can be designed for different needs and applications. Alternatively, the option interface 400 can be presented at the bottom 210 of the environment 200, as shown in FIG. Notably, in some embodiments, the option interface 400 can be raised slightly to the bottom 210.

Figure 6 shows a method of presenting data in a virtual environment in accordance with another embodiment of the present invention. The data presentation method in the virtual environment according to the embodiment of the present invention is applicable to an electronic device, such as a computer or a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Device. In this embodiment, the options can be determined dynamically.

First, in step S610, a real-world information is provided. Similarly, in some embodiments, the reality information may be a map composed of at least one still image or at least one stream of images. It is reminded that in some embodiments, the reality information may consist of different orientations of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. Then, in step S620, the environment of one of the corresponding reality information is displayed by one of the display units of the electronic device according to the reality information. Thereafter, in step S630, at least one option is determined according to one of the environment viewing states. It should be noted that in some embodiments, the viewing state may include a particular location in which the corresponding environment is viewed, such as a particular point in the environment, a particular angle, and/or a particular distance. In addition, in some embodiments, the at least one option may be determined according to one of an environment view state and an attitude of the electronic device. In step S640, at least one of the decisions is presented at the bottom of one of the environments and/or at the top. Similarly, in some embodiments, only a portion of the environment will be displayed in the display unit, and the pose of the electronic device can determine the portion. Therefore, when the attitude of the electronic device is facing downward, such as when viewing the bottom of the environment, the at least one option is presented in the display unit.

As mentioned earlier, the options presented in the environment can be used to make related settings and/or controls. Figure 7 shows a data management method in a virtual environment in accordance with an embodiment of the present invention. First, in step S710, it is determined whether one of the corresponding one of the specific options is received. If not received Trigger (NO in step S710), the determination in step S710 is continued. If a trigger for a corresponding specific option is received (YES in step S710), in step S720, a job corresponding to one of the corresponding specific options is triggered accordingly. For example, a particular option is a camera feature. An image preview and/or capture operation can be performed in a virtual reality when a trigger for the corresponding camera function is received.

The reminder is that the trigger method of the corresponding option can be changed. For example, in some embodiments, the user can click the location of the corresponding specific option through the touch screen of the electronic device to complete the triggering of the specific option.

Figure 8 shows a method of trigger generation of corresponding options in accordance with an embodiment of the present invention. In step S810, at least one image is captured by an image capturing unit of the electronic device, and in step S820, a specific object in the at least one image is detected, and it is determined whether the specific object generates a specific action. In some embodiments, a particular item can be a user's arm, finger, or foot. When the specific object does not generate a specific action (NO in step S820), the flow returns to step S810. When a specific object generates a specific action (YES in step S820), in step S830, a trigger corresponding to the specific option is generated. For example, when it is detected that the user's foot makes a lame action, it indicates that the specific option is to be selected.

Figure 9 shows a method of trigger generation of corresponding options in accordance with an embodiment of the present invention. In step S910, at least one image is captured by one of the image capturing units of the electronic device, and in step S920, one of the at least one image is detected, and at least one option and the specific object are displayed on the display unit. Similarly, in some embodiments, a particular item can be a user's arm, finger, or foot. In step S930, it is determined whether the specific object generates a specific action. When the specific object does not generate a specific action (NO in step S930), the flow returns to step S910. When a specific object generates a specific action (YES in step S930), as in step S940, it is determined whether the position of the specific object overlaps with the position of one of the options. When the position of the specific object does not overlap with the position of the specific option (NO in step S940), the flow returns to step S910. When the position of the specific item overlaps with the position of the specific option (YES in step S940), in step S950, a trigger corresponding to the specific option is generated. For example, when the attitude of the electronic device is facing downward, such as when viewing the bottom of the environment, an option interface with multiple options is displayed in the display unit. At the same time, the user's foot will also be displayed in the display unit. When the user uses the foot to slap on a specific option in the option interface, it indicates that this particular option is to be selected.

Figure 10 shows data in a virtual environment in accordance with another embodiment of the present invention Presentation method. The data presentation method in the virtual environment according to the embodiment of the present invention is applicable to an electronic device, such as a computer or a camera, a mobile phone, a smart phone, a personal digital assistant, a global positioning system, a wearable device, and a notebook computer. Device.

First, as step S1010, a real-world information is provided. Similarly, in some embodiments, the reality information may be a map composed of at least one still image or at least one stream of images. It is reminded that in some embodiments, the reality information may consist of different orientations of an environment. Additionally, in some embodiments, the still image or streaming image may utilize image stitching software to generate real-world information. Then, in step S1020, the environment of one of the corresponding reality information is displayed by the display unit of the electronic device according to the reality information. In step S1030, it is determined whether a piece of data has been received. It should be noted that, in some embodiments, the foregoing information may be received by a server through a network route during the period in which the environment is viewed. In some embodiments, the aforementioned information may be pre-attached to the truth information. When the material has not been received (NO in step S1030), the flow returns to step S1020. When the data is received (Yes in step S1030), in step S1040, a virtual object is dynamically generated in the environment for presenting the material.

Figure 11 shows an example of data presentation in a virtual environment in accordance with an embodiment of the present invention. In this example, a virtual data cabinet 220 can be displayed in the environment 200, wherein each of the cells (D1~D8) in the virtual data cabinet 220 respectively correspond to different data options. Figure 12 shows another example of data presentation in a virtual environment in accordance with an embodiment of the present invention. In this example, if a message is received that requires the user to make a selection, two virtual objects (V1 and V2) can be generated in the environment to present different options, such as "yes" or "no". In some embodiments, the virtual object may be elongated by the bottom 210 of the environment 200. It must be reminded that the shape of the virtual object and its position displayed in the environment can be designed according to different applications and needs, and the present invention is not limited thereto. Similarly, specific options in the environment can be triggered to perform the corresponding job.

Therefore, the data presentation method and system in the virtual environment of the present case can dynamically present data/options in the virtual reality environment, thereby increasing the applicability of the virtual reality and enhancing the user's feeling of integrating into the virtual reality.

The method of the invention, or a particular type or portion thereof, may exist in the form of a code. The code can be included in physical media, such as floppy disks, CDs, hard disks, or any other machine readable (such as computer readable) storage media, or not limited to external computer programs. A product in which the program becomes a device for participating in the present invention when the code is loaded and executed by a machine, such as a computer. The code can also be transmitted via some transmission medium, such as a wire or cable, fiber optics, or any transmission type, where the machine becomes part of the program when it is received, loaded, and executed by a machine, such as a computer. Invented device. When implemented in a general purpose processing unit, the code combination processing unit provides a unique means of operation similar to application specific logic.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

S310, S320, S330‧‧‧ steps

Claims (10)

A data presentation method in a virtual environment, which is applicable to an electronic device, comprising the steps of: providing a real-world information; displaying, by the display unit of the electronic device, an environment corresponding to the real-world information according to the real-world information; An option interface is presented at the bottom or a top of the environment; determining at least one option according to the view state of the environment, wherein the view state includes a specific location, a specific angle, or a specific distance corresponding to the environment being viewed; The at least one option of the decision is displayed in the option interface. According to the data presentation method in the virtual environment of claim 1, the method further includes receiving a trigger corresponding to one of the at least one of the at least one option, and performing an operation corresponding to the specific option according to the trigger. According to the data presentation method in the virtual environment of claim 2, the method further includes: capturing, by the image capturing unit of the electronic device, at least one image, and determining whether a specific object in the at least one image generates a specific action When the specific object generates the specific action, the trigger corresponding to the specific option is generated. According to the data presentation method in the virtual environment of claim 3, the method further includes displaying, by the display unit, the at least one option and the specific object, and when the location of the specific object overlaps with the location of the specific option, and the specific When the object generates the particular action, the trigger corresponding to the particular option is generated. According to the data presentation method in the virtual environment of claim 1, the method further includes the following steps: receiving a data during the period in which the environment is viewed; dynamically generating a virtual object in the environment to present the data. A data presentation method in a virtual environment, which is applicable to an electronic device, comprising the steps of: providing a real-world information; displaying, according to the real-world information, an environment corresponding to the real-world information through a display unit of the electronic device; During the period in which the environment is inspected, it is determined whether a data is received, wherein the data is received through a network routing server; and when the data is received through the network, a virtual object is dynamically generated in the environment, and Presenting the material in the virtual object. A data presentation system in a virtual environment, which is applicable to an electronic device, comprising: a display unit; a storage unit including one of the environment information; and a processing unit for transmitting the display according to the reality information The unit displays an environment corresponding to the real-world information, and presents an option interface at the bottom or a top of the environment, determining at least one option according to the view state of the environment, and displaying the at least one of the decisions in the option interface. An option wherein the view state includes a particular location, a particular angle, or a particular distance for which the environment is viewed. A data presentation system in a virtual environment, which is applicable to an electronic device, comprising: a display unit; a storage unit including a real-world information; and a processing unit for displaying the one of the electronic devices according to the real-world information The unit displays an environment corresponding to the real-world information. When the environment is inspected, it determines whether a data is received, wherein the data is received through a network routing server, and when the data is received through the network A virtual object is dynamically generated in the environment, and the data is presented in the virtual object. A computer program product for loading and executing a data presentation method in a virtual environment, the computer program product comprising: a first code for displaying the corresponding content through a display unit according to a real-world information One of the environment information; a second code for presenting an option interface at the bottom or a top of the environment; a third code for determining at least one option according to one of the viewing states of the environment, wherein the The viewing state includes a specific location, a specific angle, or a specific distance corresponding to the environment being viewed; and a fourth code for displaying the determined at least one option in the option interface. A computer program product for being loaded by a machine and executing a data presentation method in a virtual environment, the computer program product comprising: a first code for displaying an environment corresponding to the real-world information through a display unit according to a real-world information; a second code for determining whether a data is received during the period in which the environment is inspected The data is received by a server through a network routing; and a third code is used to dynamically generate a virtual object in the environment when the data is received through the network, and in the virtual object. Present this information.