TWI837468B - Method of generating user-interactive object, multimedia system, and non-transitory computer-readable medium - Google Patents

Abstract

A method of generating user-interactive object is provided. The method includes the following operations: receiving a picture of a physical environment; identifying a target surface and multiple target objects located on the target surface from the picture to generate an identifying result; generating a virtual surface and multiple virtual three-dimensional (3D) objects located on the virtual surface according to the identifying result, in which the multiple virtual 3D objects are user-interactive objects; and setting multiple operational behaviors of the multiple 3D virtual objects according to a configuration file. The multiple operational behaviors correspond to multiple input operations, respectively. The virtual surface and the multiple virtual objects are for being displayed and manipulated in a virtual environment.

Description

User interactive object generation method, multimedia system and non-transient computer-readable medium

This disclosure document relates to an object generation method and a multimedia system and a non-transient computer-readable medium for implementing the method, and in particular to a user-interactive object generation method and a multimedia system and a non-transient computer-readable medium for implementing the method.

Virtual reality (VR) technology uses computers to simulate a fully immersive three-dimensional virtual world. Augmented reality (AR) technology is not fully immersive, but rather superimposes virtual objects on real-time images captured by the camera. Users can experience various situations in an immersive way by wearing devices that use the above technologies. Therefore, virtual reality and augmented reality technologies can reduce the restrictions on the content of machine operator training caused by venue and financial costs, and help improve the efficiency and flexibility of training courses. However, there is currently no method to efficiently and quickly set up machine operator training content in virtual reality and augmented reality.

This disclosure document provides a method for generating a user-interactive object, which includes the following process: receiving an image of a physical environment; identifying a target surface in the image and multiple target objects located on the target surface to generate a recognition result; creating a virtual surface and multiple virtual three-dimensional objects located on the virtual surface according to the recognition result, wherein the multiple virtual three-dimensional objects are user-interactive objects; and setting multiple operation outputs of the multiple virtual three-dimensional objects according to a setting file, wherein the multiple operation outputs correspond to multiple command inputs respectively, and the virtual surface and the multiple virtual three-dimensional objects are used to display and operate in a virtual reality environment.

The present disclosure document provides a multimedia system, which includes a storage device, a display device and a computing device. The computing device is coupled to the storage device and the display device, and is used to: receive an image of a physical environment; identify a target surface in the image and multiple target objects located on the target surface to generate a recognition result; create a virtual surface and multiple virtual three-dimensional objects located on the virtual surface according to the recognition result, wherein the multiple virtual three-dimensional objects are user-interactive objects; set multiple operation outputs of the multiple virtual three-dimensional objects according to a setting file, wherein the multiple operation outputs correspond to multiple command inputs respectively, and the virtual surface and the multiple virtual three-dimensional objects are used to display and operate in a virtual reality environment.

The present disclosure provides a non-transitory computer-readable medium comprising one or more computer-executable instructions for controlling a multimedia system. The multimedia system comprises a storage device, a display device, and a computing device. When the computing device executes one or more computer executable instructions, the computing device performs the following operations: Receive an image of a physical environment; identify a target surface in the image and multiple target objects located on the target surface to generate a recognition result; create a virtual surface and multiple virtual three-dimensional objects located on the virtual surface based on the recognition result, wherein the multiple virtual three-dimensional objects are user interactive objects; set multiple operation outputs of the multiple virtual three-dimensional objects based on a setting file, wherein the multiple operation outputs correspond to multiple instruction inputs respectively, and the virtual surface and the multiple virtual three-dimensional objects are used to display and operate in a virtual reality environment.

One of the advantages of the above embodiment is that customized virtual training content can be quickly generated.

Another advantage of the above embodiment is that it allows trainees to experience the situation firsthand.

100:Multimedia system

103: Electronic devices

105: Image

107: Machine

110: Display device

120: Computing device

122: Memory

124:Configuration file

200: User interactive object generation method

S210~S270: Process

300: Control Panel

310: Surface

320: Objects

322: Knob

324: Square button

326:Round button

410~418: Geometric figures

500:Virtual content

510: Virtual surface

522~528: Virtual 3D objects

600: Virtual Reality Environment

610: User input

Figure 1 is a simplified schematic diagram of a multimedia system according to an embodiment of this disclosure document.

Figure 2 is a flow chart of a method for generating user interactive objects according to an embodiment of this disclosure document.

Figure 3 is an enlarged schematic diagram of the image in Figure 1.

Figure 4 shows schematic diagrams of multiple two-dimensional geometric figures generated based on the images in Figure 1.

Figure 5 shows a schematic diagram of virtual content generated based on the image in Figure 1.

Figure 6 shows part of the virtual environment in the user's field of view.

The following will be used in conjunction with relevant figures to illustrate the embodiments of this disclosure document. In the figures, the same reference numerals represent the same or similar elements or method flows.

FIG. 1 is a simplified schematic diagram of a multimedia system 100 according to an embodiment of the present disclosure. The multimedia system 100 includes a display device 110 and a computing device 120. The display device 110 is used to display virtual reality (VR) images or augmented reality (AR) images. In some embodiments, the display device 110 can also play audio and/or provide vibration tactile feedback. In practice, the display device 110 can be implemented using a head-mounted device.

The computing device 120 is coupled to the display device 110, and the computing device 120 is used to transmit display data (such as RGB signals, vertical synchronization signals, and horizontal synchronization signals) to the display device 110 to control the display content of the display device 110. The display device 110 is, for example, a PC VR device. In some embodiments, the computing device 120 can be implemented by a personal computer, a server, a laptop, or other programmable electronic devices. In some embodiments, the display device 110 also has the function of the computing device 120, that is, the display device 110 and the computing device 120 are combined into an all-in-one machine, without the need for a wired or wireless external computing device 120, such as a standalone VR device.

The computing device 120 can be connected to the electronic device 103 via network communication to receive the image 105 obtained by the electronic device 103 taking a picture of the physical environment, but the present disclosure is not limited thereto. In some embodiments, the electronic device 103 can transfer the image 105 to the computing device 120 via an external memory (such as a memory card or a flash drive). In practice, the electronic device 103 can be implemented by a smart phone or a digital camera. In some embodiments, the electronic device 103 can be implemented by a camera on the display device 110.

In some embodiments, the electronic device 103 is used to photograph the operation panel of the machine 107 in the physical environment, and the obtained image 105 is transmitted to the computing device 120 via the network. The computing device 120 is used to extract the appearance of the operation panel from the image 105, and the computing device 120 will create a user-interactive virtual operation panel based on the appearance of the operation panel. In some embodiments, the aforementioned virtual operation panel can be displayed in a virtual reality environment by the display device 110. That is, the computing device 120 can recognize specific objects from the received image and automatically generate corresponding user-interactive virtual objects based on the recognition result.

FIG. 2 is a flow chart of a user interactive object generation method 200 according to an embodiment of the present disclosure. The memory 122 of the computing device 120 stores one or more computer executable instructions (not shown). When the computing device 120 executes the computer executable instructions, the computer executable instructions cause the computing device 120 to execute the user interactive object generation method 200. In some embodiments, the memory 122 also stores one or more setting files 124, and the computing device 120 is used to set multiple operation outputs of the virtual object (such as generating light, sound, image, vibration, etc.) according to the setting file 124. The detailed setting method will be described in the following paragraphs.

In process S210, the computing device 120 receives an image 105 of a physical environment, for example, the image 105 is obtained by photographing the physical environment. FIG. 3 is an enlarged schematic diagram of the image 105. In this embodiment, the image 105 includes a control panel 300, and the control panel 300 includes a surface 310 and a plurality of objects 320 on the surface 310. The plurality of objects 320 can be various movable elements or indicator elements on the control panel 300, such as a plurality of knobs 322, a plurality of square buttons 324, a circular button 326 and an indicator light 328, as well as a lever, a pull rod, a joystick, etc. (not shown in the figure).

In process S220, the computing device 120 is configured to recognize the control panel 300 from the image 105. Specifically, the computing device 120 can recognize the shape, outline, scale, text and other information of the surface 310 and the plurality of objects 320, and the computing device 120 can also recognize the position and arrangement of the plurality of objects 320 on the surface 310.

In process S230, the computing device 120 generates depth information representing the height of each object 320 on the surface 310. For example, the computing device 120 can analyze the image 105 through a suitable algorithm to obtain the depth information. For another example, the computing device 120 can receive an additional image of the control panel 300 at a different viewing angle (for example, from the electronic device 103) to calculate the depth information using the parallax between the two images. The relevant calculation method is well known to those with ordinary knowledge in the relevant technical field and will not be repeated here. In some embodiments, the height of each object 320 on the surface 310 can also be a system default value, or can be set or adjusted by the user.

In process S240, please refer to FIG. 3 and FIG. 4 simultaneously, the computing device 120 generates a plurality of two-dimensional geometric figures 410-418 according to the contours of the surface 310 and the plurality of objects 320, and according to the arrangement of the plurality of objects 320 on the surface 310. In some implementations, the contour of the geometric figure 410 is the same as or corresponds to the contour of the surface 310, and the contours of the geometric figures 412-418 are the same as or correspond to the contours of the knob 322, the square button 324, the circular button 326, and the indicator light 328, respectively. In other implementations, the arrangement of geometric figures 412-416 in geometric figure 410 is the same as or corresponds to the arrangement of knob 322, square button 324, circular button 326 and indicator light 328 on surface 310. In some implementations, computing device 120 stores geometric figures 410-418 as vector graphics.

In process S250, referring to FIG. 4 and FIG. 5 , the computing device 120 generates virtual content 500 according to the geometric figures 410-418 and the depth information, wherein the geometric figures 410-418 are used to determine the outline or shape of the virtual content 500, and the depth information is used to determine the height or thickness of the virtual content 500. Specifically, the virtual content 500 includes a virtual surface 510 and a plurality of virtual three-dimensional objects 522-528. The computing device 120 sets the outline of the virtual surface 510 to be the same as or correspond to the outline of the geometric figure 410, and sets the outlines of the virtual three-dimensional objects 522-528 to be the same as or correspond to the outlines of the geometric figures 412-416. The computing device 120 also determines the heights of the virtual three-dimensional objects 522-528 on the virtual surface 510 based on the depth information, and sets the arrangement of the virtual three-dimensional objects 522-528 on the virtual surface 510 to be the same as or correspond to the arrangement of the geometric figures 412-418 in the geometric figure 410. In some embodiments, the height of the virtual three-dimensional objects 522-528 on the virtual surface 510 may also be a system default value, or may be set or adjusted by the user.

In summary, in processes S210-S250, the multimedia system 100 recognizes the surface 310 and the multiple objects 320 in the image 105, and generates virtual content 500 having the same or similar appearance as the surface 310 and the multiple objects 320.

Next, in process S260-270, the computing device 120 sets the user interaction function of the virtual content 500. In process S260, the computing device 120 sets the types of virtual three-dimensional objects 522-528 according to the outlines of the plurality of objects 320, wherein when the virtual three-dimensional objects 522-528 respond to user input, different types of virtual three-dimensional objects will have different types of motion. The virtual three-dimensional objects 522-528 can form virtual movable elements such as virtual knobs, virtual buttons, virtual levers, virtual pull rods, virtual joysticks, etc. through the aforementioned different types of motion.

For example, referring to FIG. 3 and FIG. 5 at the same time, the virtual three-dimensional object 524 is generated based on the square button 324 with a square outline, so the computing device 120 sets the virtual three-dimensional object 524 as a virtual button. For another example, the virtual three-dimensional object 522 is generated based on the knob 322 with a circular outline, so the computing device 120 sets the virtual three-dimensional object 522 as a virtual knob. For another example, the virtual three-dimensional object 526 is generated based on the circular button 326, and the circular button 326 has an arc edge but a non-circular outline. Therefore, the computing device 120 sets the virtual three-dimensional object 526 as a virtual button. However, this disclosure document is not limited to this.

Therefore, in an embodiment as shown in FIG. 6 , when the display device 110 displays the virtual content 500 in the virtual reality environment 600, the virtual three-dimensional objects 524 and 526 will respond to the user input 610 and move back and forth in a direction perpendicular to the virtual surface 510 to simulate a button. In addition, the virtual three-dimensional object 522 will respond to the user input 610 and generate a rotational movement to simulate a knob. In summary, the movement type of each of the virtual three-dimensional objects 522-528 will correspond to the outline of a corresponding one of the multiple objects 320.

In other embodiments, the computing device 120 sets the virtual three-dimensional objects 522-528 to respond to the motion events generated by the user input according to one or more symbols or texts on or around the object 320. For example, please refer to Figures 3 and 5 at the same time. The virtual three-dimensional object 522 is generated according to the knob 322, and the computing device 120 recognizes that there are multiple scale symbols around the knob 322. Therefore, the computing device 120 will set the virtual three-dimensional object 522 as a virtual knob, and can also display the scale symbols at the corresponding position of the virtual three-dimensional object 522, such as around the virtual three-dimensional object 522.

For another example, the virtual three-dimensional object 524 is generated based on the square button 324, and the computing device 120 recognizes that there are recognizable texts "-X", "-Y", "F1" and "F2" on the square button 324, so the computing device 120 will set the virtual three-dimensional object 524 as a square virtual button, and can simultaneously display the text at the corresponding position of the virtual three-dimensional object 524, such as the upper surface of the virtual three-dimensional object 524.

For another example, the virtual three-dimensional object 526 is generated based on the circular button 326, and the computing device 120 recognizes that the circular button 326 is surrounded by recognizable text "EMERGENCY STOP", so the computing device 120 will set the virtual three-dimensional object 526 as a circular virtual button, and can simultaneously display the recognizable text at the corresponding position of the virtual three-dimensional object 526, such as the upper surface of the virtual three-dimensional object 526. However, the present disclosure is not limited to this.

In some embodiments, the computing device 120 can set the user interaction function of the virtual three-dimensional objects 522-528 based on the outline of the object 320 and the surrounding text or symbols. In this way, it is convenient for the user to set the interactive function and reduce the probability of the computing device 120 misjudging the type of the object 320.

Next, in process S270, the computing device 120 sets multiple operation outputs of the virtual content 500 according to the setting file 124 to simulate various reactions of the machine 107 under real operation conditions. In some embodiments, the operation output refers to the predetermined light, predetermined sound, predetermined image, predetermined vibration, predetermined virtual machine action, or a combination of two or more thereof generated when the virtual content 500 receives an input operation from a user, wherein the command input may be composed of the one or more user inputs 610 mentioned above, and multiple different operation outputs may correspond to multiple different command inputs respectively. For example, referring to FIG. 6 , when a user presses multiple virtual three-dimensional objects 524 in a specific order to generate a command input, the virtual three-dimensional object 528 generated by the indicator light 328 will generate a predetermined light or other prompt to prompt the user whether the operation is correct. For another example, when the user rotates the virtual three-dimensional object 522 to generate a command input, and the virtual three-dimensional object 522 rotates beyond a predetermined angle or does not reach a predetermined angle, the virtual content 500 will cause the display device 110 to play a predetermined sound effect to prompt the user. However, the present disclosure is not limited to this.

In some embodiments, the computing device 120 can identify the model of the machine 107 according to the image 105, and then automatically select one of the multiple candidate configuration files stored in advance as the configuration file 124 according to the model of the machine 107. In other embodiments, the user can manually select one of the multiple candidate configuration files as the configuration file 124, or the user can write and store the configuration file 124 on the computing device 120 through the input interface (not shown) of the computing device 120.

In some embodiments, the computing device 120 may provide the configured virtual content 500 to the display device 110 after the process S270 is completed. The display device 110 will display the virtual content 500 in a virtual reality environment (e.g., a virtual reality environment 600). Therefore, the user of the display device 110 can operate multiple virtual three-dimensional objects 522-528 in the virtual reality environment.

In summary, the user interactive object generation method 200 can quickly generate customized virtual training content, which helps reduce the time and money costs of enterprises in setting up virtual training content and training employees. When the user interactive object generation method 200 is used in conjunction with the multimedia system 100, trainees can experience the training content in an immersive way, which helps improve the training effect.

The process execution sequence in the aforementioned Figure 2 is only an exemplary implementation and does not limit the actual implementation of this disclosure document. For example, in Figure 2, process 230 and process 240 can be performed simultaneously, or the order can be swapped.

Certain terms are used in the specification and patent application to refer to specific components. However, those with ordinary knowledge in the relevant technical field should understand that the same components may be referred to by different terms. The specification and patent application do not use the difference in name as a way to distinguish components, but use the difference in function of the components as the basis for distinction. The term "including" mentioned in the specification and patent application is an open term and should be interpreted as "including but not limited to". In addition, "coupling" includes any direct and indirect connection means. Therefore, if the text describes that the first component is coupled to the second component, it means that the first component can be directly connected to the second component through electrical connection or signal connection methods such as wireless transmission, optical transmission, etc., or indirectly electrically or signal connected to the second component through other components or connection means.

The description method of "and/or" used herein includes any combination of one or more of the listed items. In addition, unless otherwise specified in the description, any singular term also includes the plural meaning.

The above is only the preferred embodiment of this disclosure document. All equivalent changes and modifications made according to the requirements of this disclosure document shall fall within the scope of this disclosure document.

100:Multimedia system

103: Electronic devices

105: Image

107: Machine

110: Display device

120: Computing device

122:Memory circuit

124:Configuration file

Claims (15)

A method for generating a user interactive object comprises: receiving an image of a physical environment; identifying a target surface of a target in the image and a plurality of target objects located on the target surface to generate a recognition result of a two-dimensional image; creating a virtual surface according to the target surface based on the recognition result of the two-dimensional image, and generating a virtual surface according to the two-dimensional geometric outlines of the plurality of target objects located on the target surface and the plurality of target objects on the target surface; The method of creating a plurality of virtual three-dimensional objects on the virtual surface in an arrangement manner on the target surface, wherein the plurality of virtual three-dimensional objects respectively correspond to the plurality of target objects, and the two-dimensional geometric outline of each of the plurality of target objects determines the outline of the corresponding virtual three-dimensional object, wherein the plurality of virtual three-dimensional objects are user-interactive objects; and setting a plurality of operation outputs of the plurality of virtual three-dimensional objects according to a setting file, wherein the plurality of operation outputs respectively The virtual surface and the virtual three-dimensional objects are used to display and operate in a virtual reality environment in response to a plurality of command inputs, wherein when a first virtual three-dimensional object among the plurality of virtual three-dimensional objects responds to a user input, the first virtual three-dimensional object has a motion type, and the motion type corresponds to an outline of a corresponding one of the plurality of target objects, or corresponds to a position on or around the corresponding one of the plurality of target objects. or multiple words or symbols, wherein, if the first virtual three-dimensional object is generated based on a target object with a cylindrical two-dimensional geometric outline among the multiple target objects, the first virtual three-dimensional object is set as a virtual knob or a virtual button, If the first virtual three-dimensional object is generated based on a target object with a square column two-dimensional geometric outline among the multiple target objects, the first virtual three-dimensional object is set as the virtual button. The method as described in claim 1, wherein each of the multiple operation outputs includes one or more of the following: a predetermined light, a predetermined sound, a predetermined image, a predetermined vibration, and a predetermined virtual machine action. The method as described in claim 1, wherein setting the multiple operation outputs of the multiple virtual three-dimensional objects according to the setting file includes: selecting a corresponding one from multiple candidate setting files as the setting file according to the recognition result. The method as claimed in claim 1, wherein if the one or more words or symbols include multiple scales, the first virtual three-dimensional object forms a virtual knob, and if the one or more words or symbols include one or more recognizable words, the first virtual three-dimensional object forms a virtual button. The method as described in claim 1, wherein establishing the virtual surface and multiple virtual three-dimensional objects located on the virtual surface includes: generating multiple two-dimensional geometric figures based on the multiple contours and the arrangement of the multiple target objects; generating depth information of the multiple target objects based on the image; determining multiple shapes of the multiple virtual three-dimensional objects based on the multiple two-dimensional geometric figures; and determining the heights of the multiple virtual three-dimensional objects on the virtual surface based on the depth information. A multimedia system includes: a storage device for storing a setting file; a display device; and a computing device coupled to the storage device and the display device and configured to: receive an image of a physical environment; identify a target surface of a target in the image and a plurality of target objects located on the target surface to generate a recognition result of a two-dimensional image; based on the recognition result of the two-dimensional image, create a virtual surface based on the target surface, and generate a virtual surface based on the target surface; The method further comprises: creating a plurality of virtual three-dimensional objects on the virtual surface based on the two-dimensional geometric outlines of the plurality of target objects on the target surface and the arrangement of the plurality of target objects on the target surface, wherein the plurality of virtual three-dimensional objects respectively correspond to the plurality of target objects, and the two-dimensional geometric outline of each of the plurality of target objects determines the outline of the corresponding virtual three-dimensional object, wherein the plurality of virtual three-dimensional objects are user-interactive objects; and setting the plurality of virtual three-dimensional objects according to a setting file. The virtual surface and the virtual three-dimensional objects are used to display and operate in a virtual reality environment, wherein when a first virtual three-dimensional object among the multiple virtual three-dimensional objects responds to a user input, the first virtual three-dimensional object has a motion type, and the motion type corresponds to a contour of a corresponding one of the multiple target objects, or corresponds to the contour of the multiple target objects. One or more words or symbols on or around the corresponding one of the plurality of target objects, wherein if the first virtual three-dimensional object is generated based on a target object with a cylindrical two-dimensional geometric outline among the plurality of target objects, the first virtual three-dimensional object is configured as a virtual knob or a virtual button; if the first virtual three-dimensional object is generated based on a target object with a square columnar two-dimensional geometric outline among the plurality of target objects, the first virtual three-dimensional object is configured as the virtual button. A multimedia system as described in claim 6, wherein each of the multiple operational outputs includes one or more of the following: a predetermined light, a predetermined sound, a predetermined image, a predetermined vibration, and a predetermined virtual machine action. A multimedia system as described in claim 6, wherein when the computing device sets the multiple operation outputs of the multiple virtual three-dimensional objects according to the setting file, the computing device is used to: select a corresponding one from multiple candidate setting files according to the recognition result as the setting file. A multimedia system as described in claim 6, wherein if the one or more words or symbols include multiple scales, the first virtual three-dimensional object forms a virtual knob, and if the one or more words or symbols include one or more recognizable words, the first virtual three-dimensional object forms a virtual button. A multimedia system as described in claim 6, wherein when the computing device creates the virtual surface and the multiple virtual three-dimensional objects located on the virtual surface, the computing device is used to: generate multiple two-dimensional geometric figures based on the multiple outlines and the arrangement of the multiple target objects; generate depth information of the multiple target objects based on the image; determine multiple shapes of the multiple virtual three-dimensional objects based on the multiple two-dimensional geometric figures; and determine the heights of the multiple virtual three-dimensional objects on the virtual surface based on the depth information. A non-transitory computer-readable medium includes one or more computer-executable instructions for controlling a multimedia system, wherein the multimedia system includes a storage device, a display device, and a computing device, and when the computing device executes the one or more computer-executable instructions, the computing device performs the following operations: Receive an image of a physical environment; identify a target surface of a target in the image and multiple target objects located on the target surface to generate a recognition result of a two-dimensional image; A virtual surface is established according to the target surface based on the recognition result of the 2D image, and a plurality of virtual 3D objects are established on the virtual surface according to the 2D geometric outlines of the plurality of target objects on the target surface and the arrangement of the plurality of target objects on the target surface, wherein the plurality of virtual 3D objects respectively correspond to the plurality of target objects, and the 2D geometric outline of each of the plurality of target objects determines the outline of the corresponding virtual 3D object, wherein the plurality of virtual 3D objects are user-interactive objects; and setting a plurality of operation outputs of the plurality of virtual three-dimensional objects according to a setting file, wherein the plurality of operation outputs respectively correspond to a plurality of command inputs, and the virtual surface and the plurality of virtual three-dimensional objects are used to display and operate in a virtual reality environment, wherein, when a first virtual three-dimensional object among the plurality of virtual three-dimensional objects responds to a user input, the first virtual three-dimensional object has a motion type, and the motion type corresponds to a contour of a corresponding one of the plurality of target objects, or to One or more words or symbols should be on or around the corresponding one of the multiple target objects, wherein if the first virtual three-dimensional object is generated based on a target object with a cylindrical two-dimensional geometric outline among the multiple target objects, the first virtual three-dimensional object is set as a virtual knob or a virtual button, and if the first virtual three-dimensional object is generated based on a target object with a square columnar two-dimensional geometric outline among the multiple target objects, the first virtual three-dimensional object is set as the virtual button. The non-transitory computer-readable medium as described in claim 11, wherein each of the multiple operational outputs includes one or more of the following: a predetermined light, a predetermined sound, a predetermined image, a predetermined vibration, and a predetermined virtual machine action. The non-transitory computer-readable medium as described in claim 11, wherein setting the multiple operation outputs of the multiple virtual three-dimensional objects according to the setting file includes: selecting a corresponding one from multiple candidate setting files in the storage device as the setting file according to the recognition result. The non-transitory computer-readable medium as claimed in claim 11, wherein if the one or more words or symbols include multiple scales, the first virtual three-dimensional object forms a virtual knob, and if the one or more words or symbols include one or more recognizable words, the first virtual three-dimensional object forms a virtual button. The non-transitory computer-readable medium as described in claim 11, wherein establishing the virtual surface and multiple virtual three-dimensional objects located on the virtual surface includes: generating multiple two-dimensional geometric figures based on the multiple outlines and the arrangement of the multiple target objects; generating depth information of the multiple target objects based on the image; determining multiple shapes of the multiple virtual three-dimensional objects based on the multiple two-dimensional geometric figures; and determining the heights of the multiple virtual three-dimensional objects on the virtual surface based on the depth information.

Images