TW201516850A - Electric apparatus - Google Patents

Abstract

An electric apparatus including a target display apparatus, a information capture module and a operating display apparatus. The target display apparatus at least captures at least one first information of the target display apparatus. The operating display apparatus at least displays the at least one first information, and displays at least one second information.

Description

Electronic device

The present invention relates to an electronic device, and more particularly to an electronic device including a display device.

With the advancement of display technology and various technological processes in recent years, various display devices and corresponding operation methods have been proposed. One of the techniques of Augmented Reality has been developed, for example, after capturing information for a static pattern, displaying the information on the display panel and simultaneously displaying the virtual object to provide an augmented reality effect.

Traditional augmented reality technology must be matched with a specific mark to achieve augmented reality. The above marks have certain restrictions, and their shape, color or pattern symmetry is limited. In addition, another conventional unmarked augmented reality technique is implemented to detect the presence or absence of a known static pattern in the display. In other words, the feature database of this static pattern must be created in advance to perform this function. However, if the above mark or the static pattern moves without appearing on the display screen, the virtual object of the augmented reality disappears into the display. In the picture. Therefore, how to make the technology of augmented reality more flexible has become one of the important goals in display technology.

The invention provides an electronic device with an interactive function and an operating method thereof, which can display information on the operation display device for the target display device to provide an augmented reality effect and perform real-time interaction with the above information.

An electronic device includes a target display device, an information capture module, and an operation display device. The target display device displays at least one first information. The information capture module captures at least one first information of the target display device. The operation display device displays at least the first information captured by the information capture module and displays at least one second information.

Based on the above, the present invention proposes an interactive operation method combining two or more display devices to provide more real-time information for the user. At the same time, a virtual touch operation method is also provided, and the above information can perform a corresponding interactive mode corresponding to the user's operation, so that the user can feel a more intuitive and interesting operation experience.

The above described features and advantages of the invention will be apparent from the following description.

10, 10a, 10b, 20‧‧‧ electronic devices

100‧‧‧ memory

102, 102a‧‧‧Information Capture Module

104, 104a‧‧‧ arithmetic unit

110‧‧‧Target display device

120, 130‧‧‧Operation display device

111‧‧‧First Information

121‧‧‧Second information

121T‧‧‧virtual location

131‧‧‧ Third Information

200‧‧‧Processing unit

210‧‧‧Information Capture Module

220‧‧‧Computation Module

230‧‧‧ display module

240‧‧‧Detection module

250‧‧‧Execution module

A‧‧‧ actual objects

F‧‧‧Control objects

T‧‧‧ touch position

FIG. 1 is a block diagram of an electronic device according to an embodiment of the invention.

2 is a perspective view of an electronic device according to an embodiment of the invention.

3 is a perspective view of an electronic device according to an embodiment of the invention.

4 is a perspective view of an electronic device according to an embodiment of the invention.

FIG. 5 is a schematic perspective view of an electronic device according to an embodiment of the invention.

FIG. 6 is a perspective view of an electronic device according to an embodiment of the invention.

FIG. 7 is a perspective view of an electronic device according to an embodiment of the invention.

FIG. 1 is a block diagram of an electronic device according to an embodiment of the invention. In FIG. 1, the electronic device 10 includes a memory 100 and a processing unit 200. The memory 100 is used to store a plurality of instructions. The processing unit 200 is configured to execute the above instructions to perform a plurality of steps.

In addition, the electronic device 10 further includes an information capture module 210, a calculation module 220, a display module 230, a detection module 240, and an execution module 250. The processing unit 200 is coupled to the information capture module 210, the computing module 220, the display module 230, the detection module 240, and the execution module 250. The information capture module 210 is configured to capture information displayed by the target display device. The calculation module 220 is configured to calculate, according to the information captured by the information capture module 210, the position of the target display device corresponding to the operation display device. The display module 230 is configured to display information on the operation display device. The detection module 240 is configured to detect an operation mapped on the operation display device. The execution module 250 is configured to map the position of the operation display device according to the operation, the position of the target display device corresponding to the operation display device, and the position of the information on the operation display device. The function corresponding to the above information or the function corresponding to the target display device is executed.

The above modules may be code written in a programming language or as separate chips. For example, the information capture module 210, the computing module 220, the display module 230, the detection module 240, and the execution module 250 may be code written by a programming language, and the codes are stored in the memory. 100 is executed by the processing unit 200. The memory 100 is, for example, a non-volatile memory, a flash memory, or a hard disk.

Alternatively, the information capture module 210, the computing module 220, the display module 230, the detection module 240, and the execution module 250 are independent chips, respectively coupled to the processing unit 200, and are controllable by the processing unit 200. Each of the above wafers.

The above electronic device 10 and its corresponding operation method will be described below by way of examples. 2 is a perspective view of an electronic device according to an embodiment of the invention. Referring to FIG. 2 , the electronic device 10 includes a target display device 110 , an information capture module 102 , and an operation display device 120 .

The target display device 110 displays the first information 111. The information capturing device 102 can capture the first information 111. In another embodiment, the information capture module 102 can simultaneously capture the image of the target display device 110 and the first information 111 displayed thereon. In this embodiment, the first information 111 includes a moving image, a still image, a text, a sound, or an electromagnetic signal. This embodiment does not limit the number of first information 111. Here, the first information 111 is, for example, a motion picture. The target display device 110 is, for example, a mobile phone, a tablet computer, a television, a monitor, or other electronic device having a display panel. The data of the first information 111 is transmitted to the arithmetic unit 104. Here, the target display device 110 may be one or more, and the invention is not limited thereto.

The operation unit 104 inputs the signal corresponding to the first information 111 to the operation display device 120 to display the first information 111 captured by the information capture module 102, and displays the second information 121. In the embodiment, the operation display device 120 can also display the image of the target display device 110 and the first information 111 displayed thereon. In other embodiments, the operation display device 120 may also display only the first information 111 of the target display device 110.

In detail, the position of the target display device 110 corresponding to the operation display device 120 may be calculated according to the first information 111, wherein the calculation step is performed by the operation unit 104. The target display device 110 is a display panel that is relatively far from the user, and the operation display device 120 is a display panel that is relatively close to the user. In the present embodiment, the operation display device 120 is, for example, a display having an arithmetic unit 104 such as a mobile phone, a tablet computer, a head mounted display, or a micro projection display.

In other words, the operation display device 120 displays a corresponding display screen according to an instruction of the operation unit 104, wherein the operation display device 120 can display real information, which is information actually existing outside the operation display device 120 (such as the target display device 110 and its The first message displayed 111). In other words, the real information is information generated by non-augmented reality technology.

In this embodiment, the information capturing device 102, the computing unit 104, and the operation display device 120 can be integrated in the same piece of hardware. For example, the information capture device 102 can be a tablet computer integrated with a camera device and a processor. In this embodiment, the operation display device 120 is a non-transparent display panel, so the operation method can be The display unit 110 and/or the displayed first information 111 (such as a motion picture, a still image, a text, a sound, or an electromagnetic signal) are displayed on the operation display device 120. In other embodiments, the operation display device 120 can also be a transparent display panel, so that the user can directly view the target display device 110 and the displayed first information 111 on the operation display device 120.

Specifically, in the operation display device 120, the second information 121 has a relative positional relationship with the first information 111. The foregoing relative positional relationship is exemplified as follows: The second information 121 may be located on one side of the first information 111 and spaced apart from the first information 111, as shown in FIG. However, the invention is not limited thereto. The second information 121 may partially overlap the first information 111. Alternatively, the second information 121 may completely overlap with the first information 111 such that the second information 121 is located in the first information 111. As shown in Figure 3.

In detail, the second information 121 may be a virtual object. For example, the second information 121 may be disposed in the operation display device 120. The virtual object is, for example, a virtual button, an image or a text, etc., which is not actually present in the target. The virtual information in the device 110 is displayed, and the user can see the display screen combined with the virtual information by operating the display device 120. For example, a virtual object is information generated by augmented reality technology. Here, the second information 121 may be one or more, and the invention is not limited thereto. When the second information 121 is plural, the size of the second information 121 can be controlled to generate an illusory near-far effect. For example, one of the second information 121 may be larger than the other second information 121. In this case, the second information 121 having a larger size may generate an effect closer to the user, and the second information having a smaller size may be generated. 121 can produce effects that are farther away from the user.

Corresponding to the relative positional relationship between the second information 121 and the first information 111, the electronic device 10 can include three different touch positions (as shown in FIGS. 2 to 4). The first touch position will be described below. First, an operation mapped to the operation display device 120 is detected. In detail, after grasping the information of the control object F, the three-dimensional position of the control object F is calculated. Next, the three-dimensional spatial position map is calculated to the two-dimensional spatial position of the operation display device 120, and the operation on the operation display device 120 is detected based on the two-dimensional spatial position. Specifically, the control object F is, for example, a user's finger, and the user can move the finger to an object in the display screen of the operation display device 120, such as the first information 111 or the second information 121 (virtual object), Make touch clicks.

As shown in FIG. 2, in the present embodiment, corresponding to the position of the second information 121, there is a virtual position 121T corresponding to the second information 121 between the target display device 110 and the operation display device 120. For example, the touch position T corresponds to the virtual position 121T, and the user can place a finger between the target display device 110 and the operation display device 120 to volley the touch position T. In this way, the user can see a virtual click on the virtual object by the finger on the display screen of the operation display device 120. At this time, the user's finger clicks on the air, and the user can observe through the operation display device 120. Virtual object, so the user can know if there is a correct click to the virtual image. In other words, the user can see the position of the finger by operating the display device 120, and the position of the finger in the three-dimensional space is converted into a two-dimensional spatial position and displayed on the operation display device 120.

By clicking the touch operation of the touch position T, the target display device 110 is caused Or operating the display device 120 to perform a function corresponding to the touch operation, for example, causing the first information 111 or the second information 121 to perform a corresponding function (for example, causing the first information 111 to perform functions of zooming in, zooming out, rotating, etc.) to provide instant Interactive features.

Performing a function corresponding to the virtual object or corresponding to the position of the operation display device 120, the position of the target display device 110 corresponding to the operation display device 120, and the position of the virtual object corresponding to the operation display device 120 according to the above-described touch operation mapping The function of the target display device 110. For example, when the user's finger makes a virtual click on the virtual object, the function corresponding to the virtual object can be performed. The virtual object may be a virtual volume control button of the operation display device 120. When the virtual object is virtually clicked, the volume of the operation display device 120 may be adjusted. Alternatively, the virtual object may be an interactive icon. When the virtual object is virtual clicked, the virtual object may correspondingly move, display corresponding information (such as providing weather information, traffic information) or other instant interaction mode. In addition, after the user's finger makes a virtual click on the second information 121, the function corresponding to the second information 121 can be performed. For example, the target display device 110 is, for example, a television, and the second information 121 is, for example, a channel switching button of the television. After the user's finger volleys virtual clicks on the second information 121, the target display device 110 executes the corresponding second information 121. The function, for example, is to switch channels of the TV.

The following describes a second description of the electronic device 10 and its corresponding touch position operation method. FIG. 3 is a schematic perspective view of an electronic device according to another embodiment of the present invention. Referring to FIG. 3, the electronic device of the present embodiment is similar to the electronic device of the embodiment of FIG. 2, except that the touch position T is different. In this embodiment, use The touch position T of the person is located on the operation display device 120. In other words, the operation mapped to the operation display device 120 in this embodiment is, for example, detecting the touch operation on the operation display device 120 and acquiring the operation mapped on the operation display device 120 according to the touch operation. The user can directly touch the display device 120 by the finger F or perform a floating touch on the operation display device 120.

The user can simultaneously view the first information 111 and the second information 121 (virtual object) by operating the display device 120. The user can perform a touch click on the first information 111 or the second information 121. When the user touches the first information 111, the target display device 110, the operation display device 120, or the second information 121 may perform a corresponding function corresponding to the touch event. Alternatively, when the user touches the second information 121, the target display device 110, the operation display device 120, or the first information 111 may perform a corresponding function corresponding to the touch event.

For example, when the user performs touch control by using the above operation mode by operating the display device 120, the display screen or function of the target display device 110 can be synchronously controlled. In other words, the first information 111 displayed on the operation display device 120 and the first information 111 in the target display device 110 can perform corresponding functions. Specifically, both the target display device 110 and the operation display device 120 are electrically coupled to the operation unit 104. The computing unit 104 can transmit the corresponding control command to the target display device 110 and the operation display device 120 through the wireless transmission mode or the wired transmission mode, thereby driving the target display device 110 and the operation display device 120. In the wired transmission manner, the operation unit 104 is electrically connected to the target display device 110 and the operation display device 120, for example, and controls the target display device 110 and the operation through the operation unit 104. The display device 120 performs the corresponding functions in synchronization. The target display device 110 is, for example, a television. The first information 111 or the second information 121 is, for example, a channel switching button of the television. When the user's finger touches the first information 111 or the second information 121 on the operation display panel 120. Thereafter, the target display device 110 can perform a function corresponding to the first information 111 or the second information 121, for example, switching channels of the television.

The third embodiment of the electronic device 10 and its corresponding touch position operation method will be described below. FIG. 4 is a schematic perspective view of an electronic device according to another embodiment of the present invention. Referring to FIG. 4, the electronic device of the embodiment is similar to the electronic device of the embodiment of FIG. 2, except that the touch position T is different. In this embodiment, the touch position T of the user is located on the target display device 110. In other words, the operations mapped to the operation target display device 110 in this embodiment are, for example, detecting a touch operation on the target display device 110 and acquiring an operation mapped to the target display device 110 according to the touch operation. The user can directly touch the target display device 110 by the finger F or perform hovering touch on the target display device 110. At this time, the target display device 110 can perform a corresponding function according to the touch position of the finger F.

This method of operation can have the following practical applications of various flexibility. For example, when the distance between the user and the target display device 110 and the operation display device 120 is close enough, the user can perform the above three operations mapped on the operation display device 120 (as shown in FIGS. 2 to 4). When the target display device 110 is far away from the user, the first or second mapping operation on the operation display device 120 may be performed (as shown in FIGS. 2 to 3). When the operation display device 120 is, for example, a head mounted display, the second or third operation described above mapped to the operation display device 120 may be selected. (As shown in Figures 3 to 4).

FIG. 5 is a perspective view of an electronic device according to another embodiment of the present invention. Referring to FIG. 5, the electronic device 10a is similar to the electronic device 10 of FIGS. 2 to 4. In the electronic device 10a, the target display device 110 is a transparent display. Therefore, the image of the actual object A can exist directly on the display screen of the target display device 110, and becomes the first information 111 displayed by the target display device 110. Similar to the foregoing embodiment, the electronic device 10a of the present embodiment can implement the operation mode mapped to the operation display device 120 as shown in FIGS. 2 to 4.

FIG. 6 is a perspective view of an electronic device according to another embodiment of the present invention. Referring to FIG. 6, the electronic device 10b is similar to the electronic device 10 of FIGS. 2 to 4. In the electronic device 10b, the target display device 110 is a transparent display cabinet, the actual object A is placed in the transparent display cabinet, and the transparent display cabinet can present a display screen on the display surface facing the user, wherein the image of the actual object A can be The first information 111 displayed on the target display device 110 is directly present on the display screen of the target display device 110. Similar to the foregoing embodiment, the electronic device 10b of the present embodiment can implement the operation mode mapped to the operation display device 120 as shown in FIGS. 2 to 4.

The target display device 110 illustrated in FIGS. 5 and 6 includes, for example, a liquid crystal display medium, an electrowetting display medium, an electroluminescent display medium, or other suitable display medium, and utilizes the transparent state of the display medium to present an actual object. The image of A.

FIG. 7 is a schematic diagram of an electronic device in accordance with another embodiment of the present invention. Referring to FIG. 7 , the electronic device 20 includes a target display device 110 and an information capture module. The group 102 and the operation display device 120 further include an information capture module 102a, an operation unit 104a, and an operation display device 130. For the operation modes of the target display device 110, the information capture module 102, and the operation display device 120, reference may be made to the foregoing embodiments.

In this embodiment, the information capture module 102a can capture the second information 121 of the operation display device 120. Of course, the operation display device 130 can also capture the display screen of the operation display device 120 and the second information 121 displayed thereon. The data captured by the information capture module 102a is transmitted to the arithmetic unit 104a.

The operation unit 104a inputs the signals corresponding to the first information 111 and the second information 121 to the operation display device 130 to display the first information 111 and the second information 121 captured by the information capture module 102, and displays the first Three information 131. In the embodiment, the operation display device 130 can also display the first information 111 displayed by the image of the target display device 110 and the second information 121 displayed by the image of the operation display device 120. In other embodiments, the operation display device 130 may also display only the second information 121 of the display device 120.

The calculation target display device 110, the first information 111, the operation display device 120, the second information 121, and the third information 131 correspond to the relative positions on the operation display device 130. The operation mapped to the operation display device 130 is detected. According to the above operation, the position of the operation display device 130, the position of the target display device 110 corresponding to the operation display device 130, the position of the operation display device 120 corresponding to the operation display device 130, and the first information 111 correspond to the operation display device 130. The upper position, the second information 121 corresponds to the position on the operation display device 130, and the third The information 131 is operated on the display device 130, and performs a function corresponding to the first information 111, a function corresponding to the second information 121, a function corresponding to the third information 131, a function corresponding to the target display device 110, and an operation display corresponding to the operation display. The function of device 120 corresponds to the function of operating display device 130.

Similar to the foregoing embodiment, the present embodiment can also implement the operation mode of FIG. 2 to FIG. 4 mapped on the operation display device 120 in the operation display device 130.

In summary, the present invention provides an interactive operation method combining two or more display devices to provide more instant information for the user. At the same time, a virtual touch operation method is also provided, and the virtual object can perform a corresponding interaction mode according to the operation of the user, thereby further increasing the user's sense of realism and intuition in use.

10‧‧‧Electronic devices

102‧‧‧Information capture device

104‧‧‧ arithmetic unit

110‧‧‧Target display device

111‧‧‧First Information

120‧‧‧Operation display device

121‧‧‧Second information

121T‧‧‧virtual location

F‧‧‧Control objects

T‧‧‧ touch location

Claims (18)

An electronic device includes: a target display device that displays at least one first information; an information capture module that captures at least the first information displayed by the target display device; and an operation display device that displays at least The information captures the at least first information captured by the module and displays at least one second information. The electronic device of claim 1, wherein the at least one first information comprises a motion picture, a still picture, a text, a voice or an electromagnetic signal. The electronic device as claimed in claim 1, wherein the information capture module comprises an image capture module, a sound capture module or an electromagnetic signal capture module. The electronic device of claim 1, wherein the information capture module captures the target display device and the at least one first information displayed thereon, and the operation display device displays the target display device and The at least one first information displayed. The electronic device of claim 1, wherein in the operation display device, the at least one second information has at least one relative positional relationship with the at least one first information. The electronic device of claim 5, wherein the electronic device comprises at least one touch position according to the at least one relative positional relationship. The electronic device of claim 6, wherein the at least one first information or the touch operation of the at least one first information or the at least one second information or the at least one touch position causes the at least one first information or The at least one second information performs a corresponding action. The electronic device of claim 6, wherein the at least one touch The control position is located on the target display device. The electronic device of claim 6, wherein the at least one touch position is located on the operation display device. The electronic device of claim 6, wherein the at least one touch position is located between the target display device and the operation display device. The electronic device of claim 5, wherein the at least one relative positional relationship comprises: the at least one second information is located on a side of the at least one first information and has a spacing between the at least one first information . The electronic device of claim 5, wherein the at least one relative positional relationship comprises: the at least one second information partially overlapping the at least one first information. The electronic device of claim 5, wherein the at least one relative positional relationship comprises: the at least one second information completely overlapping the at least one first information, such that the at least one second information is located in the at least one The first information. The electronic device of claim 1, further comprising: a computing module, configured to calculate, according to the at least one first information, a position of the target display device corresponding to the operation display device; For detecting an operation mapped to the operation display device, and an execution module for performing touch operation by the at least one first information or the at least one second information or the at least one touch position So that the at least first information performs a corresponding action. The electronic device of claim 1, wherein the second asset The message is a virtual button, image or text. An electronic device includes: an information capture module that captures at least one first information displayed by a target display device; and an operation display device that displays at least the first captured by the information capture module Information and display at least one second information. The electronic device of claim 16, wherein the at least one first information comprises a moving image, a still image, a text, a sound, or an electromagnetic signal. The electronic device of claim 16, wherein the second information is a virtual button, image or text.