TWI766509B - Display apparatus and control method of projected on-screen-display interface - Google Patents

Abstract

A control method of projected on-screen-display (OSD) interface for use in a display apparatus is provided. The display apparatus includes a display module, a display controller, a projection device, and a camera, and the display apparatus is placed on a first plane. The method includes the following steps: projecting an option screen onto the first plane by the projection device, wherein the option screen includes a plurality of icons; capturing a first image of the option screen projected onto the first plane by the camera; detecting whether a predetermined object covers a specific icon among the icons; and when it is detected that the predetermined object covers the specific icon, displaying an OSD interface corresponding to the specific icon on the display module, and performing a specific operation corresponding to the specific icon.

Description

Display device and control method of display interface on projection screen

The present invention relates to a display device, and more particularly, to a display device and a method for controlling a display interface on a projection screen.

Most of the display devices currently on the market (eg, televisions or computer monitors) have an on-screen display function. The function of displaying on the screen, for example, can display the options for adjusting the picture quality on the display device, and overlay it on other pictures, so as to facilitate the user to adjust in real time. In a conventional display device, the user can call out the OSD option screen through a physical button (five-way key) or a five-way joystick, such as adjusting brightness, contrast, color, color temperature and other options. However, the position of the five-way key on the display device is fixed, and there are limitations in operation. In some cases, the user cannot quickly operate the five-way key to control the OSD options.

In view of this, the present invention provides a display device and a method for controlling a display interface on a projection screen to solve the above problems.

The present invention provides a display device placed on a first plane. The display device includes: a display module; a display controller for controlling the display screen of the display module; a projection device for projecting a menu screen to the first plane, wherein the menu screen includes a plurality of images and a camera for shooting the first image of the menu screen projected on the first plane. The display controller detects whether a predetermined object covers a specific icon of the icons in the first image. When the display controller detects that the predetermined object covers the specific icon, the display controller displays an on-screen display (OSD) interface corresponding to the specific icon on the display module, and executes the specific icon. The illustration corresponds to the specific operation.

In some embodiments, a display plane of the display module is substantially perpendicular to the first plane.

In some embodiments, the display device further includes a five-way joystick, and the operations shown in each image in the menu screen correspond to the four direction keys and the confirmation key of the five-way joystick, respectively.

In some embodiments, the display device further includes an infrared module, the infrared module includes an infrared transmitter and one or more infrared cameras, and the infrared transmitter and the one or more infrared cameras are disposed in the The base of the display device, and the position of each infrared camera corresponds to the position of each icon in the menu screen. The infrared emitter emits infrared light to the first plane, and each infrared camera captures the infrared light reflected by the predetermined object to obtain infrared images.

In some embodiments, the display controller receives the infrared image from the infrared camera corresponding to the specific icon, and detects the height of the predetermined object from the first plane from the infrared image. During the period when the display controller determines that the predetermined object has covered the specific icon: when the display controller determines that the height changes from high to low and is less than or equal to a predetermined height, the display controller determines that the predetermined object is attached to The specific icon is pressed; and when the display controller determines that the height changes from low to high and is greater than the predetermined height, the display controller determines that the predetermined object is to be released on the specific icon.

In some embodiments, when the display controller determines from the first image that the predetermined object is covered with the specific icon and determines from the infrared image that the height is not greater than the predetermined height, if the height of the predetermined object is High, low, high, and low are changed, and the display controller determines that the predetermined object performs continuous clicking operations on the specific icon.

The present invention further provides a method for controlling a display interface on a projection screen, which is used in a display device. The display device includes a display module, a display controller, a projection device and a camera, and the display device is placed on a first plane. The method includes: using the projection device to project a menu screen to the first plane, wherein the menu screen includes a plurality of icons; using the camera to shoot a first image of the menu screen projected on the first plane; detecting Whether there is a predetermined object covering a specific icon of the icons in the first image; and when it is detected that the predetermined object covers the specific icon, a corresponding one of the specific icons is displayed on the display module On-screen display (OSD) interface, and perform the specific operation corresponding to the specific icon.

10: Computer System

100: host

110: Processing unit

111: System busbar

120: Graphics Processing Unit

130: Memory unit

140: Storage Device

141: Apps

142: Operating System

143: Display menu control program on the screen

150: Transmission interface

160: Peripherals

200: Display device

210: Display Controller

211: Image resizer

212: Timing Controller

220: Display Module

230: Storage Unit

231:Firmware

232: Display interface on the screen

233: Menu screen

240: Image buffer

250: Transmission interface

260: input interface

261: Entity button

262: Five-way joystick

270: Projection Device

271: Camera

280: Infrared module

281: Infrared Emitter

282: Infrared Camera

290: Tripod

300: Projection plane

310-350: Graphics

370: User Finger

S410~S440: Steps

H: Predetermined height

h: height

FIG. 1 is a block diagram of a computer system according to an embodiment of the present invention.

FIGS. 2A-2B are schematic diagrams of projecting an OSD interface by a display device according to an embodiment of the present invention.

FIGS. 3A-3B are schematic diagrams of projecting an OSD interface by the display device according to the embodiment of FIGS. 2A-2B of the present invention.

FIG. 4 is a flowchart of a control method of a display interface on a projection screen according to an embodiment of the present invention.

In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, a preferred embodiment is exemplified below, and is described in detail as follows in conjunction with the accompanying drawings.

FIG. 1 is a block diagram of a computer system according to an embodiment of the present invention. The computer system 10 may be, for example, a personal computer or a server equipped with a display device. As shown in FIG. 1 , the computer system 10 includes a host 100 and a display device 200 , wherein the host 100 is connected to the display device 200 for signals. The host 100 includes, for example, a processing unit 110 , a graphics processing unit 120 , a memory unit 130 , a storage device 140 , one or more transmission interfaces 150 , and one or more peripheral devices 160 . The processing unit 110 , the graphics processing unit 120 , the memory unit 130 , the storage device 140 , the transmission interface 150 , and the peripheral device 160 are coupled to each other through the system bus 111 . processing unit 110 may be, for example, a central processing unit (CPU), a general-purpose processor, etc., but the present invention is not limited thereto. The graphics processing unit 120 can be, for example, a graphics processing unit on a display card or a graphics processing unit integrated into the processor 110 .

The memory unit 130 is a random access memory, such as a dynamic random access memory (DRAM) or a static random access memory (SRAM), but the invention is not limited thereto. The storage device 140 is a non-volatile memory, such as a hard disk drive, a solid-state disk, and a flash memory. , or a read-only memory, but the invention is not limited to this.

The transmission interface 150 may include a wired transmission interface and/or a wireless transmission interface, wherein the wired transmission interface may include: a High Definition Multimedia Interface (HDMI), a DisplayPort (DP) interface, an embedded display port ( embedded DisplayPort (eDP), interface Universal Serial Bus (USB) interface, USB Type-C interface, Thunderbolt interface, Digital Video Interface (DVI), Video Graphics Array (VGA) interface, general purpose Input Output (GPIO) interface, Universal Asynchronous Transceiver Transmitter (UART) interface, Serial Peripheral Interface (SPI) interface, Integrated Circuit Bus (I2C) interface, or a combination thereof, and the wireless transmission interface may include: Bluetooth ( Bluetooth), WiFi, Near Field Communication (NFC) interface, etc., but the present invention is not limited thereto. The peripheral device 160 includes, for example, an input device such as a keyboard, a mouse, and a touch panel, but the invention is not limited thereto.

For example, the storage device 140 can store one or more application programs 141, an operating system 142 (eg, can be Windows, Linux, MacOS, etc.), and an on-screen display (OSD) menu control program 143, and the processing unit 110 reads one or more application programs 141, the operating system 142 and the on-screen display menu control program 143 into the memory unit 130 and executes it. The on-screen display menu control program 143 is used to allow the user to control the on-screen display menu of the display device 200 through the peripheral device 160 of the host 100 . For example, the graphics processing unit 120 can perform the drawing processing of the application program executed by the processing unit 110 to generate an image signal including one or more images, and transmit the image signal through the transmission interfaces 150 and 250 (eg, HDMI interface or DisplayPort interface). to the display controller 210 of the display device 200 .

The display device 200 can be, for example, a flat panel display, a television, a projector, a computer screen, etc., but the present invention is not limited thereto. The display device 200 includes a display controller 210 , a display module 220 , a storage unit 230 , an image buffer 240 , or a plurality of transmission interfaces 250 , an input interface 260 , a projection device 270 , a camera 271 and an infrared module 280 .

The transmission interface 250 may include a wired transmission interface and/or a wireless transmission interface, wherein the wired transmission interface may include: a High Definition Multimedia Interface (HDMI), a DisplayPort (DP) interface, an embedded display port ( embedded DisplayPort (eDP), interface Universal Serial Bus (USB) interface, USB Type-C interface, Thunderbolt interface, Digital Video Interface (DVI), Video Graphics Array (VGA) interface, general purpose Input and output (GPIO) interface interface, Universal Asynchronous Transceiver Transmitter (UART) interface, Serial Peripheral Interface (SPI) interface, Integrated Circuit Bus (I2C) interface, or a combination thereof, and the wireless transmission interface may include: Bluetooth, WiFi, Near Field Communication (NFC) interface, etc., but the present invention is not limited thereto.

The display controller 210 can be, for example, an application-specific integrated circuit, a system-on-chip, a processor, or a microcontroller, but the invention is not limited thereto.

The display module 220 can be, for example, a liquid crystal panel, a light-emitting diode (light-emitting diode) panel, an organic light-emitting diode (organic light-emitting diode) panel, a cathode ray tube (cathode ray) tube), electronic ink (E-Ink) display module, electroluminescent (electroluminescent) display module, plasma (Plasma) display module, projection (projection) display module, quantum dot (Quantum Dot) display module , but the present invention is not limited to this.

The storage unit 230 can be, for example, a non-volatile memory, such as read only memory (ROM), erasable programmable read only memory (EPROM), and electronically erasable programmable read only memory (EEPROM). The storage unit 230 is used for storing the firmware 231 related to the display device 200 . The storage unit 230 may be external to the display controller 210 , or may be integrated into the display controller 210 , for example.

The firmware 231 includes, for example, the display settings of the on-screen display interface of the display device 200 and the extended display capability identification data (Extended Display). Identification Data, EDID), display settings, one or more on-screen-display (OSD) interfaces 232 and a menu screen 233 . The extended display capability identification data includes, for example, the manufacturer of the display device 200 , the product name, the resolution, the number of displayed frames per second, and the like. The display settings include, for example, settings of the display device 200 such as brightness, contrast, sharpness, and color temperature.

In one embodiment, the display controller 210 can read the program codes of the firmware 231 and the OSD interface 232 stored in the storage unit 230 through a bus (eg, I2C bus), and set relevant display parameters accordingly . In addition, the display controller 210 can also transmit the extended display capability identification data of the display device 200 to the host 100 through one of the transmission interfaces 250 (for example, an image transmission channel or a data transmission channel) for the host 100 to transmit the extended display capability identification data. The processing unit 110 and the graphics processing unit 120 set the resolution of the image signal to be output and the related synchronization signal. The on-screen display interface 232 includes, for example, an OSD Menu and options, an information dashboard, a timer, a counter, a crosshair, a specific symbol, a specific color, a specific text, or a combination thereof, but The present invention is not limited to this.

The image buffer 240 can be, for example, a volatile memory (such as a dynamic random access memory) or a non-volatile memory (such as a flash memory), which is used to store images to be played on the display module 220 . Outputting an image, wherein the host 100 or the display controller 210 can overlay one or more on-screen display interfaces 232 with a specific one of the image signals stored in the image buffer 240 according to an on-screen display enable signal generated by the host 100 area to generate the output image.

The input interface 260 is used to control the menu displayed on the screen of the display device 200 . The input interface 260 can be implemented by, for example, a five-way joystick 262 or five physical buttons 261, so as to implement commands such as up, down, left, right, and confirmation.

In one embodiment, when the user operates one of the directions of the five-direction joystick 262 (or presses one of the physical buttons 261 , the display controller 210 can read the firmware 232 from the storage unit 230 and the display on the screen). The screen in the display interface 232 displays the code of the menu and related options, and the menu and related options are displayed on the display module 220. In one embodiment, the user can operate on the input interface 260 to control A menu is displayed on the screen of the display device 200, and then the brightness, contrast, sharpness, color temperature of the display module 220 are adjusted, or other interfaces in the on-screen display interface 232 are turned on or off. In another embodiment, the user can pass The peripheral device 160 of the host 100 operates to control the on-screen display menu of the display device 200, thereby adjusting the brightness, contrast, sharpness, color temperature of the display module 220, or turning on or off other interfaces in the on-screen display interface 232, which Details will be described later.

For example, the firmware 231 can be regarded as the default firmware of the display device 200, and the user can control the options of the on-screen display interface 232 displayed by the display device 200 through the five-way joystick 262 (or the physical button 261). set up.

In one embodiment, the display controller 210 includes an image scaler 211 and a timing controller 212 . The display controller 210 receives the image signal from the host 100 and/or the image signal from other hosts through one of the transmission interfaces 250, and the image scaler 211 can perform image scaling processing on the image in the received image signal and/or image overlay The processing is performed to match the resolution of the display module 220 , and the image after image scaling processing (eg, called the output image) is stored in the image buffer 240 . The timing controller 212 controls the display module 220 to read and play the output image from the image buffer 240 .

In another embodiment, the display controller 210 may include the timing controller 212 , and the resolution of the image signal from the host 100 is consistent with the resolution of the display module 220 , so the display controller 210 receives the image from the host 100 After the signal, the image signal can be stored in the image buffer 240 without the need for image scaling. The timing controller 220 can read the output image from the image buffer 240 and control the display module 220 to play the output image.

The projection device 270 and the camera 271 are electrically connected to the display controller 210 . The projection device 270 is, for example, an optical projection device or a laser projection device, and is used to project the menu screen 233 onto the first plane (ie, the projection plane) on which the display device 200 is placed, and the menu screen 233 may include a plurality of icons, and Each figure corresponds to the operation of the five-way lever 262 (or the physical button 261 ). In addition, the projection plane of the menu screen 233 is substantially perpendicular to the display plane of the display device 200 . In some embodiments, the projection device 270 includes a rotating mechanism (not shown), which can be used to change the projection direction of the projection device 270 , that is, the projection device 270 can be projected on a plane other than the plane on which the display device 200 is placed other planes.

In some embodiments, the display module 220 is, for example, a flexible display panel or a curved panel, that is, the display module 220 presents a curved surface. In this case, the display device 200 may be referred to as a curved display. At this time, the center axis of the display screen of the display module 220 (ie, perpendicular to the center point of the display panel) The normal of ) is substantially perpendicular to the normal of the projection plane.

The camera 271 is, for example, a color camera, which is used to capture an image of the menu screen 233 projected on the projection plane, and transmit the captured image to the display controller 210 . The display controller 210 can determine whether any option in the menu screen 233 in the image is covered (eg, a user's finger). If a specific icon in the menu screen 233 in the image is blocked, the display controller 210 can determine that the user wants to perform the operation of the specific icon, read the corresponding OSD menu 232 and the codes of the related options, and On-screen display menus and related options are displayed on the display module 220 . The operation of the OSD menu 232 by the user through the projected menu screen is similar to the operation of the OSD menu 232 by using the five-way joystick 262 or the physical button 261 . In some embodiments, the user can select to enable or disable the function of the projection menu screen 233 through the OSD menu 232 .

In some embodiments, the menu screen 233 uses a single color as the background color (eg, black or white), and each option in the menu screen 233 uses other colors. Therefore, the display controller 210 can simply detect from the image of the menu screen 233 to determine whether the user's fingers and arms are covering one or more options.

The infrared module 280 is electrically connected to the display controller 210 . The infrared module 280 includes an infrared transmitter 281 and one or more infrared cameras 282 . The infrared emitter 281 and the infrared camera 282 are disposed on the tripod 290 of the display device 200 (as shown in FIGS. 2A and 2B ) and are close to the projection plane. The infrared emitter 281 emits infrared light to the projection plane. The infrared camera 282 is disposed on the tripod 290 at a position corresponding to each icon of the projected menu screen 233 for photographing the projection plane and transmits the captured infrared image to the display controller 210 . When the user's finger and/or arm is placed in the area of the menu screen 233, the user's finger and/or arm will reflect infrared light, and the infrared camera 282 can capture the reflected infrared light. Therefore, the display controller 210 can detect whether the user's finger touches the projection plane from the infrared image, and can detect whether the user's finger is continuously raised/lowered, so as to determine whether the user wants to view the image on the menu screen 233 or not. A specific icon is clicked continuously.

FIGS. 2A-2B are schematic diagrams of projecting an OSD interface by a display device according to an embodiment of the present invention. FIGS. 3A-3B are schematic diagrams of projecting an OSD interface by the display device according to the embodiment of FIGS. 2A-2B of the present invention. Please also refer to Figure 1, Figure 2A-2B, and Figure 3A-3B.

In one embodiment, the arrangement of the icons 310 to 350 in the menu screen 233 projected by the projection device 270 to the projection plane is similar to the predetermined operation menu of the five-way joystick 262 , as shown in FIG. 2A . When the user wants to perform a virtual touch operation on the menu screen 233 , the user can use his finger to click on any one of the icons 310 to 350 on the menu screen 233 . However, if the user's right index finger wants to click on the icon 320 , the user's right arm may cover the icons 310 , 340 and 350 together.

Similarly, if the user's right index finger wants to click on the icon 310 , the user's right arm may cover the icons 340 and 350 together. When the display controller 210 determines the icon clicked by the user, the display controller 210 can detect the protruding object (ie, the user's finger) from the image of the menu screen 233, and determine the image selected by the protruding object Show. In addition, the display controller 210 can cooperate with the user's finger to click on the menu picture The possible occlusion of each icon on the surface 233 can accurately determine the icon actually clicked by the user's finger.

Referring to FIG. 3A , when the user's finger 370 wants to click on the icon 350 and has not touched the projection plane 300 , the display controller 210 can first determine the user's finger 370 from the image of the menu screen 233 captured by the camera 271 The icon 350 is shielded, so it can be determined that the user wants to click on the icon 350 to perform a corresponding operation. At this time, the position of the user's finger 370 in the infrared image captured by the infrared camera 282 is slightly higher than the projection plane 300. For example, the height of the user's finger 370 from the projection plane 300 is h, so the display controller 210 can read the infrared image from the infrared image. It is determined that the user is performing an operation of pressing the option.

When the user's finger 370 touches the icon 350 on the projection plane 300 , the position of the user's finger 370 in the infrared image captured by the infrared camera 282 will touch the projection plane 300 , for example, the user's finger 370 is away from the projection plane 300 The height is 0, so the display controller 210 can determine from the infrared image that the user continues to press the option, as shown in FIG. 3B .

Specifically, the display controller 210 can set a predetermined height H to further determine whether the user really performs the operation of clicking the icon in the menu screen 233 . For example, when the display controller 210 determines from the image of the menu screen 233 captured by the camera 271 that the user's finger 370 is covering the icon 350 , the display controller 210 can further determine that in the infrared image captured by the infrared camera 282 The height of the user's finger 370 from the projection plane 300 . If the height of the user's finger 370 is greater than the predetermined height H, the display controller 210 can determine that the user has not clicked on the icon 350 intention of. If the height of the user's finger 370 is less than or equal to the predetermined height H, the display controller 210 can determine that the user wants to click on the icon 350 . The above-mentioned predetermined height H is larger than the height h in Fig. 3A.

In this embodiment, when the user's finger 370 moves from a height to the icon 350 on the projection plane 300 , in addition to determining whether the user's finger covers the icon 350 (or any other icon) according to the image of the menu screen 233 ), the display controller 210 further determines whether the user intends to click on the icon 350 (or any other icon) according to the height of the user's finger 370 from the projection plane 300 . When the height of the user's finger 370 from the projection plane 300 changes from high to low and is less than or equal to the predetermined height H, the display controller 210 can determine that the user's finger 370 is continuously pressing on the icon 350 . When the height of the user's finger 370 from the projection plane 300 changes from low to high and is greater than the predetermined height H, the display controller 210 can determine that the user's finger 370 has performed a release operation on the icon 350 . In other words, the predetermined height H can be used to determine whether the user's finger performs a pressing operation or a releasing operation.

In addition, when the height of the user's finger 370 from the projection plane 300 is less than or equal to the predetermined height H, the display controller 210 can further determine whether the user's finger 370 has a continuous click operation. For example, when the display controller 210 determines from the image of the menu screen that the user's fingers 370 are all covered on the same icon (eg, the icon 350 ), and determines from the infrared image that the height of the user's finger 370 from the projection plane 300 is not the same greater than the predetermined height H, and the above-mentioned height is a change from high→low→high→low, the display controller 210 can determine that the user's finger 370 performs continuous clicking operations on the same icon (eg, the icon 350 ), and clicks the same image continuously The number of times displayed can be based on the above high→low depends on the number of changes. It should be noted that, whenever the display controller 210 determines that the user's finger has clicked on the icon once (including single click and continuous click operations), the display controller 210 will read the corresponding menu of the OSD interface 232 from the firmware 231 . and options, and display the OSD interface 232 on the display module 220 .

Referring to FIG. 2B, in another embodiment, the icons 310 to 350 in the menu screen 233 projected by the projection device 270 onto the projection plane may be arranged in a straight line. When the user wants to perform a virtual touch operation on the menu screen 233 , the user can use his finger to click on any one of the icons 310 to 350 on the menu screen 233 . In FIG. 2B, when the user's finger 370 wants to click on one of the icons 310 to 350 in the menu screen 233, the user's hand or arm is less likely to block other icons in the menu screen 233 . Therefore, when the display controller 210 determines the icon clicked by the user, the display controller 210 can detect the protruding object (ie the user's finger) from the image of the menu screen 233, and determine that the protruding object is clicked The icon of is the icon actually clicked by the user's finger.

In this embodiment, the details of the user's finger 370 for pressing, releasing and continuous clicking on the icon 350 (or any icon in the menu screen 233 ) are similar to those in FIG. 2A and FIGS. 3A-3B is an embodiment, so the details are not repeated here.

FIG. 4 is a flowchart of a control method of a display interface on a projection screen according to an embodiment of the present invention. Please also refer to Figure 1, Figure 2A-2B and Figure 4.

In step S410, the projection device 271 of the display device 200 is used to project A menu screen 233 is projected onto a first plane (eg, the projection plane 300 ), wherein the first plane is a plane set by the display device 200 , and the menu screen 233 includes a plurality of icons. For example, each icon corresponds to the operation of the five-way joystick 262 (or the physical button 261 ).

In step S420 , the camera 271 is used to capture the first image of the menu screen 233 on the projection plane 300 . For example, the camera 271 is used to capture an image of the menu screen 233 projected on the first plane, and transmit the captured image to the display controller 210 .

In step S430, it is detected whether there is a predetermined object covering a specific icon of the icons in the first image. For example, when the display controller 210 determines the icon clicked by the user, the display controller 210 can detect a predetermined object (such as a protruding object, that is, the user's finger) from the image of the menu screen 233, and Determine the icon selected by the predetermined object. In addition, the display controller 210 can match the possible occlusion when the user's finger clicks each icon on the menu screen 233 , so as to accurately determine the icon actually clicked by the user's finger. In addition, the display controller 210 can use the infrared image captured by the infrared camera 282 to determine whether the user intends to click on any icon or whether the user's finger performs a pressing operation, a releasing operation or a continuous clicking operation. Reference is made to the preceding embodiments.

In step S440, when a predetermined object is detected covering the specific icon, a menu is displayed on the screen corresponding to the specific icon displayed by the display module 220, and an operation corresponding to the specific icon is performed. For example, the user's operation on a specific icon on the menu screen 233 is similar to that when the user operates the corresponding direction key in the five-way joystick 262 or Enter. Therefore, the display controller 210 can read the OSD interface 232 corresponding to the operation of a specific icon from the firmware 231 and execute the corresponding operation of the specific icon.

In summary, the present invention provides a display device and a method for controlling a display interface on a projection screen, which can project a menu screen corresponding to the direction key/confirmation key of the five-way joystick to the display device through the projection device. the projection plane, and the user can quickly click the icon of the menu screen on the projection plane to control the OSD menu without being restricted by the five-way joystick or physical buttons of the display device, thereby enhancing the user experience .

The use of words such as "first", "second", "third", etc. in the claims is used to modify the elements in the claims, and is not used to indicate that there is a priority order, antecedent relationship, or an element between them Prior to another element, or chronological order in which method steps are performed, is only used to distinguish elements with the same name.

Although the present invention is disclosed above with preferred embodiments, it is not intended to limit the scope of the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the appended patent application.

S410~S440: Steps

Claims (6)

A display device is placed on a first plane, the display device comprises: a display module; a display controller for controlling the display screen of the display module; a projection device for projecting a menu screen to the a first plane, wherein the menu screen includes a plurality of icons; and a camera for shooting a first image of the menu screen projected on the first plane; wherein the display controller detects the first image Whether a predetermined object covers a specific icon of the icons, wherein when the display controller detects that the predetermined object covers the specific icon, the display controller displays the specific icon on the display module A corresponding on-screen display (OSD) interface, and executes a specific operation corresponding to the specific icon, wherein the display device further includes an infrared module, the infrared module includes an infrared emitter and one or more infrared cameras , and the infrared transmitter and the one or more infrared cameras are arranged on the base of the display device, and the position of each infrared camera corresponds to the position of each icon in the menu screen, wherein the infrared transmitter emits Infrared light reaches the first plane, and each infrared camera captures the infrared light reflected by the predetermined object to obtain an infrared image, The display controller receives the infrared image from the infrared camera corresponding to the specific icon, and detects the height of the predetermined object from the first plane from the infrared image, wherein the display controller determines the predetermined object During the period covered by the specific icon: when the display controller determines that the height changes from high to low and is less than or equal to a predetermined height, the display controller determines that the predetermined object is pressed on the specific icon; and When the display controller determines that the height changes from low to high and is greater than the predetermined height, the display controller determines that the predetermined object is released on the specific icon. The display device of claim 1, wherein a display plane of the display module is substantially perpendicular to the first plane. The display device as claimed in claim 1, wherein the display device further comprises a five-way joystick, and the operations of each icon in the menu screen correspond to the four direction keys and the confirmation key of the five-way joystick respectively. The display device of claim 1, wherein when the display controller determines from the first image that the predetermined object is covered with the specific icon and determines from the infrared image that the height is not greater than the predetermined height, if the predetermined object is The height changes as high, low, high, and low, and the display controller determines that the predetermined object performs continuous clicking operations on the specific icon. A method for controlling a display interface on a projection screen is used in a display device, wherein the display device includes a display module, a display controller, a projector A projection device and a camera are provided, and the display device is placed on a first plane. The method includes: using the projection device to project a menu screen to the first plane, wherein the menu screen includes a plurality of icons; using the camera shooting a first image of the menu screen projected on the first plane; detecting whether a predetermined object in the first image covers a specific icon of the icons; and when detecting that there is a predetermined object covering the A specific icon, displaying an on-screen display (OSD) interface corresponding to the specific icon on the display module, and executing a specific operation corresponding to the specific icon, wherein the display device further includes an infrared module, the The infrared module includes an infrared transmitter and one or more infrared cameras, and the infrared transmitter and the one or more infrared cameras are arranged on the base of the display device, and the position of each infrared camera corresponds to the menu screen and the method further includes: using the infrared emitter to emit infrared light to the first plane, and using each infrared camera to capture the infrared light reflected by the predetermined object to obtain an infrared image; The infrared camera in the specific illustration receives the infrared image, and detects the height of the predetermined object from the first plane from the infrared image; and During the period when the predetermined object has covered the specific icon: when the height changes from high to low and is less than or equal to a predetermined height, it is determined that the predetermined object is pressed on the specific icon; and when the height changes from low to low If the height changes and is larger than the predetermined height, it is determined that the predetermined object is released on the specific icon. The method for controlling a display interface on a projection screen according to claim 5, further comprising: when it is determined from the first image that the predetermined object is covered with the specific icon and it is determined from the infrared image that the height is not greater than the predetermined height, If the height of the predetermined object changes as high, low, high, and low, it is determined that the predetermined object performs continuous clicking operations on the specific icon.

Images