CN116301681A - Display device and its screen traceback method - Google Patents

Abstract

A display device, comprising: an image buffer; a display module; and a display controller for receiving an image signal from a host and storing the image signal in the image buffer. In response to the display controller receiving a trigger signal, the display controller controls the display device to enter a picture backtracking mode. The display controller takes out the backtracking image corresponding to the backtracking time point from the image buffer according to a user instruction, and plays the backtracking image on the display module.

Description

Display device and its screen traceback method

technical field

The present invention relates to a display device, in particular to a display device and a method for recalling a picture thereof.

Background technique

Due to advances in technology, computer users spend more and more time using monitors every day. However, when operating the computer, the user often forgets the operation performed before, and cannot return to the desired previous step, or the user wants to watch the screen image that has been watched before. However, conventional display devices do not have the function of recalling images, which sometimes causes inconvenience to users.

Contents of the invention

In view of this, the present invention provides a display device and a frame backtracking method thereof to solve the above problems.

The invention provides a display device, comprising: an image buffer; a display module; and a display controller, used for receiving an image signal from a host and storing the image signal in the image buffer. In response to the display controller receiving a trigger signal, the display controller controls the display device to enter a frame retracement mode. The display controller fetches the retrospective image corresponding to the retrospective time point from the image buffer according to a user instruction, and plays the retrospective image on the display module.

In some embodiments, the display controller first compresses the image signal to obtain a compressed image signal, and stores the compressed image signal into the image buffer. When the display device is in the frame lookback mode, the display controller obtains the compressed image signal corresponding to the lookback time point from the image buffer, and decompresses the compressed image signal to obtain the lookback image.

In some embodiments, the image buffer stores the compressed image signal for a predetermined time interval, and the display controller uses a first-in-first-out mechanism to store the compressed image signal into the image buffer.

In some embodiments, the display device further includes: an input interface, wherein the input interface includes a first function key, a second function key and a third function key, wherein the second function key is used to generate the trigger signal to turn on or off the screen recall mode of the display device, the first function button and the third function button are used to generate the user instruction, and respectively control the screen scroll function and screen forward in the screen traceback mode post function.

In some embodiments, when the display device is in the screen backtracking mode and a user presses the first function button or the third function button and releases it, the display controller will go forward or backward from the current search time point Go back a predetermined number of seconds to obtain the lookback time point, and obtain the lookback image corresponding to the lookback time point from the image buffer.

In some embodiments, when the display device is in the screen backtracking mode and a user keeps pressing the first function button or the third function button, the display controller will quickly move forward or forward from the current search time point Then search for the backtracking image.

In some embodiments, when the display device is in the frame recall mode and the display controller receives the trigger signal from the second function key, the display controller controls the display device to return to the normal frame mode.

In some embodiments, in response to the display device entering the frame lookback mode, the display controller stops writing the image signal to the image buffer.

The present invention further provides a frame backtracking method for a display device, wherein the display device includes an image buffer, a display module, and a display controller, and the method includes: using the display controller to receive an image signal from a host, and storing the image signal in the image buffer; in response to receiving a trigger signal from the display controller, using the display controller to control the display device to enter a frame backtracking mode; and using the display controller according to a user instruction to The retrospective image corresponding to the retrospective time point is taken out from the image buffer, and played on the display module.

Description of drawings

FIG. 1 is a block diagram of a computer system according to an embodiment of the invention.

2A-2C are schematic diagrams of retrospective images according to an embodiment of the present invention.

FIG. 3 is a flow chart of a frame backtracking method of a display device according to an embodiment of the invention.

Explanation of reference signs:

10: Host

11: Image signal

20: User

100: display device

110: display controller

111: Image Resizer

112: Timing controller

120: display module

130: storage device

131: Firmware

132: Display interface on the screen

140: image buffer

141: The first storage space

142: Second storage space

150: transmission interface

160: input interface

161: Physical button

162: Five-way joystick

1631-1633: Function keys

170: Multiplexer

171-172: paths

202, 204, 206: Retrospective images

211: time column

S310～S320: steps

Detailed ways

In order to make the above objects, features and advantages of the present invention more comprehensible, a preferred embodiment will be described in detail below together with the accompanying drawings.

FIG. 1 is a block diagram of a display device according to an embodiment of the invention.

As shown in FIG. 1 , the host 10 is signal-connected to the display device 100 . For example, the host 10 can be a personal computer, server, TV stick/box, set-top box, game console, DVD/Blu-ray player or other devices with image output function. The display device 100 can be, for example, a flat panel display, a television, a projector, a computer screen, etc., but the present invention is not limited thereto. The display device 100 includes a display controller 110 , a display module 120 , a storage device 130 , an image buffer 140 , a transmission interface 150 , an input interface 160 and a multiplexing circuit 170 .

The display controller 110 can be, for example, an application-specific integrated circuit, a system-on-chip, a processor, or a microcontroller, but the present invention is not limited thereto .

The display module 120 can be, for example, a liquid crystal (liquid crystal) panel (including a backlight module), a light-emitting diode (light-emitting diode) panel, an organic light-emitting diode (organic light-emitting diode) panel, a cathode ray tube (cathode ray tube) tube), electronic ink (E-Ink) display module, electroluminescent (electroluminescent) display module, plasma (Plasma) display module, projection (projection) display module, quantum dot (Quantum Dot) display module, but the present invention does not Not limited to this.

The storage device 130 can be, for example, a non-volatile memory, such as a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electronically erasable programmable read-only memory (EEPROM). The storage device 130 is used for storing the firmware 131 related to the display device 100 . The storage device 130 can be external to the display controller 110 , or can be integrated into the display controller 110 , for example.

The firmware 131 includes, for example, display settings and extended display capability identification data (Extended Display Identification Data, EDID) of the on-screen display interface of the display device 100, display settings, one or more on-screen display interfaces (on-screen-display( OSD) interface) 132. The extended display capability identification data includes, for example, the manufacturer of the display device 100 , product name, resolution, display frames per second, and so on. The display settings include, for example, settings of brightness, contrast, sharpness, color temperature, etc. of the display device 100 .

The transmission interface 150 may include a wired transmission interface and/or a wireless transmission interface, wherein the wired transmission interface may include: a high-definition multimedia interface (High Definition Multimedia Interface, HDMI), a display port (display terminal, DisplayPort, DP) interface, an embedded Display port (embedded DisplayPort, eDP), interface Universal Serial Bus (Universal Serial Bus, USB) interface, USB Type-C interface, Thunderbolt (Thunderbolt) interface, digital video interface (DVI), video graphics array (VGA) interface, General purpose input and output (GPIO) interface, universal asynchronous transceiver (UART) interface, serial peripheral interface (SPI) interface, integrated circuit bus (I2C) interface, or a combination thereof, and the wireless transmission interface may include: Bluetooth (Bluetooth) , WiFi, Near Field Communication (NFC) interface, etc., but the present invention is not limited thereto.

In one embodiment, the display controller 110 can read the program codes of the firmware 131 and the on-screen display interface 132 stored in the storage device 130 through a bus (such as an I2C bus), and set related display parameters accordingly. . In addition, the display controller 110 can also transmit the identification data of the extended display capability of the display device 100 to the host 10 through the transmission interface 150, so that the host 10 can set the resolution of the image signal to be output and the related synchronization signal. The on-screen display interface 132 includes, for example, an on-screen display menu (OSD Menu) and options, an information display interface (information dashboard), a timer, a counter, a crosshair, a specific symbol, a specific color, a specific text, or a combination thereof, but The present invention is not limited thereto.

In one embodiment, the display controller 110 includes an image scaler (image scaler) 111 and a timing controller (timing controller) 112 . The display controller 110 receives image signals from the host 10 and/or image signals from other hosts through the transmission interface 150, and the image scaler 111 can perform image scaling processing and/or image processing on the images in the received image signals 11. The overlapping process is performed to meet the resolution of the display module 120 , and the image after the image scaling process (for example, referred to as an output image) is stored in the image buffer 140 . The timing controller 112 controls the display module 120 to read the output image from the image buffer 140 and play it.

In another embodiment, the display controller 110 may include a timing controller 112, and the resolution of the image signal 11 from the host 10 matches the resolution of the display module 120, so the display controller 110 receives the image signal from the host 10 Afterwards, the image signal can be stored in the image buffer 140 without image scaling processing. The timing controller 120 can read the output image from the image buffer 140 and control the display module 120 to play the output image.

The image buffer 140 can be, for example, a volatile memory (such as a dynamic random access memory) or a nonvolatile memory (such as a flash memory), which is used to store the image signal 11 from the host computer 10 or store the image signal 11 controlled by the display. The image signal 11 compressed by the device 110 can store the image signal for a predetermined period of time (for example, 10 minutes or longer) for use by the frame recall function of the display device 100 .

For example, the image buffer 140 includes a first storage space 141 and a second storage space 142 . When the display device 100 receives the image signal 11 from the host 10 through the transmission interface 150, the multiplexer 170 will transmit the image signal 11 to the display controller 110 through the path 171, and/or write the image signal 11 into the image through the path 172. The first storage space 141 of the buffer 140 . The first storage space 140 is, for example, used as an output image buffer in the normal frame mode, and the second storage space 142 is, for example, used as an output image buffer in the frame traceback mode.

The input interface 160 is used for controlling on/off of the menu displayed on the screen of the display device 100 and the screen recall function. In some embodiments, the input interface 160 can be realized by, for example, a five-way joystick 162 or five physical buttons 161 , so as to realize commands such as up, down, left, right, and confirmation. In addition, the input interface 160 also includes one or more function keys 1631-1633, wherein the function key 1632 is used to enable or disable the screen recall function of the display device 100, and the function keys 1631 and 1632 execute screen rewind and screen rewind. After (forward) and other functions.

In one embodiment, when the user operates one of the directions of the five-way joystick 162 (or presses one of the physical buttons 161), the display controller 110 can read the firmware 132 from the storage device 130 and display on the screen. The program codes of menus and related options are displayed on the screen in the interface 132, and the menus and related options are displayed on the display screen on the display module 120. In one embodiment, the user can operate on the input interface 160 to control the display device The menu is displayed on the screen of the display device 100, thereby adjusting the brightness, contrast, sharpness, color temperature of the display module 120, or opening or closing other interfaces in the display interface 132 on the screen. For example, the firmware 131 can be regarded as the display device 100 The firmware is preset, and the user can control the option settings of the on-screen display interface 132 displayed on the display device 100 through the five-way joystick 162 (or the physical button 161 ).

In another embodiment, the display device 100 of the present invention is not limited to use the function buttons 1631-1633 to perform the operation screen recall function. The user can also operate through the input interface 160 to open the on-screen display interface 132 related to the screen recall function, and can operate the physical button 161 or the five-way joystick 162 in the input interface 160 to control the on/off of the screen recall function, And screen rollback and screen back and other functions.

In some embodiments, the display controller 100 stores the image signal 11 (or the compressed image signal) into the second storage space 142 of the image buffer 140 by a first-in first-out mechanism. For example, the host computer 10 or the display device 100 can pre-set the capacity of the second storage space 142 in the image buffer 140, which corresponds to the number of output images that can be stored, which means that the above-mentioned number can be converted into the frame recall function. The time length of the video signal.

In detail, in some embodiments, for example, the display controller 100 can directly store the output image (for example, an RGB image) used for the frame recall function in the second storage space 142 . When the screen traceback function of the display device 100 is turned on, the display controller 100 can use the control signal of the screen traceback function to directly fetch the traceback image at the traceback time point to be played from the second storage space 142, and display it on the display module 120. Play the retrospective video.

In other embodiments, the display controller 100 first performs image compression (or video compression) on the image signal 11 used for the frame recall function to obtain a compressed image, and stores the compressed image in the second storage space 142 . When the screen backtracking function of the display device 100 is turned on, the display controller 100 can use the control signal of the screen backtracking function to directly fetch the compressed image corresponding to the backtracking time point to be played from the second storage space 142, and store the compressed image Image decompression is performed to obtain a retroactive image to be played on the display module 120 , and the retroactive image is played on the display module 120 .

It should be noted that no matter whether the display controller 110 compresses the image signal to be stored in the second storage space 142 or not, the display controller 110 uses a first-in-first-out mechanism to store the image signal or the compressed image signal in the second storage space. Space 142. In other words, when the total capacity of stored video signals or compressed video signals exceeds the capacity of the second storage space 142, the display controller 110 will store the earliest predetermined number of video signals or compressed video signals in the second storage space 142 Delete, and write the video signal or the compressed video signal at the latest time point into the second storage space 142 .

When the user activates the frame lookback function of the display device 100 through the function button 1632 or the on-screen display interface 132 at the time point T1, it means that the display controller 110 will start playing the lookback image signal on the display module 120 at the time point T1. , so the user does not need to watch the image screen from the host 10 temporarily. At this time, the switch circuit (not shown) in the multiplexer 170 will receive the trigger signal of the screen recall function from the input interface 160 to disconnect the path 172, which means that the display controller 110 will no longer send the image from the host at time T1. The image signal 11 of 10 is written into the second storage space 142 . If the user activates the frame review function of the display device 100 at the time point T1 , the user can only search for the review images within a predetermined time interval before the time point T1 through the function button 1631 . When the display device 100 is in the frame backtracking mode and the user searches back through the function button 1633 for the backtracking image, the display controller 110 can only search back the backtracking image up to the time point T1 at most.

In some embodiments, if the display device 100 is already in the screen backtracking mode, whenever the user presses the function button 1631 once and releases it, the display controller 110 will go forward a predetermined number of seconds from the current search time point (for example 5 seconds or 10 seconds) to obtain the retrospective image at the corresponding search time point, and set the current search time point as the time point corresponding to the above retrospective image. When the user continues to hold down the function button 1631 for more than a predetermined number of seconds (for example, 2 seconds), the display controller 110 will continuously and rapidly search backtracking images from the current search time point. When the user releases the function button 1631 , the display controller 110 stops searching forward for the retrospective image.

Similarly, whenever the user presses the function button 1633 once and releases it, the display controller 110 will go back a predetermined number of seconds (for example, 5 seconds or 10 seconds) from the current search time point to obtain the corresponding search time point The retrospective image of , and set the current search time point as the time point corresponding to the above retrospective image. When the user continues to hold down the function button 1633 for more than a predetermined number of seconds (for example, 2 seconds), the display controller 110 will continuously and rapidly search backward from the current search time point. When the user releases the function button 1633, the display controller 110 stops searching for the retrospective image.

2A-2C are schematic diagrams of a backtracking screen according to an embodiment of the present invention. Please refer to FIG. 1 and FIGS. 2A-2C at the same time.

Assuming that the user activates the screen review function of the display device 100 through the function button 1632 at time 09:35 (that is, time point T1), the display controller 110 will first obtain the review image at time 09:35 from the second storage space 142 202 , and play the retrospective image 202 on the display module 120 , wherein the retrospective image 202 includes a time column 211 to display the time point corresponding to the retrospective image 202 , and the user 20 faces forward at this time, as shown in FIG. 2A .

Assuming that the second storage space 142 of the display device 110 can store video signals with a length of 10 minutes at most, when the user presses the function button 1631 to continuously perform screen review, the display controller 110 can obtain at most ten minutes before the time 09:35. Minute retrospective images 204 . The lookback image 204 also includes a time column 211 to display the time point corresponding to the lookback image 204 , and the user 20 is facing left at this moment, as shown in FIG. 2B .

Next, when the user searches through the function button 1633 to search the screen in the future, the display controller 110 can search back to the retrospective image at the time of 09:35 at most. If the user uses the function button 1633 to watch the retrospective image 206 at time 09:31, the retrospective image 206 also includes a time column 211 to display the corresponding time point of the retrospective image 206, and at this time the user 20 faces backward, as shown in FIG. 2C shown.

It should be noted that when the user searches forward or backward through the function buttons 1631 or 1633 , there is still a time limit. In detail, the forward search can only search backtracking images within a predetermined time interval (for example, 10 minutes) before the time point T1 at most. The backward search can only search back to the retrospective image at the time point T1 from the earliest time point (ie ten minutes before the time point T1 ) before the predetermined time interval of the time point T1 at most.

FIG. 3 is a flow chart of a frame backtracking method of a display device according to an embodiment of the invention. Please refer to Figure 1 and Figure 3 at the same time.

In step S310 , the display controller 110 receives the image signal 11 from the host 10 and stores the image signal 11 into the image buffer 140 . For example, in some embodiments, the display controller 100 can directly store the output image (for example, RGB image) used for the frame recall function in the second storage space 142 . When the frame traceback function of the display device 100 is turned on, the display controller 100 can use the control signal of the frame traceback function to directly fetch the traceback image signal at the traceback time point to be played from the second storage space 142, and display it on the display module 120. Play the retrospective video signal on the computer.

In other embodiments, the display controller 100 first performs image compression (or video compression) on the image signal 11 used for the frame recall function to obtain a compressed image, and stores the compressed image in the second storage space 142 . When the screen backtracking function of the display device 100 is turned on, the display controller 100 can use the control signal of the screen backtracking function to directly fetch the compressed image corresponding to the backtracking time point to be played from the second storage space 142, and store the compressed image Image decompression is performed to obtain a retroactive image to be played on the display module 120 , and the retroactive image is played on the display module 120 .

In step S312, it is determined whether a trigger signal is received. When it is judged that the trigger signal is received, step S314 is executed. When it is judged that the trigger signal is not received, return to step S312. For example, the function button 1632 on the input interface 160 is used to enable or disable the screen recall function of the display device 100, that is, when the user presses the function button 1632 and releases it, the function button 1632 can generate a trigger signal to transmit to the multiplexer 170 and the display controller 110 .

In step S314, the display device 100 enters into a screen retracing mode. For example, in response to receiving the trigger signal (for example, at time point T1), the display controller 110 controls the display device 100 to enter the frame recall mode, and the switch circuit 172 of the multiplexer 170 will disconnect the path, which means that the display control The device 110 will no longer write the image signal 11 from the host 10 into the second storage space 142 at the time point T1. If the user activates the frame review function of the display device 100 at the time point T1 , the user can only search for the review images within a predetermined time interval before the time point T1 through the function button 1631 . When the display device 100 is in the frame backtracking mode and the user searches back through the function button 1633 for the backtracking image, the display controller 110 can only search back the backtracking image up to the time point T1 at most.

In step S316, the display controller 111 retrieves the video signal corresponding to the time from the video buffer according to the user instruction. For example, when the display device 100 is in the screen recall mode, the user can open the on-screen display interface 132 related to the screen recall function by operating the function buttons 1631 or 1633, or through the input interface 160, and can operate input The physical button 161 or the five-way joystick 162 in the interface 160 is used to control the on/off of the screen recall function, and functions such as screen rollback and screen backward. In some embodiments, when the frame traceback function of the display device 100 is enabled, the display controller 100 can use the control signal of the frame traceback function to directly fetch the traceback image at the traceback time point to be played from the second storage space 142 , And play the retrospective image on the display module 120 . In some other embodiments, when the frame traceback function of the display device 100 is enabled, the display controller 100 can use the control signal of the frame traceback function to directly retrieve the compressed file corresponding to the traceback time point to be played from the second storage space 142. image, and image decompression is performed on the compressed image to obtain a retrospective image to be played on the display module 120 , and the retrospective image is played on the display module 120 .

In step S318, it is determined whether a trigger signal is received. When it is determined that a trigger signal is received, step S320 is performed. When it is judged that the trigger signal is not received, return to step S316. For example, the above-mentioned trigger signal is used to switch the normal picture mode or the picture traceback mode of the display device 100 . When the display device 100 is already in the frame recall mode, if the display controller 110 determines that the trigger signal is received again, the display controller 110 controls the display device 100 to enter the normal frame mode.

In step S320, the display device 100 enters a normal screen mode. For example, the first storage space 140 is used as an output image buffer in normal frame mode. That is, in the normal image mode, the display controller 110 will obtain the output image from the first storage space 141 and play the output image on the display module 120 .

To sum up, the present invention provides a display device and its screen recall method, and the user can use the built-in screen recall function of the display device to browse the screen images within a predetermined time interval, thereby helping the user recall Users can browse the previously performed operations or browse the screens that the user has watched before, thereby enhancing the user experience.

Words such as "first", "second", and "third" used in the claims are used to modify the elements in the claims, and are not used to indicate that there is an order of priority, an antecedent relationship, or an element An element preceding another element, or a chronological order in performing method steps, is only used to distinguish elements with the same name.

Although the present invention is disclosed above with preferred embodiments, it is not intended to limit the scope of the present invention. Any person skilled in the art may make some changes and modifications without departing from the concept and scope of the present invention. Therefore, the scope of protection of the present invention should be defined by the claims.

Claims (16)

1. A display device, comprising: an image buffer; a display module; and a display controller, used for receiving an image signal from a host, and storing the image signal in the image buffer; Wherein, in response to the display controller receiving a trigger signal, the display controller controls the display device to enter a frame backtracking mode, Wherein the display controller fetches the traceback image corresponding to the traceback time point from the image buffer according to a user instruction, and plays the traceback image on the display module. 2. The display device as claimed in claim 1, wherein the display controller first compresses the image signal to obtain a compressed image signal, and stores the compressed image signal into the image buffer, Wherein when the display device is in the frame backtracking mode, the display controller obtains the compressed video signal corresponding to the backtracking time point from the image buffer, and decompresses the compressed video signal to obtain the backtracking image. 3. The display device as claimed in claim 2, wherein the image buffer stores the compressed image signal for a predetermined time interval, and the display controller uses a first-in-first-out mechanism to store the compressed image signal into the image buffer. 4. The display device according to claim 1, further comprising: an input interface, wherein the input interface includes a first function key, a second function key and a third function key, wherein the second function key is used for Generating the trigger signal to turn on or off the screen scrolling mode of the display device, the first function key and the third function key are used to generate the user instruction, and respectively control the screen scrolling function in the screen scrolling mode And screen back function. 5. The display device as claimed in claim 4, wherein when the display device is in the screen recall mode and a user presses the first function button or the third function button and releases it, the display controller starts from the current The search time point is moved forward or backward by a predetermined number of seconds to obtain the traceback time point, and the traceback image corresponding to the traceback time point is obtained from the image buffer. 6. The display device as claimed in claim 4, wherein when the display device is in the screen recall mode and a user keeps pressing the first function button or the third function button, the display controller will start from the current search Search the lookback image quickly forward or backward in time. 7. The display device as claimed in claim 4, wherein when the display device is in the screen recall mode and the display controller receives the trigger signal from the second function key, the display controller controls the display device to return to normal picture mode. 8. The display device of claim 1, wherein the display controller stops writing the image signal into the image buffer in response to the display device entering the frame look-back mode. 9. A frame backtracking method for a display device, wherein the display device includes an image buffer, a display module and a display controller, the method comprising: receiving an image signal from a host by using the display controller, and storing the image signal in the image buffer; In response to the display controller receiving a trigger signal, using the display controller to control the display device to enter a frame retrace mode; and The display controller is used to fetch the traceback image corresponding to the traceback time point from the image buffer according to a user instruction, and play the traceback image on the display module. 10. The screen backtracking method of a display device according to claim 9, further comprising: using the display controller to first compress the video signal to obtain a compressed video signal, and store the compressed video signal into the video buffer; When the display device is in the frame retrospective mode, the display controller is used to obtain the compressed image signal corresponding to the retrospective time point from the image buffer, and decompress the compressed video signal to obtain the retrospective image. 11. The frame backtracking method of a display device as claimed in claim 9, wherein the image buffer stores the compressed image signal within a predetermined time interval, and the method further comprises: utilizing a first-in-first-out mechanism by the display controller to store the compressed image signal into the image buffer. 12. The method for recalling images of a display device according to claim 9, wherein the display device further comprises: an input interface, wherein the input interface includes a first function key, a second function key and a third function key, Wherein the second function button is used to generate the trigger signal to turn on or off the screen recall mode of the display device, the first function button and the third function button are used to generate the user instruction, and respectively control the screen The screen rollback function and the screen backward function in the retrace mode. 13. The screen traceback method of a display device according to claim 12, further comprising: When the display device is in the screen backtracking mode and a user presses the first function button or the third function button and releases it, the display controller is used to move forward or backward a predetermined second from the current search time point to obtain the traceback time point, and obtain the traceback image corresponding to the traceback time point from the image buffer. 14. The screen backtracking method of a display device according to claim 12, further comprising: When the display device is in the frame review mode and a user keeps pressing the first function button or the third function button, the display controller is used to quickly search forward or backward from the current search time point for the review image . 15. The screen backtracking method of a display device according to claim 12, further comprising: When the display device is in the frame recall mode and the display controller receives the trigger signal from the second function key, the display controller is used to control the display device to return to the normal frame mode. 16. The screen backtracking method of a display device according to claim 9, further comprising: In response to the display device entering the frame look-back mode, the display controller stops writing the image signal into the image buffer.

Images