WO2021237614A1 - 触控显示设备及其触控响应方法、系统及存储介质 - Google Patents

触控显示设备及其触控响应方法、系统及存储介质 Download PDF

Info

Publication number
WO2021237614A1
WO2021237614A1 PCT/CN2020/093023 CN2020093023W WO2021237614A1 WO 2021237614 A1 WO2021237614 A1 WO 2021237614A1 CN 2020093023 W CN2020093023 W CN 2020093023W WO 2021237614 A1 WO2021237614 A1 WO 2021237614A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame rate
touch
rate processing
processing format
format
Prior art date
Application number
PCT/CN2020/093023
Other languages
English (en)
French (fr)
Inventor
王建亭
王洁琼
王薇
石阳
黄翠兰
邢颖
Original Assignee
京东方科技集团股份有限公司
北京京东方显示技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方显示技术有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US17/280,320 priority Critical patent/US11507224B2/en
Priority to CN202080000846.9A priority patent/CN114008570B/zh
Priority to PCT/CN2020/093023 priority patent/WO2021237614A1/zh
Publication of WO2021237614A1 publication Critical patent/WO2021237614A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers

Definitions

  • This application relates to the field of computer technology, and in particular to a touch display device and its touch response method, system and storage medium.
  • the interactive whiteboard is a human-computer interactive electronic display platform that integrates various technologies, because it can display the content displayed on the smart terminal to the user, for the user to watch or touch the content It is widely used in various fields for editing.
  • the IWB can be connected with smart terminals.
  • the content displayed on the smart terminal can be synchronized to the IWB
  • the IWB can synchronously edit the content displayed on the IWB in response to the received touch operation
  • the edited content can be synchronized to the smart terminal again. That is, the user can control the smart terminal by performing a touch operation on the IWB.
  • the content of the present invention is provided in order to introduce a part of the embodiments further described in the detailed description below.
  • the present application provides a touch display device and a touch response method, system, and storage medium thereof, so as to improve the phenomenon that the sense of touch delay becomes more and more obvious.
  • a touch response method of a touch display device includes: a data buffer, and the method includes:
  • Controlling the data buffer to buffer the touch data according to a target mode including: a single frame first-in first-out mode or a line buffer mode;
  • the touch display device further includes: a display data random access memory DDRAM; before controlling the data buffer to buffer the touch data in a target mode, the method further includes: turning off the configuration of the DDRAM Function.
  • DDRAM display data random access memory
  • the DDRAM includes multiple storage address selection pins, data write pins, and read/write selection pins;
  • the disabling the configuration function of the DDRAM includes at least one of the following methods:
  • the touch display device is connected to a terminal device, and before the frame rate conversion processing is performed on the touch data in the data buffer based on a target frame rate processing format, the method further includes:
  • Target frame rate processing format is the first frame rate processing format or the second frame rate supported by the terminal device Processing format.
  • the format acquisition request also carries the request priority of the first frame rate processing format and the second frame rate processing format, and the request priority of the first frame rate processing format is greater than Request priority of the second frame rate processing format;
  • the received target frame rate processing format is The second frame rate processing format
  • the received target frame rate processing format is the first frame rate processing format.
  • the first frame rate processing format is a full frame rate processing format; the second frame rate processing format is a half frame rate processing format.
  • the performing frame rate conversion processing on the touch data in the data buffer based on a target frame rate processing format includes:
  • the performing frame line locking processing on the touch data in the data buffer includes:
  • Signal locking is performed on the line clock signal controlling the touch data in the data buffer, and the frame clock signal controlling the touch data in the data buffer is signal locked.
  • the performing frequency multiplication read processing on the touch data in the data buffer includes:
  • the method further includes: processing the video signal output based on the touch data Perform spread spectrum processing.
  • a touch response device of a touch display device is provided, the touch display device has a touch area, and the touch display device includes: a data buffer and a processor, the processor Configured as:
  • Controlling the data buffer to buffer the touch data according to a target mode including: a single frame first-in first-out mode or a line buffer mode;
  • the touch display device further includes: a display data random access memory DDRAM; the processor is further configured to: before controlling the data buffer to buffer the touch data in a target mode, turn off the DDRAM configuration function.
  • DDRAM display data random access memory
  • the touch display device is connected to a terminal device, and the processor is further configured to:
  • Target frame rate processing format is the first frame rate processing format or the second frame rate supported by the terminal device Processing format.
  • the format acquisition request also carries the request priority of the first frame rate processing format and the second frame rate processing format, and the request priority of the first frame rate processing format is greater than Request priority of the second frame rate processing format;
  • the received target frame rate processing format is The second frame rate processing format
  • the received target frame rate processing format is the first frame rate processing format.
  • the first frame rate processing format is a full frame rate processing format; the second frame rate processing format is a half frame rate processing format.
  • the processor is configured to:
  • a touch response system of a touch display device includes: a terminal device and the touch display device as described in the foregoing embodiments;
  • the touch display device is used to obtain touch data generated based on a user's touch operation on the touch display device, control the data buffer to buffer the touch data in a target mode, and send it to the terminal device Format acquisition request, and perform frame rate conversion processing on the touch data in the data buffer based on the target frame rate processing format sent by the terminal device, wherein the target mode includes: single-frame first-in-first-out mode or line Cache mode; the terminal device is used to send a target frame rate processing format to the touch display device based on the format acquisition request.
  • the terminal device is an open pluggable built-in computer device or an external computer device.
  • a non-volatile computer-readable storage medium is provided, and instructions are stored in the computer-readable storage medium.
  • the computer-readable storage medium runs on a computer, the computer can execute The touch response method of the touch display device described in the implementation mode.
  • FIG. 1 is a schematic diagram of a system formed between a touch display device and a terminal device according to one or more embodiments of the present disclosure
  • FIG. 2 is a schematic structural diagram of a touch display device provided by one or more embodiments of the present disclosure
  • FIG. 3 is a schematic diagram of touch delay in a touch display device provided by one or more embodiments of the present disclosure
  • FIG. 4 is a flowchart of a touch response method of a touch display device according to one or more embodiments of the present disclosure
  • FIG. 5 is a flowchart of another touch response method of a touch display device provided by one or more embodiments of the present disclosure
  • FIG. 6 is a block diagram of a touch response device of a touch display device provided by one or more embodiments of the present disclosure
  • FIG. 7 is a block diagram of another touch response device of a touch display device provided by one or more embodiments of the present disclosure.
  • FIG. 8 is a block diagram of still another touch response device of a touch display device according to one or more embodiments of the present disclosure.
  • FIG. 9 is a block diagram of a processing module provided by one or more embodiments of the present disclosure.
  • FIG. 10 is a block diagram of still another touch response device of a touch display device according to one or more embodiments of the present disclosure.
  • FIG. 11 is a schematic diagram of the hardware structure of a touch response device of a touch display device provided by one or more embodiments of the present disclosure.
  • FIG. 1 it is a schematic diagram of a system formed between a touch display device and a terminal device.
  • the system may include: a terminal device 01 and a touch display device 02, and the touch display device 02 may have a touch area for the user to touch.
  • a communication connection between the terminal device 01 and the touch display device 02 may be established through a wired or wireless network, and the terminal device 01 and the touch display device 02 may perform data transmission based on the communication connection.
  • the touch display device 02 can obtain the touch data generated based on the user's touch operation on the touch area of the touch display device 02, and send the touch data to the terminal device 01 in real time for display by the terminal device 01 . That is, the images displayed on the touch display device 02 and the terminal device 01 can be updated simultaneously.
  • the touch data acquired by the touch display device 02 may be data generated directly based on the touch operation performed by the user in the touch area, or it may also be the data generated by the touch operation performed by the user in the touch area. Data generated after a series of processing (eg, optimization).
  • the touch display device 02 may at least include a data buffer (buffer) 021, a display data random access memory (DDRAM) 022 As well as a system on chip (SOC) 023, the system on chip 023 may also be referred to as a processing chip.
  • the processing chip may include a touch response device capable of implementing the touch display device described in the embodiments of the present disclosure.
  • the data buffer 021 and DDRAM 022 can both be used to buffer uncompressed video transport stream (TS) data. That is, the DDRAM 022 is also a kind of buffer, but generally performs frame buffering (ie, frame storage), and each frame of data buffered by the DDRAM 022 can constitute a frame of image.
  • the touch display device 02 can be a touch all-in-one machine that integrates touch control, display, and data transmission with the terminal device 01.
  • touch all-in-one devices are intelligent interactive devices that include functions such as writing, file playback, and video, such as conference machines, educational machines, and so on.
  • the touch display device 02 shown in FIG. 1 is an IWB in scenarios such as education or conferences.
  • the terminal device 01 may be an open pluggable specification (open pluggable specification, OPS) built-in computer device or an external computer device. That is, the touch display device 02 may have a built-in OPS terminal device, or the touch display device 02 may establish a connection with a computer device independent of the touch display device 02.
  • the touch display device 02 may be a display device capable of supporting a multi-processing system.
  • the terminal device 01 shown in FIG. 1 is an external notebook computer.
  • IWB generally may also include a touch drive integrated circuit (touch drive integrated circuit, touch drive IC) that performs touch drive based on touch operations, and a display drive IC that displays images based on touch operations, which may also be referred to as a display system.
  • touch drive integrated circuit touch drive integrated circuit
  • display drive IC displays images based on touch operations
  • the factors that affect IWB touch response speed can include the following aspects: first, the impact of the touch coordinate reporting rate of the touch drive circuit; second, some software (such as writing trajectory processing related software) algorithms configured in IWB Impact. For example, software algorithms such as data packet transmission, conversation, expression, and graphic fitting based on touch operations; third, the delay effect of the display system on the processing of touch data.
  • the display system's processing of touch data can include a series of processing such as noise reduction, motion compensation, small angle calculation, frame rate conversion, and scaling.
  • the display system generally processes multiple frames of data at the same time.
  • the display system receives multiple frames of touch data at the same time, and performs noise reduction or motion compensation on the multiple frames of touch data.
  • the multi-frame processing of the display system has become the main factor causing the improvement of the touch delay.
  • DDRAM 022 for buffering. Assuming that three frames are processed at the same time, and assuming that one frame (for example, 60 Hz) processing brings about a delay of x milliseconds (ms), then processing three frames at the same time may bring about a delay of 3x ms, which will cause touch A more obvious phenomenon of time delay.
  • the embodiments of the present disclosure provide a touch response method for a touch display device.
  • the method adopts a single-frame first input first output (FIFO) or line buffer (line buffer) mode by turning off multi-frame processing related algorithms. Cache the touch data, and perform frame rate conversion processing on the touch data based on the point-to-point pixel by pixel full frame rate/half frame rate format.
  • FIFO first input first output
  • line buffer line buffer
  • FIG. 4 is a flowchart of a touch response method of a touch display device provided by one or more embodiments of the present disclosure.
  • the method can be applied to the SOC of the touch display device 02 shown in FIG. 1, in other words, the The method can be executed by the SOC of the touch display device 02 and implemented in the scene of the touch display device 02.
  • the method may include:
  • Step 401 Acquire touch data generated based on the touch operation of the user on the touch display device.
  • the SOC of the touch display device can detect the touch operation, and further obtain touch data generated based on the touch operation.
  • Step 402 Control the data buffer to buffer the touch data according to the target mode.
  • the target mode may include: single frame FIFO mode or line buffer mode.
  • the SOC can buffer the touch data according to the above-mentioned target mode by controlling the data buffer to reduce frame memory related algorithms.
  • Step 403 Perform frame rate conversion processing on the touch data in the data buffer based on the target frame rate processing format.
  • the SOC can further perform frame rate conversion processing on the touch data buffered in the data buffer based on the target frame rate processing format to ensure reliable display of the touch display device.
  • the target frame rate processing format may be obtained by the SOC from the terminal device in advance.
  • the embodiments of the present disclosure provide a touch response method of a touch display device. Since this method can obtain the touch data generated based on the user's touch operation on the touch display device, the data buffer can be controlled to buffer the touch data according to the single-frame first-in-first-out mode or the line buffer mode, and can be based on the target frame rate
  • the processing format performs frame rate conversion processing on the touch data buffered in the data buffer. Therefore, while ensuring the reliable display of the touch display device based on the touch data, the touch response speed is improved by reducing the frame memory related algorithms. Touch time delay.
  • FIG. 5 is a flowchart of another touch response method of a touch display device provided by one or more embodiments of the present disclosure, which can be applied to FIG.
  • the touch display device 02 shown in 1 is included in the SOC.
  • the method may include:
  • Step 501 Acquire touch data generated based on the user's touch operation on the touch display device.
  • the SOC can detect whether the user has performed a touch operation in its touch area in real time or every preset time period. If a touch operation is detected, the SOC can further obtain touch data generated based on the touch operation .
  • the touch data acquired by the SOC can be directly generated based on the user's touch operation without any processing (for example, motion compensation, noise reduction or beautification, etc.) data.
  • the touch data acquired by the SOC may be data obtained after the above optimization processing is performed on the touch data generated by the user's touch operation.
  • the embodiments of the present disclosure do not limit the acquired touch data.
  • the touch display device can have a built-in terminal device, or an external terminal device. And for the built-in terminal device, the touch operation can be fed back to the SOC through the internal touch follow channel. Therefore, if the touch display device is a built-in terminal device, the SOC of the touch display device can determine that there is an internal touch follow channel When, confirm that a touch operation is detected. In the same way, for an external terminal device, the touch operation can be fed back to the SOC through the external touch follow channel. Therefore, if the touch display device is an external terminal device, the SOC of the touch display device can be determined to have an internal touch When following the channel, make sure that a touch operation is detected. That is, “detect touch operation and obtain touch data” can be understood as “execute reading touch data and determine whether the channel is a touch follower" operation.
  • Step 502 Send a format acquisition request to the terminal device.
  • the touch display device since the touch display device is working normally, it can not only display an image based on the received touch operation, for example, it can display the trajectory of the touch operation. Alternatively, the image may not be automatically displayed based on the touch operation, such as directly receiving and displaying the image sent by the terminal device. For scenes that do not receive the touch operation and display normally, because the user does not perform the touch operation on the touch display device, there is no touch delay problem, and only in the scene where the image is displayed based on the touch operation. There is a touch delay problem. Therefore, the SOC of the touch display device can further send a format acquisition request to the terminal device connected to it when a touch operation is detected. Correspondingly, if no touch operation is detected, that is, no touch data is acquired, the touch display device may not execute the following steps, for example, it may directly enter the normal display program.
  • the SOC can send a format acquisition request to the terminal device through a direct digital control (direct digital control, DDC) communication interface.
  • the format acquisition request can be used to request the frame rate processing format of the touch data when it is finally displayed based on the touch data.
  • the format acquisition request may carry the first frame rate processing format and the second frame rate processing format.
  • frame rate refers to the number of frames or images that can be displayed per second.
  • frame rate processing can refer to controlling the touch display device to simultaneously display images corresponding to several frame rates of touch data.
  • the format acquisition request sent by the SOC to the terminal device can also carry the request priority of the two frame rate processing formats.
  • the higher the request priority the more the touch display device is. I want to get the corresponding frame rate processing format.
  • the request priority of the first frame rate processing format may be greater than the request priority of the second frame rate processing format.
  • the first frame rate processing format with a higher priority may be a full frame rate processing format.
  • the second frame rate processing format with a lower priority may be a half frame rate processing format.
  • Full frame rate processing means that the number of frame rates processed at the same time is the same as the number of received frame rates.
  • Half frame rate processing means that the number of frame rates processed at the same time is half of the number of received frame rates, that is, all frame rates need to be processed twice to complete.
  • Step 503 Receive the target frame rate processing format returned by the terminal device after responding to the format acquisition request.
  • the frame rate processing format used by the touch display device for touch data processing needs to be the same as the frame rate processing format supported by the connected terminal device, and the content carried in the request is obtained due to the format received by the terminal device It is the first frame rate processing format and the second frame rate processing format, so the target frame rate processing format sent by the terminal device to the SOC is either the first frame rate processing format or the second frame rate processing format. That is, the target frame rate processing format returned by the terminal device may be the first frame rate processing format or the second frame rate processing format supported by the terminal device.
  • the terminal device may first determine its own format when receiving the format acquisition request.
  • the frame rate processing format that can be supported is then based on the frame rate processing format that can be supported and the priority carried in the received format acquisition request to reliably send the target frame rate processing format to the SOC. For example, if the frame rate processing format supported by the terminal device includes the first frame rate processing format and the second frame rate processing format, that is, the terminal device can support the frame rate processing format with priority requirements, of course, the terminal device should provide the touch display device as much as possible. Send the first frame rate processing format corresponding to the priority demand.
  • the target frame rate processing format received by the SOC is the first frame rate processing format. If the frame rate processing format supported by the terminal device includes the first frame rate processing format and the second frame rate processing format in the second frame rate processing format, that is, the terminal device cannot support the priority demand, the terminal device can send to the SOC at this time The second frame rate processing format corresponding to the second priority requirement. That is, the target frame rate processing format received by the SOC is the second frame rate processing format.
  • the SOC can configure the target frame rate processing format to itself for subsequent frame rate processing of touch data for touch operations to ensure reliable display.
  • the SOC can also set the frame rate to the display frame rate mode, that is, the frame rate processing is ultimately used to display images.
  • Step 504 Turn off the configuration function of the DDRAM.
  • DDRAM is generally used for frame memory. Therefore, in order to reduce frame memory related algorithms, the SOC can first turn off the configuration function of DDRAM.
  • the DDRAM may include pins with various different functions, such as multiple storage address selection pins A0-An, data write pins data, and read write (write) selection pins R/W.
  • pins with various different functions such as multiple storage address selection pins A0-An, data write pins data, and read write (write) selection pins R/W.
  • turning off the configuration function of DDRAM can be implemented in at least one of the following ways:
  • the high-impedance state refers to an output state
  • setting the pin to high-impedance state can be understood as setting the pin to float.
  • the signal output by the pin can be turned off, that is, the pin that is set to the high-impedance state will not output signals to other devices to affect other devices.
  • turning off the DDRAM configuration function is not limited to the above-mentioned implementation methods.
  • the SOC after turning off the DDRAM configuration function, detects that the touch display device displays the image generated by the non-touch operation at a certain moment (that is, it enters the normal display state), that is, when it detects that the touch follow channel is switched to other channels, it can again Turn on the configuration function of DDRAM to ensure the normal operation of IWB.
  • Step 505 Control the data buffer to buffer the touch data according to the target mode.
  • the target mode may be a single frame FIFO mode or a line buffer mode.
  • the single-frame FIFO mode means that only one frame of touch data is processed at a time, and when the touch data is written and read through the data buffer, the touch data that enters the data buffer first is read from the data buffer. That is, the data buffer does not need to be connected to an external read-write address line.
  • the line buffer mode refers to: when the touch data is written and read through the data buffer, the touch data is read once when a line feed operation is detected.
  • the SOC may adjust the working mode of the data buffer to the target mode after turning off the configuration function of the DDRAM, that is, control the data buffer to buffer the acquired touch data according to the target mode. That is, turning off the DDRAM configuration function in step 504 is a prerequisite for controlling the working mode of the data buffer to be the above-mentioned target mode.
  • the single-frame FIFO mode and the line buffer mode can both be point-to-point (ie pixel by pixel) modes to ensure one-to-one correspondence between display data and touch data.
  • the frame rate of the SOC you can set the pixel by pixel processing mode at the same time. Configuring the frame rate and setting the pixel by pixel processing mode can also be referred to as setting the channel source output operation.
  • Step 506 Perform frame rate conversion processing on the touch data in the data buffer based on the target frame rate processing format.
  • the SOC After the SOC buffers the touch data, it can perform frame rate conversion processing on the touch data buffered in the data buffer based on the target frame rate processing format acquired in advance.
  • the SOC may first determine whether the target frame rate processing format is a processing format with priority requirements, and perform frame rate conversion on the touch data based on the determination result.
  • the first frame rate processing format is the full frame rate processing format
  • the frame rate processing format with lower priority is requested as the second frame rate processing format.
  • the second frame rate processing format is a half frame rate processing format.
  • the SOC can respond to the target frame rate processing format as the second frame rate processing format at this time.
  • the line clock signal and the frame clock signal of the touch data in the control data buffer are subjected to frequency multiplication processing, so as to realize the frequency multiplication read processing of the touch data in the data buffer. After that, the touch display device can synchronously display the image corresponding to the touch data.
  • the frame rate conversion based on the target frame rate processing format and the setting of the data buffer to buffer data in the target mode can be referred to as image processing channel configuration.
  • the foregoing steps 502 to 506 may be referred to as adjusting extended display identification data (EDID).
  • Step 507 Perform spread spectrum processing on the video signal output based on the touch data.
  • the SOC can first output the video signal based on the touch data for display by the touch display device.
  • perform spread spectrum processing refers to modulating the spike signal of the video signal to change it from a narrowband signal to a spectrum with sidebands, and disperse the spike energy of the signal to multiple frequency bands in the spread spectrum region.
  • the video signal can output the video signal through the V-B-O interface or the LVDS interface.
  • the embodiment of the present disclosure adopts the Bypass protection mode; the first frame rate processing format with high request priority is the full frame rate processing format, and the second frame rate processing format with low request priority is the half frame rate processing format; the target mode is single Frame FIFO mode; perform direction correlational deinterlacing (DCDI) processing for noise reduction, motion compensation and directionality correlation; spread the clock signal in the video signal, and the spread amplitude is 1.5% as an example.
  • DCDI direction correlational deinterlacing
  • the Scaler function algorithm refers to an algorithm that adjusts the image display size for touch display devices of different resolutions. Setting the Scaler function algorithm to 0 means not running the algorithm.
  • step 507 can be deleted according to the situation.
  • the embodiments of the present disclosure provide a touch response method of a touch display device. Since this method can obtain the touch data generated based on the user's touch operation on the touch display device, the data buffer can be controlled to buffer the touch data according to the single-frame first-in-first-out mode or the line buffer mode, and can be based on the target frame rate
  • the processing format performs frame rate conversion processing on the touch data buffered in the data buffer. Therefore, while ensuring the reliable display of the touch display device based on the touch data, the touch response speed is improved by reducing the frame memory related algorithms. Touch time delay.
  • FIG. 6 is a block diagram of a touch response device of a touch display device provided by one or more embodiments of the present disclosure.
  • the device may be in the SOC of the touch display device in the implementation environment described in FIG. 1, or the The device can also be set on the SOC.
  • the device may include:
  • the acquiring module 601 is configured to acquire touch data generated based on the touch operation of the user in the touch area.
  • the control module 602 is used to control the data buffer to buffer the touch data according to the target mode.
  • the target mode may include: a single-frame first-in-first-out mode or a line buffer mode.
  • the processing module 603 performs frame rate conversion processing on the touch data in the data buffer based on the target frame rate processing format.
  • the touch display device may further include: a display data random access memory DDRAM 022.
  • FIG. 7 is a block diagram of a touch response device of a touch display device provided by one or more embodiments of the present disclosure. As shown in Figure 7, the device may also include:
  • the closing module 604 is used to close the configuration function of the DDRAM before controlling the data buffer to buffer the touch data according to the target mode.
  • the DDRAM may include multiple storage address selection pins, data write pins, and read/write selection pins.
  • the shutdown module 504 can be used to perform at least one of the following methods:
  • Disable DDR clock signal input to DDRAM.
  • FIG. 8 is a block diagram of another touch response device of a touch display device provided by one or more embodiments of the present disclosure.
  • the device may include:
  • the sending module 605 is configured to send a format acquisition request to the terminal device before performing frame rate conversion processing on the touch data in the data buffer based on the target frame rate processing format.
  • the format acquisition request carries the first frame rate processing format and the second frame rate processing format. Frame rate processing format.
  • the receiving module 606 is configured to receive the target frame rate processing format returned by the terminal device after responding to the format acquisition request.
  • the target frame rate processing format may be the first frame rate processing format or the second frame rate processing format supported by the terminal device.
  • the format acquisition request may also carry the request priority of the first frame rate processing format and the second frame rate processing format, and the request priority of the first frame rate processing format may be greater than that of the second frame rate processing format.
  • Request priority the request priority of the first frame rate processing format may be greater than that of the second frame rate processing format.
  • the received target frame rate processing format is the second frame rate processing format. If the frame rate processing format supported by the terminal device includes the first frame rate processing format and the second frame rate processing format, the received target frame rate processing format is the first frame rate processing format.
  • the first frame rate processing format may be a full frame rate processing format.
  • the second frame rate processing format may be a half frame rate processing format.
  • the processing module 603 may include:
  • the locking sub-module 6031 is configured to perform frame line locking processing on the touch data in the data buffer in response to the target frame rate processing format being the first frame rate processing format.
  • the frequency multiplication reading sub-module 6032 is configured to perform frequency multiplication reading processing on the touch data in the data buffer in response to the target frame rate processing format being the second frame rate processing format.
  • the locking sub-module 6031 can be used to: lock the line clock signal of the touch data in the control data buffer, and lock the frame clock signal of the touch data in the control data buffer.
  • the frequency multiplication reading submodule 6032 can be used to: multiply the frequency of the line clock signal that controls the touch data in the data buffer, and perform frequency multiplication on the frame clock signal of the touch data in the control data buffer Frequency multiplication processing.
  • FIG. 10 is a block diagram of another touch response device of a touch display device provided by one or more embodiments of the present disclosure. As shown in Figure 10, the device may also include:
  • the spread spectrum processing module 607 is configured to perform a spread spectrum processing on the video signal output based on the touch data after performing frame rate conversion processing on the touch data in the data buffer based on the target frame rate processing format.
  • the embodiments of the present disclosure provide a touch response device of a touch display device. Since the device can obtain touch data generated based on the user's touch operation on the touch display device, it can control the data buffer to buffer the touch data according to the single-frame first-in-first-out mode or the line buffer mode, and can be based on the target frame rate
  • the processing format performs frame rate conversion processing on the touch data buffered in the data buffer. Therefore, while ensuring the reliable display of the touch display device based on the touch data, the touch response speed is improved by reducing the frame memory related algorithms. Touch time delay.
  • an embodiment of the present disclosure further provides a touch display device, which may have a touch area, and may include a data buffer 021 and a processor (ie, FIG. 2 shows System chip 023).
  • the processor can be used to execute the touch response method of the touch display device as shown in FIG. 6 or FIG. 7.
  • FIG. 11 shows a structural block diagram of a touch display device 1100 provided by an exemplary embodiment of the present disclosure.
  • the device 1100 includes a processor 1101 and a memory 1102.
  • the processor 1101 may include one or more processing cores, such as a 4-core processor, an 11-core processor, and so on.
  • the processor 1101 can adopt at least one hardware form among DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array, Programmable Logic Array). accomplish.
  • the processor 1101 may also include a main processor and a coprocessor.
  • the main processor is a processor used to process data in the wake state, also called a CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor used to process data in the standby state.
  • the processor 1101 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used to render and draw content that needs to be displayed on the display screen.
  • the processor 1101 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computing operations related to machine learning.
  • AI Artificial Intelligence
  • the memory 1102 may include one or more computer-readable storage media, which may be non-transitory.
  • the memory 1102 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices.
  • the non-transitory computer-readable storage medium in the memory 1102 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 1101 to realize the operation of the touch display device of the embodiment of the present disclosure. Touch response method.
  • the device 1100 may further include: a peripheral device interface 1103 and at least one peripheral device.
  • the processor 1101, the memory 1102, and the peripheral device interface 1103 may be connected by a bus or a signal line.
  • Each peripheral device can be connected to the peripheral device interface 1103 through a bus, a signal line, or a circuit board.
  • the peripheral device includes: at least one of a radio frequency circuit 1104, a touch screen 1105, a camera 1106, an audio circuit 1107, a positioning component 1108, and a power supply 1109.
  • the peripheral device interface 1103 can be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1101 and the memory 1102.
  • the processor 1101, the memory 1102, and the peripheral device interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one of the processor 1101, the memory 1102, and the peripheral device interface 1103 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.
  • the radio frequency circuit 1104 is used to receive and transmit RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals.
  • the radio frequency circuit 1104 communicates with a communication network and other communication devices through electromagnetic signals.
  • the radio frequency circuit 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals.
  • the radio frequency circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and so on.
  • the radio frequency circuit 1104 can communicate with other terminals through at least one wireless communication protocol.
  • the wireless communication protocol includes, but is not limited to: metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks and/or WiFi (Wireless Fidelity, wireless fidelity) networks.
  • the radio frequency circuit 1104 may also include a circuit related to NFC (Near Field Communication), which is not limited in the present disclosure.
  • the display screen 1105 is used to display UI (User Interface).
  • the UI can include graphics, text, icons, videos, and any combination thereof.
  • the display screen 1105 also has the ability to collect touch signals on or above the surface of the display screen 1105.
  • the touch signal can be input to the processor 1101 as a control signal for processing.
  • the display screen 1105 may also be used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards.
  • the display screen 1105 there may be one display screen 1105, which is provided with the front panel of the device 1100; in other embodiments, there may be at least two display screens 1105, which are respectively provided on different surfaces of the device 1100 or in a folded design; In still other embodiments, the display screen 1105 may be a flexible display screen, which is arranged on a curved surface or a folding surface of the device 1100. Furthermore, the display screen 1105 can also be set as a non-rectangular irregular pattern, that is, a special-shaped screen.
  • the display screen 1105 may be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
  • the camera assembly 1106 is used to capture images or videos.
  • the camera assembly 1106 includes a front camera and a rear camera.
  • the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal.
  • the camera assembly 1106 may also include a flash.
  • the flash can be a single-color flash or a dual-color flash. Dual color temperature flash refers to a combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.
  • the power supply 1107 is used to supply power to various components in the device 1100.
  • the power source 1107 may be alternating current, direct current, disposable batteries, or rechargeable batteries.
  • the rechargeable battery may support wired charging or wireless charging. Rechargeable batteries can also be used to support fast charging technology.
  • the device 1100 further includes one or more sensors 1108.
  • the one or more sensors 1108 include, but are not limited to: an acceleration sensor 11081, a gyroscope sensor 11082, a pressure sensor 11083, a fingerprint sensor 11084, an optical sensor 11085, and a proximity sensor 11086.
  • the acceleration sensor 11081 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the device 1100.
  • the acceleration sensor 11081 can be used to detect the components of gravitational acceleration on three coordinate axes.
  • the processor 1101 may control the touch screen 1105 to display the user interface in a horizontal view or a vertical view according to the gravitational acceleration signal collected by the acceleration sensor 11081.
  • the acceleration sensor 11081 may also be used for the collection of game or user motion data.
  • FIG. 11 does not constitute a limitation on the device 1100, and may include more or fewer components than shown in the figure, or combine certain components, or adopt different component arrangements.
  • a non-volatile computer-readable storage medium storing instructions, such as a memory including instructions.
  • the computer-readable storage medium runs on the computer, the computer can be caused to execute the touch response method of the touch display device shown in FIG. 6 or FIG. 7.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种触控显示设备及其触控响应方法、系统及存储介质,属于计算机技术领域。由于该方法包括:获取基于用户对触控显示设备的触控操作生成的触控数据(401),控制数据缓存器按照单帧先进先出模式或行缓存模式缓存该触控数据(402),基于目标帧频处理格式对数据缓存器中缓存的该触控数据进行帧频转换处理(403),能够在确保触控显示设备基于触控数据可靠显示的同时,通过减少帧存相关算法的方式提高触控响应速度,改善触控延时感。

Description

触控显示设备及其触控响应方法、系统及存储介质 技术领域
本申请涉及计算机技术领域,特别涉及一种触控显示设备及其触控响应方法、系统及存储介质。
背景技术
交互式电子白板(interactive whiteboard,IWB)作为一种融合了各类技术的人机交互电子展示平台,因其能够将智能终端上显示的内容展示给用户,供用户观看或通过触控操作对内容进行编辑而被广泛应用于各个领域中。
IWB可以与智能终端连接。其中,智能终端上显示的内容可以同步至IWB上,IWB可以响应于接收到的触控操作对其上显示的内容进行同步编辑,且编辑后的内容可以再同步显示至智能终端上。即,用户可以通过在IWB上进行触控操作实现对智能终端的控制。
但随着IWB的尺寸越来越大,触控延时相对明显。
发明内容
提供本发明内容以便以引入下文在具体实施方式中进一步描述的一部分实施例。本申请提供了一种触控显示设备及其触控响应方法、系统及存储介质,以改善触控延时感越来越明显的现象。
一些实施方式中,提供了一种触控显示设备的触控响应方法,所述触控显示设备包括:数据缓存器,所述方法包括:
获取基于用户对所述触控显示设备的触控操作生成的触控数据;
控制所述数据缓存器按照目标模式缓存所述触控数据,所述目标模式包括:单帧先进先出模式或行缓存模式;
基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理。
一些实施方式中,所述触控显示设备还包括:显示数据随机存储器DDRAM; 在控制所述数据缓存器按照目标模式缓存所述触控数据之前,所述方法还包括:关闭所述DDRAM的配置功能。
一些实施方式中,所述DDRAM包括多个存储地址选择引脚、数据写入引脚和读写选择引脚;
所述关闭所述DDRAM的配置功能,包括下述方式中的至少一种:
禁止DDR时钟信号输入至所述DDRAM;
设置所述多个存储地址选择引脚为高阻态;
设置所述数据写入引脚为高阻态;
设置所述读写选择引脚为高阻态。
一些实施方式中,所述触控显示设备与终端设备连接,所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之前,所述方法还包括:
向所述终端设备发送格式获取请求,所述格式获取请求携带有第一帧频处理格式和第二帧频处理格式;
接收所述终端设备响应于所述格式获取请求后返回的目标帧频处理格式,所述目标帧频处理格式是所述终端设备支持的所述第一帧频处理格式或所述第二帧频处理格式。
一些实施方式中,所述格式获取请求中还携带有所述第一帧频处理格式和所述第二帧频处理格式的请求优先级,且所述第一帧频处理格式的请求优先级大于所述第二帧频处理格式的请求优先级;
若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式中的所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第二帧频处理格式;
若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第一帧频处理格式。
一些实施方式中,所述第一帧频处理格式为全帧频处理格式;所述第二帧频处理格式为半帧频处理格式。
一些实施方式中,所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理,包括:
响应于所述目标帧频处理格式为所述第一帧频处理格式,对所述数据缓存 器中的所述触控数据进行帧行锁定处理;
响应于所述目标帧频处理格式为所述第二帧频处理格式,对所述数据缓存器中的所述触控数据进行倍频读取处理。
一些实施方式中,所述对所述数据缓存器中的所述触控数据进行帧行锁定处理,包括:
对控制所述数据缓存器中的所述触控数据的行时钟信号进行信号锁定,并对控制所述数据缓存器中的所述触控数据的帧时钟信号进行信号锁定。
一些实施方式中,所述对所述数据缓存器中的所述触控数据进行倍频读取处理,包括:
对控制所述数据缓存器中的所述触控数据的行时钟信号进行倍频处理,并对控制所述数据缓存器中的所述触控数据的帧时钟信号进行倍频处理。
一些实施方式中,所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之后,所述方法还包括:对基于所述触控数据输出的视频信号进行展频处理。
一些实施方式中,提供了一种触控显示设备的触控响应装置,所述触控显示设备具有触控区域,且所述触控显示设备包括:数据缓存器和处理器,所述处理器配置为:
获取基于用户在所述触控区域的触控操作生成的触控数据;
控制所述数据缓存器按照目标模式缓存所述触控数据,所述目标模式包括:单帧先进先出模式或行缓存模式;
基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理。
一些实施方式中,所述触控显示设备还包括:显示数据随机存储器DDRAM;所述处理器还被配置为:在控制所述数据缓存器按照目标模式缓存所述触控数据之前,关闭所述DDRAM的配置功能。
一些实施方式中,所述触控显示设备与终端设备连接,所述处理器还被配置为:
基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之前,向所述终端设备发送格式获取请求,所述格式获取请求携带有第一帧频处理格式和第二帧频处理格式;
接收所述终端设备响应于所述格式获取请求后返回的目标帧频处理格式,所述目标帧频处理格式是所述终端设备支持的所述第一帧频处理格式或所述第二帧频处理格式。
一些实施方式中,所述格式获取请求中还携带有所述第一帧频处理格式和所述第二帧频处理格式的请求优先级,且所述第一帧频处理格式的请求优先级大于所述第二帧频处理格式的请求优先级;
若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式中的所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第二帧频处理格式;
若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第一帧频处理格式。
一些实施方式中,所述第一帧频处理格式为全帧频处理格式;所述第二帧频处理格式为半帧频处理格式。
一些实施方式中,所述处理器被配置为:
响应于所述目标帧频处理格式为所述第一帧频处理格式,对所述数据缓存器中的所述触控数据进行帧行锁定处理;
响应于所述目标帧频处理格式为所述第二帧频处理格式,对所述数据缓存器中的所述触控数据进行倍频读取处理。
一些实施方式中,提供了一种触控显示设备的触控响应系统,所述系统包括:终端设备和如上述实施方式所述的触控显示设备;
其中,所述终端设备与所述触控显示设备之间建立有通信连接;
所述触控显示设备用于获取基于用户对所述触控显示设备的触控操作生成的触控数据,控制所述数据缓存器按照目标模式缓存所述触控数据,向所述终端设备发送格式获取请求,以及基于终端设备发送的于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理,其中所述目标模式包括:单帧先进先出模式或行缓存模式;所述终端设备用于基于所述格式获取请求,向所述触控显示设备发送目标帧频处理格式。
可选的,所述终端设备为开放式可拔插内置计算机设备或外置计算机设备。
一些实施方式中,提供了一种非易失性计算机可读存储介质,所述计算机可读存储介质中存储有指令,当所述计算机可读存储介质在计算机上运行时, 使得计算机执行如上述实施方式所述的触控显示设备的触控响应方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本公开一个或多个实施例提供的一种触控显示设备和终端设备之间构成的系统示意图;
图2是本公开一个或多个实施例提供的一种触控显示设备的结构示意图;
图3是本公开一个或多个实施例提供的一种触控显示设备中触控延时的示意图;
图4是本公开一个或多个实施例提供的一种触控显示设备的触控响应方法的流程图;
图5是本公开一个或多个实施例提供的另一种触控显示设备的触控响应方法的流程图;
图6是本公开一个或多个实施例提供的一种触控显示设备的触控响应装置的框图;
图7是本公开一个或多个实施例提供的另一种触控显示设备的触控响应装置的框图;
图8是本公开一个或多个实施例提供的再一种触控显示设备的触控响应装置的框图;
图9是本公开一个或多个实施例提供的一种处理模块的框图;
图10是本公开一个或多个实施例提供的再一种触控显示设备的触控响应装置的框图;
图11是本公开一个或多个实施例提供的一种触控显示设备的触控响应装置的硬件结构示意图。
具体实施方式
为使本申请实施例的申请构思的目的、技术方案和优点更加清楚,下面将 结合附图和一些实施例对所述申请构思做详细描述。
一个或多个实施例中,如图1所示,为触控显示设备和终端设备之间构成的系统示意图。如图1所示,该系统可以包括:终端设备01和触控显示设备02,该触控显示设备02可以具有触控区域以供用户进行触控。
参考图1,该终端设备01和触控显示设备02之间可以通过有线或无线网络建立有通信连接,且终端设备01与触控显示设备02可以基于该通信连接进行数据传输。如,触控显示设备02可以获取基于用户对触控显示设备02的触控区域的触控操作生成的触控数据,并将该触控数据实时发送至终端设备01,以供终端设备01显示。即触控显示设备02和终端设备01上显示的图像可以同步更新。可选的,触控显示设备02获取到的触控数据可以为直接基于用户在触控区域执行的触控操作生成的数据,或者,也可以为对用户在触控区域执行的触控操作进行一系列处理(如,优化)后生成的数据。
可选的,一个或多个实施例中,结合图1和图2,该触控显示设备02至少可以包括数据缓存器(buffer)021、显示数据随机存储器(display data random access memory,DDRAM)022以及系统芯片(system on chip,SOC)023,该系统芯片023也可以称为处理芯片。该处理芯片可以包括能够实现本公开实施例记载的触控显示设备的触控响应装置。其中,该数据缓存器021和DDRAM 022均可以用于缓存非压缩视频传送流(transport stream,TS)数据。即DDRAM 022也是缓存器的一种,只是一般进行帧缓存(即,帧存),DDRAM 022缓存的每帧数据均可以构成一帧图像。
可选的,触控显示设备02可以为集触控、显示以及能够与终端设备01进行数据传输为触控一体机。从应用场景角度,触控一体机为包含书写、文件播放和视频等功能的智能交互设备,比如会议机、教育机等。例如,图1示出的触控显示设备02为教育或会议等场景下的IWB。终端设备01可以为开放式可拔插规范(open pluggable specification,OPS)的内置计算机设备或外置计算机设备。也即是,触控显示设备02可以内置一OPS终端设备,或,触控显示设备02与独立于触控显示设备02的一计算机设备建立连接。且,触控显示设备02可以为能够支持多处理系统的显示设备。例如,图1示出的终端设备01为外接笔记本电脑。
以触控显示设备为IWB为例对影响触控速度的因素进行以下分析:
IWB一般还可以包括基于触控操作进行触控驱动的触控驱动电路(touch drive integrated circuit,touch drive IC),以及基于触控操作显示图像的显示驱动IC,也可以称为显示系统。影响IWB触控响应速度的因素可以包括如下几个方面:第一,触控驱动电路的触控坐标报点速率的影响;第二,IWB中配置的一些软件(如书写轨迹处理相关软件)算法的影响。如,数据包的传输、会话、表达和基于触控操作进行的图形拟合等软件算法;第三,显示系统对触控数据处理时产生的延时影响。如,显示系统对触控数据的处理可以包括:降噪、运动补偿、小角度计算、帧频变换和缩放等一系列处理。且显示系统一般是针对多帧数据进行同时处理。如,显示系统同时接收多帧触控数据,并对该多帧触控数据进行降噪或运动补偿。
随着触控驱动电路的迭代更新和软件算法的不断改善,显示系统的多帧处理成为造成触控延时感提升的主要因素。在进行多帧处理时,一般必然需要通过DDRAM 022进行缓存。假设同时进行三帧处理,且假设一帧(如,60赫兹Hz)处理带来x毫秒(ms)的延时,则同时进行三帧处理即可能带来3x ms的延时,进而造成触控延时感较为明显的现象。
例如,结合图3,假设用户在IWB上执行的触控操作为从a点至b点进行直线图像绘制,当用户在结束触控操作的同时,因触控延时问题,IWB上仅显示出a点至c点的直线图像,而并未显示出c点至b点的直线图像(图3以虚线标识未显示),c点位于a点至b点之间。
本公开实施例提供了一种触控显示设备的触控响应方法,该方法通过关闭多帧处理相关算法,采用单帧先进先出(first input first output,FIFO)或行缓存(line buffer)模式对触控数据进行缓存,并基于点对点pixel by pixel全帧频/半帧频格式对触控数据进行帧频转换处理。在不降低触控显示设备显示的画面品质的前提下,有效减少触控延时,改善了用户体验。
图4是本公开一个或多个实施例提供的一种触控显示设备的触控响应方法流程图,该方法可以应用于图1所示的触控显示设备02的SOC中,或者说,该方法可以由触控显示设备02的SOC执行,在触控显示设备02的场景中实现。如图4所示,该方法可以包括:
步骤401、获取基于用户对触控显示设备的触控操作生成的触控数据。
当用户在触控显示设备的触控区域上进行触控操作时,触控显示设备的 SOC可以检测到该触控操作,并进一步获取基于该触控操作生成的触控数据。
步骤402、控制数据缓存器按照目标模式缓存该触控数据。
其中,该目标模式可以包括:单帧FIFO模式或行缓存模式。为了在保证可靠显示的同时,改善触控延时感,SOC可以通过控制数据缓存器按照上述目标模式对触控数据进行缓存,以减少帧存相关算法。
步骤403、基于目标帧频处理格式,对数据缓存器中的触控数据进行帧频转换处理。
在缓存触控数据后,SOC可以进一步基于目标帧频处理格式对数据缓存器中缓存的触控数据进行帧频转换处理,保证触控显示设备的可靠显示。可选的,该目标帧频处理格式可以为SOC预先从终端设备获取到的。
综上,本公开实施例提供了一种触控显示设备的触控响应方法。由于该方法可以获取基于用户对触控显示设备的触控操作生成的触控数据,可以控制数据缓存器按照单帧先进先出模式或行缓存模式缓存该触控数据,且可以基于目标帧频处理格式对数据缓存器中缓存的该触控数据进行帧频转换处理,因此在确保触控显示设备基于触控数据可靠显示的同时,通过减少帧存相关算法的方式提高触控响应速度,改善触控延时感。
以触控显示设备为IWB为例,对触控响应方法进行介绍:图5是本公开一个或多个实施例提供的另一种触控显示设备的触控响应方法流程图,可以应用于图1所示的触控显示设备02包括的SOC中。如图5所示,该方法可以包括:
步骤501、获取基于用户对所述触控显示设备的触控操作生成的触控数据。
可选的,SOC可以实时或每隔预设时间段检测用户是否在其触控区域进行了触控操作,若检测到触控操作后,SOC可以进一步获取基于该触控操作生成的触控数据。且,SOC获取到的触控数据可以为基于用户的触控操作直接生成,且未经过任何处理(如,运动补偿、降噪或美化等)的数据。或者,SOC获取到的触控数据可以为对用户的触控操作生成的触控数据进行上述优化处理后得到的数据。本公开实施例对获取到的触控数据不做限定。
另,结合图1实施例,由于触控显示设备可以内置一终端设备,或,外接一终端设备。且对于内置终端设备而言,触控操作可以通过内部触控跟随通道反馈至SOC,故,若触控显示设备是内置终端设备,则触控显示设备的SOC可 以在判定有内部触控跟随通道时,确定检测到触控操作。同理,对于外接终端设备而言,触控操作可以通过外部触控跟随通道反馈至SOC,故,若触控显示设备是外接终端设备,则触控显示设备的SOC可以在判定有内部触控跟随通道时,确定检测到触控操作。即“检测触控操作,获取触控数据”可以理解为“执行读取触控数据,判定通道是否为触控跟随”的操作。
步骤502、向终端设备发送格式获取请求。
可选的,由于触控显示设备在正常工作时,不仅可以基于接收到的触控操作显示图像,例如可以显示该触控操作的轨迹。或者,也可以不基于触控操作自动显示图像,如直接接收终端设备发送的图像并显示。对于未接收到触控操作正常显示的场景,因用户并未在触控显示设备上执行触控操作,故也不存在触控延时问题,而只有在基于触控操作显示图像的场景下才存在触控延时的问题,故,触控显示设备的SOC可以在检测到触控操作时,再进一步向其所连接的终端设备发送格式获取请求。相应的,若未检测到触控操作,即未获取到触控数据,则触控显示设备可以不执行下述步骤,如可以直接进入正常显示程序。
其中,SOC可以通过直接数字控制(direct digital control,DDC)通讯接口向终端设备发送格式获取请求。该格式获取请求可以用于请求最终基于触控数据进行显示时,对触控数据进行帧频处理的格式。如,该格式获取请求中可以携带有第一帧频处理格式和第二帧频处理格式。另,帧频(frame rate)是指每秒钟可以显示的帧或图像的数量,相应的,帧频处理可以是指控制触控显示设备同时显示几个帧频的触控数据对应图像。
为了进一步确保能够获取到需要的帧频处理格式,SOC向终端设备发送的格式获取请求中还可以携带有该两个帧频处理格式的请求优先级,请求优先级越大表明触控显示设备更想获取对应的帧频处理格式。如,该第一帧频处理格式的请求优先级可以大于第二帧频处理格式的请求优先级。
可选的,优先级较大的第一帧频处理格式可以为全帧频处理格式。优先级较小的第二帧频处理格式可以为半帧频处理格式。全帧频处理是指:同时处理的帧频数量与接收到的帧频数量相同。半帧频处理是指:同时处理的帧频数量为接收到的帧频数量一半,即所有帧频数量需经两次处理才能完成。
步骤503、接收终端设备响应于格式获取请求后返回的目标帧频处理格式。
可选的,由于触控显示设备进行触控数据处理时采用的帧频处理格式需要 与连接的终端设备所支持的帧频处理格式相同,且由于终端设备接收到的格式获取请求中携带的内容为第一帧频处理格式和第二帧频处理格式,因此终端设备发送至SOC的目标帧频处理格式要么为第一帧频处理格式,要么为第二帧频处理格式。即终端设备返回的目标帧频处理格式可以是终端设备支持的第一帧频处理格式或第二帧频处理格式。
另,若终端设备接收到的格式获取请求中还携带第一帧频处理格式的优先级大于第一帧频处理格式的优先级,则终端设备在接收到格式获取请求时,可以先确定自己所能支持的帧频处理格式,然后基于所能支持的帧频处理格式,以及接收到的格式获取请求中携带的优先级向SOC可靠发送目标帧频处理格式。如,若终端设备支持的帧频处理格式包含第一帧频处理格式和第二帧频处理格式,即终端设备能够支持优先需求的帧频处理格式,则终端设备当然尽可能向触控显示设备发送优先需求对应的第一帧频处理格式。即,SOC接收到的目标帧频处理格式为第一帧频处理格式。若终端设备支持的帧频处理格式包含第一帧频处理格式和第二帧频处理格式中的第二帧频处理格式,即终端设备不能够支持优先需求,则此时终端设备可以向SOC发送次优先需求对应的第二帧频处理格式。即,SOC接收到的目标帧频处理格式为第二帧频处理格式。
可选的,SOC在接收到目标帧频处理格式后,可以将目标帧频处理格式配置给自身,以供后续对触控操作的触控数据进行帧频处理,保证可靠显示。另,SOC还可以设置帧频为显示屏帧频模式,即帧频处理最终是用于显示图像。
步骤504、关闭DDRAM的配置功能。
结合上述图1实施例,DDRAM一般用于进行帧存,故为了减少帧存相关算法,SOC可以先关闭DDRAM的配置功能。
可选的,DDRAM可以包括各种不同功能的引脚,如,多个存储地址选择引脚A0-An、数据写入引脚data和读(read)写(write)选择引脚R/W。相应的,关闭DDRAM的配置功能可以通过下述方式中的至少一种方式实现:
第一,禁止DDR时钟信号(即,DDR CLK)输入至DDRAM。
第二,设置多个存储地址选择引脚(即,A0-An)为高阻态。
第三,设置数据写入引脚(即,data)为高阻态。
第四,设置读写选择引脚(即,R/W)为高阻态。
其中,高阻态是指一种输出状态,设置引脚为高阻态可以理解为设置引脚 悬空。相应的,通过设置引脚为高阻态,即可以实现对该引脚输出的信号的关断,即被设置高阻态的引脚不会输出信号至其他器件以对其他器件产生影响。当然,关闭DDRAM的配置功能也不限于上述几种实现方式。
若SOC在关闭DDRAM配置功能后,检测到触控显示设备某刻显示了非触控操作生成的图像(即进入正常显示状态),即检测到从触控跟随通道切换至其他通道时,可以再次开启DDRAM的配置功能以保证IWB的正常运行。
步骤505、控制数据缓存器按照目标模式缓存触控数据。
其中,该该目标模式可以为单帧FIFO模式或行缓存模式。其中,单帧FIFO模式是指:每次仅处理一帧触控数据,且通过该数据缓存器写入读取触控数据时,先进入数据缓存器的触控数据先从数据缓存器中读出,即数据缓存器无需连接外部读写地址线。行缓存模式是指:通过数据缓存器写入读取触控数据时,当检测到执行换行操作时,读取一次触控数据。
在本公开实施例中,SOC可以在关闭DDRAM的配置功能之后,调整数据缓存器的工作模式为目标模式,即控制数据缓存器按照目标模式缓存获取到的触控数据。也即是,上述步骤504关闭DDRAM配置功能属于控制数据缓存器工作模式为上述目标模式的前提条件。
通过关闭DDRAM的配置功能,以及调整数据缓存器按照单帧FIFO模式或行缓存模式缓存触控数据,可以达到减少帧存算法的目的,进而提高了触控响应速度,改善了触控延时。可选的,单帧FIFO模式和行缓存模式可以均为点对点(即pixel by pixel)模式,保证显示数据和触控数据一一对应。SOC在配置帧频时,可以同时设置pixel by pixel处理模式。配置帧频和设置pixel by pixel处理模式也可以称为设置通道源输出操作。
步骤506、基于目标帧频处理格式对数据缓存器中的触控数据进行帧频转换处理。
SOC在缓存触控数据后,可以基于预先获取到的目标帧频处理格式,对缓存于数据缓存器中的触控数据进行帧频转换处理。可选的,SOC可以先判断目标帧频处理格式是否为优先需求的处理格式,并基于判断结果对触控数据进行帧频转换。
例如,假设请求优先级较高的帧频处理格式为第一帧频处理格式,第一帧频处理格式为全帧频处理格式,请求优先级较低的帧频处理格式为第二帧频处 理格式,第二帧频处理格式为半帧频处理格式。则当SOC获取到目标帧频处理格式后可以先判断是否为全帧频处理格式,若为全帧频处理格式,则此时SOC可以响应于目标帧频处理格式为第一帧频处理格式,通过对控制数据缓存器中的触控数据的行时钟信号和帧时钟信号进行信号锁定,从而实现对数据缓存器中的触控数据进行帧行锁定。相反,若目标帧频处理格式不是全帧频处理格式,即目标帧频处理格式为半帧频处理格式,则此时SOC可以响应于目标帧频处理格式为第二帧频处理格式,通过对控制数据缓存器中的触控数据的行时钟信号和帧时钟信号进行倍频处理,从而实现对数据缓存器中的触控数据进行倍频读取处理。之后,触控显示设备即可以同步显示出触控数据对应的图像。
其中,基于目标帧频处理格式进行帧频转换和设置数据缓存器按目标模式缓存数据可以称为图像处理通道配置。上述步骤502至步骤506可以称为调整扩展显示器识别数据(extended display identification data,EDID)。
步骤507、对基于触控数据输出的视频信号进行展频处理。
为了减少外界环境给基于触控数据输出的视频信号带来的电磁干扰(electro magnetic interference,EMC),SOC可以在基于触控数据输出视频信号以供触控显示设备显示时,先对该视频信号进行展频处理。其中,该展频处理是指过对视频信号的尖峰信号进行调制处理,使其从一个窄带信号变为一个具有边带的频谱,将信号的尖峰能量分散到展频区域的多个频率段。
可选的,该视频信号可以通过V-B-O接口或LVDS接口输出视频信号。
需要说明的是,上述步骤均可以采用软件算法实现。本公开实施例以采用Bypass防护模式;请求优先级高的第一帧频处理格式为全帧频处理格式,请求优先级低的第二帧频处理格式为半帧频处理格式;目标模式为单帧FIFO模式;执行降噪、运动补偿和方向性关联的隔行扫描(direction correlational deinterlacing,DCDI)处理;展频处理视频信号中的时钟信号,且展频幅度为1.5%为例以软件代码示出上述执行方法:
{buffer==单帧FIFO模式;       //设置数据缓存器按单帧FIFO模式工作
QDram EN;                      //控制DDRAM处于使能状态
Bypass noise reduction;       //设置降噪
Bypass motion compensation;  //设置运动补偿
Bypass DCDI;                //设置DCDI
Scaler==0;                      //scaler功能算法置0
If{Display frame==Input frame    //目标帧频处理格式为全帧频处理格式
DHclock==locked;                //锁定行时钟信号
DVclock==locked;               //锁定帧时钟信号
Else
DHclock==dobule;                //倍频行时钟信号
DVclock==dobule;                //倍频帧时钟信号
}
{Dclock==Hintotal*Vintotal*Vfre;  //置时钟信号为行与帧与参考信号之积
Dclock spread spectrum==1.5%;   //将时钟信号展频1.5%幅度
}
其中,Scaler功能算法是指一种针对不同分辨率的触控显示设备调整图像显示大小的算法。将Scaler功能算法置0是指不运行该算法。
需要说明的是,上述实施例提供的触控显示设备的触控响应方法步骤先后顺序可以进行适当调整,也可以根据情况进行相应增减,如步骤507可以根据情况进行删除。任何熟悉本技术领域的技术人员在本公开揭露的技术范围内,可轻易想到变化的方法,都应涵盖在本公开的保护范围之内,因此不再赘述。
综上所述,本公开实施例提供了一种触控显示设备的触控响应方法。由于该方法可以获取基于用户对触控显示设备的触控操作生成的触控数据,可以控制数据缓存器按照单帧先进先出模式或行缓存模式缓存该触控数据,且可以基于目标帧频处理格式对数据缓存器中缓存的该触控数据进行帧频转换处理,因此在确保触控显示设备基于触控数据可靠显示的同时,通过减少帧存相关算法的方式提高触控响应速度,改善触控延时感。
图6是本公开一个或多个实施例提供的一种触控显示设备的触控响应装置的框图,该装置可以是图1所述实施环境中的触控显示设备的SOC中,或者,该装置也可以设置在SOC上。如图6所示,该装置可以包括:
获取模块601,用于获取基于用户在触控区域的触控操作生成的触控数据。
控制模块602,用于控制数据缓存器按照目标模式缓存触控数据。
其中,该目标模式可以包括:单帧先进先出模式或行缓存模式。
处理模块603,基于目标帧频处理格式对数据缓存器中的触控数据进行帧频转换处理。
可选的,如图2所示,触控显示设备还可以包括:显示数据随机存储器DDRAM 022。图7是本公开一个或多个实施例提供的一种触控显示设备的触控响应装置的框图。如图7所示,该装置还可以包括:
关闭模块604,用于在控制数据缓存器按照目标模式缓存触控数据之前,关闭DDRAM的配置功能。
可选的,DDRAM可以包括多个存储地址选择引脚、数据写入引脚和读写选择引脚。相应的,关闭模块504,可以用于执行下述方式中的至少一种:
禁止DDR时钟信号输入至DDRAM。
设置多个存储地址选择引脚为高阻态。
设置数据写入引脚为高阻态。
设置读写选择引脚为高阻态。
可选的,如图1所示,触控显示设备可以与终端设备连接。相应的,图8是本公开一个或多个实施例提供的另一种触控显示设备的触控响应装置的框图,如图8所示,该装置可以包括:
发送模块605,用于基于目标帧频处理格式对数据缓存器中的触控数据进行帧频转换处理之前,向终端设备发送格式获取请求,格式获取请求携带有第一帧频处理格式和第二帧频处理格式。
接收模块606,用于接收终端设备响应于格式获取请求后返回的目标帧频处理格式。其中,该目标帧频处理格式可以为终端设备支持的第一帧频处理格式或第二帧频处理格式。
可选的,格式获取请求中还可以携带有第一帧频处理格式和第二帧频处理格式的请求优先级,且第一帧频处理格式的请求优先级可以大于第二帧频处理格式的请求优先级。则若终端设备支持的帧频处理格式包含第一帧频处理格式和第二帧频处理格式中的第二帧频处理格式,则接收到的目标帧频处理格式为第二帧频处理格。若终端设备支持的帧频处理格式包含第一帧频处理格式和第二帧频处理格式,则接收到的目标帧频处理格式为第一帧频处理格式。
可选的,第一帧频处理格式可以为全帧频处理格式。第二帧频处理格式可以为半帧频处理格式。
可选的,如图9所示,处理模块603,可以包括:
锁定子模块6031,用于响应于目标帧频处理格式为第一帧频处理格式,对数据缓存器中的触控数据进行帧行锁定处理。
倍频读取子模块6032,用于响应于目标帧频处理格式为第二帧频处理格式,对数据缓存器中的触控数据进行倍频读取处理。
可选的,锁定子模块6031可以用于:对控制数据缓存器中的触控数据的行时钟信号进行信号锁定,并对控制数据缓存器中的触控数据的帧时钟信号进行信号锁定。
可选的,倍频读取子模块6032可以用于:对控制数据缓存器中的触控数据的行时钟信号进行倍频处理,并对控制数据缓存器中的触控数据的帧时钟信号进行倍频处理。
可选的,图10是本公开一个或多个实施例提供的又一种触控显示设备的触控响应装置的框图。如图10所示,该装置还可以包括:
展频处理模块607,用于基于目标帧频处理格式对数据缓存器中的触控数据进行帧频转换处理之后,对基于触控数据输出的视频信号进行展频处理。
综上所述,本公开实施例提供了一种触控显示设备的触控响应装置。由于该装置可以获取基于用户对触控显示设备的触控操作生成的触控数据,可以控制数据缓存器按照单帧先进先出模式或行缓存模式缓存该触控数据,且可以基于目标帧频处理格式对数据缓存器中缓存的该触控数据进行帧频转换处理,因此在确保触控显示设备基于触控数据可靠显示的同时,通过减少帧存相关算法的方式提高触控响应速度,改善触控延时感。
可选的,结合上述图2,本公开实施例还提供了一种触控显示设备,该触控显示设备可以具有触控区域,且可以包括数据缓存器021和处理器(即图2示出的系统芯片023)。该处理器可以用于执行如图6或图7示出的触控显示设备的触控响应方法。
图11示出了本公开一个示例性实施例提供的触控显示设备1100的结构框图。该设备1100包括有处理器1101和存储器1102。
其中,处理器1101可以包括一个或多个处理核心,比如4核心处理器、11 核心处理器等。处理器1101可以采用DSP(Digital Signal Processing,数字信号处理)、FPGA(Field-Programmable Gate Array,现场可编程门阵列)、PLA(Programmable Logic Array,可编程逻辑阵列)中的至少一种硬件形式来实现。处理器1101也可以包括主处理器和协处理器,主处理器是用于对在唤醒状态下的数据进行处理的处理器,也称CPU(Central Processing Unit,中央处理器);协处理器是用于对在待机状态下的数据进行处理的低功耗处理器。在一些实施例中,处理器1101可以集成有GPU(Graphics Processing Unit,图像处理器),GPU用于负责显示屏所需要显示的内容的渲染和绘制。一些实施例中,处理器1101还可以包括AI(Artificial Intelligence,人工智能)处理器,该AI处理器用于处理有关机器学习的计算操作。
存储器1102可以包括一个或多个计算机可读存储介质,该计算机可读存储介质可以是非暂态的。存储器1102还可包括高速随机存取存储器,以及非易失性存储器,比如一个或多个磁盘存储设备、闪存存储设备。在一些实施例中,存储器1102中的非暂态的计算机可读存储介质用于存储至少一个指令,该至少一个指令用于被处理器1101所执行以实现本公开实施例的触控显示设备的触控响应方法。
在一些实施例中,设备1100还可以包括有:外围设备接口1103和至少一个外围设备。处理器1101、存储器1102和外围设备接口1103之间可以通过总线或信号线相连。各个外围设备可以通过总线、信号线或电路板与外围设备接口1103相连。具体地,外围设备包括:射频电路1104、触摸显示屏1105、摄像头1106、音频电路1107、定位组件1108和电源1109中的至少一种。
外围设备接口1103可被用于将I/O(Input/Output,输入/输出)相关的至少一个外围设备连接到处理器1101和存储器1102。在一些实施例中,处理器1101、存储器1102和外围设备接口1103被集成在同一芯片或电路板上;在一些其他实施例中,处理器1101、存储器1102和外围设备接口1103中的任意一个或两个可以在单独的芯片或电路板上实现,本实施例对此不加以限定。
射频电路1104用于接收和发射RF(Radio Frequency,射频)信号,也称电磁信号。射频电路1104通过电磁信号与通信网络以及其他通信设备进行通信。射频电路1104将电信号转换为电磁信号进行发送,或者,将接收到的电磁信号转换为电信号。可选地,射频电路1104包括:天线系统、RF收发器、一个或 多个放大器、调谐器、振荡器、数字信号处理器、编解码芯片组、用户身份模块卡等等。射频电路1104可以通过至少一种无线通信协议来与其它终端进行通信。该无线通信协议包括但不限于:城域网、各代移动通信网络(2G、3G、4G及5G)、无线局域网和/或WiFi(Wireless Fidelity,无线保真)网络。在一些实施例中,射频电路1104还可以包括NFC(Near Field Communication,近距离无线通信)有关的电路,本公开对此不加以限定。
显示屏1105用于显示UI(User Interface,用户界面)。该UI可以包括图形、文本、图标、视频及其它们的任意组合。当显示屏1105是触摸显示屏时,显示屏1105还具有采集在显示屏1105的表面或表面上方的触摸信号的能力。该触摸信号可以作为控制信号输入至处理器1101进行处理。此时,显示屏1105还可以用于提供虚拟按钮和/或虚拟键盘,也称软按钮和/或软键盘。在一些实施例中,显示屏1105可以为一个,设置设备1100的前面板;在另一些实施例中,显示屏1105可以为至少两个,分别设置在设备1100的不同表面或呈折叠设计;在再一些实施例中,显示屏1105可以是柔性显示屏,设置在设备1100的弯曲表面上或折叠面上。甚至,显示屏1105还可以设置成非矩形的不规则图形,也即异形屏。显示屏1105可以采用LCD(Liquid Crystal Display,液晶显示屏)、OLED(Organic Light-Emitting Diode,有机发光二极管)等材质制备。
摄像头组件1106用于采集图像或视频。可选地,摄像头组件1106包括前置摄像头和后置摄像头。通常,前置摄像头设置在终端的前面板,后置摄像头设置在终端的背面。在一些实施例中,后置摄像头为至少两个,分别为主摄像头、景深摄像头、广角摄像头、长焦摄像头中的任意一种,以实现主摄像头和景深摄像头融合实现背景虚化功能、主摄像头和广角摄像头融合实现全景拍摄以及VR(Virtual Reality,虚拟现实)拍摄功能或者其它融合拍摄功能。在一些实施例中,摄像头组件1106还可以包括闪光灯。闪光灯可以是单色温闪光灯,也可以是双色温闪光灯。双色温闪光灯是指暖光闪光灯和冷光闪光灯的组合,可以用于不同色温下的光线补偿。
电源1107用于为设备1100中的各个组件进行供电。电源1107可以是交流电、直流电、一次性电池或可充电电池。当电源1107包括可充电电池时,该可充电电池可以支持有线充电或无线充电。可充电电池还可以用于支持快充技术。
在一些实施例中,设备1100还包括有一个或多个传感器1108。该一个或多 个传感器1108包括但不限于:加速度传感器11081、陀螺仪传感器11082、压力传感器11083、指纹传感器11084、光学传感器11085以及接近传感器11086。
加速度传感器11081可以检测以设备1100建立的坐标系的三个坐标轴上的加速度大小。比如,加速度传感器11081可以用于检测重力加速度在三个坐标轴上的分量。处理器1101可以根据加速度传感器11081采集的重力加速度信号,控制触摸显示屏1105以横向视图或纵向视图进行用户界面的显示。加速度传感器11081还可以用于游戏或者用户的运动数据的采集。
图11中示出的结构并不构成对设备1100的限定,可以包括比图示更多或更少的组件,或组合某些组件,或采用不同的组件布置。在示例性实施例中,还提供了一种存储有指令的非易失性计算机可读存储介质,例如包括指令的存储器。当计算机可读存储介质在计算机上运行时,可以使得计算机执行上述图6或图7所示的触控显示设备的触控响应方法。
例如,非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
应当理解的是,在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。
以上所述仅为本公开的可选实施例,并不用以限制本公开,凡在本公开的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本公开的保护范围之内。

Claims (20)

  1. 一种触控显示设备的触控响应方法,其中,所述触控显示设备包括:数据缓存器,所述方法包括:
    获取基于用户对所述触控显示设备的触控操作生成的触控数据;
    控制所述数据缓存器按照目标模式缓存所述触控数据,所述目标模式包括:单帧先进先出模式或行缓存模式;
    基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理。
  2. 根据权利要求1所述的方法,其中,所述触控显示设备还包括:显示数据随机存储器DDRAM;在控制所述数据缓存器按照目标模式缓存所述触控数据之前,所述方法还包括:关闭所述DDRAM的配置功能。
  3. 根据权利要求2所述的方法,其中,所述DDRAM包括多个存储地址选择引脚、数据写入引脚和读写选择引脚;
    所述关闭所述DDRAM的配置功能,包括下述方式中的至少一种:
    禁止DDR时钟信号输入至所述DDRAM;
    设置所述多个存储地址选择引脚为高阻态;
    设置所述数据写入引脚为高阻态;
    设置所述读写选择引脚为高阻态。
  4. 根据权利要求1至3任一所述的方法,其中,所述触控显示设备与终端设备连接,所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之前,所述方法还包括:
    向所述终端设备发送格式获取请求,所述格式获取请求携带有第一帧频处理格式和第二帧频处理格式;
    接收所述终端设备响应于所述格式获取请求后返回的目标帧频处理格式,所述目标帧频处理格式是所述终端设备支持的所述第一帧频处理格式或所述第二帧频处理格式。
  5. 根据权利要求4所述的方法,其中,所述格式获取请求中还携带有所述第一帧频处理格式和所述第二帧频处理格式的请求优先级,且所述第一帧频处理格式的请求优先级大于所述第二帧频处理格式的请求优先级;
    若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式中的所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第二帧频处理格式;
    若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第一帧频处理格式。
  6. 根据权利要求4所述的方法,其中,所述第一帧频处理格式为全帧频处理格式;所述第二帧频处理格式为半帧频处理格式。
  7. 根据权利要求6所述的方法,其中,所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理,包括:
    响应于所述目标帧频处理格式为所述第一帧频处理格式,对所述数据缓存器中的所述触控数据进行帧行锁定处理;
    响应于所述目标帧频处理格式为所述第二帧频处理格式,对所述数据缓存器中的所述触控数据进行倍频读取处理。
  8. 根据权利要求7所述的方法,其中,所述对所述数据缓存器中的所述触控数据进行帧行锁定处理,包括:
    对控制所述数据缓存器中的所述触控数据的行时钟信号进行信号锁定,并对控制所述数据缓存器中的所述触控数据的帧时钟信号进行信号锁定。
  9. 根据权利要求7所述的方法,其中,所述对所述数据缓存器中的所述触控数据进行倍频读取处理,包括:
    对控制所述数据缓存器中的所述触控数据的行时钟信号进行倍频处理,并对控制所述数据缓存器中的所述触控数据的帧时钟信号进行倍频处理。
  10. 根据权利要求1至9任一所述的方法,其中,所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之后,所述方法还包括:对基于所述触控数据输出的视频信号进行展频处理。
  11. 根据权利要求9所述的方法,其中,所述格式获取请求中还携带有所述第一帧频处理格式和所述第二帧频处理格式的请求优先级,且所述第一帧频处理格式的请求优先级大于所述第二帧频处理格式的请求优先级;
    若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式中的所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第二帧频处理格式;
    若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第一帧频处理格式;
    所述对所述数据缓存器中的所述触控数据进行帧行锁定处理,包括:
    对控制所述数据缓存器中的所述触控数据的行时钟信号进行信号锁定,并对控制所述数据缓存器中的所述触控数据的帧时钟信号进行信号锁定;
    所述基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之后,所述方法还包括:对基于所述触控数据输出的视频信号进行展频处理。
  12. 一种触控显示设备,其中,所述触控显示设备具有触控区域,且所述触控显示设备包括:数据缓存器和处理器,所述处理器配置为:
    获取基于用户在所述触控区域的触控操作生成的触控数据;
    控制所述数据缓存器按照目标模式缓存所述触控数据,所述目标模式包括:单帧先进先出模式或行缓存模式;
    基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理。
  13. 根据权利要求12所述的触控显示设备,其中,所述触控显示设备还包括:显示数据随机存储器DDRAM;所述处理器还被配置为:在控制所述数据缓存器按照目标模式缓存所述触控数据之前,关闭所述DDRAM的配置功能。
  14. 根据权利要求12或13所述的触控显示设备,其中,所述触控显示设备与终端设备连接,所述处理器还被配置为:
    基于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理之前,向所述终端设备发送格式获取请求,所述格式获取请求携带有第一帧频处理格式和第二帧频处理格式;
    接收所述终端设备响应于所述格式获取请求后返回的目标帧频处理格式,所述目标帧频处理格式是所述终端设备支持的所述第一帧频处理格式或所述第二帧频处理格式。
  15. 根据权利要求14所述的触控显示设备,其中,所述格式获取请求中还携带有所述第一帧频处理格式和所述第二帧频处理格式的请求优先级,且所述第一帧频处理格式的请求优先级大于所述第二帧频处理格式的请求优先级;
    若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式中的所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第二帧频处理格式;
    若所述终端设备支持的帧频处理格式包含所述第一帧频处理格式和所述第二帧频处理格式,则接收到的目标帧频处理格式为所述第一帧频处理格式。
  16. 根据权利要求14所述的触控显示设备,其中,所述第一帧频处理格式为全帧频处理格式;所述第二帧频处理格式为半帧频处理格式。
  17. 根据权利要求16所述的触控显示设备,其中,所述处理器被配置为:
    响应于所述目标帧频处理格式为所述第一帧频处理格式,对所述数据缓存器中的所述触控数据进行帧行锁定处理;
    响应于所述目标帧频处理格式为所述第二帧频处理格式,对所述数据缓存器中的所述触控数据进行倍频读取处理。
  18. 一种触控显示设备的触控响应系统,其中,所述系统包括:终端设备和如权利要求12至17任一所述的触控显示设备;
    其中,所述终端设备与所述触控显示设备之间建立有通信连接;
    所述触控显示设备用于获取基于用户对所述触控显示设备的触控操作生成的触控数据,控制所述数据缓存器按照目标模式缓存所述触控数据,向所述终端设备发送格式获取请求,以及基于终端设备发送的于目标帧频处理格式对所述数据缓存器中的所述触控数据进行帧频转换处理,其中所述目标模式包括:单帧先进先出模式或行缓存模式;所述终端设备用于基于所述格式获取请求,向所述触控显示设备发送目标帧频处理格式。
  19. 根据权利要求18所述的系统,其中,所述终端设备为开放式可拔插内置计算机设备或外置计算机设备。
  20. 一种非易失性计算机可读存储介质,其中,所述计算机可读存储介质中存储有指令,当所述计算机可读存储介质在计算机上运行时,使得计算机执行如权利要求1至11任一所述的触控显示设备的触控响应方法。
PCT/CN2020/093023 2020-05-28 2020-05-28 触控显示设备及其触控响应方法、系统及存储介质 WO2021237614A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US17/280,320 US11507224B2 (en) 2020-05-28 2020-05-28 Touch display device, touch response method and system thereof, and storage medium
CN202080000846.9A CN114008570B (zh) 2020-05-28 2020-05-28 触控显示设备及其触控响应方法、系统及存储介质
PCT/CN2020/093023 WO2021237614A1 (zh) 2020-05-28 2020-05-28 触控显示设备及其触控响应方法、系统及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/093023 WO2021237614A1 (zh) 2020-05-28 2020-05-28 触控显示设备及其触控响应方法、系统及存储介质

Publications (1)

Publication Number Publication Date
WO2021237614A1 true WO2021237614A1 (zh) 2021-12-02

Family

ID=78745414

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/093023 WO2021237614A1 (zh) 2020-05-28 2020-05-28 触控显示设备及其触控响应方法、系统及存储介质

Country Status (3)

Country Link
US (1) US11507224B2 (zh)
CN (1) CN114008570B (zh)
WO (1) WO2021237614A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116305221B (zh) * 2023-05-18 2023-08-29 深圳曦华科技有限公司 图像处理芯片系统的加密方法及相关装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547435A (zh) * 2011-12-16 2012-07-04 Tcl集团股份有限公司 一种多媒体文件播放处理系统及方法
CN105118424A (zh) * 2014-12-05 2015-12-02 京东方科技集团股份有限公司 数据传输模块及方法、显示面板及驱动方法、显示装置
CN107172365A (zh) * 2017-04-25 2017-09-15 西安诺瓦电子科技有限公司 视频源预监装置及方法和视频显示处理器
CN110716671A (zh) * 2019-10-15 2020-01-21 京东方科技集团股份有限公司 一种电子白板及其驱动方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009509203A (ja) * 2005-09-20 2009-03-05 エヌエックスピー ビー ヴィ ビデオストリームのフレームレートの保存、リサンプリング、またはリフォーマット装置及び方法
US9075457B2 (en) * 2008-12-12 2015-07-07 Maxim Integrated Products, Inc. System and method for interfacing applications processor to touchscreen display for reduced data transfer
FR2964235B1 (fr) * 2010-08-31 2013-05-24 Canon Kk Procede de synchronisation, systeme et dispositif correspondants
US9811213B2 (en) * 2013-03-15 2017-11-07 Synaptics Incorporated Systems and methods for input device noise mitigation via a touch buffer
US9261939B2 (en) * 2013-05-09 2016-02-16 Apple Inc. Memory power savings in idle display case
KR102082936B1 (ko) * 2013-10-21 2020-04-14 엘지디스플레이 주식회사 터치 센싱 시스템과 그 구동 방법
US9554189B2 (en) * 2014-06-30 2017-01-24 Microsoft Technology Licensing, Llc Contextual remote control interface
KR102396036B1 (ko) * 2015-05-18 2022-05-10 엘지전자 주식회사 디스플레이 디바이스 및 그 제어 방법
JP7034423B2 (ja) * 2016-04-28 2022-03-14 オムニヴィジョン ティーディーディーアイ オンタリオ リミテッド パートナーシップ 駆動制御デバイス及び電子機器
US10754456B2 (en) * 2018-12-26 2020-08-25 Intel Corporation Power-efficient touch input processing
CN110333834B (zh) * 2019-05-09 2023-08-29 京东方科技集团股份有限公司 帧频调整方法及装置、显示设备、计算机可读存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547435A (zh) * 2011-12-16 2012-07-04 Tcl集团股份有限公司 一种多媒体文件播放处理系统及方法
CN105118424A (zh) * 2014-12-05 2015-12-02 京东方科技集团股份有限公司 数据传输模块及方法、显示面板及驱动方法、显示装置
CN107172365A (zh) * 2017-04-25 2017-09-15 西安诺瓦电子科技有限公司 视频源预监装置及方法和视频显示处理器
CN110716671A (zh) * 2019-10-15 2020-01-21 京东方科技集团股份有限公司 一种电子白板及其驱动方法

Also Published As

Publication number Publication date
CN114008570B (zh) 2024-01-30
CN114008570A (zh) 2022-02-01
US11507224B2 (en) 2022-11-22
US20220206655A1 (en) 2022-06-30

Similar Documents

Publication Publication Date Title
WO2020187157A1 (zh) 一种控制方法和电子设备
US11367307B2 (en) Method for processing images and electronic device
US20200192500A1 (en) Electronic Devices With Adaptive Frame Rate Displays
WO2021098603A1 (zh) 预览画面显示方法及电子设备
CN110333834B (zh) 帧频调整方法及装置、显示设备、计算机可读存储介质
KR102138518B1 (ko) 단말기 및 그 제어 방법
US11393418B2 (en) Method, device and system for data transmission, and display device
WO2023125677A1 (zh) 独显插帧电路、方法、装置、芯片、电子设备及介质
CN114442894B (zh) 屏幕显示画面调整方法、装置及电子设备
WO2021082744A1 (zh) 视频查看方法及电子设备
KR20150081765A (ko) 영상 데이터 출력 제어 방법 및 이를 지원하는 장치
US20230017899A1 (en) Method for obtaining exposure data and electronic device
US20220086365A1 (en) Photographing method and terminal
CN116820289A (zh) 信息展示方法、装置、设备及存储介质
WO2019120059A1 (zh) 图像显示方法和移动终端
WO2021237614A1 (zh) 触控显示设备及其触控响应方法、系统及存储介质
US20220114126A1 (en) Technologies for a controller hub with a usb camera
CN110738971A (zh) 用于墨水屏的页面刷新方法及装置
CN111860440A (zh) 人脸特征点的位置调整方法、装置、终端及存储介质
WO2023125273A1 (zh) 电子设备的图像显示方法、图像处理电路和电子设备
US11838637B2 (en) Video recording method and terminal
US20220114946A1 (en) Technologies for low-power selective frame update on a display
KR20150057129A (ko) 이동 단말기 및 그 동작 방법
WO2022088050A1 (zh) 视频会议实现方法、装置、系统以及存储介质
WO2022206566A1 (zh) 一种协同显示方法和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20937566

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20937566

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 06/07/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20937566

Country of ref document: EP

Kind code of ref document: A1