WO2020034893A1 - Système intelligent d'interaction, procédé et dispositif d'affichage de trajectoire d'écriture, tablette et support - Google Patents

Système intelligent d'interaction, procédé et dispositif d'affichage de trajectoire d'écriture, tablette et support Download PDF

Info

Publication number
WO2020034893A1
WO2020034893A1 PCT/CN2019/099797 CN2019099797W WO2020034893A1 WO 2020034893 A1 WO2020034893 A1 WO 2020034893A1 CN 2019099797 W CN2019099797 W CN 2019099797W WO 2020034893 A1 WO2020034893 A1 WO 2020034893A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
signal
interface
image
driving board
Prior art date
Application number
PCT/CN2019/099797
Other languages
English (en)
Chinese (zh)
Inventor
刘伟
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2020034893A1 publication Critical patent/WO2020034893A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros

Definitions

  • the present application relates to image processing technology of a touch device, for example, to an intelligent interaction system, a writing track display method, a device, a tablet, and a medium.
  • the related art intelligent interactive system generally includes a system main chip and a screen driving board.
  • the system main chip is set to control basic functions such as the operating system, and the screen driving board is set to process according to the image signal output by the system main chip to form a screen display. Signal to control the display of the display.
  • the system main chip is generally connected to an external system module or an internal system module through an image input interface, such as High Definition Multimedia Interface (HDMI), to receive the screen interface image transmitted by the system module, and then through the image output interface ( HDMI) to output the screen interface image transmitted by the system module or the screen interface image of the local system to the screen driver board to control the display screen of the display screen.
  • HDMI High Definition Multimedia Interface
  • the intelligent interaction system in the related art will also allow the system main chip to connect to input devices such as a handwriting pad and a touch pad to receive signals input by the user's touch.
  • input devices such as a handwriting pad and a touch pad to receive signals input by the user's touch.
  • the related art has at least the following problems.
  • the delay time of the HDMI when transmitting the image is usually more than 30ms.
  • the screen interface image and the writing track image are synthesized in the system main chip, it also needs to pass through the system main chip's HDMI output interface. It is sent to the screen driver board for processing and display, so there is a phenomenon that the display of the writing track image is delayed relative to the user's actual writing.
  • the embodiments of the present application provide an intelligent interactive system, a writing track display method, a device, a tablet, and a medium, so as to shorten the writing delay time and improve the synchronization of writing operation and display.
  • an embodiment of the present application provides an intelligent interaction system, including a system main chip and a screen driving board.
  • the screen driving board is provided with a screen driving signal interface and a touch signal interface, wherein:
  • the screen driving signal interface is configured to receive a screen interface image signal from the system main chip, and the touch signal interface is configured to receive a writing track signal from a touch device;
  • the screen driving board is configured to perform image synthesis on the screen interface image signal and the writing track signal for display.
  • an embodiment of the present application further provides a writing track display method, including:
  • the screen driving board of the intelligent interactive system receives the screen interface image signal from the system main chip of the intelligent interactive system through the screen driving signal interface;
  • the screen driving board receives a writing track signal from a touch device through a touch signal interface
  • the screen driving board performs image synthesis on the screen interface image signal and the writing track signal for display.
  • an embodiment of the present application further provides a writing track display device.
  • the device includes:
  • the image receiving unit is configured to control a screen driving board of the intelligent interactive system, and receives a screen interface image signal from a system main chip of the intelligent interactive system through a screen driving signal interface;
  • a track receiving unit configured to control the screen driving board to receive a writing track signal from a touch device through a touch signal interface
  • the image synthesizing unit is configured to control the screen driving board to synthesize an image signal of the screen interface and the writing track signal for display.
  • An embodiment of the present application further provides a smart interactive tablet, where the smart interactive tablet includes:
  • One or more processors are One or more processors;
  • Memory set to store one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method described in any embodiment of the present application.
  • the embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored.
  • a computer program is stored on which a computer program is stored.
  • FIG. 1a is a schematic structural diagram of an intelligent interaction system according to the first embodiment of the present application.
  • FIG. 1b is a schematic structural diagram of an intelligent interaction system in the related art
  • FIG. 2 is a schematic structural diagram of an intelligent interaction system provided in Embodiment 2 of the present application.
  • FIG. 3 is a schematic flowchart of a writing track display method provided in Embodiment 3 of the present application.
  • FIG. 4 is a schematic structural diagram of a writing track display device according to a fourth embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of an intelligent interactive tablet provided in Embodiment 5 of the present application.
  • FIG. 1a is a schematic structural diagram of an intelligent interaction system according to the first embodiment of the present application.
  • the intelligent interaction system includes: a system main chip 1 and a screen driving board 2. Each part is described in detail below.
  • the screen driving board 2 is provided with a driving screen signal interface 21 and a touch signal interface 22, wherein the driving screen signal interface 21 is configured to receive a screen interface image signal from the system main chip 1, and the touch signal interface 22 is configured In order to receive the writing track signal from the touch device 3, the screen driving board 2 is configured to perform image synthesis of the screen interface image signal and the writing track signal for display.
  • the system main chip 1 may be the main chip of the intelligent interactive system, for example, it may be a data processing chip of an intelligent interactive tablet, which may be configured to obtain the screen interface image signal on itself or other system modules and send it to the screen driver.
  • the screen driver board 2 may be a timer / counter control register (Timer Control Register, TCON) main chip. The role of the TCON board is to send the screen interface image signal (including Red Green Blue, RGB) from the system main chip 1. ) Data signals, clock signals, and control signals are processed, and then converted into low-voltage differential signals (LVDS) that can drive the LCD screen, and then the signals are sent directly to the LCD screen.
  • LVDS receiver chip In this embodiment, the screen driving board 2 performs image synthesis before signal conversion, for example, the screen interface image signal and the writing track signal are synthesized into a frame image, and then the image is signal converted.
  • the touch device 3 when the user performs a writing operation on the touch device 3, the touch device 3 sends the collected writing track to the screen drive board 2 through the touch signal interface 22 of the screen drive board 2.
  • the system master The chip 1 can send the screen interface image to be displayed on the display screen to the screen drive board 2 through the screen drive signal interface 21 of the screen drive board 2.
  • the screen drive board 2 synthesizes the screen interface image and the writing track, it synthesizes the image
  • the image is converted into a signal format supported by the display screen to send a composite image signal to the display screen for display after the conversion.
  • the screen driving board 2 is configured to enable a touch signal interface 22 when receiving an image synthesis instruction, and receive a writing track signal from the touch device 3 through the touch signal interface 22.
  • the screen driving board 2 receives the writing track signal when receiving the image synthesis instruction, and turns on the image synthesis mode at the same time.
  • the advantage is that the writing track can be prevented from being displayed incorrectly when the user uses the touch device 3 for other operations.
  • the intelligent interactive system further includes: a touch device 3, which is connected to the screen driving board 2 through a touch signal interface 22, and is configured to collect the writing track signal and send the writing track signal Give the screen driver board 2.
  • the touch device 3 may be a touch device provided in the smart interactive system, such as a touch screen in a touch display screen, or a touch device external to the smart interactive system, such as a tablet or a smart electronic pen.
  • the operation process is collected and recorded in data form.
  • the coordinate data of the touch point is collected at a preset frequency, and the writing trajectory signal is generated according to the coordinate data collected within a preset period of time.
  • the touch signal interface 22 is transmitted to the screen driving board 2.
  • the preset time period may be, for example, the time from when the touch point is detected to the time when the last touch point is detected, that is, the pen-down time to the pen-up time.
  • the image synthesis instruction is the software startup information of the target application software transmitted from the system main chip 1; or the image synthesis instruction is the communication interface 23 of the screen driver board 2 and the target in the system module received from the micro control unit 6. Software startup information for application software.
  • the target application software may be software having a writing function, such as whiteboard software, drawing software, and the like.
  • An optional implementation manner of this embodiment is that, when the target application software is installed on the system main chip, when the target application software is started, software startup information may be generated as an image synthesis instruction and sent directly to the screen driver board. For example, as shown in FIG. 1a, when the whiteboard software installed on the system main chip 1 is started, the generated software startup information is sent to the micro control unit 6, and the micro control unit 6 passes the communication interface of the screen driving board 2 23 is sent to the screen driver board 2.
  • the target application software is installed on the system module 4.
  • the intelligent interactive system further includes other system modules 4 connected or externally connected, and the system main chip 1 passes the image
  • the transmission interface 11 is connected to the system module 4 and is configured to receive a screen interface image of a target application software running on the system module 4.
  • the image transmission interface 11 may be, for example, an HDMI interface.
  • the system main chip 1 is respectively connected to two system modules 4 through an image transmission interface 11.
  • the types of operating systems running in the two system modules 4 may be different, for example, a system running on one system module may be It is a windows system, and the system running on another system module may be an Android system.
  • the two system modules 4 are connected to the micro control unit 6 through the system switching switch 5.
  • the micro control unit 6 can switch the operating system by controlling the on and off of the system switching switch 5. For example, one system module can be switched to a windows system; Or connect to another system module to switch to the Android system; or cut off the connection to the two to switch to the system of the smart interactive tablet itself.
  • at least one of the system main chip 1 and the two system modules 4 or the target application software is installed in the chip.
  • the generated software startup information may be sent to the micro control unit 6 through the system switch 5 that is turned on, and the micro control unit 6 passes the screen through the screen.
  • the communication interface 23 of the driving board 2 is sent to the screen driving board 2.
  • the system module 4d is connected through the image transmission interface 11d of the system main chip 1d, and the system main chip 1d connects the screen interface of the system main chip or the system module where the target application software is located.
  • the synthesized image is sent to the screen driving board 2d through the screen signal interface 21d for image processing and display.
  • the image transmission interface 11d and the driving signal signal interface 21d are both HDMI interfaces.
  • the image transmission delay time is long, which causes the touch device 3d to capture the writing track and the final display time interval of the writing track.
  • the influence of the image transmission delay of the signal interface 21d makes the display of the writing track image with a delay of more than 30ms relative to the user's actual writing, and the delay time is longer.
  • an intelligent interactive system as shown in FIG. 1a is used. Since the image synthesis process is transferred from the system main chip 1 to the screen driver board 2, the synthesized image does not need to be driven through the screen anymore.
  • the signal interface 21 performs transmission, but is directly sent by the screen driving board 2 to a display screen for display. Therefore, the writing delay time can be greatly reduced, and the synchronization between the writing operation and the display can be improved.
  • the working principle of the intelligent interaction system shown in FIG. 1a is described in detail through a specific example.
  • the system module 4 such as an Android module or a Personal Computer (PC) module
  • the system main chip 1 detects that the target application software (such as whiteboard software) installed in its own system is started, it generates software startup information and guides it through the
  • the system switching switch 5 sends the software startup information to the micro control unit 6; the micro control unit 6 forwards the software startup information to the screen drive board 2 through the communication interface 23; the screen drive board 2 turns on after receiving the software startup information And enter the image synthesis mode, and in this image synthesis mode, the screen interface image received from the system main chip 1 through the screen signal interface 21, and the touch device 3 (for example, The writing track received by the tablet) is synthesized into a frame image for display.
  • the system module 4 such as an Android module or a Personal Computer (PC) module
  • the system main chip 1 detects that the target application software (such as whiteboard software) installed in its own system is started, it generates
  • the screen interface image is a screen interface image to be displayed on the display screen.
  • the system module 4 sends the screen interface image to be displayed to the system main chip 1.
  • the system main chip 1 then sends the screen driver board 2 to the screen driver board 2 through the screen drive signal interface 21; if the target application software is installed in the system of the system main chip 1, the system main chip 1 directly sends the screen interface image through the screen drive signal interface 21 Go to the screen driver board 2.
  • a screen driving signal interface and a touch signal interface are provided on a screen driving board in an intelligent interactive system, and the screen driving board receives a screen interface image signal received from the screen driving signal interface and a touch screen.
  • the writing track signal received by the control signal interface is used for image synthesis for display. Because the image synthesis process originally performed in the system main chip is transferred to the screen driver board, the process of displaying the synthesized image is not performed. Affected by the delay of the HDMI output interface, it solves the display of the writing track image in the related technology because the image synthesis process needs to be sent to the screen driver board for processing through the HDMI output interface after the image synthesis process is completed in the system main chip. Compared with the problem that the user's real writing is delayed, the effect of shortening the writing delay time and improving the synchronization of writing operation and display is realized.
  • the screen driving board 2 is further provided with an instruction sending interface 24 configured to be connected to the system main chip 1.
  • the screen driving board 2 may be based on the current The buffered one-frame composite image performs image synthesis on the received writing track signal.
  • the screen drive board 2 only needs to receive the writing track signal.
  • the screen drive board 2 can generate a pause command and send it to the system through the command sending interface 24.
  • the main chip so that the system main chip 1 temporarily suspends sending a new screen interface image signal. After the user "lifts the pen", it starts to receive the new screen interface image signal again.
  • the advantage of this setting is that within "one stroke", the image composition can be completed without waiting to receive a new screen interface image, thereby further reducing the writing delay time and improving the synchronization of the writing operation and display.
  • FIG. 2 is a schematic structural diagram of an intelligent interaction system provided in Embodiment 2 of the present application. Based on the above embodiment, this embodiment provides an optional intelligent interaction system.
  • the intelligent interaction system further includes: a touch switch 7.
  • the input terminal of the touch switch 7 is connected to the touch device 3.
  • the first output of the touch switch 7 is connected to the system main chip 1.
  • the second output of the touch switch 7 is connected to the touch signal.
  • the interface 22 is connected, and the touch switch 7 is set to switch between the first output terminal and the second output terminal according to the image composition instruction.
  • the touch device 3 may be a touch device provided in the smart interactive system, such as a touch screen in a touch display screen.
  • the first output terminal of the touch switch 7 can be set as the default conducting terminal, that is, when no touch switch instruction is received, the default touch device 3 is connected to the system main chip 1; when a touch is received, When the switching instruction is controlled, the touch device 3 is switched to be connected to the screen driving board 2.
  • the control terminal of the touch switch 7 is connected to the micro control unit 6.
  • the micro control unit 6 receives the software startup information of the target application software, it can generate a touch switch instruction and send it to the touch switch 7 to control the touch switch 3 to connect the touch device 3 and the system.
  • the main chip 1 is connected, and the touch device 3 is switched to be connected to the screen driving board 2.
  • the advantage of setting the touch switch 7 is that the touch device 3 can be reused, so that the track device can be used to collect the writing track signal directly, and the system main chip 1 is connected by default. While not affecting other normal operations of the touch device 3, it can also be switched to connect to the screen drive board 2 in time when the target application software is started, and then the collected writing track signals are sent directly to the screen drive board 2 in time to interface with the screen
  • the image is subjected to image synthesis processing to achieve the effect of reducing writing delay.
  • the working principle of the intelligent interaction system shown in FIG. 2 is described in detail through a specific example.
  • the system module 4 for example, an Android module or a PC module
  • the system main chip 1 detects that the target application software (for example, whiteboard software) installed in the system is started, the software startup information is generated, and the system switch 5 that is turned on is used to turn on
  • the software startup information is sent to the micro control unit 6; the micro control unit 6 forwards the software startup information to the screen drive board 2 through the communication interface 23, and generates a corresponding touch switch instruction to send to the touch switch 7 to make the touch
  • the conduction state of the switch 7 is switched from the default input terminal to the first output terminal, that is, the default touch device 3 is connected to the system main chip 1, and the input terminal is switched to the second output terminal, that is, switched.
  • the touch device 3 is connected to the screen driving board 2; the screen driving board 2 turns on and enters the image synthesis mode after receiving the software startup information, and in this image synthesis mode, it will be driven from the system main chip through the screen signal interface 21
  • the screen interface image received by 1 and the writing track received from the touch device 3 connected to it through the touch signal interface 22 are combined into a frame image for display.
  • the touch device by setting a touch switch, the touch device can be multiplexed and compatible with the connection methods in the related technology, and the target can be achieved without affecting the normal operation of the touch device.
  • the application software When the application software is started, it is switched to be connected to the screen drive board in time, and then the collected writing track signal is sent directly to the screen drive board in time to complete the image synthesis processing between the writing track signal and the screen interface image signal, which reduces the writing delay time. At the same time, it improves the compatibility of the system.
  • FIG. 3 is a schematic flowchart of a writing track display method provided in Embodiment 3 of the present application.
  • This method may be suitable for displaying a writing track, and the method may be executed by a writing track display device, which may be composed of hardware and / or software, and may generally be integrated in a smart interactive tablet and provided by any of the foregoing embodiments
  • the intelligent interactive system includes S310 to S330.
  • the screen driving board of the intelligent interactive system receives a screen interface image signal from a system main chip of the intelligent interactive system through a screen driving signal interface.
  • the screen interface image may be a screen displayed on a display screen in an intelligent interaction system.
  • the screen interface image signal may be sent by a system module (such as an Android module or a PC module) as an image signal source to the system main chip, or the system main chip itself may be used as an image signal source by the intelligent interactive system.
  • the operating system currently in use is determined.
  • the system main chip may be the main chip of the intelligent interactive system, for example, it may be a data processing chip of an intelligent interactive tablet, which may be configured to obtain the screen interface image signal on itself or other system modules and send it to the screen driving board.
  • the screen driver board can be a TCON main chip. The role of the TCON board is to process the screen interface image signals (including RGB data signals, clock signals, and control signals) sent by the system main chip 1 and convert them to drive liquid crystals.
  • the LVDS of the display screen sends the signal directly to the LVDS receiving chip of the LCD screen.
  • the drive screen signal interface can be an HDMI interface or other types of interfaces, which is not limited here.
  • the system main chip periodically sends the acquired image signals of the screen interface to the screen driving board, so as to provide conditions for the screen driving board to perform image synthesis in subsequent steps.
  • the screen driver board sends the received screen interface image signal to the display screen for normal signal conversion after normal signal conversion.
  • the screen driving board receives a writing track signal from a touch device through a touch signal interface.
  • the touch device in this embodiment may be a touch device provided in the smart interactive system, such as a touch screen in a touch display screen, or a touch device external to the smart interactive system, such as a tablet or a smart electronic pen.
  • the operation process is collected and recorded in data form, for example, the coordinate data of the touch point is collected at a preset frequency, and the writing trajectory signal is generated based on the coordinate data collected within a preset period of time, It is transmitted to the screen driving board through the touch signal interface.
  • the preset time period may be, for example, the time from when the touch point is detected to the time when the last touch point is detected, that is, the pen-down time to the pen-up time.
  • the touch signal interface may be a universal serial bus (Universal Serial Bus, USB) interface, and is configured to receive a writing track signal.
  • USB Universal Serial Bus
  • the screen driving board when it receives an image synthesis instruction, it enables a touch signal interface, and receives a writing track signal from a touch device through the touch signal interface.
  • the screen driving board receives the writing track signal when receiving the image synthesis instruction, and turns on the image synthesis mode at the same time.
  • the advantage is that the writing track can be prevented from being displayed incorrectly when the user uses the touch device for other operations.
  • the screen driving board receiving the image synthesis instruction includes: the screen driving board receives the software startup information of the target application software from the system main chip as the image synthesis instruction; or the screen driving board receives the target in the system module from the micro control unit through the communication interface.
  • the software startup information of the application software is used as an image composition instruction.
  • the target application software may be software having a writing function installed in a system main chip and / or a system module system, such as whiteboard software, drawing software, and the like.
  • An optional implementation manner of this embodiment is that, when the target application software is installed on the system main chip, when the target application software is started, software startup information may be generated as an image synthesis instruction and sent directly to the screen driver board.
  • the target application software is installed on a system module, and when the target application software is started, the generated software startup information may be sent to the micro control unit, which is then driven by the micro control unit through the screen.
  • the communication interface of the board is sent to the screen driver board.
  • the system modules are connected to the micro control unit through a system switch, and the micro control unit can switch the operating system by controlling the on and off of the system switch.
  • a touch switch in the intelligent interaction system which switches a touch device from a main chip connected to the system to a touch signal interface connected to a screen driving board according to an image synthesis instruction.
  • the touch device is a touch device provided in the intelligent interactive system, such as a touch screen in a touch screen
  • a function of the touch device can be multiplexed by setting a touch switch.
  • the micro control unit when the micro control unit receives the software startup information of the target application software, that is, the image synthesis instruction, it can generate a touch switch instruction and send it to the touch switch to control the touch switch to switch the touch device. It is connected to the system main chip, and it is switched to a touch device connected to the screen driving board.
  • the screen driving board synthesizes an image signal of the screen interface and a writing track signal for display.
  • the implementation of image synthesis of the screen interface image signal and the writing trajectory signal may be to draw the point coordinate data in the writing trajectory signal directly on the screen interface image according to the coordinates of each point, or it may be The trajectory map generated based on the point coordinate data in the writing trajectory signal and the screen interface image are directly superimposed.
  • the screen driving board receives the continuous writing track signal, that is, when the user moves from the "pen down” to the "pen lifting", the writing track is not displayed, and when the user "lifts the pen", the composite image is sent to The display screen displays the writing track.
  • the advantage of image synthesis by the screen driving board in this embodiment is that the synthesized image can be transmitted to the screen driving board without using the screen driving signal interface. , And then send it to the display screen for display, and then synthesize it by the screen driver board and send it directly to the display screen for display. Therefore, the writing delay time can be greatly reduced, and the synchronization between the writing operation and the display can be improved.
  • the screen driving board of the intelligent interactive system will perform the screen interface image signal received from the system main chip by using the screen driving signal interface and the writing track signal received from the touch device by using the touch signal interface
  • Image synthesis for display uses the advantages of image synthesis in the screen driver board to shorten the transmission time of the synthesized image, and achieves the effects of shortening the writing delay time and improving the synchronization of writing operations and display.
  • the system main chip further includes: The screen interface image of the target application software running locally is transmitted to the screen drive board; or the system main chip receives the screen interface image of the target application software running on the system module through the image transmission interface and transmits it to the screen drive board.
  • the signal source of the screen interface image signal may be a system main chip or a system module.
  • the system main chip can transmit the screen interface image of the locally running target application software to the screen driver board; if the target application software installed on the system module starts to run, The system main chip can receive the screen interface image of the target application software running on the system module through the image transmission interface, and then forward it to the screen driver board.
  • the method further includes: when the screen driving board determines to receive the writing track signal again within a preset time period. At the time, a pause command is generated and sent to the system main chip, and image synthesis is performed based on the currently buffered composite image and the writing track signal for display; wherein the pause command is used to instruct the system main chip to suspend sending the target application software to the screen driver board. Screen interface image.
  • a frame image is buffered for image synthesis with the received writing track signal.
  • the received pair of received track signals may be based on the currently buffered frame of the synthesized image.
  • the writing track signal is synthesized, and the screen driver board only needs to receive the writing track signal, so a pause command can be generated and sent to the system main chip, so that the system main chip suspends sending new image signals.
  • the user After the user "lifts the pen", that is, when the writing track signal is no longer received within a preset time period, the user starts to receive a new screen interface image signal again.
  • the advantage of this setting is that within "one stroke", the image composition can be completed without waiting to receive a new screen interface image, thereby further reducing the writing delay time and improving the synchronization of the writing operation and display.
  • FIG. 4 is a schematic structural diagram of a writing track display device according to a fourth embodiment of the present application.
  • the writing track display device includes an image receiving unit 410, a track receiving unit 420, and an image synthesizing unit 430. Each module is described below.
  • the image receiving unit 410 is configured to control a screen driving board of the intelligent interactive system, and receives a screen interface image signal from a system main chip of the intelligent interactive system through a screen driving signal interface;
  • the track receiving unit 420 is configured to control the screen driving board to receive a writing track signal from a touch device through a touch signal interface;
  • the image synthesizing unit 430 is configured to control the screen driving board to synthesize an image signal of the screen interface and the writing track signal for display.
  • the trajectory receiving unit 420 may include:
  • the screen driving board receiving the image composition instruction includes:
  • the screen driving board receives the software startup information of the target application software in the system module from the micro control unit through the communication interface as the image composition instruction.
  • Optional also includes:
  • Optional also includes:
  • the local image transmission unit is configured to control the screen driving board of the intelligent interactive system, and before receiving the screen interface image signal from the system main chip of the intelligent interactive system through the screen driving signal interface, the system main chip is controlled to target applications running locally
  • the screen image of the software is transmitted to the screen driving board; or the module image transmission unit is configured to control the screen driving board of the intelligent interactive system, and before receiving the screen interface image signal from the system main chip of the intelligent interactive system through the screen driving signal interface Controlling the system main chip to receive a screen interface image of a target application software running on a system module through an image transmission interface and transmitting the screen interface image to the screen driving board.
  • Optional also includes:
  • the instruction sending unit is configured to control the screen driving board to synthesize the screen interface image signal with the writing track signal, and after controlling the screen driving board to determine that the writing track signal is received again within a preset time period When a pause command is generated and sent to the system main chip, and image synthesis is performed based on the currently buffered composite image and the writing track signal for display;
  • the pause instruction is set to instruct the system main chip to suspend sending the screen interface image of the target application software to the screen driver board.
  • the above products can execute the method provided by any embodiment of the present application, and have the corresponding functional modules and effects of executing the method.
  • FIG. 5 is a schematic structural diagram of an intelligent interactive tablet provided in Embodiment 5 of the present application.
  • an intelligent interactive tablet provided in this embodiment includes a processor 51 and a memory 52. There may be one or more processors in the smart interactive tablet.
  • a processor 51 is taken as an example in FIG. 5.
  • the processor 51 and the memory 52 in the smart interactive tablet may be connected through a bus or other methods. Take the connection via a bus as an example.
  • the processor 51 of the smart interactive tablet in this embodiment integrates the writing track display device provided in the foregoing embodiment.
  • the memory 52 in the smart interactive tablet serves as a computer-readable storage medium, and may be configured to store one or more programs.
  • the programs may be software programs, computer-executable programs, and modules, as in the embodiments of the present application.
  • Program instructions / modules corresponding to the writing track display method include an image receiving unit 410, a track receiving unit 420, and an image synthesizing unit 430).
  • the processor 51 executes various functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory 52, that is, implementing the writing track display method in the foregoing method embodiment.
  • the memory 52 may include a storage program area and a storage data area, where the storage program area may store an operating system and application programs required for at least one function; the storage data area may store data created according to the use of the device, and the like.
  • the memory 52 may include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage device.
  • the memory 52 may include memory remotely provided with respect to the processor 51, and these remote memories may be connected to the device through a network. Examples of the above network include the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the program when one or more programs included in the smart interactive tablet are executed by the one or more processors 51, the program performs the following operations:
  • the screen driving board of the intelligent interactive system receives a screen interface image signal from a system main chip of the intelligent interactive system through a screen driving signal interface; the screen driving board receives a writing track signal from a touch device through a touch signal interface; the screen The driving board performs image synthesis on the screen interface image signal and the writing track signal for display.
  • the sixth embodiment of the present application also provides a computer-readable storage medium.
  • the computer-readable storage medium stores a computer program, and when the computer program is executed by the writing track display device, the writing track display provided in the third embodiment of the present application is displayed.
  • a method comprising: a screen driving board of an intelligent interactive system, receiving a screen interface image signal from a system main chip of the intelligent interactive system through a screen driving signal interface; and the screen driving board receiving writing from a touch device through a touch signal interface Track signal; the screen driving board image-combines the screen interface image signal with the writing track signal for display.
  • the computer-readable storage medium provided in the embodiments of the present application is not limited to the implementation of the method operations described above when the computer program stored thereon is executed, and can also realize the writing track display provided by any embodiment of the present application. Related operations in the method.
  • the present application may be implemented by software and general hardware, and may also be implemented by hardware.
  • the technical solution of this application is essentially in the form of a software product that contributes to related technologies.
  • the computer software product can be stored in a computer-readable storage medium, such as a computer's floppy disk, read-only memory (Read -Only Memory (ROM), Random Access Memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including multiple instructions to make a computer device (can be a personal computer, server, or network) Equipment, etc.) perform the method described in each embodiment of the present application.
  • the multiple units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, each functional unit
  • the names are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of this application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Facsimiles In General (AREA)

Abstract

Le mode de réalisation de la présente invention concerne un système intelligent d'interaction, un procédé et un dispositif d'affichage de trajectoire d'écriture, une tablette et un support. Le système comporte une puce principale de système et une carte de pilotage d'écran, la carte de pilotage d'écran étant munie d'une interface de signal de pilotage d'écran et d'une interface de signal tactile, l'interface de signal de pilotage d'écran étant configurée pour recevoir un signal d'image d'interface d'écran en provenance de la puce principale de système, l'interface de signal tactile étant configurée pour recevoir un signal de trajectoire d'écriture en provenance d'un dispositif tactile; la carte de pilotage d'écran étant configurée pour effectuer une synthèse d'image sur le signal d'image d'interface d'écran et le signal de trajectoire d'écriture en vue de l'affichage.
PCT/CN2019/099797 2018-08-15 2019-08-08 Système intelligent d'interaction, procédé et dispositif d'affichage de trajectoire d'écriture, tablette et support WO2020034893A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810928929.9A CN109032494B (zh) 2018-08-15 2018-08-15 智能交互系统、书写轨迹显示方法、装置、平板及介质
CN201810928929.9 2018-08-15

Publications (1)

Publication Number Publication Date
WO2020034893A1 true WO2020034893A1 (fr) 2020-02-20

Family

ID=64631479

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/099797 WO2020034893A1 (fr) 2018-08-15 2019-08-08 Système intelligent d'interaction, procédé et dispositif d'affichage de trajectoire d'écriture, tablette et support

Country Status (2)

Country Link
CN (1) CN109032494B (fr)
WO (1) WO2020034893A1 (fr)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109032494B (zh) * 2018-08-15 2021-04-20 广州视源电子科技股份有限公司 智能交互系统、书写轨迹显示方法、装置、平板及介质
CN112580313B (zh) * 2019-09-30 2023-06-20 广州视源电子科技股份有限公司 一种课件的批注方法、系统、设备和存储介质
CN112579023B (zh) * 2019-09-30 2023-03-07 广州视源电子科技股份有限公司 一种课件的显示方法、系统、设备与存储介质
CN112581800B (zh) * 2019-09-30 2024-05-31 广州视源电子科技股份有限公司 一种课件的显示方法、系统、设备和存储介质
CN110716671B (zh) * 2019-10-15 2023-06-27 京东方科技集团股份有限公司 一种电子白板及其驱动方法
WO2021208921A1 (fr) 2020-04-13 2021-10-21 海信视像科技股份有限公司 Dispositif d'affichage
CN111459337B (zh) * 2020-04-13 2024-02-06 海信视像科技股份有限公司 显示设备和触控显示方法
CN111831160A (zh) * 2020-07-17 2020-10-27 广州视源电子科技股份有限公司 显示屏的控制方法、显示屏控制器与触控显示装置
CN113946400B (zh) * 2021-10-29 2023-04-25 四川长虹教育科技有限公司 在智能交互大屏上降低Windows端书写延迟的方法
CN114510159A (zh) * 2021-12-30 2022-05-17 锐捷网络股份有限公司 书写轨迹显示方法、装置及存储介质
CN118057961A (zh) * 2022-09-19 2024-05-21 广州视源电子科技股份有限公司 交互系统、板卡、书写轨迹显示方法、平板和存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6671235B1 (en) * 2000-03-27 2003-12-30 Ultratech Stepper, Inc. Method of and apparatus for defining disk tracks in magnetic recording media
CN1940842A (zh) * 2005-07-14 2007-04-04 深圳市联思精密机器有限公司 具有触控功能的平板显示器
CN203759658U (zh) * 2014-03-31 2014-08-06 上海华师京城高新技术（集团）有限公司 一种多笔同时书写的电磁感应显示装置
CN105808083A (zh) * 2014-12-30 2016-07-27 鸿合科技有限公司 一种显示方法与装置
CN106325729A (zh) * 2015-06-30 2017-01-11 中强光电股份有限公司 触控显示系统、图像处理装置、触控显示方法以及图像处理方法
CN107193794A (zh) * 2017-06-28 2017-09-22 广州视源电子科技股份有限公司 显示内容的批注方法和装置
CN109032494A (zh) * 2018-08-15 2018-12-18 广州视源电子科技股份有限公司 智能交互系统、书写轨迹显示方法、装置、平板及介质
CN209118244U (zh) * 2018-08-15 2019-07-16 广州视源电子科技股份有限公司 智能交互系统以及智能交互平板
CN209373557U (zh) * 2018-08-15 2019-09-10 广州视源电子科技股份有限公司 智能交互系统以及智能交互平板

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103425336A (zh) * 2013-07-16 2013-12-04 深圳市创凯电子有限公司 图像与文字信息合成的装置和方法
CN205647772U (zh) * 2016-05-16 2016-10-12 索绪香 智能互动系统
CN107958232A (zh) * 2017-12-26 2018-04-24 石狮市森科智能科技有限公司 基于体感交互的虚拟试衣方法、系统和试衣间

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6671235B1 (en) * 2000-03-27 2003-12-30 Ultratech Stepper, Inc. Method of and apparatus for defining disk tracks in magnetic recording media
CN1940842A (zh) * 2005-07-14 2007-04-04 深圳市联思精密机器有限公司 具有触控功能的平板显示器
CN203759658U (zh) * 2014-03-31 2014-08-06 上海华师京城高新技术（集团）有限公司 一种多笔同时书写的电磁感应显示装置
CN105808083A (zh) * 2014-12-30 2016-07-27 鸿合科技有限公司 一种显示方法与装置
CN106325729A (zh) * 2015-06-30 2017-01-11 中强光电股份有限公司 触控显示系统、图像处理装置、触控显示方法以及图像处理方法
CN107193794A (zh) * 2017-06-28 2017-09-22 广州视源电子科技股份有限公司 显示内容的批注方法和装置
CN109032494A (zh) * 2018-08-15 2018-12-18 广州视源电子科技股份有限公司 智能交互系统、书写轨迹显示方法、装置、平板及介质
CN209118244U (zh) * 2018-08-15 2019-07-16 广州视源电子科技股份有限公司 智能交互系统以及智能交互平板
CN209373557U (zh) * 2018-08-15 2019-09-10 广州视源电子科技股份有限公司 智能交互系统以及智能交互平板

Also Published As

Publication number Publication date
CN109032494A (zh) 2018-12-18
CN109032494B (zh) 2021-04-20

Similar Documents

Publication Publication Date Title
WO2020034893A1 (fr) Système intelligent d'interaction, procédé et dispositif d'affichage de trajectoire d'écriture, tablette et support
US10922041B2 (en) Wireless screen transmission method, extension device, and wireless screen transmission system
CN104917990B (zh) 通过调整垂直消隐进行视频帧速率补偿
US10031710B2 (en) Display device constituting multi-display system and control method thereof
CN209373557U (zh) 智能交互系统以及智能交互平板
CN106358063B (zh) 一种触摸电视及其控制方法及控制装置
US9563582B2 (en) Modular device, system, and method for reconfigurable data distribution
CN111031371B (zh) 单线投屏系统及方法
CN105657291A (zh) 视频控制器
CN103995567A (zh) 一种双系统智能交互一体机及其双系统切换实现方法
CN112822438A (zh) 一种实时控制多路视频管理器
CN209118244U (zh) 智能交互系统以及智能交互平板
WO2019196415A1 (fr) Tablette intelligente interactive
CN103970370A (zh) 光电触控系统以及光电触控方法
CN113253877A (zh) 电子白板系统及其控制方法
CN108959153B (zh) 一种一体机、数据续传的方法、装置、设备和存储介质
CN102710877B (zh) 移动终端的外部控制方法、移动终端及系统
CN107340983B (zh) 一种电子设备双显示方法、装置及电子设备
CN111294624B (zh) 电子设备和电子设备的控制方法
WO2022184029A1 (fr) Système d'affichage à collage et son procédé de traitement de données
US11862116B2 (en) Handwriting reading device, method for processing report point data, and computer storage medium
CN109308862A (zh) 信号控制方法、控制装置、处理装置及信号控制设备
CN110012254B (zh) 电视及实时可视信源切换处理方法
CN202093787U (zh) 低成本rgb接口tft模组控制单元
JP2005122119A (ja) Ｍｐｕとビデオコーデックとで構成されるシステムにおけるビデオインタフェース装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19850669

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19850669

Country of ref document: EP

Kind code of ref document: A1