CN107862213B

CN107862213B - Electronic equipment, display system, integrated control device of display system and data protection method

Info

Publication number: CN107862213B
Application number: CN201711241612.XA
Authority: CN
Inventors: 李坤; 徐东; 樊磊; 张晋芳
Original assignee: Chipone Technology Beijing Co Ltd
Current assignee: Chipone Technology Beijing Co Ltd
Priority date: 2017-11-30
Filing date: 2017-11-30
Publication date: 2020-04-14
Anticipated expiration: 2037-11-30
Also published as: CN107862213A

Abstract

The application discloses an electronic device, a display system, an integrated control device of the display system and a data protection method. The integrated control device includes: the sensor unit is used for obtaining induction signals from various sensors and converting the induction signals into induction data; and the processor is used for judging whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encryption transmission instruction and encrypting the sensitive data. The integrated control device can distinguish whether the sensing data from each sensor is sensitive data or non-sensitive data according to the type of the sensor and/or an encryption transmission instruction from the main control unit, and encrypts the sensitive data, so that the safety is improved, and system resources are saved.

Description

Electronic equipment, display system, integrated control device of display system and data protection method

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to an electronic device, a display system, an integrated control apparatus thereof, and a data protection method.

Background

With the advent of the big data era, the security of mass data becomes a key problem which must be effectively solved in the human-computer interaction. A display screen provided on an electronic device is not only used to display images and text, but is further developed as an important approach for human-computer interaction. A touch sensor, a fingerprint sensor, an acoustic sensor, an optical sensor, etc. may be integrated on the display screen to form a display system. The user can directly input characters, select icons, perform gesture control, perform voice, perform face recognition and the like on the display screen.

The display system is used as an entrance for information acquisition and an exit for display content, and plays an irreplaceable important role in the safety of data interaction. The interaction data collected on the display screen includes not only text information, such as keyboard entries, but also possibly private information such as fingerprints, facial features, etc. The sensitive data are transmitted from a driving chip of the display screen to a processor on the mainboard and processed by an operating system to realize functions such as security verification and the like.

The prior art in which the display system provides sensitive data directly to the operating system presents a potential risk of revealing the user's sensitive data. Security authentication at the system level is a function of the operating system of most mobile terminals, for example, the android system provides a fingerprinting framework. The application program APP obtains the authority for calling the identity authentication from the operating system, and functional requirements such as payment can be finished. After receiving a request of an application program APP, the operating system collects fingerprints and compares the collected fingerprints with stored fingerprint feature data so as to judge the identity of a user. The application APP obtains the result of the authentication from the operating system. However, the purpose of the user to the application APP is to implement the authentication function, and not to provide the application APP with its own sensitive data intentionally. Protection of user privacy is extremely disadvantageous if the application APP tries to acquire sensitive data. Some malicious applications APP may even impersonate the user identity with sensitive data, thereby creating a significant potential safety hazard.

In a further improved system, hardware level security verification may be employed. For example, the electronic device may include an additional security chip, whereby sensitive data is stored and verified separately by the security chip. However, not only does the secure chip increase system cost, but communication between the secure chip and the operating system can also result in reduced system efficiency.

Therefore, it is desirable to further improve the security of the display system and to improve the efficiency of the security verification by the operating system.

Disclosure of Invention

In view of the foregoing, an object of the present invention is to provide an electronic device, a display system, an integrated control device thereof, and a data protection method, wherein sensing data is divided into sensitive data and non-sensitive data in the integrated control device of the display system, and the sensitive data is encrypted, so as to improve security and save system resources.

According to a first aspect of the present invention, there is provided an integrated control device comprising: the sensor unit is used for obtaining induction signals from various sensors and converting the induction signals into induction data; and the processor is used for judging whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encryption transmission instruction and encrypting the sensitive data.

Preferably, the plurality of sensors include at least one of a touch sensor, a fingerprint sensor, a palm print sensor, an acoustic sensor, and an optical sensor, and the sensing data is used for representing at least one of a two-dimensional code, a touch position, a fingerprint, a palm print, a voiceprint, and an iris.

Preferably, the processor takes the sensed data from the fingerprint sensor and the palm print sensor as sensitive data and encrypts the sensed data, and takes the sensed data from the other sensors as non-sensitive data.

Preferably, the processor, when receiving the encrypted transmission instruction to indicate that a specified sensor of the plurality of sensors relates to the security application, takes the sensing data from the specified sensor as sensitive data and encrypts the sensing data, and takes the sensing data from other sensors as non-sensitive data.

Preferably, the processor is further configured to preset an initial key with a main control unit of the electronic device in advance, authenticate with the main control unit according to the initial key, and interact with the main control unit to generate a time-varying key after the authentication is passed, where the encrypting of the sensitive data is performed by using the time-varying key.

Preferably, the integrated control apparatus further includes: a non-volatile memory to store at least one of the initial key, a time-varying key, and encrypted sensitive data.

Preferably, the integrated control apparatus further includes: a display unit for providing a display driving signal to a display screen; the processor is also used for controlling the display unit and the sensor unit.

Preferably, the integrated control device is a single chip.

According to a second aspect of the present invention, there is provided a display system comprising: a display screen for displaying an image according to the display data; the sensor is used for acquiring a sensing signal of user interaction; and the integrated control device.

According to a third aspect of the present invention, there is provided an electronic apparatus comprising: the above display system; and the main control unit is used for sending an encryption transmission instruction to the display system and receiving encrypted sensitive data and/or unencrypted non-sensitive data from the display system, wherein the encryption transmission instruction is used for the display system to judge whether the sensing data from the sensor unit is sensitive data or non-sensitive data.

Preferably, the electronic device is any one selected from a mobile phone, a tablet computer, a notebook computer, a VR device, an AR device, a watch, an automobile, and a bicycle.

According to a fourth aspect of the present invention, there is provided a data protection method performed in the above-described integrated control apparatus, including: obtaining sensing signals from a plurality of sensors; converting the sensing signal into sensing data; and judging whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encryption transmission instruction, and encrypting the sensitive data.

Preferably, the determining whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encrypted transmission instruction comprises: the sensing data from the fingerprint sensor and the palm print sensor is taken as sensitive data, and the sensing data from other sensors is taken as non-sensitive data.

Preferably, the determining whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encrypted transmission instruction comprises: and when the received encryption transmission instruction indicates that a specified sensor in the various sensors relates to the security application, taking the sensing data from the specified sensor as sensitive data and taking the sensing data from other sensors as non-sensitive data.

Preferably, the data protection method further includes: presetting an initial secret key between the electronic equipment and a main control unit of the electronic equipment in advance, authenticating the electronic equipment and the main control unit according to the initial secret key, and generating a time-varying secret key by interacting with the main control unit after the authentication is passed; and said encrypting the sensitive data is performed using said time-varying key.

Preferably, the data protection method further includes: and packaging the encrypted sensitive data and/or the unencrypted non-sensitive data into a data packet, and sending the data packet.

Preferably, the packing adds a start bit and a type identifier before the data content and adds an end bit and a check bit after the data content.

According to an embodiment of the present invention, the integrated control device distinguishes whether the sensed data from each sensor is sensitive data or non-sensitive data according to the sensor type and/or the encrypted transmission instruction from the main control unit. For sensitive data, the sensitive data is encrypted and then locally stored or provided to a main control unit for security-related operations such as security verification; for non-sensitive data, encryption may not be necessary and may be provided to the master control unit for non-security related operations such as touch control, photo, voice control, etc. In this way, sensitive data is encrypted before being transmitted to the outside of the display system, thereby improving security. The display system does not need to be provided with a separate security chip, and can still perform data protection at a hardware level under the condition of not increasing the hardware cost.

By adopting the integrated control device, the structure size of the existing display module can be reduced, the number of electronic components is reduced, the design complexity is reduced, and the yield is improved.

In a preferred embodiment, the individual modules of the integrated control device are integrated in a single chip. Further, a flash memory is also integrated in the chip of the integrated control device. Since the feature data is locally stored inside the chip, security can be further improved.

Drawings

The above and other objects, features and advantages of the present invention will become more apparent from the following description of the embodiments of the present invention with reference to the accompanying drawings.

Fig. 1 illustrates an equivalent circuit diagram of a liquid crystal display device in a display system according to an embodiment of the present invention.

Fig. 2 is an equivalent circuit diagram of a touch device in a display system according to an embodiment of the invention.

Fig. 3 shows an internal structural diagram of a display system according to an embodiment of the present invention.

Fig. 4 shows a circuit connection schematic of an electronic device comprising a display system according to an embodiment of the invention.

Fig. 5 shows a schematic block diagram of an electronic device comprising a display system according to an embodiment of the invention.

Fig. 6 shows a schematic block diagram of an integrated control device in a display system according to an embodiment of the present invention.

Fig. 7 shows a schematic block diagram of another integrated control device in a display system according to an embodiment of the present invention.

Fig. 8 is a timing diagram illustrating a time-division multiplexing display and touch control method in the display system according to the embodiment of the present invention.

FIG. 9 shows a flow diagram of a data protection method according to an embodiment of the invention.

Fig. 10 shows a flow chart of a data protection method according to another embodiment of the present invention.

Detailed Description

The invention will be described in more detail below with reference to the accompanying drawings. Like elements in the various figures are denoted by like reference numerals. For purposes of clarity, the various features in the drawings are not necessarily drawn to scale. In addition, certain well known components may not be shown.

In the following description, numerous specific details of the invention, such as structure, materials, dimensions, processing techniques and techniques of the devices are described in order to provide a more thorough understanding of the invention. However, as will be understood by those skilled in the art, the present invention may be practiced without these specific details.

In this application, the term "local" means inside the chip of the integrated control device disposed at the display side, or on the same printed circuit board as the integrated control device. For example, "local authentication" means that an authentication program is executed by a processor inside a chip of the integrated control device, and "local storage" means that a nonvolatile memory for storing feature data, an encryption program, and the authentication program is located inside the chip of the integrated control device or on the same printed circuit board as the integrated control device.

The present invention may be embodied in various forms, some examples of which are described below.

A display system according to an embodiment of the present invention includes a display device and at least one sensor for acquiring user information. The display device is, for example, any one selected from a liquid crystal display screen, an LED display screen, an AMOLED display screen, a quantum dot display screen, electronic paper, and a micro LED display screen. The sensor is, for example, any one selected from a touch device, a fingerprint sensor, an optical sensor, and an acoustic sensor. In the following embodiments, a touch-control liquid crystal display is taken as an example for explanation, wherein the display device is a liquid crystal display device, and the sensor is a touch-control device.

The liquid crystal display device 110 includes a gate driving module 111, a source driving module 112, a plurality of thin film transistors T, and a plurality of pixel capacitors C formed between pixel electrodes and a common electrode_LC. The plurality of thin film transistors T form an array. The gate driving module 111 is respectively connected to the gates of the thin film transistors T of the corresponding row via a plurality of gate scan lines for supplying gate voltages G1 to Gm in a scanning manner, thereby displaying an image frameIn the cycle, the thin film transistors of different rows are gated. The source driving module 112 is respectively connected to the sources of the tfts T in the corresponding row through a plurality of source data lines, and is configured to respectively provide gray scale voltages S1 to Sn corresponding to gray scales to the tfts T in each row when the tfts T in each row are turned on. Wherein m and n are natural numbers. The drains of the thin film transistors T are respectively connected to a corresponding pixel capacitor C_LC。

In the gating state, the source driving module 112 applies a gray scale voltage to the pixel capacitor C via the source data line and the thin film transistor T_LCThe above. Pixel capacitance C_LCThe applied voltage acts on the liquid crystal molecules to change the orientation of the liquid crystal molecules to achieve a light transmittance corresponding to a gray scale. To maintain the voltage between update periods of the pixel, the pixel capacitance C_LCThe storage capacitor Cs may be connected in parallel to obtain a longer holding time.

The touch device 120 includes a touch driving module 121, a touch sensing module 122, and a plurality of sensing capacitors CT formed between the excitation electrodes and the sensing electrodes. The plurality of sensing capacitors CT form an array. The touch driving module 121 is connected to the excitation electrodes of all rows for providing the excitation signals Tx1 to Txm in a scanning manner, so as to sequentially provide the excitation signals to the excitation electrodes of different rows in one touch frame period. The touch sensing module 122 is connected to the sensing electrodes of all columns, so as to receive the receiving signals Rx1 to Rxn of the corresponding column. Wherein m and n are natural numbers.

The touch driving module 121 generates an ac electrical signal as an excitation signal, for example, and the touch sensing module 122 receives the ac electrical signal, detects a current value according to the received signal, and further obtains a capacitance value at an intersection of the driving electrode and the sensing electrode according to the magnitude of the current value, thereby determining whether a touch action is generated at the point.

Fig. 3 shows an internal structural diagram of a display system according to an embodiment of the present invention. In this embodiment, the display system is a touch display screen 100.

As shown, the touch display screen 100 includes a liquid crystal screen, and a touch sensor 171 and a glass cover 172 sequentially stacked thereon. The liquid crystal panel includes a backlight unit 131 that provides backlight and a liquid crystal panel that changes light transmittance according to a gray-scale signal. The touch sensor 171 is, for example, a plastic sheet as a substrate.

The liquid crystal panel further includes a first glass substrate 141, a second glass substrate 142, and a liquid crystal layer 161 interposed therebetween, which are sequentially opposite to each other, the first polarizer 142 and the TFT array 143 are formed on the first glass substrate 141, and the second polarizer 152 and the color filter 153 are formed on the second glass substrate 142. In that

The first glass substrate 141 also forms a plurality of gate scan lines and a plurality of source data lines and a plurality of pixel electrodes, and the TFT array 143 includes a plurality of thin film transistors having gates connected to a corresponding one of the gate scan lines, sources connected to a corresponding one of the source data lines, and drains connected to a corresponding one of the pixel electrodes. A pixel capacitance is formed between the pixel electrode and the common electrode. As described below, the liquid crystal panel further includes a driving chip, and the gate driving module and the source driving module in the driving chip respectively provide the gate voltage and the gray scale voltage.

In the gating state of the thin film transistor, the source drive module applies gray scale voltage to the pixel capacitor C through the source data line and the thin film transistor_LCThe above. Pixel capacitance C_LCThe applied voltage acts on the liquid crystal molecules to change the orientation of the liquid crystal molecules to realize the light transmittance corresponding to the gray scale, thereby realizing the corresponding gray scale display.

In this embodiment, a touch display screen 100 of "cover-over-bezel sensor" is shown to illustrate the basic principles of the present invention. However, the present invention can be applied to touch display screens of various structures, not limited to the type of sensor and the manner of integration thereof in the display screen.

With this design, the touch sensor 171 is either added to the Cover Glass (CG) or placed in a dedicated sensor layer. The method of integrating the touch Sensor 171 on the Glass cover is sometimes referred to as a "cover-on-Lens (SoL)" or "cover-integrated Solution (OGS), because it does not need to add a separate Sensor layer, and only uses the Glass cover. The design method using the single touch sensor 171 is referred to as Glass-Film (GF) or Glass-Film (GFF), in which the former uses a single-layer electrode and the latter uses two-layer electrodes. These design methods are all referred to as "separated", i.e., the touch sensor 171 is stacked as a separate structure on the surface of the liquid crystal panel. The separated touch sensor cover layer has the advantages of mature technology, low risk and fast product marketing. When the latest display and touch technologies are adopted, a separate design is also adopted, and under the condition, the separate design is often integrated in a subsequent design link.

In a further improved configuration, the electrode array of touch sensor 171 is integrated directly onto one or more layers of the liquid crystal screen. This integration may be implemented On or within the base unit In the display screen, i.e., On-Cell integration or In-Cell integration.

The method of disposing the touch electrode array onto the second glass substrate 151 is called out-of-line integration because the sensor is located above the display screen basic unit. The drive and receive electrodes of the sensor may be electrically isolated from the jumpers or may be specially laid out so that the grids are realized without bridges. The latter design is referred to as Single-Layer-On-Cell (SLOC), which is common due to low cost and high yield.

The method is simple and reliable in adding the touch function to the display screen by adopting an externally-embedded technology, and is often the best choice for an Active-Matrix Organic Light Emitting Diode (AMOLED) display screen. For larger display screens and curved or flexible display screens, the metal mesh sensor integrated in an external embedding manner without jumper wires is also a good choice.

Another type of in-cell integration is a hybrid design, in which the driving electrodes of the touch sensor are embedded in the first glass substrate 141 and the receiving electrodes are externally embedded in the second glass substrate 151. This approach is called Hybrid In-Cell (Hybrid In-Cell) design. To avoid confusion, the term "Full In-Cell" refers to both the drive and receive electrodes being located within the base unit.

In this embodiment, a touch sensor is integrated in the display system. In alternative embodiments, in addition to the touch sensor, various bio-optical sensors, such as fingerprint sensor, acoustic sensor, optical sensor, etc., may be integrated for collecting biometric information such as fingerprint, voiceprint, iris, etc.

Fig. 4 shows a circuit connection schematic of a display system according to an embodiment of the invention. In this embodiment, the display system is a touch display screen 100. The touch display screen 100 further includes an integrated control chip 210 for providing display driving signals including gate voltages and gray-scale voltages to the tfts in the lcd, controlling the touch driving signals for the driving electrodes in the touch sensor, and obtaining receiving signals from the receiving electrodes in the touch sensor to determine the touch position. The integrated control chip 210 is connected to the motherboard 410 via the connection component 310. The connection member 310 is, for example, a flexible circuit board. The main board 410 includes a main processor (hereinafter, referred to as a main control unit 410) as a main control unit, and is configured to implement functions of an operating system.

Fig. 5 shows a schematic block diagram of an electronic device comprising a display system according to an embodiment of the invention. As shown in fig. 5, the electronic device includes a main control unit 410 and a display system, such as the touch display screen 100 described above. The display system 100 may include a display device 110 and at least one sensor including, but not limited to, a touch sensor 120, a fingerprint/palm print sensor 130, an acoustic sensor 140, an optical sensor 150, and the like. The display system 100 further comprises an integrated control device, such as the integrated control chip 210 described above, which may comprise a processor 211, a memory unit 24, a display unit 21 and a sensor unit 22. The main control unit 410 of the electronic device is used to implement the functions of an operating system, which may be implemented by an Application Processor (AP) of the electronic device.

In the example of fig. 5, the integrated control chip 210 may drive the display device 110 to display, drive the touch sensor 120 to obtain touch related information to determine a touch position, and drive the fingerprint sensor 130, the acoustic sensor 140, the optical sensor 150, and other sensors (if driving is required) and obtain sensing data about a fingerprint, a palm print, a voiceprint, an iris, a human face, and the like. The integrated control chip 210 can determine whether the sensed data from the sensor unit 22 is sensitive data or non-sensitive data according to the type of the sensor and/or the received encryption transmission command, and encrypt the sensitive data. Ways to distinguish between sensitive data and non-sensitive data include, but are not limited to, hardware differentiation and software differentiation.

As an example, different pins of the integrated control chip 210 may be connected to different types of sensors, and the identification of the sensors may be obtained through the pins. In an alternative embodiment, the sensors 120 to 150 may transmit identification and sensing signals to the integrated control chip 210 together, so that the integrated control chip 210 recognizes from which sensor the sensing data came. For example, whereas fingerprints and palmprints are typically used only when security applications are involved, the processor 211 of the integrated control chip 210 may distinguish between sensitive and non-sensitive data in a simple manner by using the sensed data from the fingerprint/palmprint sensor 130 as sensitive data and the sensed data from the other sensors 120, 140 and 150 as non-sensitive data.

As another example, the integrated control chip 210 may determine whether the sensing data is sensitive data or non-sensitive data according to an instruction from the main control unit 410. For example, when Personal Identification Number (PIN) code verification, iris verification, face verification, and other security-related operations are involved, the main control unit 410 may send an encrypted transmission instruction to the integrated control chip 210, the encrypted transmission instruction indicating that a specific sensor of the plurality of sensors is involved in a security application, for example, when PIN code verification is involved, the touch sensor 120 may be indicated to be involved in a security application, and the processor of the integrated control chip 210 may receive the encrypted transmission instruction and encrypt the sensing data from the touch sensor 120 as sensitive data during PIN code verification. Preferably, the integrated control chip 210 may further send a verification success instruction to stop encrypting the sensing data from the touch sensor 120 after the PIN code verification succeeds, continue encrypting the sensing data from the touch sensor 120 when the PIN code verification fails and re-input is required, and stop encrypting the sensing data from the touch sensor 120 when the PIN code verification fails for too many times to disallow continuous input.

The integrated control chip 210 may provide the encrypted sensitive data and the unencrypted non-sensitive data to the main control unit 410 for the main control unit 410 to perform PIN code verification. In some embodiments, the integrated control chip 210 may also perform security verification locally, thereby further improving security.

The display system in the prior art generally provides the sensing data from various sensors directly to the main control unit on the main board, and the main control unit uses the sensing data to perform corresponding operations according to application requirements. However, some of the sensing data may be related to security, for example, when the sensing data from the sensor relates to biometric verification such as fingerprint, palm print, iris, face, PIN code verification and other security operations, if the sensing data is transmitted to the master control unit without any security protection, the sensing data may be easily stolen or tampered during transmission or at the master control unit side.

In the display system according to this embodiment, the integrated control chip 210 distinguishes whether the sensing data from each sensor is sensitive data or non-sensitive data according to the sensor type and/or the encryption transmission command from the main control unit 410. For sensitive data, it is encrypted and stored locally or provided to the master control unit 410 for security-related operations such as security verification; for non-sensitive data, encryption may not be necessary and may be provided to the master control unit 410 for non-security related operations such as touch control, photo, voice control, etc. In this manner, sensitive data is encrypted before being transmitted to the outside of the display system 100, thereby improving security. The display system does not need to be provided with a separate security chip, and can still perform data protection at a hardware level under the condition of not increasing the hardware cost.

Fig. 6 shows a schematic block diagram of an integrated control device in a display system according to an embodiment of the present invention. The display system employs, for example, a liquid crystal display.

As shown, the integrated control chip 210 includes a processor 211, a user interface 231, a storage unit 24, a display unit 21, and a sensor unit 22.

Processor 211 is a von neumann or harvard architecture RISC CPU including but not limited to ARM, MIPS, OPENRISC, etc., preferably ARM; or a DSP, etc. The processor 211 is optimized for touch detection or for the remaining types of sensors. Touch input may be processed locally to determine whether the operating system needs to be woken up to handle the user request. The processor 211 may determine whether the sensed data from the sensor unit 22 is sensitive data or non-sensitive data according to the type of sensor and/or the received encryption transmission instruction, and encrypt the sensitive data. For example, the following may be used for encryption: the processor 211 presets an initial key between the main control unit 410 of the electronic device and the main control unit 410 in advance, authenticates the main control unit 410 according to the initial key, interacts with the main control unit 410 after the authentication is passed to generate a time-varying key, and encrypts the sensitive data by using the time-varying key.

The user interface 231 may support a plurality of communication protocols and digital I/O, such as I2C protocol and SPI protocol, and provide a plurality of digital I/O pins. The user interface 231 may communicate with a host processor on the motherboard.

The storage unit 24 further includes a data RAM 241, a program RAM 242, a boot ROM243, and a flash memory 244. In the flash memory 244, at least one of the following may be stored: the system comprises characteristic data, an encryption program, a secret key, encrypted sensing data and a verification program. For example, during the power-on of the integrated control chip 210, the boot program in the boot ROM243 may detect the flash memory 244, and load the encryption program from the flash memory 244 to encrypt the sensitive data when encryption is required, and store the encrypted sensitive data. Preferably, the flash memory 244 may also store an authentication program and feature data for the integrated control chip 210 to perform security authentication locally. Data generated by processor 211 during operation may be stored in data RAM 241. In this embodiment, the feature data in the flash memory 244 may come from a host processor on the motherboard or may be feature data acquired and processed locally under the control of the processor 211. In the latter case, not only the user's sensitive data but also the characteristic data are generated locally. The operating system obtains only the verification result from the integrated control chip 210, and cannot obtain both the sensitive data and the feature data, thereby contributing to further improvement of security.

The display unit 21 includes a display controller 212, a graphic engine 213, a timing controller 214, a display and graphic interface 215, a gate driving module 216, a source driving module 217, a common voltage driving module 218, a backlight control module 219, and a gamma reference module 251. The display controller 212 is used to generate graphic data based on the input display data. The graphics engine 213 is used to control memory windows, cursors, pointers, and sprites, thereby providing high performance optimized graphics for touch. Display and graphics interface 215 provides a variety of industry standard display interfaces for receiving display data, such as DSI TCVR, DBI I/F, DPI I I/F. The backlight control module 219 is used to control the backlight of the liquid crystal panel, and implement low power consumption management, so that it can be combined with the existing backlight energy-saving technology. The gate driving module 216, the source driving module 217 and the common voltage driving module 218 are used for generating a gate voltage, a gray scale voltage and a common voltage, respectively. The timing controller 214 controls output timings of the gate electrodes and the gray scale voltages such that the gate voltages G1 to Gm are supplied in a scanning manner during one image frame period, and the gray scale voltages S1 to Sn corresponding to the gray scale are supplied to the plurality of thin film transistors T of each column when the thin film transistors of the corresponding row are turned on, thereby applying a voltage to the pixel capacitors to change the orientation of the liquid crystal molecules to achieve light transmittance corresponding to the gray scale. The gamma reference module 251 is used for storing a gamma correction curve and providing a correction signal to the source driving module 217 for correcting the gray scale voltage to meet the non-linear requirement of human eyes on brightness variation.

The sensor unit 22 is used to obtain sensing signals from various sensors such as the touch sensor 120, the fingerprint/palm print sensor 130, the acoustic sensor 140, the optical sensor 150, and the like, and to convert the sensing signals into sensing data. Sensor unit 22 may have separate sub-modules for each type of sensor, each providing sensing data to processor 211 separately, and sensor unit 22 may also have a management module for coordinating and managing the transfer of data between each sub-module and processor 211. For example, for the touch sensor 120, the sensor unit 22 may include a touch sub-module including a touch logic module and a touch interface. The touch logic module has the functions of both the touch driving module and the touch sensing module, so as to provide the touch driving signal TX and receive the touch sensing signal RX. The touch control logic module amplifies and performs digital-to-analog conversion on the received touch control sensing signal to generate sensing data. The touch interface provides the sensing data to a main processor of the mainboard for further processing by an operating system. In some embodiments, each sub-module may provide pins for its corresponding sensor, such that different pins of the integrated control chip 210 connect different types of sensors and may obtain the identification of the sensor through the pins. In an alternative embodiment, each sensor 120-150 may transmit identification and sensing signals to the integrated control chip 210 together, so that the integrated control chip 210 recognizes from which sensor the sensing data came.

The integrated control device according to the related art is used to implement at least one of display driving and touch driving functions. The CPU in the integrated control device can have both display driving and touch driving functions. In the integrated control device, the CPU obtains the sensing data from the touch logic module and then directly provides the sensing data to the touch interface, thereby transmitting a single type of sensing data to the outside of the display screen. And the processor on the mainboard acquires the induction data, further wakes up the operating system and verifies the induction data. The integrated control device in the prior art does not distinguish sensitive data from non-sensitive data, and an operating system directly obtains the sensitive data.

Unlike the integrated control device of the prior art, the integrated control chip 210 distinguishes whether the sensing data from each sensor is sensitive data or non-sensitive data according to the type of the sensor and/or the encryption transmission instruction from the main control unit 410, and encrypts the sensitive data, so that the sensitive data can be provided to the operating system in a form of a ciphertext, thereby reducing the possibility that the sensitive data is stolen and tampered when being transmitted between the display system and the operating system, and improving the security.

In this embodiment, the processor 211 in the integrated control chip 210 has the functions of display driving, touch driving and data protection. In a preferred embodiment, the modules of the integrated control chip 210 are integrated in a single chip, thereby improving security. However, the present invention is not limited to these. The integrated control chip 210 may be formed as a plurality of chips and mounted together on a circuit board at the display screen side. After obtaining the sensing data from the touch logic module 221, the processor 211 performs different data processing according to the type of the sensing data. Thus, the transmission data provided at the touch interface 222 is not a single type of sensing data, but may be one of sensing data, encryption data, and verification results.

The flash memory 244 is employed in the integrated control chip 210 of this embodiment to store at least one of the characteristic data, the encryption program, the key, the encrypted sensing data, and the verification program. However, the present invention is not limited thereto. In alternate embodiments, the integrated control chip 210 may employ any type of non-volatile memory, such as any selected from flash, SRAM, DRAM, EEPROM, EPROM.

The integrated control chip 210 does not need to be provided with a separate security chip, and can still perform data protection at a hardware level without increasing hardware cost.

In this embodiment, the flash memory 244 is integrated in the integrated control chip 210 to improve security. In alternative embodiments, the flash memory 244 may be located outside the integrated control chip 210 and connected to the integrated control chip 210 via a bus to reduce system cost.

Fig. 7 shows a schematic block diagram of another integrated control device in a display system according to an embodiment of the present invention. The display system employs, for example, an AMOLED display screen.

As shown, the integrated control chip 220 includes a processor 211, a user interface 231, a storage unit, a display unit, and a touch unit.

Processor 211 is a von neumann or harvard architecture RISC CPU including but not limited to ARM, MIPS, OPENRISC, etc., preferably ARM; or a DSP, etc. The processor 211 is optimized for touch detection or for the remaining types of sensors. Touch input may be processed locally to determine whether the operating system needs to be woken up to handle the user request.

The memory unit further includes a data RAM 241, a program RAM 242, a boot ROM243, and a flash memory 244. The feature data and the encryption program and the authentication program are stored in the flash memory 244. During power-on of the integrated control chip 220, the boot program in the boot ROM243 detects the flash memory 244, and the encryption program and the authentication program are loaded from the flash memory 244, and decryption and data storage in the program RAM are performed. Data generated by the processor 211 during operation may then be stored in the data RAM 241. In this embodiment, the feature data in the flash memory 244 may come from a host processor on the motherboard or may be feature data acquired and processed locally under the control of the processor 211. In the latter case, not only the user's sensitive data but also the characteristic data are generated locally. The operating system obtains only the verification result from the integrated control chip 220 and cannot obtain both the sensitive data and the feature data, thereby contributing to further improvement of security.

The display unit includes a display controller 212, a graphic engine 213, a timing controller 214, a display and graphic interface 215, a row driving module 226, a column driving module 227, and a gamma reference module 251. The display controller 212 is used to generate graphic data based on the input display data. The graphics engine 213 is used to control memory windows, cursors, pointers, and sprites, thereby providing high performance optimized graphics for touch. Display and graphics interface 215 provides a variety of industry standard display interfaces for receiving display data, such as DSI TCVR, DBI I/F, DPI I I/F. The row driving module 226 and the column driving module 227 are used for generating gate voltages and gray scale voltages, respectively. The timing controller 214 controls output timings of the gate electrodes and the gray scale voltages such that the gate voltages G1 to Gm are supplied in a scanning manner during one image frame period, and the gray scale voltages S1 to Sn corresponding to the gray scale are supplied to the plurality of thin film transistors T of each row when the thin film transistors of the corresponding row are turned on, thereby applying a current having a value corresponding to the gray scale voltage to the light emitting diodes to emit light, thereby realizing light emission luminance corresponding to the gray scale. The gamma reference module 251 is used for storing a gamma correction curve, and provides a correction signal for correcting the gray scale voltage to the column driving module 227, so as to meet the non-linear requirement of human eyes on brightness variation.

The touch unit includes a touch logic module 221 and a touch interface 222. The touch logic module 221 has both functions of a touch driving module and a touch sensing module, so as to provide a touch driving signal TX and receive a touch sensing signal RX. The touch logic module 221 amplifies and performs digital-to-analog conversion on the received touch sensing signal to generate sensing data. The touch interface 222 provides the sensed data to the main processor of the motherboard for further processing by the operating system.

In this embodiment, the processor 211 in the integrated control chip 220 has the functions of display driving, touch driving and data protection. After the processor 211 obtains the sensing data from the sensor unit 22, it distinguishes whether the sensing data from each sensor is sensitive data or non-sensitive data according to the type of the sensor providing the sensing data and/or the encryption transmission instruction from the main control unit 410, and encrypts the sensitive data, so that the sensitive data can be provided to the operating system in the form of a ciphertext, which reduces the possibility that the sensitive data is stolen and tampered when being transmitted between the display system and the operating system, thereby improving the security.

In some embodiments, the flash memory 244 of the integrated control chip 220 may also store the feature data locally, and the processor 211 may also perform security verification locally, thereby eliminating the need to transfer sensitive data to the outside of the display system 100, thereby improving security. The integrated control chip 220 does not need to be provided with a separate security chip, and can still perform security verification at a hardware level without increasing hardware cost.

In this embodiment, the flash memory 244 is integrated in the integrated control chip 220 to improve security. In alternative embodiments, the flash memory 244 may be located outside the integrated control chip 220 and connected to the integrated control chip 220 via a bus to reduce system cost.

In practical applications, the display system may integrate multiple types of sensors. The processor in the integrated control chip 210 has three functions of display driving, sensor driving and security verification, thereby providing a hardware-level security verification mechanism. The various sensing units are in a periodic polling state at a lower operating frequency.

For touch detection, when the sensing unit senses that an object touches, the sensing unit is switched to a working state, touch data are collected, and at the moment, the display data and the touch data adopt a time-sharing multiplexing mode.

For contact biometric identification, such as fingerprint identification, touch is required for contact biometric identification, and therefore, biometric data acquired in this way is similar to touch data and is time-multiplexed with display data.

For contactless biometric identification, a preset may be made. For the acquisition needing manual supervision, a serial data frame can be adopted, the display data is switched to be the current acquisition data, and after the currently displayed acquisition data is terminated, the current acquisition data is switched to be the original image to be displayed. If the non-contact biometric feature identification acquisition process does not need manual supervision (unsupervised), the non-contact biometric feature identification acquisition process and the display data can be processed in the background in a time-sharing multiplexing mode. If the image sensor is adopted to collect the image, whether the real-time collected image meets the requirement needs to be manually corrected, the current object being captured can be displayed, and the display data is the current data collected by the image sensor at the moment.

The case where touch control and display are performed simultaneously is taken as an example for explanation.

In the blanking period in the image frame switching process, the noise influence of the display unit on the touch unit is small. Therefore, when the device actually works, the display and touch adopt a time division multiplexing principle, and the display data processing and the touch data processing can be separated in time so as to reduce mutual interference. In the image frame scanning, some time slots are divided as touch frames.

As shown in fig. 7, during one image frame, a plurality of display periods TP and a plurality of touch periods TP are respectively included. And alternately processing the display data and the touch data in different time periods. Namely, time-sharing multiplexing of display and touch control. Because human eyes have a certain recognition time window for picture conversion, the ratio of the frame rate to the time of two time periods has certain requirements. By adopting the driving mode, the influence of the noise electric signal of the liquid crystal display array on the touch working layer can be effectively reduced, the shielding lamination is also saved, and the thickness of the touch display screen is reduced.

The time division multiplexing function can be operated by a software program, and can also be switched by combining with the MUX multiplexing selection unit.

FIG. 9 shows a flow diagram of a data protection method according to an embodiment of the invention. The data protection method may be performed in the integrated control device described above, such as the

integrated control device

210 or 220. The integrated control device is connected with at least one sensor to obtain sensing data, and carries out different data according to the sensitivity level of the sensing data. The sensor is at least one of a touch sensor, a fingerprint sensor, a palm print sensor, an acoustic sensor, and an optical sensor, and the sensing data is at least one of a two-dimensional code, a touch position, a fingerprint, a voiceprint, and an iris, for example.

In step S101, the integrated control chip collects sensing data from various sensors. For example, the integrated control chip may obtain sensing signals from different sensors and convert the sensing signals into sensing data.

In step S102, the integrated control chip determines whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor, if the sensing data is sensitive data, step S103 is executed, otherwise step S104 is executed. As an example, it may be determined whether the sensing data is from a fingerprint sensor or a palm print sensor, if so, the sensing data is regarded as sensitive data, and step S103 is executed, otherwise, the sensing data is regarded as non-sensitive data, and step S104 is executed.

In step S103, the integrated control chip encrypts the sensitive data. For example, the integrated control chip may preset an initial key with a main control unit of the electronic device in advance, authenticate with the main control unit according to the initial key, interact with the main control unit after the authentication is passed to generate a time-varying key (for example, a random key), and encrypt the sensitive data by using the time-varying key. For example, the main control unit may set a shared key according to information such as a product model and a production lot, and perform an encryption operation according to the shared key and a padded hash value of an ID serial number of the integrated control device, where the padded hash value is generated after the ID serial number is processed by a padding function (padding function) and a hash function (hash function), and the encryption operation may include any symmetric cryptographic algorithm. The shared secret key is written in a flash memory of the integrated control device.

In step S104, the integrated control chip packages the data into a data packet and sends the data packet to the main control unit of the electronic device. For example, a start bit and a type identifier may be appended before the data content, and an end bit and a check bit may be appended after the data content, so that the master unit can recognize whether the received data is encrypted sensitive data or unencrypted non-sensitive data.

Fig. 10 shows a flow diagram of a data protection method according to another embodiment of the invention. The data protection method may be performed in the integrated control device described above, such as the

integrated control device

In step S201, the integrated control chip collects sensing data from various sensors. For example, the integrated control chip may obtain sensing signals from different sensors and convert the sensing signals into sensing data.

In step S202, the integrated control chip determines whether the sensed data from the sensor unit is sensitive data or non-sensitive data according to the received encrypted transmission command, if the sensed data is sensitive data, step S203 is executed, otherwise step S204 is executed. The encryption transmission instruction can be provided by a main control unit of the electronic equipment where the integrated control chip is located, and when the integrated control chip receives the encryption transmission instruction and indicates that a specified sensor in the various sensors relates to a security application, the integrated control chip takes the sensing data from the specified sensor as sensitive data and takes the sensing data from other sensors as non-sensitive data. For example, when the integrated control chip is installed in a smart phone, the application processor of the smart phone may transmit an encryption transmission instruction to the integrated control chip when performing operations related to Personal Identification Number (PIN) code verification, iris verification, face verification, and other security-related operations, the encryption transmission instruction may indicate that a specific sensor of the plurality of sensors is related to a security application, for example, when PIN code verification is related, the touch sensor may be indicated to be related to a security application, and then the processor of the integrated control chip may, upon receiving the encryption transmission instruction, take the sensing data from the touch sensor 120 as sensitive data and encrypt the sensing data during PIN code verification. The period of time that encryption is required may be included in the encrypted transmission instruction. In other embodiments, the time period in which encryption is required may also be controlled by the main processor according to application requirements, for example, the main processor may send a verification success instruction to the integrated control chip to stop encrypting the sensing data from the touch sensor after the PIN code is successfully verified, continue encrypting the sensing data from the touch sensor when the PIN code is failed to be verified and re-input is required, and stop encrypting the sensing data from the touch sensor when the PIN code is not verified for too many times, which results in that input is not allowed to continue.

In step S203, the integrated control chip encrypts the sensitive data. For example, the integrated control chip may preset an initial key with a main control unit of the electronic device in advance, authenticate with the main control unit according to the initial key, interact with the main control unit after the authentication is passed to generate a time-varying key (for example, a random key), and encrypt the sensitive data by using the time-varying key. For example, the main control unit may set a shared key according to information such as a product model and a production lot, and perform an encryption operation according to the shared key and a padded hash value of an ID serial number of the integrated control device, where the padded hash value is generated after the ID serial number is processed by a padding function (padding function) and a hash function (hash function), and the encryption operation may include any symmetric cryptographic algorithm. The shared secret key is written in a flash memory of the integrated control device.

In step S204, the integrated control chip packages the data into a data packet and sends the data packet to the main control unit of the electronic device. For example, a start bit and a type identifier may be appended before the data content, and an end bit and a check bit may be appended after the data content, so that the master unit can recognize whether the received data is encrypted sensitive data or unencrypted non-sensitive data.

In the above method, different processing is performed for the type of sensing data. And for the non-sensitive data, the integrated control chip directly transmits the induction data to the outside of the display system, and for the sensitive data, the integrated control chip encrypts the induction data and transmits the encrypted induction data to the outside of the display screen. Therefore, the sensitive data exists in the form of the ciphertext when leaving the integrated control device, the possibility that the sensitive data is stolen or tampered in the transmission process or on the operating system side is reduced, and the safety is improved compared with the traditional mode. Preferably, for specific sensing data, for example, sensing data with higher security requirements than the above sensitive data, the integrated control chip also performs security verification locally, compares the sensing data with the feature data to obtain a verification result, and transmits the verification result to the outside of the display screen, thereby further improving the security.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

While embodiments in accordance with the invention have been described above, these embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching, including but not limited to alterations to the local configuration of the circuit, and substitutions of types or models of components. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. The invention is limited only by the claims and their full scope and equivalents.

Claims

1. An integrated control apparatus, comprising:

a display unit for providing a display driving signal to a display screen;

the sensor unit is used for obtaining induction signals and identifications from various sensors and converting the induction signals into induction data;

a processor for judging the type of the sensor according to the identification, judging whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encryption transmission instruction, and encrypting the sensitive data,

wherein the integrated control device is a single chip and the sensor unit has a separate sub-module for each sensor, each sub-module providing pins for the respective sensor, such that different pins of the integrated control device are connected to different types of sensors, the display unit having a display and graphical interface for receiving display data.

2. The integrated control device of claim 1, wherein the plurality of sensors comprise at least one of a touch sensor, a fingerprint sensor, a palm print sensor, an acoustic sensor, and an optical sensor, and the sensing data is used to represent at least one of a two-dimensional code, a touch location, a fingerprint, a palm print, a voice print, and an iris.

3. The integrated control device of claim 2, wherein the processor encrypts the sensed data from the fingerprint sensor and the palm print sensor as sensitive data and encrypts the sensed data from the other sensor as non-sensitive data.

4. The integrated control device of claim 1, wherein the processor is configured to encrypt the sensed data from a given sensor of the plurality of sensors as sensitive data and to treat the sensed data from other sensors as non-sensitive data when the encrypted transmission instruction indicates that the given sensor is involved in the security application.

5. The integrated control device according to claim 1, wherein the processor is further configured to preset an initial key with a main control unit of the electronic device in advance, authenticate with the main control unit according to the initial key, and interact with the main control unit after the authentication is passed to generate a time-varying key, and the encrypting the sensitive data is performed by using the time-varying key.

6. The integrated control device of claim 5, further comprising: a non-volatile memory to store at least one of the initial key, the time-varying key, and the encrypted sensitive data.

7. A display system, comprising:

a display screen for displaying an image according to the display data;

the sensor is used for acquiring a sensing signal of user interaction;

the integrated control device according to any one of claims 1 to 6.

8. An electronic device, comprising:

the display system of claim 7;

the main control unit is used for sending an encryption transmission instruction to the display system and receiving encrypted sensitive data and/or unencrypted non-sensitive data from the display system, wherein the encryption transmission instruction is used for the display system to judge whether the sensing data from the sensor unit is sensitive data or non-sensitive data.

9. The electronic device of claim 8, wherein the electronic device is any one selected from a cell phone, a tablet computer, a laptop computer, a VR device, an AR device, a watch, an automobile, and a bicycle.

10. A data protection method performed in the integrated control device of any one of claims 1 to 6, comprising:

obtaining sensing signals from a plurality of sensors;

converting the sensing signal into sensing data; and

and judging whether the sensing data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encryption transmission instruction, and encrypting the sensitive data.

11. The data protection method of claim 10, wherein the plurality of sensors comprise at least one of a touch sensor, a fingerprint sensor, a palm print sensor, an acoustic sensor, and an optical sensor, and the sensing data is used for representing at least one of a two-dimensional code, a touch position, a fingerprint, a palm print, a voice print, and an iris.

12. The data protection method of claim 11, wherein the determining whether the sensed data from the sensor unit is sensitive data or non-sensitive data according to the type of the sensor and/or the received encrypted transmission instruction comprises: the sensing data from the fingerprint sensor and the palm print sensor is taken as sensitive data, and the sensing data from other sensors is taken as non-sensitive data.

13. The data protection method of claim 10, wherein determining whether the sensed data from the sensor unit is sensitive data or non-sensitive data according to the type of sensor and/or the received encrypted transmission instruction comprises: and when the received encryption transmission instruction indicates that a specified sensor in the various sensors relates to the security application, taking the sensing data from the specified sensor as sensitive data and taking the sensing data from other sensors as non-sensitive data.

14. The data protection method of claim 10, further comprising: presetting an initial key between the electronic equipment and a main control unit of the electronic equipment in advance, authenticating the electronic equipment and the main control unit according to the initial key, and generating a time-varying key by interacting with the main control unit after the authentication is passed; and is

The encrypting the sensitive data is performed using the time-varying key.

15. The data protection method of claim 10, further comprising: and packaging the encrypted sensitive data and/or the unencrypted non-sensitive data into a data packet, and sending the data packet.

16. The method of claim 15, wherein the packing appends a start bit and a type identifier before the data content and appends an end bit and a check bit after the data content.