CN111860497A - Information identification method and device - Google Patents

Information identification method and device Download PDF

Info

Publication number
CN111860497A
CN111860497A CN202010607511.5A CN202010607511A CN111860497A CN 111860497 A CN111860497 A CN 111860497A CN 202010607511 A CN202010607511 A CN 202010607511A CN 111860497 A CN111860497 A CN 111860497A
Authority
CN
China
Prior art keywords
brightness value
display area
target brightness
information
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010607511.5A
Other languages
Chinese (zh)
Other versions
CN111860497B (en
Inventor
黄浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202010607511.5A priority Critical patent/CN111860497B/en
Publication of CN111860497A publication Critical patent/CN111860497A/en
Application granted granted Critical
Publication of CN111860497B publication Critical patent/CN111860497B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/255Detecting or recognising potential candidate objects based on visual cues, e.g. shapes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

本申请公开了一种信息识别方法及装置,属于通信技术领域。该方法主要包括获取第一颜色传感器采集的第一显示区域的第一目标亮度值,第一目标亮度值为第一显示区域中每个像素点的发光亮度值;根据第一显示区域的第一目标亮度值,识别第一显示区域中的显示内容。本申请实施例中提供的方法能够解决识别信息繁琐、效率低的问题。

Figure 202010607511

The present application discloses an information identification method and device, which belong to the technical field of communication. The method mainly includes acquiring a first target brightness value of a first display area collected by a first color sensor, where the first target brightness value is the luminous brightness value of each pixel in the first display area; The target brightness value identifies the display content in the first display area. The methods provided in the embodiments of the present application can solve the problems of cumbersome identification information and low efficiency.

Figure 202010607511

Description

信息识别方法及装置Information identification method and device

技术领域technical field

本申请属于通信技术领域,具体涉及一种信息识别方法及装置。The present application belongs to the field of communication technologies, and specifically relates to an information identification method and device.

背景技术Background technique

随着电子设备硬件配置的逐步提高以及功能的拓展,电子设备已经成为人们日常生活中必不可少的必需品。用户使用电子设备进行社交的频率也越来越高,如用户可以通过电子设备将图片或者文本分享给其他用户。如果这些图片或者文本中带有敏感信息如隐私信息或者支付二维码信息等,在用户没有察觉的情况下就分享给其他用户,就会导致隐私信息泄露,造成不必要的损失。With the gradual improvement of the hardware configuration of electronic equipment and the expansion of functions, electronic equipment has become an indispensable necessities in people's daily life. Users use electronic devices to socialize more and more frequently. For example, users can share pictures or texts with other users through electronic devices. If these pictures or texts contain sensitive information, such as private information or payment QR code information, etc., and are shared with other users without the user's awareness, it will lead to the leakage of private information and cause unnecessary losses.

目前,识别图像或者文本中是否包括隐私信息的方式主要通过,判断该隐私信息所在截图中的图像特征是否满足一定的预设条件,若图像特征满足一定的预设条件,则确定该截图中包括隐私信息。但是,这种方式需要用户先截图,然后才能对截图中的图像特征进行识别,增加了用户的操作复杂度;另外,截图的清晰度会影响识别结果,在一些场景如想要快速识别信息的场景下并不适用。At present, the method of identifying whether an image or text contains private information is mainly by judging whether the image feature in the screenshot where the private information is located satisfies a certain preset condition, and if the image feature satisfies a certain preset condition, it is determined that the screenshot includes Privacy Information. However, this method requires the user to take a screenshot before identifying the image features in the screenshot, which increases the complexity of the user's operation; in addition, the clarity of the screenshot will affect the recognition result. In some scenarios, such as those who want to quickly identify information Not applicable in the scenario.

发明内容SUMMARY OF THE INVENTION

本申请实施例的目的是提供一种信息识别方法及装置,能够解决识别信息繁琐、效率低的问题。The purpose of the embodiments of the present application is to provide an information identification method and device, which can solve the problems of cumbersome identification information and low efficiency.

为了解决上述技术问题,本申请是这样实现的:In order to solve the above technical problems, this application is implemented as follows:

第一方面,本申请实施例提供了一种信息识别方法,应用于电子设备,电子设备包括设置在屏幕下方的第一颜色传感器,该方法包括:In a first aspect, an embodiment of the present application provides an information identification method, which is applied to an electronic device. The electronic device includes a first color sensor disposed below a screen, and the method includes:

获取第一颜色传感器采集的第一显示区域的第一目标亮度值,第一目标亮度值为第一显示区域中每个像素点的发光亮度值;acquiring a first target brightness value of the first display area collected by the first color sensor, where the first target brightness value is the luminous brightness value of each pixel in the first display area;

根据第一显示区域的第一目标亮度值,识别第一显示区域中的显示内容。According to the first target luminance value of the first display area, the display content in the first display area is identified.

第二方面,本申请实施例提供了一种信息识别装置,应用于电子设备,电子设备包括设置在屏幕下方的第一颜色传感器,该装置包括:In a second aspect, an embodiment of the present application provides an information identification device, which is applied to an electronic device, where the electronic device includes a first color sensor disposed below a screen, and the device includes:

第一获取模块,用于获取第一颜色传感器采集的第一显示区域的第一目标亮度值,第一目标亮度值为第一显示区域中每个像素点的发光亮度值;a first acquisition module, configured to acquire a first target brightness value of the first display area collected by the first color sensor, where the first target brightness value is the luminous brightness value of each pixel in the first display area;

识别模块,用于根据第一显示区域的第一目标亮度值,识别第一显示区域中的显示内容。The identification module is configured to identify the display content in the first display area according to the first target brightness value of the first display area.

第三方面,本申请实施例提供了一种电子设备,该电子设备包括处理器、存储器及存储在存储器上并可在处理器上运行的程序或指令,程序或指令被处理器执行时实现如第一方面涉及的方法步骤。In a third aspect, an embodiment of the present application provides an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor. When the program or instruction is executed by the processor, the The method steps involved in the first aspect.

第四方面,本申请实施例提供了一种可读存储介质,可读存储介质上存储程序或指令,程序或指令被处理器执行时实现如第一方面涉及的方法步骤。In a fourth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the method steps involved in the first aspect are implemented.

第五方面,本申请实施例提供了一种芯片,芯片包括处理器和通信接口,通信接口和处理器耦合,处理器用于运行程序或指令,实现如第一方面涉及的方法步骤。In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run programs or instructions to implement the method steps involved in the first aspect.

在本申请实施例中,采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。由于,用户在使用电子设备时,会使显示区域常亮,这样,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,在提高识别效率的同时,减少用户操作。In the embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Because when the user uses the electronic device, the display area will be always bright, so that the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation. While improving recognition efficiency, user operations are reduced.

附图说明Description of drawings

图1为本申请实施例提供的一种信息识别方法的应用场景示意图;1 is a schematic diagram of an application scenario of an information identification method provided by an embodiment of the present application;

图2为本申请实施例提供的一种信息识别方法的流程图;2 is a flowchart of an information identification method provided by an embodiment of the present application;

图3为本申请实施例提供的一种信息识别的界面示意图;3 is a schematic interface diagram of information identification provided by an embodiment of the present application;

图4为本申请实施例提供的一种信息识别装置的结构示意图;4 is a schematic structural diagram of an information identification device provided by an embodiment of the present application;

图5为本申请实施例提供的一种电子设备的结构示意图;5 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

图6为本申请实施例提供的一种电子设备的硬件结构示意图。FIG. 6 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that embodiments of the application can be practiced in sequences other than those illustrated or described herein. In addition, the objects distinguished by "first", "second", etc. are usually one type, and the number of objects is not limited. For example, the first object may be one or more than one. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the associated objects are in an "or" relationship.

基于此,下面结合附图1-图3,通过具体的实施例及其应用场景对本申请实施例提供的信息识别方法进行详细地说明。Based on this, the information identification method provided by the embodiment of the present application will be described in detail below with reference to FIG. 1 to FIG. 3 , through specific embodiments and application scenarios thereof.

本申请提出一种信息识别方法的应用场景,参照图1,首先,本申请实施例中提供了一种电子设备,该电子设备包括设置在屏幕下方的第一颜色传感器如色温传感器。其中,将色温传感器置于电子设备的有机发光二极管(Organic Light-Emitting Diode,OLED)屏幕下面,用于采集OLED屏幕中每个像素点的第一目标亮度值,该第一目标亮度值可以包括RGB色彩模式的发光亮度值,和/或检测电子设备的OLED屏幕中显示区域的每个像素点的亮度值。这里,具体能够采集与显示区域对应的每个像素点的RGB(如红、绿、蓝)成分的发光亮度值。需要提示的是,采集到的RGB发光亮度值采用统一单位。The present application proposes an application scenario of an information identification method. Referring to FIG. 1 , first, an embodiment of the present application provides an electronic device, the electronic device includes a first color sensor such as a color temperature sensor disposed below the screen. Wherein, the color temperature sensor is placed under the organic light-emitting diode (Organic Light-Emitting Diode, OLED) screen of the electronic device to collect the first target brightness value of each pixel in the OLED screen. The first target brightness value may include The luminous brightness value of the RGB color mode, and/or the brightness value of each pixel in the display area of the OLED screen of the detection electronic device. Here, the luminous luminance value of the RGB (eg, red, green, and blue) components of each pixel point corresponding to the display area can be collected specifically. It should be reminded that the collected RGB luminous brightness value adopts a unified unit.

本申请实施例中,利用色温传感器识别目标信息的原理可以是通过色温传感器采集发光物体的发光量中的RGB成分(如红、绿和蓝颜色的成分),识别物体的颜色,接着,本申请实施例中的OLED屏幕自身是可以发光的,当其上面显示的内容不同,每个像素点的发光的RGB也会不同,本申请实施例中可以通过采集每个像素点的RGB发光亮度值(或者,显示区域的每个像素点的亮度值)来分析和识别当前显示区域中显示的内容。In the embodiment of the present application, the principle of using the color temperature sensor to identify the target information may be to collect the RGB components (such as red, green and blue color components) in the luminous amount of the light-emitting object through the color temperature sensor, and identify the color of the object. Next, this application The OLED screen itself in the embodiment can emit light. When the content displayed on it is different, the RGB light emitted by each pixel point will also be different. In the embodiment of the present application, the RGB light emission brightness value ( Or, the brightness value of each pixel in the display area) to analyze and identify the content displayed in the current display area.

基于此,获取色温传感器识别的第一显示区域中的显示内容,如某一个图片、一个短信息、一段视频等所在第一显示区域10;接着,根据第一显示区域的第一目标亮度值,构建第一显示区域中至少一个对象的形状;根据至少一个对象的形状,识别第一显示区域中的显示内容。Based on this, obtain the display content in the first display area identified by the color temperature sensor, such as the first display area 10 where a certain picture, a short message, a video, etc. are located; then, according to the first target brightness value of the first display area, constructing the shape of at least one object in the first display area; and identifying the display content in the first display area according to the shape of the at least one object.

在确定显示内容中包括目标信息如用户的隐私信息或者敏感信息等用户不想分享或者公开展示的信息的情况下,显示提示信息,提示信息用于提示显示内容中包括需要进行隐藏处理的目标信息,以防止用户给别人观看或者,在发送图片或者文本时泄露隐私信息。In the case where it is determined that the displayed content includes target information such as the user's private information or sensitive information and other information that the user does not want to share or publicly display, prompt information is displayed, and the prompt information is used to prompt that the displayed content includes target information that needs to be hidden. In order to prevent users from watching others or revealing private information when sending pictures or texts.

基于此,本申请实施例中通过采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。这样,用户在使用电子设备时,会使显示区域常亮,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,减少用户操作,提高识别效率。Based on this, in the embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. In this way, when the user uses the electronic device, the display area will be always bright, and the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation, and the user operation can be reduced. , to improve the recognition efficiency.

另外,本申请实施例可以实现无需用户触发识别操作,这样,即可以减少用户操作,还可实时识别显示内容中是否包括目标信息如隐私信息或敏感信息,在确定显示内容中包括目标信息的情况下,提示用户第一信息中包括隐私信息,防止用户在发送图片或者文本时泄露隐私信息。In addition, the embodiment of the present application can realize that the user does not need to trigger the identification operation, so that the user operation can be reduced, and whether the displayed content includes target information, such as private information or sensitive information, can be identified in real time, and it is determined that the displayed content includes the target information. Next, prompt the user to include private information in the first information, so as to prevent the user from leaking private information when sending pictures or texts.

需要说明的是,本申请实施例中涉及的场景除了可以如上述根据本申请提供的识别方法进行隐私信息识别的场景之外,还可以应用于任何通过第一颜色传感器如色温传感器采集显示区域的亮度值,以通过亮度值进行信息识别的场景中,如在视频剪辑中,通过上述方式,识别视频中的敏感信息或者用户预设信息(如不想出现在视频中的广告商的名称)等。由此,提供一种通过亮度值进行信息识别这种新的识别方式,在提高识别信息效率的同时,保证用户隐私信息不容易被泄露。It should be noted that the scenarios involved in the embodiments of the present application can be applied to any scenario where the display area is collected by a first color sensor such as a color temperature sensor, in addition to the scenarios in which privacy information can be identified according to the identification method provided by the present application as described above. The brightness value is used to identify sensitive information in the video or user preset information (such as the name of an advertiser who does not want to appear in the video) in a scene where information is identified by the brightness value, such as in a video clip. Therefore, a new identification method of information identification based on brightness value is provided, which improves the efficiency of identification information and ensures that user privacy information is not easily leaked.

根据上述应用场景,下面结合图2-图3对本申请实施例提供的信息识别方法进行详细说明。According to the above application scenario, the information identification method provided by the embodiment of the present application will be described in detail below with reference to FIG. 2 to FIG. 3 .

图2为本申请实施例提供的一种信息识别方法的流程图。FIG. 2 is a flowchart of an information identification method provided by an embodiment of the present application.

如图2所示,该信息识别方法可以应用于电子设备,电子设备包括设置在屏幕下方的第一颜色传感器,基于此,具体可以包括如下步骤:As shown in FIG. 2 , the information identification method can be applied to an electronic device. The electronic device includes a first color sensor disposed below the screen. Based on this, the following steps may be specifically included:

首先,步骤210,取第一颜色传感器采集的第一显示区域的第一目标亮度值,第一目标亮度值为第一显示区域中每个像素点的发光亮度值。First, in step 210, the first target brightness value of the first display area collected by the first color sensor is taken, and the first target brightness value is the luminous brightness value of each pixel in the first display area.

然后,步骤220,根据第一显示区域的第一目标亮度值,识别第一显示区域中的显示内容。Then, in step 220, the display content in the first display area is identified according to the first target brightness value of the first display area.

由此,采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。这样,用户在使用电子设备时,会使显示区域常亮,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,在提高识别效率的同时,减少用户操作。Thus, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. In this way, when the user uses the electronic device, the display area will be always bright, and the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation, which can improve the recognition performance. Efficiency while reducing user operations.

下面对上述步骤进行详细说明,具体如下所示:The above steps are described in detail below, as follows:

首先,涉及步骤220,本申请实施例中提供了下述三种识别第一显示区域中的显示内容的方式,具体如下所示:First, involving step 220, the embodiment of the present application provides the following three ways to identify the display content in the first display area, which are as follows:

方式(1),在一种可能的实施例中,通过设置在电子设备屏幕下方的第一颜色传感器获取的第一目标亮度值,识别第一显示区域中的显示内容。这里,第一颜色传感器如色温传感器。In a way (1), in a possible embodiment, the display content in the first display area is identified by the first target brightness value obtained by the first color sensor disposed below the screen of the electronic device. Here, the first color sensor is such as a color temperature sensor.

其中,基于色温传感器采集的第一显示区域中每个像素点的第一目标亮度值,构建第一显示区域中至少一个对象的形状;根据至少一个对象的形状,识别第一显示区域中的显示内容。The shape of at least one object in the first display area is constructed based on the first target brightness value of each pixel in the first display area collected by the color temperature sensor; the display in the first display area is identified according to the shape of the at least one object content.

举例说明,利用全屏幕的色温传感器实时检测在第一显示区域,获取第一显示区域中多个像素点中每个像素点的rgb成分组成的通道组,以确定每个像素点对应的亮度值,然后,根据每个像素点对应的亮度值,得到第一显示区域中至少一个对象的形状如形状“3”;根据至少一个对象的形状,识别第一显示区域中的显示内容如根据形状“3”识别出该形状为数字“3”。For example, a full-screen color temperature sensor is used to detect the first display area in real time, and a channel group composed of rgb components of each pixel in the multiple pixels in the first display area is obtained to determine the brightness value corresponding to each pixel. , and then, according to the brightness value corresponding to each pixel, obtain the shape of at least one object in the first display area, such as shape "3"; according to the shape of at least one object, identify the display content in the first display area 3" identifies the shape as the number "3".

方式(2),在另一种可能的实施例中,在一些场景中,为了保证识别第一显示区域中的显示内容的精度,以提高确定显示内容的准确度。这样,在电子设备还包括设置在屏幕上方的第二颜色传感器的情况下,识别第一显示区域中的显示内容具体可以包括:Manner (2), in another possible embodiment, in some scenarios, in order to ensure the accuracy of identifying the display content in the first display area, the accuracy of determining the display content is improved. In this way, when the electronic device further includes a second color sensor disposed above the screen, identifying the display content in the first display area may specifically include:

获取第二颜色传感器采集的第二目标亮度值,第二目标亮度值为电子设备所处环境的亮度值;根据第一目标亮度值和第二目标亮度值,识别第一显示区域中的显示内容。Obtain the second target brightness value collected by the second color sensor, where the second target brightness value is the brightness value of the environment where the electronic device is located; identify the display content in the first display area according to the first target brightness value and the second target brightness value .

其中,可以根据第一目标亮度值和第二目标亮度值,构建第一显示区域中至少一个对象的形状;根据至少一个对象的形状,识别第一显示区域中的显示内容。The shape of at least one object in the first display area can be constructed according to the first target brightness value and the second target brightness value; the display content in the first display area can be identified according to the shape of the at least one object.

举例说明,通过获取的两种不同方面的亮度值,即全屏幕的色温传感器实时采集的每个像素点对应的第一目标亮度值,以及第二颜色传感器如环境光敏传感器采集的电子设备所处环境的第二目标亮度值。由于,在一些场景下,环境光会影响第一显示区域的显示亮度,如环境光过高,会调小第一显示区域的显示亮度,反之,若环境光过暗,会提高第一显示区域的显示亮度,由此,可以理解的是,第二目标亮度值在一定程度上回影响第一目标亮度值。这样,为了保证识别显示内容的准确性,根据第一显示区域的每个像素点对应的第一目标亮度值和第二目标亮度值更能得到准确度更高的至少一个对象的形状如形状“3”;根据至少一个对象的形状,识别第一显示区域中的显示内容如根据形状“3”识别出该形状为数字“3”。By way of example, two different aspects of brightness values are obtained, that is, the first target brightness value corresponding to each pixel point collected in real time by the full-screen color temperature sensor, and the location of the electronic device collected by the second color sensor such as the ambient light sensor. The second target brightness value of the environment. Because, in some scenarios, the ambient light will affect the display brightness of the first display area. If the ambient light is too high, the display brightness of the first display area will be reduced. On the contrary, if the ambient light is too dark, the display brightness of the first display area will be increased. Therefore, it can be understood that the second target brightness value affects the first target brightness value to a certain extent. In this way, in order to ensure the accuracy of identifying the displayed content, the shape of at least one object with higher accuracy can be obtained according to the first target brightness value and the second target brightness value corresponding to each pixel in the first display area. 3"; according to the shape of at least one object, identify the display content in the first display area. For example, according to the shape "3", the shape is identified as a number "3".

需要提示的是,本申请实施例中的环境光敏传感器可以设置在电子设备的屏幕上,用于检测并获取电子设备所处环境的亮度值的功能。It should be noted that the ambient light sensor in the embodiment of the present application may be set on the screen of the electronic device, and is used for the function of detecting and acquiring the brightness value of the environment where the electronic device is located.

方式(3)基于方式(2),在又一种可能的实施例,本申请实施例可以提供一种,具体的根据第一目标亮度值和第二目标亮度值,识别显示内容的方式,如下所示:Mode (3) Based on Mode (2), in another possible embodiment, the embodiment of the present application may provide a specific method for identifying the display content according to the first target brightness value and the second target brightness value, as follows shown:

基于第二目标亮度值分别对与第一目标亮度值对应的每个像素点的亮度值进行调整,得到每个像素点的第三目标亮度值;Based on the second target brightness value, the brightness value of each pixel corresponding to the first target brightness value is adjusted to obtain the third target brightness value of each pixel;

基于每个像素点的第三目标亮度值,构建第一显示区域中至少一个对象的形状;constructing the shape of at least one object in the first display area based on the third target luminance value of each pixel;

根据至少一个对象的形状,识别第一显示区域中的显示内容。Display content in the first display area is identified based on the shape of the at least one object.

基于此,基于第二目标亮度值分别对发光亮度值和每个像素点的亮度值进行调整,得到第一显示区域中每个像素点的第三目标亮度值进行举例说明:Based on this, the light-emitting luminance value and the luminance value of each pixel are adjusted respectively based on the second target luminance value, and the third target luminance value of each pixel in the first display area is obtained.

首先,获取全屏幕的色温传感器实时采集的第一显示区域中每个像素点的发光亮度值和如RGB通道组(红,绿,蓝)[R1,R2,R3.....Rn],[G1,G2,G3.....Gn],[B1,B2,B3.....Bn];接着,获取环境光敏传感器采集的电子设备所处环境的第二目标亮度值如RGB(LR,LG,LB)。First, obtain the luminous brightness value of each pixel in the first display area collected in real time by the full-screen color temperature sensor and the RGB channel group (red, green, blue) [R1, R2, R3.....Rn], [G1, G2, G3.....Gn], [B1, B2, B3.....Bn]; Next, obtain the second target brightness value of the environment where the electronic device is located, collected by the ambient light sensor, such as RGB ( LR, LG, LB).

然后,获取滤除RGB通道组中的环境光影响即第二目标亮度值,即[(R1-LR),(R2-LR),(R3-LR)……(Rn-LR)],[(G1-LG),(G2-LG),(G3-LG)....Gn-LG],[(B1-LB),(B2-LG),(B3-LG)....Bn-LG],由此,得到第一显示区域上每一个像素点的第三目标亮度值。Then, obtain and filter out the influence of ambient light in the RGB channel group, that is, the second target luminance value, namely [(R1-LR), (R2-LR), (R3-LR)...(Rn-LR)], [( G1-LG), (G2-LG), (G3-LG)....Gn-LG], [(B1-LB), (B2-LG), (B3-LG)....Bn-LG ], thereby obtaining the third target brightness value of each pixel on the first display area.

基于此,可以基于上述确定的每个像素点的第三目标亮度值,构建第一显示区域中至少一个对象的形状;根据至少一个对象的形状,识别第一显示区域中的显示内容。Based on this, the shape of at least one object in the first display area can be constructed based on the above-determined third target brightness value of each pixel; the display content in the first display area can be identified according to the shape of the at least one object.

举例说明,通过上述获取的第三目标亮度值来分离和识别出第一显示区域中的至少一个对象的形状。For example, the shape of at least one object in the first display area is separated and identified by the third target luminance value obtained above.

其中,可以通过第一显示区域中每个像素点显示不同颜色来区分,根据每个像素点的第三目标亮度值就可以确定第一显示区域中的信息,下面以识别出数字3为例进行说明。Among them, each pixel in the first display area can be distinguished by displaying different colors, and the information in the first display area can be determined according to the third target brightness value of each pixel. The following is an example of identifying the number 3. illustrate.

首先,假设数值3所在电子设备的屏幕中是以白字黑底的形式显示,其中,屏幕中第一显示区域的大小为30*30个像素点大小。First, it is assumed that the screen of the electronic device where the numerical value 3 is located is displayed in the form of white characters and black background, wherein the size of the first display area on the screen is 30*30 pixels.

接着,获取与30*30像素点对应的第三目标亮度值。即该30*30像素点对应的900个像素点的第三目标亮度值可以表示为:[(R1-LR),(R2-LR),(R3-LR).....(R900-LR)],[(G1-LG),(G2-LG),(G3-LG)....G900-LG],[(B1-LB),(B2-LG),(B3-LG)....B900-LG]。Next, a third target luminance value corresponding to 30*30 pixels is obtained. That is, the third target luminance value of the 900 pixels corresponding to the 30*30 pixels can be expressed as: [(R1-LR), (R2-LR), (R3-LR).....(R900-LR) )], [(G1-LG), (G2-LG), (G3-LG)....G900-LG], [(B1-LB), (B2-LG), (B3-LG).. ..B900-LG].

然后,区分出底色区域和数值区域,定义出边界。其中,区分底色和数字的颜色可以采用如下过程,对应这个900像素点的第三目标亮度值进行遍历,统计其中所有发光量(或者亮度值)相同的像素点并且分类,假设该例子只有黑白两种颜色,通过遍历得出白色像素点的个数为300个,黑色像素点的个数600个,这就区分出数字显示区域的颜色和底色区域的颜色,本申请实施例中假设像素的个数多的为底色,那就得出黑色为底色,白色为数字颜色。需要提示的是,对于第一显示区域中比较复杂的信息一样可以采用上述过程对底色和数字颜色进行区分,本申请中可以通过预设不同的阈值进行区分。接着,通过900像素点的第三目标亮度值在整个显示屏幕中占据的分量识别出数字的形状。Then, distinguish the background color area and the numerical area, and define the boundary. Among them, the following process can be used to distinguish the color of the background color and the number. The third target brightness value corresponding to the 900 pixels is traversed, and all the pixels with the same luminous amount (or brightness value) are counted and classified, assuming that the example is only black and white. Two colors, through traversal, the number of white pixels is 300, and the number of black pixels is 600, which distinguishes the color of the digital display area and the color of the background area. In the embodiment of this application, it is assumed that the pixel The number of the number is the background color, then it is concluded that black is the background color, and white is the digital color. It should be noted that, for the more complex information in the first display area, the above process can also be used to distinguish the background color and the digital color, and different thresholds can be preset in this application to distinguish. Next, the shape of the digit is identified by the component occupied by the third target luminance value of 900 pixels in the entire display screen.

需要提示的是,若采用第一目标亮度值来分离和识别出第一显示区域中的至少一个对象的形状,可以将该例子中,涉及的第三目标亮度值替换为第一目标亮度值,且该30*30像素点对应的900个像素点的第一目标亮度值可以表示为:[(R1),(R2),(R3).....(R900)],[(G1),(G2),(G3)....G900],[(B1),(B2),(B3)....B900],这样,原理如上述例子所示,在此不再赘述。It should be noted that if the first target brightness value is used to separate and identify the shape of at least one object in the first display area, the third target brightness value involved in this example can be replaced with the first target brightness value, And the first target brightness value of the 900 pixels corresponding to the 30*30 pixels can be expressed as: [(R1), (R2), (R3).....(R900)], [(G1), (G2), (G3)....G900], [(B1), (B2), (B3)....B900], in this way, the principle is shown in the above example, and will not be repeated here.

其中,在另一种可能的实施例中,上述方式(1)-(3)中根据第三目标亮度值,构建第一显示区域中至少一个对象的形状的步骤,均可以具体包括:Wherein, in another possible embodiment, the steps of constructing the shape of at least one object in the first display area according to the third target luminance value in the above manners (1)-(3) may specifically include:

在第一显示区域中,获取与每个第三目标亮度值对应的像素点的坐标信息;In the first display area, obtain the coordinate information of the pixel corresponding to each third target brightness value;

根据坐标信息,构建第一显示区域中至少一个对象的形状。According to the coordinate information, the shape of at least one object in the first display area is constructed.

举例说明,接上述例子,通过上述方式底色和数字的颜色,其中,数字的颜色个数集合,也就是上面300个白色像素点对应的RGB第三目标亮度值的集合,通过获取到300个白色像素点对应显示屏幕的坐标值[(x1,y1),(x2,y2)....(x300,y300)],循环遍历这个300个白色像素点的坐标值,并且求取相邻两个坐标的欧式距离,并且将相邻的两点连线处理,得出一个大致的形状。For example, following the above example, through the above method, the background color and the color of the number, where the number of colors of the number set, that is, the set of RGB third target brightness values corresponding to the above 300 white pixels, is obtained by obtaining 300 The white pixel corresponds to the coordinate value of the display screen [(x1,y1),(x2,y2)....(x300,y300)], loop through the coordinate values of the 300 white pixels, and find the adjacent two The Euclidean distance of the coordinates, and connect the two adjacent points to obtain a rough shape.

然后,将上述得到的大致的形状的数据输入到目标识别模型中,得到该大致的形状与预设形状的相似度,在该相似度满足预设相似度时,将大致的形状确定为数值“3”。同理,根据上述方式,识别第一显示区域中所有的至少一个对象,以根据至少一个对象的形状,识别第一显示区域中的显示内容。Then, input the data of the rough shape obtained above into the target recognition model to obtain the similarity between the rough shape and the preset shape. When the similarity meets the preset similarity, the rough shape is determined as a numerical value" 3". Similarly, according to the above method, all at least one object in the first display area is identified, so as to identify the display content in the first display area according to the shape of the at least one object.

由此,可以结合色温传感器和环境光敏传感器获取的亮度值,进一步进行内容识别,即排除色温传感器获取的亮度值中电子设备所处环境的亮度值的影响,这样,在保证目标发光亮度值的精度的同时,提高确定目标信息的准确度。Therefore, content identification can be further carried out in combination with the brightness values obtained by the color temperature sensor and the ambient light sensor, that is, the influence of the brightness value of the environment in which the electronic device is located in the brightness value obtained by the color temperature sensor can be excluded. While improving the accuracy, the accuracy of determining the target information is improved.

基于上述方式(1)-(3)任意一种方式识别第一显示区域中的显示内容,本申请实施例还提供了一种基于上述信息识别方法实现文本识别的场景,即在步骤220之后,方法还包括:通过上述识别方式,识别第一显示区域中显示内容是否为包括目标信息,这里,该目标信息可以包括下述信息中的至少一种:敏感信息、隐私信息、用户预设的信息。Based on any one of the above methods (1)-(3) to identify the display content in the first display area, the embodiment of the present application also provides a scene for realizing text recognition based on the above information recognition method, that is, after step 220, The method further includes: identifying whether the displayed content in the first display area includes target information through the above identification method, where the target information may include at least one of the following information: sensitive information, private information, and user-preset information .

由此,在上述步骤识别到显示内容包括目标信息的情况下,显示提示信息,提示信息用于提示显示内容中包括需要进行隐藏处理的信息;接收对提示信息的第一输入;响应于第一输入,在将显示内容发送到第一用户时,对目标信息进行隐藏处理,以使目标信息在与第一用户对应的设备上显示的第二显示区域中,以非明文的方式显示。Thus, in the case that the above steps recognize that the displayed content includes target information, display prompt information, and the prompt information is used to prompt that the displayed content includes information that needs to be hidden; receive the first input of the prompt information; respond to the first In the input, when the displayed content is sent to the first user, the target information is hidden, so that the target information is displayed in non-plain text in the second display area displayed on the device corresponding to the first user.

举例说明,根据至少一个对象的形状,确定显示内容中包括满足预设规则的目标信息。其中,预设规则可以包括下述中的至少一种:至少一个对象的形状是否是电话号码连续11位数字匹配,及常用敏感字符匹配如身份证号码、银行卡号等匹配,用户预设的敏感信息。For example, according to the shape of at least one object, it is determined that the display content includes target information that satisfies a preset rule. Wherein, the preset rules may include at least one of the following: whether the shape of at least one object is a phone number matching with 11 consecutive digits, and a common sensitive character matching such as an ID card number, a bank card number, etc., the user preset sensitive information.

然后,如图3所示,在接收用户触发截屏动作、截图动作或者待发送目标信息的第一输入时,显示提示信息,向用户提示,在将目标信息发送到第一用户时,是否在第一用户的第二显示区域中以非明文方式或者明文方式显示目标信息,Then, as shown in FIG. 3 , when receiving the first input of the user triggering the screenshot action, the screenshot action or the target information to be sent, a prompt message is displayed to prompt the user whether the target information is sent to the first user in the first In the second display area of a user, the target information is displayed in non-clear text or in plain text,

在接收到用户选择“在第一用户处以非明文显示”时,如图3右边图所示,目标信息在与第一用户对应的设备上显示的第二显示区域中以非明文的方式显示。基于此,在将第一信息发送到第一用户时,对目标信息进行隐藏处理,以使目标信息在与第一用户对应的设备上显示的第二显示区域中,以非明文的方式显示。When receiving a user selection of "display in non-plain text at the first user", as shown in the right figure in FIG. 3 , the target information is displayed in non-plain text in the second display area displayed on the device corresponding to the first user. Based on this, when the first information is sent to the first user, the target information is hidden, so that the target information is displayed in non-clear text in the second display area displayed on the device corresponding to the first user.

这样,利用色温传感器即可以提升电子设备的显示屏幕的显示效果,又利用色温传感器识别光源中的RGB的特点,通过算法模拟来动态识别当前显示区域的显示内容,相比于其他识别信息的方式具有一定快速的特点和省电的特点,另外,还可以实时的提醒用户当前显示区域中是否存在目标信息,提高了用户体验。In this way, the color temperature sensor can be used to improve the display effect of the display screen of the electronic device, and the color temperature sensor can be used to identify the characteristics of RGB in the light source, and the display content of the current display area can be dynamically identified through algorithm simulation, compared with other ways of identifying information. It has certain characteristics of fast speed and power saving. In addition, it can also remind the user whether there is target information in the current display area in real time, which improves the user experience.

综上,在本申请实施例中,采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。由于,用户在使用电子设备时,会使显示区域常亮,这样,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,在提高识别效率的同时,减少用户操作。To sum up, in this embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Because when the user uses the electronic device, the display area will be always bright, so that the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation. While improving recognition efficiency, user operations are reduced.

另外,可以实现无需用户触发识别操作,即可实时识别显示内容中是否包括目标信息如隐私信息或敏感信息,在确定显示内容中包括目标信息的情况下,提示用户第一信息中包括隐私信息,防止用户在发送图片或者文本时泄露隐私信息。In addition, it can be realized that whether the displayed content includes target information such as private information or sensitive information can be realized in real time without the user triggering the identification operation, and when it is determined that the displayed content includes the target information, the user is prompted that the first information includes private information, Prevent users from revealing private information when sending pictures or texts.

需要说明的是,本申请实施例提供的信息识别方法,执行主体可以为信息识别装置,或者该信息识别装置中的用于执行信息识别方法的控制模块。本申请实施例中以信息识别装置执行信息识别的方法为例,结合图4说明本申请实施例提供的信息识别装置。It should be noted that, in the information identification method provided by the embodiments of the present application, the execution subject may be an information identification device, or a control module in the information identification device for executing the information identification method. In this embodiment of the present application, a method for performing information identification by an information identification device is taken as an example, and the information identification device provided by the embodiment of the present application is described with reference to FIG. 4 .

图4为本申请实施例提供的一种信息识别装置的结构示意图。FIG. 4 is a schematic structural diagram of an information identification device according to an embodiment of the present application.

如图4所示,该信息识别装置40具体可以包括:As shown in FIG. 4 , the information identification device 40 may specifically include:

第一获取模块401,用于获取第一颜色传感器采集的第一显示区域的第一目标亮度值,第一目标亮度值为第一显示区域中每个像素点的发光亮度值;A first acquisition module 401, configured to acquire a first target luminance value of a first display area collected by a first color sensor, where the first target luminance value is a light-emitting luminance value of each pixel in the first display area;

识别模块402,用于根据第一显示区域的第一目标亮度值,识别第一显示区域中的显示内容。The identification module 402 is configured to identify the display content in the first display area according to the first target brightness value of the first display area.

由此,采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。由于,用户在使用电子设备时,会使显示区域常亮,这样,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,在提高识别效率的同时,减少用户操作。Thus, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Because when the user uses the electronic device, the display area will be always bright, so that the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation. While improving recognition efficiency, user operations are reduced.

下面对该信息识别装置40进行详细说明,具体如下所示:The information identification device 40 will be described in detail below, and the details are as follows:

在一种可能的实施例中,信息识别装置40还包括第二获取模块403,用于在电子设备还包括设置在屏幕上方的第二颜色传感器的情况下,获取第二颜色传感器采集的第二目标亮度值,第二目标亮度值为电子设备所处环境的亮度值。In a possible embodiment, the information identification apparatus 40 further includes a second acquisition module 403, configured to acquire the second color sensor collected by the second color sensor in the case that the electronic device further includes a second color sensor disposed above the screen The target brightness value, the second target brightness value is the brightness value of the environment where the electronic device is located.

基于此,识别模块402具体用于,根据第一目标亮度值和第二目标亮度值,识别第一显示区域中的显示内容。Based on this, the identifying module 402 is specifically configured to identify the display content in the first display area according to the first target brightness value and the second target brightness value.

其中,在一种可能的实施例中,识别模块402具体用于,基于第二目标亮度值分别对与第一目标亮度值对应的每个像素点的亮度值进行调整,得到每个像素点的第三目标亮度值;Wherein, in a possible embodiment, the identification module 402 is specifically configured to adjust the brightness value of each pixel point corresponding to the first target brightness value based on the second target brightness value, to obtain the brightness value of each pixel point. The third target brightness value;

基于每个像素点的第三目标亮度值,构建第一显示区域中至少一个对象的形状;constructing the shape of at least one object in the first display area based on the third target luminance value of each pixel;

根据至少一个对象的形状,识别第一显示区域中的显示内容。Display content in the first display area is identified based on the shape of the at least one object.

在另一种可能的实施例中,识别模块402具体用于,在第一显示区域中,获取与每个第三目标亮度值对应的像素点的坐标信息;In another possible embodiment, the identification module 402 is specifically configured to, in the first display area, acquire the coordinate information of the pixel corresponding to each third target brightness value;

根据坐标信息,构建第一显示区域中至少一个对象的形状。According to the coordinate information, the shape of at least one object in the first display area is constructed.

另外,在又一种可能的实施例中,信息识别装置40还包括显示模块404、接收模块405和处理模块406;其中,In addition, in another possible embodiment, the information identification device 40 further includes a display module 404, a receiving module 405 and a processing module 406; wherein,

显示模块404,用于在识别到显示内容包括目标信息的情况下,显示提示信息,提示信息用于提示显示内容中包括需要进行隐藏处理的信息;The display module 404 is configured to display prompt information when it is recognized that the displayed content includes target information, and the prompt information is used to prompt that the displayed content includes information that needs to be hidden;

接收模块405,用于接收对提示信息的第一输入;a receiving module 405, configured to receive the first input of the prompt information;

处理模块406,用于响应于第一输入,在将显示内容发送到第一用户时,对目标信息进行隐藏处理,以使目标信息在与第一用户对应的设备上显示的第二显示区域中,以非明文的方式显示。The processing module 406 is configured to, in response to the first input, perform concealment processing on the target information when the display content is sent to the first user, so that the target information is displayed in the second display area displayed on the device corresponding to the first user , displayed in non-clear text.

本申请实施例中的信息识别装置可以是装置,也可以是电子设备中的部件、集成电路、或芯片。该装置可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。The information identification device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in an electronic device. The apparatus may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). assistant, PDA), etc., the non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc. This application Examples are not specifically limited.

本申请实施例中的信息识别装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。The information identification device in the embodiment of the present application may be a device with an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

本申请实施例提供的信息识别装置能够实现图1至图3的方法实施例实现的各个过程,为避免重复,这里不再赘述。The information identification device provided in the embodiment of the present application can implement each process implemented by the method embodiments in FIG. 1 to FIG. 3 , and to avoid repetition, details are not repeated here.

综上,在本申请实施例中,通过采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。这样,用户在使用电子设备时,会使显示区域常亮,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,在提高识别效率的同时,减少用户操作。To sum up, in this embodiment of the present application, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. In this way, when the user uses the electronic device, the display area will be always bright, and the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation, which can improve the recognition performance. Efficiency while reducing user operations.

另外,可以实现无需用户触发识别操作,即可以减少用户操作,还可实时识别显示内容中是否包括目标信息如隐私信息或敏感信息,在确定显示内容中包括目标信息的情况下,提示用户第一信息中包括隐私信息,防止用户在发送图片或者文本时泄露隐私信息。In addition, it can realize that there is no need for the user to trigger the identification operation, that is, the user operation can be reduced, and whether the displayed content includes target information such as private information or sensitive information can be identified in real time. The information includes private information to prevent users from leaking private information when sending pictures or texts.

可选的,如图5所示,本申请实施例还提供一种电子设备500,包括处理器501,存储器502,存储在存储器502上并可在处理器501上运行的程序或指令,该程序或指令被处理器501执行时实现上述信息识别方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Optionally, as shown in FIG. 5 , an embodiment of the present application further provides an electronic device 500, including a processor 501, a memory 502, and a program or instruction stored in the memory 502 and executable on the processor 501, the program Or, when the instruction is executed by the processor 501, each process of the foregoing information identification method embodiment can be implemented, and the same technical effect can be achieved. To avoid repetition, details are not described here.

需要说明的是,本申请实施例中的电子设备包括上述的移动电子设备和非移动电子设备。It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

图6为本申请实施例提供的一种电子设备的硬件结构示意图。FIG. 6 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

该电子设备600包括但不限于:射频单元601、网络模块602、音频输出单元603、输入单元604、传感器605、显示单元606、用户输入单元607、接口单元608、存储器609、以及处理器610等部件。The electronic device 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610, etc. part.

本领域技术人员可以理解,电子设备600还可以包括给各个部件供电的电源(比如电池),电源可以通过电源管理系统与处理器610逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图6中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。Those skilled in the art can understand that the electronic device 600 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 610 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions. The structure of the electronic device shown in FIG. 6 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than those shown in the figure, or combine some components, or arrange different components, which will not be repeated here. .

其中,传感器605,用于获取第一颜色传感器采集的第一显示区域的第一目标亮度值,第一目标亮度值为第一显示区域中每个像素点的发光亮度值;Wherein, the sensor 605 is used to obtain the first target brightness value of the first display area collected by the first color sensor, and the first target brightness value is the luminous brightness value of each pixel in the first display area;

处理器610,用于根据第一显示区域的第一目标亮度值,识别第一显示区域中的显示内容。The processor 610 is configured to identify the display content in the first display area according to the first target brightness value of the first display area.

由此,采用获取设置在屏幕下方的第一颜色传感器采集的第一显示区域的第一目标亮度值的方式,识别第一显示区域中的显示内容。由于,用户在使用电子设备时,会使显示区域常亮,这样,可以实时获取电子设备中显示区域的亮度值,从而可以实现无需用户触发识别操作即可实时识别显示区域中的显示内容,在提高识别效率的同时,减少用户操作。Thus, the display content in the first display area is identified by acquiring the first target brightness value of the first display area collected by the first color sensor disposed below the screen. Because when the user uses the electronic device, the display area will be always bright, so that the brightness value of the display area in the electronic device can be obtained in real time, so that the display content in the display area can be recognized in real time without the user triggering the recognition operation. While improving recognition efficiency, user operations are reduced.

应理解的是,本申请实施例中,传感器605可以包括第一颜色传感器如色温传感器和/或第二颜色传感器如环境光敏传感器,用于获取亮度值。输入单元604可以包括图形处理器(Graphics Processing Unit,GPU)6041和麦克风6042,图形处理器6041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元606可包括显示面板6061,可以采用液晶显示器、有机发光二极管等形式来配置显示面板6061。用户输入单元607包括触控面板6071以及其他输入设备6072。触控面板6071,也称为触摸屏。触控面板6071可包括触摸检测装置和触摸控制器两个部分。其他输入设备6072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。存储器609可用于存储软件程序以及各种数据,包括但不限于应用程序和操作系统。处理器610可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器610中。It should be understood that, in this embodiment of the present application, the sensor 605 may include a first color sensor, such as a color temperature sensor, and/or a second color sensor, such as an ambient light sensor, for acquiring a brightness value. The input unit 604 may include a graphics processor (Graphics Processing Unit, GPU) 6041 and a microphone 6042, and the graphics processor 6041 captures images of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The display unit 606 may include a display panel 6061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 607 includes a touch panel 6071 and other input devices 6072 . The touch panel 6071 is also called a touch screen. The touch panel 6071 may include two parts, a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again. Memory 609 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. The processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and an application program, and the like, and the modem processor mainly processes wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 610.

本申请实施例还提供一种可读存储介质,可读存储介质上存储有程序或指令,该程序或指令被处理器执行时实现上述信息识别方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, each process of the foregoing information identification method embodiment can be implemented, and the same technology can be achieved. The effect, in order to avoid repetition, is not repeated here.

其中,处理器为上述实施例中的电子设备中的处理器。其中,可读存储介质,包括计算机可读存储介质,如计算机只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

另外,本申请实施例另提供了一种芯片,芯片包括处理器和通信接口,通信接口和处理器耦合,处理器用于运行程序或指令,实现上述信息识别方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。In addition, an embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used for running a program or an instruction to implement the various processes of the above information identification method embodiments, and can achieve The same technical effect, in order to avoid repetition, will not be repeated here.

应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to enable a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods of the various embodiments of the present application.

上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, which all fall within the protection of this application.

Claims (10)

1. An information identification method is applied to an electronic device, the electronic device comprises a first color sensor arranged below a screen, and the method is characterized by comprising the following steps:
acquiring a first target brightness value of a first display area acquired by the first color sensor, wherein the first target brightness value is a luminous brightness value of each pixel point in the first display area;
and identifying the display content in the first display area according to the first target brightness value of the first display area.
2. The method according to claim 1, wherein before identifying the display content in the first display region according to the first target brightness value of the first display region, the method further comprises:
Under the condition that the electronic equipment further comprises a second color sensor arranged above the screen, acquiring a second target brightness value acquired by the second color sensor, wherein the second target brightness value is the brightness value of the environment where the electronic equipment is located;
the identifying the display content in the first display area according to the first target brightness value of the first display area comprises:
and identifying the display content in the first display area according to the first target brightness value and the second target brightness value.
3. The method of claim 2, wherein identifying display content in the first display region based on the first target brightness value and the second target brightness value comprises:
respectively adjusting the brightness value of each pixel point corresponding to the first target brightness value based on the second target brightness value to obtain a third target brightness value of each pixel point;
constructing the shape of at least one object in the first display area based on the third target brightness value of each pixel point;
according to the shape of the at least one object, display content in the first display area is identified.
4. The method according to claim 3, wherein said constructing the shape of at least one object in the first display area based on the third target brightness value of each pixel point comprises:
acquiring coordinate information of pixel points corresponding to each third target brightness value in the first display area;
and constructing the shape of at least one object in the first display area according to the coordinate information.
5. The method of claim 1, wherein after identifying the display content in the first display region, the method further comprises:
displaying prompt information under the condition that the display content is identified to comprise target information, wherein the prompt information is used for prompting that the display content comprises information needing hiding;
receiving a first input of the prompt message;
in response to the first input, when the display content is sent to a first user, the target information is subjected to hiding processing, so that the target information is displayed in a non-plaintext manner in a second display area displayed on a device corresponding to the first user.
6. An information recognition apparatus applied to an electronic device including a first color sensor disposed below a screen, comprising:
A first obtaining module, configured to obtain a first target brightness value of a first display area, where the first target brightness value is a light-emitting brightness value of each pixel point in the first display area, and the first target brightness value is collected by the first color sensor;
and the identification module is used for identifying the display content in the first display area according to the first target brightness value of the first display area.
7. The apparatus according to claim 6, wherein the information recognition apparatus further comprises a second obtaining module, configured to, in a case where the electronic device further includes a second color sensor disposed above the screen, obtain a second target brightness value collected by the second color sensor, where the second target brightness value is a brightness value of an environment in which the electronic device is located;
the identification module is specifically configured to identify display content in the first display area according to the first target brightness value and the second target brightness value.
8. The apparatus according to claim 7, wherein the identifying module is specifically configured to adjust a brightness value of each pixel corresponding to the first target brightness value based on the second target brightness value, respectively, to obtain a third target brightness value of each pixel;
Constructing the shape of at least one object in the first display area based on the third target brightness value of each pixel point;
according to the shape of the at least one object, display content in the first display area is identified.
9. The apparatus according to claim 8, wherein the identifying module is specifically configured to, in the first display area, obtain coordinate information of a pixel point corresponding to each of the third target brightness values;
and constructing the shape of at least one object in the first display area according to the coordinate information.
10. The apparatus of claim 6, wherein the information recognition apparatus further comprises a display module, a receiving module and a processing module; wherein,
the display module is used for displaying prompt information under the condition that the display content is identified to comprise target information, wherein the prompt information is used for prompting that the display content comprises information needing to be hidden;
the receiving module is used for receiving a first input of the prompt message;
the processing module is configured to, in response to the first input, perform hiding processing on the target information when the display content is sent to a first user, so that the target information is displayed in a non-plaintext manner in a second display area displayed on a device corresponding to the first user.
CN202010607511.5A 2020-06-30 2020-06-30 Information identification method and device Active CN111860497B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010607511.5A CN111860497B (en) 2020-06-30 2020-06-30 Information identification method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010607511.5A CN111860497B (en) 2020-06-30 2020-06-30 Information identification method and device

Publications (2)

Publication Number Publication Date
CN111860497A true CN111860497A (en) 2020-10-30
CN111860497B CN111860497B (en) 2024-11-22

Family

ID=72988697

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010607511.5A Active CN111860497B (en) 2020-06-30 2020-06-30 Information identification method and device

Country Status (1)

Country Link
CN (1) CN111860497B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115278066A (en) * 2022-07-18 2022-11-01 Oppo广东移动通信有限公司 Point light source detection method, focusing method and device, storage medium and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104036707A (en) * 2014-05-26 2014-09-10 京东方科技集团股份有限公司 Display device detection device and method and display system
CN104065959A (en) * 2014-06-20 2014-09-24 成都绿洲电子有限公司 LED based display screen luminance uniformity assessment method
CN206196081U (en) * 2016-07-27 2017-05-24 欧普照明股份有限公司 Lighting device and terminal
CN109740519A (en) * 2018-12-29 2019-05-10 联想(北京)有限公司 Control method and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104036707A (en) * 2014-05-26 2014-09-10 京东方科技集团股份有限公司 Display device detection device and method and display system
CN104065959A (en) * 2014-06-20 2014-09-24 成都绿洲电子有限公司 LED based display screen luminance uniformity assessment method
CN206196081U (en) * 2016-07-27 2017-05-24 欧普照明股份有限公司 Lighting device and terminal
CN109740519A (en) * 2018-12-29 2019-05-10 联想(北京)有限公司 Control method and electronic equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115278066A (en) * 2022-07-18 2022-11-01 Oppo广东移动通信有限公司 Point light source detection method, focusing method and device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN111860497B (en) 2024-11-22

Similar Documents

Publication Publication Date Title
CN111767554B (en) Screen sharing method and device, storage medium and electronic equipment
CN108701439B (en) Image display optimization method and device
CN111859900B (en) Message display method, device and electronic device
CN111757175A (en) Video processing method and device
CN111884908B (en) Contact person identification display method and device and electronic equipment
CN112422817B (en) Image processing method and device
CN113179205B (en) Image sharing method and device and electronic equipment
WO2019184017A1 (en) Control display method and electronic device
CN112035877A (en) Information hiding method, device, electronic device and readable storage medium
CN111835937A (en) Image processing method, device and electronic device
CN114138215B (en) Display method and related equipment
CN109670507A (en) Image processing method, device and mobile terminal
CN111860497B (en) Information identification method and device
US10438377B2 (en) Method and device for processing a page
CN111767765A (en) Video processing method, device, storage medium and electronic device
CN112383666B (en) Content sending method and device and electronic equipment
CN113747076A (en) Shooting method and device and electronic equipment
CN112214774A (en) Permission setting method, file playing method and device and electronic equipment
CN114327715B (en) Interface display method, interface display device, electronic apparatus, and readable storage medium
CN111813741B (en) File sharing method and electronic equipment
CN113706371B (en) A special effect verification method, device and electronic equipment
WO2023061267A1 (en) Personal information display method and apparatus, and device and storage medium
CN115761867A (en) Identity detection method, device, medium and equipment based on face image
CN112468794B (en) Image processing method and device, electronic equipment and readable storage medium
CN112637588B (en) Method and device for detecting contamination of camera and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TG01 Patent term adjustment
TG01 Patent term adjustment