CN110737334A - Information output method, device, terminal and computer-readable storage medium - Google Patents
Information output method, device, terminal and computer-readable storage medium Download PDFInfo
- Publication number
- CN110737334A CN110737334A CN201910956118.4A CN201910956118A CN110737334A CN 110737334 A CN110737334 A CN 110737334A CN 201910956118 A CN201910956118 A CN 201910956118A CN 110737334 A CN110737334 A CN 110737334A
- Authority
- CN
- China
- Prior art keywords
- terminal
- facial expression
- prompt information
- face image
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
技术领域technical field
本发明涉及计算机技术领域,尤其涉及一种信息输出方法、装置、终端及计算机可读存储介质。The present invention relates to the field of computer technology, and in particular, to an information output method, device, terminal and computer-readable storage medium.
背景技术Background technique
随着电子技术和互联网技术的快速发展,人们对智能手机,平板电脑等终端的喜爱和依赖度越来越强烈。终端可以根据用户输入的操作做出相应的响应,并提供对应的服务。With the rapid development of electronic technology and Internet technology, people's love and dependence on terminals such as smart phones and tablet computers have become stronger and stronger. The terminal can respond accordingly according to the operation input by the user, and provide the corresponding service.
但是,现有的终端中,用户需要手动的输入操作,终端才可以做出相应的响应,而在用户不手动输入操作时,终端无法智能的识别出用户需要的服务功能,因此,终端的智能性较低。However, in the existing terminal, the user needs a manual input operation before the terminal can make a corresponding response. When the user does not manually input the operation, the terminal cannot intelligently identify the service function required by the user. Therefore, the intelligence of the terminal low sex.
发明内容SUMMARY OF THE INVENTION
本发明实施例所要解决的技术问题在于,提供一种信息输出方法,可以使得终端根据用户的表情做出相应的响应,增加终端的智能性。The technical problem to be solved by the embodiments of the present invention is to provide an information output method, which can make the terminal respond accordingly according to the user's expression, thereby increasing the intelligence of the terminal.
为了解决上述技术问题,本发明实施例第一方面公开了一种信息输出方法,所述方法包括:In order to solve the above technical problem, the first aspect of the embodiments of the present invention discloses an information output method, the method includes:
终端获取人脸图像,并识别所述人脸图像中的人脸表情;The terminal acquires the face image, and recognizes the facial expression in the face image;
根据所述人脸表情获取对应的目标提示信息;Obtain corresponding target prompt information according to the facial expression;
输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。The target prompt information is output, where the target prompt information includes caring words and/or recommended control application information.
本发明实施例第二方面公开了一种信息输出装置,所述装置包括:A second aspect of the embodiments of the present invention discloses an information output device, and the device includes:
识别模块,用于终端获取人脸图像,并识别所述人脸图像中的人脸表情;an identification module, used for the terminal to acquire a face image and identify the facial expression in the face image;
获取模块,用于根据所述人脸表情获取对应的目标提示信息;an acquisition module, configured to acquire corresponding target prompt information according to the facial expression;
输出模块,用于输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。An output module, configured to output the target prompt information, where the target prompt information includes caring words and/or recommended control application information.
本发明实施例第三方面公开了一种终端,包括处理器、输入设备、输出设备和存储器,所述处理器、输入设备、输出设备和存储器相互连接,其中,所述存储器用于存储计算机程序,所述计算机程序包括程序指令,所述处理器被配置用于调用所述程序指令,执行上述第一方面的方法。A third aspect of the embodiments of the present invention discloses a terminal, including a processor, an input device, an output device, and a memory, wherein the processor, the input device, the output device, and the memory are connected to each other, wherein the memory is used to store a computer program , the computer program includes program instructions, and the processor is configured to invoke the program instructions to execute the method of the first aspect.
本发明实施例第四方面公开了一种计算机可读存储介质,其特征在于,所述计算机存储介质存储有计算机程序,所述计算机程序包括程序指令,所述程序指令当被处理器执行时使所述处理器执行上述第一方面的方法。A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium, wherein the computer storage medium stores a computer program, and the computer program includes program instructions, and the program instructions, when executed by a processor, cause The processor performs the method of the first aspect above.
本发明实施例中,终端获取人脸图像,并识别人脸图像中的人脸表情,进一步的,根据人脸表情获取对应的目标提示信息,并输出目标提示信息,目标提示信息包括关怀用语和/或推荐控制应用信息。通过实施上述方法,可以使得终端根据用户的表情做出相应的响应,增加终端的智能性。In the embodiment of the present invention, the terminal acquires a face image, and recognizes the facial expression in the face image, further, acquires corresponding target prompt information according to the facial expression, and outputs the target prompt information, and the target prompt information includes care words and / or recommended control application information. By implementing the above method, the terminal can make a corresponding response according to the user's expression, thereby increasing the intelligence of the terminal.
附图说明Description of drawings
为了更清楚地说明本发明实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present invention, which are of great significance to the art For those of ordinary skill, other drawings can also be obtained from these drawings without any creative effort.
图1是本发明实施例提供的一种信息输出方法的流程示意图;1 is a schematic flowchart of an information output method provided by an embodiment of the present invention;
图2是本发明实施例提供的另一种信息输出方法的流程示意图;2 is a schematic flowchart of another information output method provided by an embodiment of the present invention;
图3是本发明实施例提供的又一种信息输出方法的流程示意图;3 is a schematic flowchart of another information output method provided by an embodiment of the present invention;
图4是本发明实施例提供的一种信息输出装置的结构示意图;4 is a schematic structural diagram of an information output device provided by an embodiment of the present invention;
图5是本发明实施例提供的一种终端的结构示意图。FIG. 5 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
请参阅图1,为本发明实施例提供的一种信息输出方法的流程示意图。本实施例中所描述的信息输出方法,包括以下步骤:Please refer to FIG. 1 , which is a schematic flowchart of an information output method provided by an embodiment of the present invention. The information output method described in this embodiment includes the following steps:
S101:终端获取人脸图像,并识别人脸图像中的人脸表情。S101: The terminal acquires a face image, and recognizes the facial expression in the face image.
本发明实施例中,终端可以为智能手机、平板电脑等电子设备,人脸表情可以为“哈欠”、“哭泣”、“大笑”、“闭眼”等。具体实现中,终端可以在检测到预设触发条件时,开启摄像头,获取到操作终端的用户的人脸图像,并识别人脸图像中的人脸表情。其中,预设触发条件可以为当前时间属于预设时间段内,具体的,在终端获取人脸图像,并识别人脸图像中的人脸表情之前,终端检测当前时间是否在预设的时间范围内,其中,该预设的时间范围可以是不同的时间段,例如午休时间范围12:00-14:00,或是晚上时间范围22:00-2:00等等,若终端检测当前时间是在预设的时间范围内的任一时间段,则终端开启摄像头获取到操作终端的用户的人脸图像,并识别人脸图像中的人脸表情。或者,预设触发条件也可以为用户输入的操作指令,具体的,用户可以输入开启表情识别模式的操作,终端检测到上述操作之后,将开启表情识别模式,并通过摄像头实时获取操作终端的用户的人脸图像,并分析出人脸图像对应的人脸表情。或者,预设触发条件也可以为终端当前运行的应用程序为目标应用程序,其中,目标应用程序可以为游戏程序、音乐程序、视频程序等,具体可以由系统预设或用户设置,则当终端检测到当前运行的应用程序为目标应用程序时,终端开启摄像头获取到操作终端的用户的人脸图像,并识别人脸图像中的人脸表情。In the embodiment of the present invention, the terminal may be an electronic device such as a smart phone and a tablet computer, and the facial expressions may be "yawn", "crying", "laughing", "eyes closed", and the like. In a specific implementation, the terminal may turn on the camera when detecting the preset trigger condition, obtain the face image of the user operating the terminal, and recognize the facial expression in the face image. The preset trigger condition may be that the current time falls within a preset time period. Specifically, before the terminal acquires the face image and recognizes the facial expression in the face image, the terminal detects whether the current time is within the preset time range. , where the preset time range can be different time periods, such as the lunch break time range of 12:00-14:00, or the evening time range of 22:00-2:00, etc. If the terminal detects that the current time is In any time period within the preset time range, the terminal turns on the camera to obtain the face image of the user operating the terminal, and recognizes the facial expression in the face image. Alternatively, the preset trigger condition may also be an operation instruction input by the user. Specifically, the user may input an operation to enable the expression recognition mode. After the terminal detects the above operation, the expression recognition mode will be turned on, and the user who operates the terminal will be acquired in real time through the camera. face image, and analyze the facial expression corresponding to the face image. Alternatively, the preset trigger condition may also be that the application currently running on the terminal is the target application, wherein the target application may be a game program, a music program, a video program, etc., which may be preset by the system or set by the user, when the terminal is When it is detected that the currently running application is the target application, the terminal turns on the camera to obtain the face image of the user operating the terminal, and recognizes the facial expression in the face image.
在一种实现方式中,终端识别人脸表情的具体方式可以为,终端通过摄像头获取操作终端的用户的人脸图像,并检测获取到的人脸图像是否与预设数据库中的任意一个参考人脸图像相匹配,若是,则将与获取到的人脸图像相匹配的参考人脸图像对应的表情确定为获取到的人脸图像对应的人脸表情。具体的,终端可以基于人脸图像与参考人脸图像之间的相似度确定两者是否相匹配,若人脸图像与参考人脸图像的相似度大于预设相似度,则可以确定该人脸图像与参考人脸图像相匹配。其中,相似度的具体计算方式可以为,计算人脸图像的第一哈希值以及参考人脸图像的第二哈希值,并确定第一哈希值与第二哈希值之间的汉明距离,根据汉明距离与相似度的对应关系确定人脸图像与参考人脸图像之间的相似度,其中,汉明距离与相似度的对应关系具体可以由研发人员预先设置,具体可以为汉明距离越小,则相似度越大。预设数据存储的参考人脸图像具体可以由用户预先录入。具体的,用户可以预先在终端中录入多个人脸图像作为参考人脸图像,并为每个参考人脸图像配置对应的表情,作为参考人脸图像对应的表情,终端将用户输入的参考人脸图像以及参考人脸图像的表情存储于预设数据库中。In an implementation manner, the specific way for the terminal to recognize the facial expression may be as follows: the terminal obtains the face image of the user operating the terminal through the camera, and detects whether the obtained face image matches any reference person in the preset database. The face image matches, and if so, the expression corresponding to the reference face image that matches the obtained face image is determined as the face expression corresponding to the obtained face image. Specifically, the terminal can determine whether the two match based on the similarity between the face image and the reference face image, and if the similarity between the face image and the reference face image is greater than the preset similarity, the face can be determined. The image is matched to the reference face image. Wherein, the specific calculation method of the similarity may be: calculating the first hash value of the face image and the second hash value of the reference face image, and determining the difference between the first hash value and the second hash value. The similarity between the face image and the reference face image is determined according to the corresponding relationship between the Hamming distance and the similarity. The corresponding relationship between the Hamming distance and the similarity can be preset by the research and development personnel. Specifically, it can be The smaller the Hamming distance, the greater the similarity. Specifically, the reference face image stored in the preset data may be pre-entered by the user. Specifically, the user can pre-enter multiple face images in the terminal as reference face images, and configure a corresponding expression for each reference face image. The images and expressions of the reference face images are stored in a preset database.
在一种实现方式中,终端识别人脸表情的方式也可以为,基于摄像头与人脸表情识别模型对人脸表情进行识别,具体的,终端通过摄像头获取到用户输入的人脸图像,人脸表情识别模型确定该人脸图像对应的人脸表情。其中,上述人脸表情识别模型可以利用一种基于深度卷积神经网络的人脸表情识别算法得到,用于确定人脸图像对应的人脸表情。具体的,可以利用训练图像集中的人脸图像训练人脸表情识别模型,训练图像集中包括多幅具有预设表情的人脸图像,人脸表情识别模型通过深度卷积神经网络训练生成。在人脸表情识别模型确定之后,在用户在使用终端时,终端通过摄像头获取用户的人脸图像,并采用内置的人脸表情识别模型确定出该用户的人脸图像所对应的人脸表情。In an implementation manner, the terminal can also recognize the facial expression by recognizing the facial expression based on the camera and the facial expression recognition model. The facial expression recognition model determines the facial expression corresponding to the facial image. Wherein, the above facial expression recognition model can be obtained by using a facial expression recognition algorithm based on a deep convolutional neural network, and is used to determine the facial expression corresponding to the facial image. Specifically, the facial expression recognition model can be trained by using the facial images in the training image set, the training image set includes multiple face images with preset expressions, and the facial expression recognition model is generated by training a deep convolutional neural network. After the facial expression recognition model is determined, when the user uses the terminal, the terminal obtains the user's facial image through the camera, and uses the built-in facial expression recognition model to determine the facial expression corresponding to the user's facial image.
S102:根据人脸表情获取对应的目标提示信息。S102: Acquire corresponding target prompt information according to the facial expression.
本发明实施例中,终端在终端获取人脸图像,并识别人脸图像中的人脸表情之后,将根据表情与提示信息的对应关系,确定人脸表情对应的目标提示信息,并获取该目标提示信息,其中目标提示信息包括关怀用语和/或推荐控制应用信息。In this embodiment of the present invention, after the terminal acquires a face image and recognizes the facial expression in the face image, the terminal determines the target prompt information corresponding to the facial expression according to the corresponding relationship between the expression and the prompt information, and acquires the target Prompt information, wherein the target prompt information includes caring words and/or recommended control application information.
在一种实现方式中,表情与提示信息的对应关系可以由系统预设,具体的,利用大数据学习,将不同表情建模,人脸识别后可以自动对应不同表情,进而获得提示信息,表情与提示信息的对应关系也可以由用户设置,具体的,用户提前将“哈欠”对应哈欠类表情,“哭泣”对应哭泣类表情,“大笑”,“闭眼”对应录入各类表情,并针对各类表情录入对应的提示信息,以建立表情与提示信息的对应关系,例如,用户设置的人脸表情与提示信息的对应关系如表1所示。In an implementation manner, the corresponding relationship between expressions and prompt information can be preset by the system. Specifically, different expressions are modeled by using big data learning. After face recognition, different expressions can be automatically corresponded to, and then prompt information and expressions The corresponding relationship with the prompt information can also be set by the user. Specifically, the user can enter "yawn" corresponding to the yawning expression, "crying" corresponding to the crying expression, "laughing" and "closed eyes" corresponding to various expressions, and Corresponding prompt information is entered for various expressions to establish a corresponding relationship between the expressions and the prompt information. For example, the corresponding relationship between the facial expressions set by the user and the prompt information is shown in Table 1.
表1:Table 1:
则当终端检测到操作终端的用户的人脸表情为“哈欠”时,可以确定表情对应的关怀用语为“宝贝,要早点休息哟,这样才能长高哟”及表1所示的推荐控制应用信息,当终端检测到操作终端的用户的人脸表情为“哭泣”时,可以确定表情对应的关怀用语为“明天会是新的一天”及表1所示的推荐控制应用信息,当终端检测到操作终端的用户的人脸表情为“大笑”时,可以确定表情对应的关怀用语为“心情美美哒”及表1所示的推荐控制应用信息。当终端检测到操作终端的用户的人脸表情为“闭眼”时,可以确定表情对应的关怀用语为“主人晚安”及表1所示的推荐控制应用信息。Then, when the terminal detects that the facial expression of the user operating the terminal is "yawn", it can be determined that the corresponding caring expression is "Baby, rest early so that you can grow taller" and the recommended control applications shown in Table 1. information, when the terminal detects that the facial expression of the user operating the terminal is "crying", it can determine that the expression of concern is "tomorrow will be a new day" and the recommended control application information shown in Table 1. When the terminal detects When the facial expression of the user operating the terminal is "laughing", it can be determined that the caring word corresponding to the expression is "beautiful mood" and the recommended control application information shown in Table 1. When the terminal detects that the facial expression of the user operating the terminal is "eyes closed", it can be determined that the caring expression corresponding to the expression is "good night master" and the recommended control application information shown in Table 1.
在一种实现方式中,终端根据表情与提示信息的对应关系,确定人脸表情对应的目标提示信息的具体方式可以为,终端检测人脸表情是否与预置数据库中存储的任意一个参考人脸表情相匹配,若检测到人脸表情与预置数据库中存储的任意一个参考人脸表情相匹配,则查找预置数据库中存储的与该人脸表情相匹配的参考人脸表情对应的提示信息,其中,预置数据库中存储了预先配置的至少一个参考人脸表情、针对至少一个参考人脸表情中每个参考人脸表情输入的提示信息和表情与提示信息的对应关系。例如,预置数据库中存储的参考人脸表情包括“哈欠”、“哭泣”、“大笑”和“闭眼”,若终端识别到的人脸表情为“哈欠”,则终端确定该人脸表情与预置数据库中存储的参考人脸表情(“哈欠”)相匹配,并找到“哈欠”对应的提示信息作为目标提示信息。若终端识别到的人脸表情为愤怒,则终端确定该人脸表情与预置数据库中存储的参考人脸表情均不匹配,并结束本流程。In an implementation manner, the terminal determines the target prompt information corresponding to the facial expression according to the corresponding relationship between the facial expressions and the prompt information. If the detected facial expression matches any of the reference facial expressions stored in the preset database, look for the prompt information corresponding to the reference facial expression stored in the preset database that matches the facial expression , wherein the preset database stores at least one preconfigured reference facial expression, prompt information input for each reference facial expression in the at least one reference facial expression, and the corresponding relationship between the expressions and the prompt information. For example, the reference facial expressions stored in the preset database include "yawn", "crying", "laughing" and "eyes closed". If the facial expression recognized by the terminal is "yawning", the terminal determines the facial expression The expression is matched with the reference facial expression ("yawn") stored in the preset database, and the prompt information corresponding to the "yawn" is found as the target prompt information. If the facial expression recognized by the terminal is anger, the terminal determines that the facial expression does not match the reference facial expression stored in the preset database, and ends the process.
S103:输出目标提示信息,目标提示信息包括关怀用语和/或推荐控制应用信息。S103: Output target prompt information, where the target prompt information includes caring words and/or recommended control application information.
本发明实施例中,终端根据表情与提示信息的对应关系,确定人脸表情对应的目标提示信息之后,将输出目标表情对应的提示信息。In the embodiment of the present invention, after determining the target prompt information corresponding to the facial expression according to the corresponding relationship between the expression and the prompt information, the terminal will output the prompt information corresponding to the target expression.
具体的,终端输出目标表情对应的提示信息的具体方式可以为,终端检测当前运行的应用程序,并获取应用程序对应的提示信息输出方式,再以该应用程序对应的提示信息输出方式输出目标提示信息。其中,不同的应用程序对应不同的提示信息输出方式,提示信息输出方式可以是文字信息输出方式、图片信息输出方式、语音信息输出方式,文字提示信息输出方式与图片信息输出方式可以是在终端屏幕自动弹出、在终端屏幕上方滑入、在终端屏幕下方滑入等等,提示信息可以在终端屏幕任意处输出。Specifically, the specific way for the terminal to output the prompt information corresponding to the target expression may be as follows: the terminal detects the currently running application program, obtains the prompt information output mode corresponding to the application program, and then outputs the target prompt in the prompt information output mode corresponding to the application program. information. Among them, different application programs correspond to different prompt information output methods. The prompt information output methods can be text information output methods, picture information output methods, and voice information output methods. Text prompt information output methods and picture information output methods can be on the terminal screen. Automatically pop up, slide in at the top of the terminal screen, slide in at the bottom of the terminal screen, etc. The prompt information can be output anywhere on the terminal screen.
例如,终端当前运行的应用程序为游戏应用,且游戏应用对应的提示信息输出方式为在游戏应用界面的右上角显示文字提示信息,则当终端在运行游戏应用且检测到用户输入的“哈欠”表情时,终端可以在游戏应用界面的右上角显示关怀用语和推荐控制应用信息,以对用户进行提示。For example, if the application currently running on the terminal is a game application, and the prompt information corresponding to the game application is output by displaying text prompt information in the upper right corner of the game application interface, then when the terminal is running the game application and detects the "yawn" input by the user When emoticons are displayed, the terminal can display caring words and recommended control application information in the upper right corner of the game application interface to prompt the user.
又如,终端当前运行的应用程序为视频应用,且视频应用对应的提示信息输出方式为在视频应用界面的右上角显示图片提示信息,则当终端在运行视频应用且检测到用户输入的“哈欠”表情时,终端可以在视频应用界面的右上角显示一个图片提示信息,该图片提示信息可以包括关怀用语和推荐控制应用信息,以对用户进行提示。For another example, if the application currently running on the terminal is a video application, and the output mode of the prompt information corresponding to the video application is to display picture prompt information in the upper right corner of the video application interface, then when the terminal is running the video application and detects the “yawn” input by the user. ” emoticon, the terminal can display a picture prompt information in the upper right corner of the video application interface, and the picture prompt information can include caring words and recommended control application information to prompt the user.
本发明实施例中,终端获取人脸图像,并识别人脸图像中的人脸表情,进一步的,根据人脸表情获取对应的目标提示信息,输出目标提示信息,目标提示信息包括关怀用语和/或推荐控制应用信息。通过实施上述方式,可以使得终端根据用户的表情做出相应的响应,增加终端的智能性。In the embodiment of the present invention, the terminal acquires a face image, and recognizes the facial expression in the face image, further, acquires corresponding target prompt information according to the facial expression, and outputs the target prompt information, and the target prompt information includes caring words and/or Or recommend control application information. By implementing the above manner, the terminal can make a corresponding response according to the user's expression, thereby increasing the intelligence of the terminal.
请参阅图2,为本发明实施例提供的另一种信息输出方法的流程示意图。本实施例中所描述的信息输出方法,包括以下步骤:Please refer to FIG. 2 , which is a schematic flowchart of another information output method provided by an embodiment of the present invention. The information output method described in this embodiment includes the following steps:
S201:检测当前时间是否在预设的时间范围内。S201: Detect whether the current time is within a preset time range.
本发明实施例中,终端可以为智能手机、平板电脑等电子设备,终端可以检测当前时间是否在预设的时间范围内,其中,该预设的时间范围可以是不同的时间段,例如午休时间范围12:00-14:00,或是晚上时间范围22:00-2:00等等,若检测当前时间是在预设的时间范围内的任一时间段,则执行步骤S202。若当前时间不在预设的时间范围内,则结束本流程。其中,该时间范围可以由用户设定,或者,终端根据用户的操作习惯以及正常作息时段确定,具体的,可以将用户常用的对手机的常用操作时段与休息时段的重叠时段确定为预设的时间范围。例如,终端从用户的历史操作记录中查找到用户习惯在时间范围22:00-2:00玩手机,而时间范围22:00-2:00属于休息时段,则终端可以将时间范围22:00-2:00确定为预设的时间范围。In this embodiment of the present invention, the terminal may be an electronic device such as a smart phone or a tablet computer, and the terminal may detect whether the current time is within a preset time range, where the preset time range may be different time periods, such as lunch break time The range is 12:00-14:00, or the evening time range is 22:00-2:00, etc. If it is detected that the current time is within any time period within the preset time range, step S202 is performed. If the current time is not within the preset time range, the process ends. The time range may be set by the user, or determined by the terminal according to the user's operating habits and the normal work and rest period. Specifically, the overlapping period of the user's common operation period for the mobile phone and the rest period may be determined as a preset. time limit. For example, if the terminal finds from the user's historical operation records that the user is accustomed to play mobile phones in the time range of 22:00-2:00, and the time range of 22:00-2:00 belongs to the rest period, the terminal can set the time range of 22:00 to -2:00 is determined as the preset time range.
S202:终端获取人脸图像,并识别人脸图像中的人脸表情。S202: The terminal acquires a face image, and recognizes the facial expression in the face image.
本发明实施例中,人脸表情可以为“哈欠”、“哭泣”、“大笑”、“闭眼”等。终端可以在检测到预设触发条件时,开启摄像头,获取到操作终端的用户的人脸图像,并识别人脸图像中的人脸表情。其中,预设触发条件可以为用户输入的操作指令,具体的,用户可以输入开启表情识别模式的操作,终端检测到上述操作之后,将开启表情识别模式,并通过摄像头实时获取操作终端的用户的人脸图像,并分析出人脸图像对应的人脸表情。或者,预设触发条件也可以为终端当前运行的应用程序为目标应用程序,其中,目标应用程序可以为游戏程序、音乐程序、视频程序等,具体可以由系统预设或用户设置,则当终端检测到当前运行的应用程序为目标应用程序时,终端开启摄像头获取到操作终端的用户的人脸图像,并识别人脸图像中的人脸表情。In this embodiment of the present invention, the facial expressions may be "yawn", "crying", "laughing", "eyes closed", and the like. The terminal may turn on the camera when detecting the preset trigger condition, obtain the face image of the user operating the terminal, and recognize the facial expression in the face image. The preset trigger condition may be an operation instruction input by the user. Specifically, the user may input an operation to enable the expression recognition mode. After the terminal detects the above operation, the expression recognition mode will be turned on, and the camera will acquire the information of the user operating the terminal in real time. face image, and analyze the facial expression corresponding to the face image. Alternatively, the preset trigger condition may also be that the application currently running on the terminal is the target application, wherein the target application may be a game program, a music program, a video program, etc., which may be preset by the system or set by the user, when the terminal is When it is detected that the currently running application is the target application, the terminal turns on the camera to obtain the face image of the user operating the terminal, and recognizes the facial expression in the face image.
在一种实现方式中,终端识别人脸表情的具体方式可以为,终端通过摄像头获取操作终端的用户的人脸图像,并检测获取到的人脸图像是否与预设数据库中的任意一个参考人脸图像相匹配,若是,则将与获取到的人脸图像相匹配的参考人脸图像对应的表情确定为获取到的人脸图像对应的人脸表情。具体的,终端可以基于人脸图像与参考人脸图像之间的相似度确定两者是否相匹配,若人脸图像与参考人脸图像的相似度大于预设相似度,则可以确定该人脸图像与参考人脸图像相匹配。In an implementation manner, the specific way for the terminal to recognize the facial expression may be as follows: the terminal obtains the face image of the user operating the terminal through the camera, and detects whether the obtained face image matches any reference person in the preset database. The face image matches, and if so, the expression corresponding to the reference face image that matches the obtained face image is determined as the face expression corresponding to the obtained face image. Specifically, the terminal can determine whether the two match based on the similarity between the face image and the reference face image, and if the similarity between the face image and the reference face image is greater than the preset similarity, the face can be determined. The image is matched to the reference face image.
在一种实现方式中,终端识别人脸表情的方式也可以为,基于摄像头与人脸表情识别模型对人脸表情进行识别,具体的,终端通过摄像头获取到用户输入的人脸图像,人脸表情识别模型确定该人脸图像对应的人脸表情。In an implementation manner, the terminal can also recognize the facial expression by recognizing the facial expression based on the camera and the facial expression recognition model. The facial expression recognition model determines the facial expression corresponding to the facial image.
S203:检测人脸表情对应的对象是否与目标对象相匹配,获取目标对象对应的表情与提示信息的对应关系。S203: Detect whether the object corresponding to the facial expression matches the target object, and obtain the correspondence between the expression corresponding to the target object and the prompt information.
本发明实施例中,终端在识别针对终端输入的人脸表情之后,检测人脸表情对应的对象是否与目标对象相匹配,其中,该目标对象可以为儿童、大人和老人,若检测人脸表情对应的对象是与目标对象相匹配,则获取目标对象对应的表情与提示信息的对应关系。In this embodiment of the present invention, after recognizing the facial expression input to the terminal, the terminal detects whether the object corresponding to the facial expression matches the target object, wherein the target object may be children, adults and the elderly. If the corresponding object matches the target object, the corresponding relationship between the expression corresponding to the target object and the prompt information is obtained.
在一种实现方式中,目标对象为儿童,当终端检测到用户输入的人脸表情对应的对象为儿童时,则确定人脸表情对应的对象与目标对象相匹配,并获取目标对象对应的表情与提示信息的对应关系,例如,目标对象对应的表情与提示信息的对应关系如表2所示。In an implementation manner, the target object is a child. When the terminal detects that the object corresponding to the facial expression input by the user is a child, the terminal determines that the object corresponding to the facial expression matches the target object, and obtains the expression corresponding to the target object. The corresponding relationship with the prompt information, for example, the corresponding relationship between the expression corresponding to the target object and the prompt information is shown in Table 2.
表2:Table 2:
则当终端检测到操作终端的用户的人脸表情为“哈欠”,并且人脸表情对应的对象为儿童,可以确定表情对应的关怀用语为“宝贝,要早点休息哟,这样才能长高哟”及表2所示的推荐控制应用信息,当终端检测到操作终端的用户的人脸表情为“哈欠”,并且人脸表情对应的对象为大人,可以确定表情对应的关怀用语为“主人主人,该早点休息了,明天要早起上班哟”及表2所示的推荐控制应用信息。当终端检测到操作终端的用户的人脸表情为“哈欠”,并且人脸表情对应的对象为老人,可以确定表情对应的关怀用语为“早睡早起,身体棒棒”及表2所示的推荐控制应用信息。Then, when the terminal detects that the facial expression of the user operating the terminal is "yawn", and the object corresponding to the facial expression is a child, it can be determined that the caring language corresponding to the expression is "Baby, take a rest early, so that you can grow taller". And the recommended control application information shown in Table 2, when the terminal detects that the facial expression of the user operating the terminal is "yawn", and the object corresponding to the facial expression is an adult, it can be determined that the caring term corresponding to the expression is "master, master, It's time to rest early, and get up early for work tomorrow" and the recommended control application information shown in Table 2. When the terminal detects that the facial expression of the user operating the terminal is "yawn", and the object corresponding to the facial expression is an elderly person, it can be determined that the corresponding caring expression is "early to bed, early to rise, good health" and the expressions shown in Table 2. It is recommended to control application information.
S204:根据人脸表情获取对应的目标提示信息。S204: Acquire corresponding target prompt information according to the facial expression.
本发明实施例中,终端在识别针对终端输入的人脸表情之后,将根据表情与提示信息的对应关系,确定人脸表情对应的目标提示信息。In this embodiment of the present invention, after recognizing the facial expression input to the terminal, the terminal will determine the target prompt information corresponding to the facial expression according to the corresponding relationship between the facial expression and the prompt information.
在一种实现方式中,终端根据表情与提示信息的对应关系,确定人脸表情对应的目标提示信息的具体方式可以为,终端检测人脸表情是否与预置数据库中存储的任意一个参考人脸表情相匹配,若检测到人脸表情与预置数据库中存储的任意一个参考人脸表情相匹配,则查找预置数据库中存储的与该人脸表情相匹配的参考人脸表情对应的提示信息,其中,预置数据库中存储了预先配置的至少一个参考人脸表情、针对至少一个参考人脸表情中每个参考人脸表情输入的提示信息和表情与提示信息的对应关系。In an implementation manner, the terminal determines the target prompt information corresponding to the facial expression according to the corresponding relationship between the facial expressions and the prompt information. If the detected facial expression matches any of the reference facial expressions stored in the preset database, look for the prompt information corresponding to the reference facial expression stored in the preset database that matches the facial expression , wherein the preset database stores at least one preconfigured reference facial expression, prompt information input for each reference facial expression in the at least one reference facial expression, and the corresponding relationship between the expressions and the prompt information.
S205:输出目标提示信息,目标提示信息包括关怀用语和/或推荐控制应用信息。S205: Output target prompt information, where the target prompt information includes caring words and/or recommended control application information.
本发明实施例中,终端根据表情与提示信息的对应关系,确定人脸表情对应的目标提示信息之后,将输出目标表情对应的提示信息。In the embodiment of the present invention, after determining the target prompt information corresponding to the facial expression according to the corresponding relationship between the expression and the prompt information, the terminal will output the prompt information corresponding to the target expression.
在一种实现方式中,在输出目标提示信息之前,可以检测终端当前的运行状态是否为空闲状态,其中,运行状态包括忙碌状态或空闲状态,若检测到终端当前的运行状态为空闲状态,则执行步骤S205,若检测到终端当前的运行状态为忙碌状态,则可以结束本流程。In an implementation manner, before outputting the target prompt information, it is possible to detect whether the current running state of the terminal is an idle state, wherein the running state includes a busy state or an idle state, if it is detected that the current running state of the terminal is an idle state, then Step S205 is executed, and if it is detected that the current running state of the terminal is a busy state, the process can be ended.
其中,空闲状态具体可以定义为终端当前运行的应用程序为娱乐应用程序或未运行应用程序的状态,其中,娱乐应用程序可以为音乐应用程序、视频应用程序、新闻应用程序等,如当终端运行的应用程序为视频应用程序时,则确定终端处于空闲状态。忙碌状态可以为当前运行的应用程序为非娱乐应用程序的状态,其中,非娱乐应用程序可以包括电话应用程序、短信应用程序以及办公软件应用程序等,如当终端运行的应用程序为电话应用程序时,则确定终端处于忙碌状态。The idle state can be specifically defined as a state in which the currently running application of the terminal is an entertainment application or a non-running application, wherein the entertainment application can be a music application, a video application, a news application, etc., for example, when the terminal is running When the application program is a video application program, it is determined that the terminal is in an idle state. The busy state can be a state in which the currently running application is a non-entertainment application, wherein the non-entertainment application can include a phone application, a short message application, and an office software application, for example, when the application running on the terminal is a phone application , it is determined that the terminal is in a busy state.
在一种实现方式中,终端输出目标表情对应的提示信息的具体方式可以为,终端检测当前运行的应用程序,并获取应用程序对应的提示信息输出方式,再以该应用程序对应的提示信息输出方式输出目标提示信息。In an implementation manner, the specific manner of outputting the prompt information corresponding to the target expression by the terminal may be as follows: the terminal detects the currently running application program, obtains the prompt information output mode corresponding to the application program, and then outputs the prompt information corresponding to the application program. way to output target prompt information.
其中,不同的应用程序对应不同的提示信息输出方式,提示信息输出方式可以是文字信息输出方式、图片信息输出方式、语音信息输出方式,文字提示信息输出方式与图片信息输出方式可以是在终端屏幕自动弹出、在终端屏幕上方滑入、在终端屏幕下方滑入等等,提示信息可以在终端屏幕任意处输出。例如,游戏应用对应的提示信息输出方式为在游戏应用界面的右上角显示文字提示信息,视频应用对应的提示信息输出方式为在视频应用界面的右上角显示图片提示信息。Among them, different application programs correspond to different prompt information output methods. The prompt information output methods can be text information output methods, picture information output methods, and voice information output methods. Text prompt information output methods and picture information output methods can be on the terminal screen. Automatically pop up, slide in at the top of the terminal screen, slide in at the bottom of the terminal screen, etc. The prompt information can be output anywhere on the terminal screen. For example, the prompt information output mode corresponding to the game application is to display text prompt information in the upper right corner of the game application interface, and the prompt information output mode corresponding to the video application is to display picture prompt information in the upper right corner of the video application interface.
在一种实现方式中,目标提示信息包括至少一个推荐控制应用信息,在输出目标提示信息时,终端可以获取操作终端的当前时间,根据时间与推荐控制应用信息的对应关系,从至少一个推荐控制应用信息中确定出目标推荐控制应用信息,并输出该目标推荐控制应用信息。例如,终端检测到操作终端的用户的人脸表情为“哈欠”,如果终端当前运行的时间是早上,可以确定当前时间对应的推荐控制应用信息为“是否买杯咖啡?”,以提醒用户要不要买杯咖啡来提精神,如果终端当前运行的时间是晚上,可以确定当前时间对应的推荐控制应用信息为“是否打开闹钟设置?”,以提醒用户定闹钟,睡觉。又如,终端检测到操作终端的用户的人脸表情为“闭眼”,如果终端当前运行的时间是早上,闹钟会一直叫,以提醒用户是否关闭闹钟,如果终端当前运行的时间是晚上,则终端会自动进入关闭应用或进入省电模式,并提醒用户已进入相应模式或关闭相关应用,是否恢复原应用或原模式?以上所有应用控制提醒,如果用户根据提醒信息进行相应操作,则控制相应的应用打开或关闭。In an implementation manner, the target prompt information includes at least one recommended control application information. When outputting the target prompt information, the terminal can obtain the current time of the operation terminal, and according to the corresponding relationship between the time and the recommended control application information, select the recommended control application information from the at least one recommended control application. The target recommendation control application information is determined from the application information, and the target recommendation control application information is output. For example, the terminal detects that the facial expression of the user operating the terminal is "yawn". If the current running time of the terminal is in the morning, it can determine that the recommended control application information corresponding to the current time is "Do you want to buy a cup of coffee?" to remind the user to Don't buy a cup of coffee to refresh your mind. If the current running time of the terminal is at night, you can determine that the recommended control application information corresponding to the current time is "Do you want to open the alarm clock setting?" to remind the user to set the alarm clock and sleep. For another example, the terminal detects that the facial expression of the user operating the terminal is "eyes closed". If the current running time of the terminal is in the morning, the alarm clock will keep ringing to remind the user whether to turn off the alarm clock. If the current running time of the terminal is in the evening, Then the terminal will automatically enter to close the application or enter the power saving mode, and remind the user to enter the corresponding mode or close the relevant application, whether to restore the original application or the original mode? All the above applications control reminders, and if the user performs a corresponding operation according to the reminder information, it controls the corresponding application to open or close.
在一种实现方式中,输出目标推荐控制应用信息之后,终端可以接收针对终端输入的用户操作,用户操作包括手势操作或者表情操作,终端根据用户操作控制推荐控制应用信息对应的推荐控制应用。例如,当终端接收到用户输入的“OK”手势或者微笑表情时,推荐控制应用信息对应的推荐控制应用会自动打开,当终端接收到用户输入的“X”手势或者长闭眼时,推荐控制应用信息对应的推荐控制应用会自动关闭。In an implementation manner, after outputting the target recommended control application information, the terminal may receive user operations input to the terminal, the user operations include gesture operations or facial expressions, and the terminal controls the recommended control application corresponding to the recommended control application information according to the user operations. For example, when the terminal receives the "OK" gesture or smiling expression input by the user, the recommended control application corresponding to the recommended control application information will be automatically opened, and when the terminal receives the "X" gesture input by the user or long-closed eyes, the recommended control application The recommended control application corresponding to the application information will be automatically closed.
本发明实施例中,终端检测当前时间是否在预设的时间范围内,接着,终端获取人脸图像,并识别人脸图像中的人脸表情,检测人脸表情对应的对象是否与目标对象相匹配,获取目标对象对应的表情与提示信息的对应关系,进一步的,终端根据人脸表情获取对应的目标提示信息,并输出目标提示信息,目标提示信息包括关怀用语和推荐控制应用信息。通过实施上述方式,可以使得终端根据用户的表情做出相应的响应,根据用户表情输出推荐控制应用信息,进而根据用户操作打开或关闭推荐控制应用,可以更准确满足用户需求,避免误打开或误关闭,增加终端的人性化与智能性。In this embodiment of the present invention, the terminal detects whether the current time is within a preset time range, and then the terminal acquires a face image, recognizes the facial expression in the face image, and detects whether the object corresponding to the facial expression is similar to the target object. Matching, obtaining the corresponding relationship between the expression corresponding to the target object and the prompt information, further, the terminal obtains the corresponding target prompt information according to the facial expression, and outputs the target prompt information, and the target prompt information includes caring words and recommendation control application information. By implementing the above method, the terminal can make a corresponding response according to the user's expression, output the recommended control application information according to the user's expression, and then open or close the recommended control application according to the user operation, which can more accurately meet the user's needs and avoid mistakenly opening or mistakenly opening or closing the application. Close to increase the humanization and intelligence of the terminal.
请参阅图3,为本发明实施例提供的又一种信息输出方法的流程示意图。在图3的流程中,用户可以预先在终端表情库中录入多类表情,该表情可以是“哈欠”、“哭泣”和“大笑”等,并针对每一类表情录入对应的提示信息,以建立表情与提示信息的对应关系,用户设置的人脸表情与提示信息的对应关系可以如表1所示。在晚上时间范围22:00-2:00内,终端开启摄像头,并一直监控操作终端的用户的人脸表情,在某一时间,摄像头获取到操作终端的用户的人脸图像,并识别人脸图像中的人脸表情是哈欠,并且检测该人脸表情对应的目标对象为大人,则终端确定该人脸表情与表情库中存储的表情(“哈欠”)相匹配,并找到“哈欠”对应的提示信息作为目标提示信息,此时关怀用语为“主人主人,该早点休息了,明天要早起上班哟”及推荐控制应用信息为“是否打开闹钟设置?”。在输出目标提示信息之前,检测到终端当前运行的应用程序是视频应用程序,因此,可以确定终端当前的运行状态为空闲状态,进一步的,获取应用程序为视频的对应的提示信息输出方式,并在视频应用界面的右上角显示目标提示信息,以对用户进行提示,当用户想进入推荐控制应用,则做出“OK”手势或者微笑表情,闹钟设置会打开,当用户想关闭推荐应用,则做出“X”手势或者长闭眼,闹钟设置会关闭。Please refer to FIG. 3 , which is a schematic flowchart of another information output method provided by an embodiment of the present invention. In the process of Figure 3, the user can pre-enter multiple types of expressions in the terminal expression library, the expressions can be "yawn", "crying", "laughing", etc., and enter corresponding prompt information for each type of expression, In order to establish the corresponding relationship between the facial expressions and the prompt information, the corresponding relationship between the facial expressions and the prompt information set by the user may be as shown in Table 1. During the night time range of 22:00-2:00, the terminal turns on the camera and keeps monitoring the facial expressions of the user operating the terminal. At a certain time, the camera obtains the face image of the user operating the terminal and recognizes the face. The facial expression in the image is a yawn, and the target object corresponding to the detected facial expression is an adult, the terminal determines that the facial expression matches the expression (“yawn”) stored in the expression library, and finds the corresponding “yawn” The prompt information of , is used as the target prompt information. At this time, the caring language is "Master, it's time to rest early, you have to get up early for work tomorrow" and the recommended control application information is "Do you want to turn on the alarm clock setting?". Before outputting the target prompt information, it is detected that the application currently running on the terminal is a video application. Therefore, it can be determined that the current running state of the terminal is an idle state. The target prompt information is displayed in the upper right corner of the video application interface to remind the user. When the user wants to enter the recommended control application, he or she makes an "OK" gesture or smiles, and the alarm clock setting will be turned on. When the user wants to close the recommended application, then Make an "X" gesture or close your eyes for a long time, and the alarm setting will be turned off.
下面将结合附图4对本发明实施例提供的信息输出装置进行详细介绍。需要说明的是,附图4所示的信息输出装置,用于执行本发明图1或者图2所示实施例的方法,为了便于说明,仅示出了与本发明实施例相关的部分,具体技术细节未揭示的,经参照本发明图1或者图2所示的实施例。The information output device provided by the embodiment of the present invention will be described in detail below with reference to FIG. 4 . It should be noted that the information output device shown in FIG. 4 is used to execute the method of the embodiment shown in FIG. 1 or FIG. 2 of the present invention. For convenience of description, only the part related to the embodiment of the present invention is shown. If the technical details are not disclosed, refer to the embodiment shown in FIG. 1 or FIG. 2 of the present invention.
请参阅图4,为本发明提供的一种信息输出装置的结构示意图,该信息输出装置40包括:识别模块401、获取模块402、输出模块403、建立模块404。Please refer to FIG. 4 , which is a schematic structural diagram of an information output device provided by the present invention. The
识别模块401,用于终端获取人脸图像,并识别所述人脸图像中的人脸表情;The
获取模块402,用于根据所述人脸表情获取对应的目标提示信息;an obtaining
输出模块403,用于输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。The
在一种实现方式中,所述装置还包括建立模块404,具体用于:In an implementation manner, the apparatus further includes a establishing
将至少一个参考人脸表情以及针对所述至少一个参考人脸表情的提示信息建立对应关系。A corresponding relationship is established between at least one reference facial expression and prompt information for the at least one reference facial expression.
在一种实现方式中,所述对应关系由系统预设或用户设置。In an implementation manner, the corresponding relationship is preset by the system or set by the user.
在一种实现方式中,所述识别模块401,还用于:In an implementation manner, the
检测当前时间是否在预设的时间范围内;Check whether the current time is within the preset time range;
若检测到当前时间在所述预设的时间范围内,则执行终端获取人脸图像,并识别所述人脸图像中的人脸表情的步骤。If it is detected that the current time is within the preset time range, the terminal acquires a face image and recognizes the facial expression in the face image.
在一种实现方式中,所述获取模块402,还用于:In an implementation manner, the obtaining
检测所述人脸表情对应的对象是否与目标对象相匹配;Detecting whether the object corresponding to the facial expression matches the target object;
若检测到所述人脸表情对应的对象与所述目标对象相匹配,则获取所述目标对象对应的表情与提示信息的对应关系。If it is detected that the object corresponding to the facial expression matches the target object, the corresponding relationship between the expression corresponding to the target object and the prompt information is acquired.
在一种实现方式中,所述获取模块402,具体用于:In an implementation manner, the obtaining
检测所述人脸表情是否与任意一个所述参考人脸表情匹配;Detecting whether the facial expression matches any one of the reference facial expressions;
如果匹配,将与所述人脸表情相匹配的参考人脸表情对应的提示信息确定为目标提示信息。If there is a match, the prompt information corresponding to the reference facial expression matched with the facial expression is determined as the target prompt information.
在一种实现方式中,所述输出模块403,具体用于:In an implementation manner, the
获取当前时间;get the current time;
根据时间与推荐控制应用信息的对应关系,从所述至少一个推荐控制应用信息中确定出目标推荐控制应用信息;Determine the target recommended control application information from the at least one recommended control application information according to the corresponding relationship between the time and the recommended control application information;
输出所述目标推荐控制应用信息。The target recommendation control application information is output.
在一种实现方式中,所述输出模块403,还用于:In an implementation manner, the
终端接收用户操作,所述用户操作包括手势操作和/或表情操作;The terminal receives a user operation, where the user operation includes a gesture operation and/or an expression operation;
控制所述推荐控制应用信息对应的推荐控制应用。A recommended control application corresponding to the recommended control application information is controlled.
本发明实施例中,识别模块401终端获取人脸图像,并识别所述人脸图像中的人脸表情,进一步的,获取模块402根据所述人脸表情获取对应的目标提示信息,输出模块403输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。通过实施上述方法,可以使得终端根据用户的表情做出相应的响应,增加终端的智能性。In this embodiment of the present invention, the
请参阅图5,为本发明实施例提供了一种终端的结构示意图。如图5所示,该终端包括:至少一个处理器501,输入设备503,输出设备504,存储器505,至少一个通信总线502。其中,通信总线502用于实现这些组件之间的连接通信。其中,输入设备503可以是控制面板或者麦克风等,输出设备504可以是显示屏等。其中,存储器505可以是高速RAM存储器,也可以是非不稳定的存储器(non-volatile memory),例如至少一个磁盘存储器。存储器505可选的还可以是至少一个位于远离前述处理器501的存储装置。其中处理器501可以结合图5所描述的装置,存储器505中存储一组程序代码,且处理器501,输入设备503,输出设备504调用存储器505中存储的程序代码,用于执行以下操作:Please refer to FIG. 5 , which is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 5 , the terminal includes: at least one processor 501 , an input device 503 , an output device 504 , a memory 505 , and at least one communication bus 502 . Among them, the communication bus 502 is used to realize the connection and communication between these components. The input device 503 may be a control panel or a microphone, and the output device 504 may be a display screen or the like. The memory 505 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 505 can optionally also be at least one storage device located away from the aforementioned processor 501 . Wherein the processor 501 can be combined with the apparatus described in FIG. 5, a group of program codes are stored in the memory 505, and the processor 501, the input device 503, and the output device 504 call the program code stored in the memory 505 for performing the following operations:
处理器501,用于终端获取人脸图像,并识别所述人脸图像中的人脸表情;The processor 501 is used for the terminal to acquire a face image, and identify the facial expression in the face image;
处理器501,用于根据所述人脸表情获取对应的目标提示信息;A processor 501, configured to obtain corresponding target prompt information according to the facial expression;
输出设备504,用于输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。The output device 504 is configured to output the target prompt information, where the target prompt information includes caring words and/or recommended control application information.
在一种实现方式中,所述处理器501,还用于:In an implementation manner, the processor 501 is further configured to:
将至少一个参考人脸表情以及针对所述至少一个参考人脸表情的提示信息建立对应关系。A corresponding relationship is established between at least one reference facial expression and prompt information for the at least one reference facial expression.
在一种实现方式中,所述对应关系由系统预设或用户设置。In an implementation manner, the corresponding relationship is preset by the system or set by the user.
在一种实现方式中,所述处理器501,还用于:In an implementation manner, the processor 501 is further configured to:
检测当前时间是否在预设的时间范围内;Check whether the current time is within the preset time range;
若检测到当前时间在所述预设的时间范围内,则执行获取针对终端输入设备503输入的人脸图像,并识别所述人脸图像中的人脸表情的步骤。If it is detected that the current time is within the preset time range, the steps of acquiring the face image input to the terminal input device 503 and recognizing the facial expression in the face image are performed.
在一种实现方式中,所述处理器501,还用于:In an implementation manner, the processor 501 is further configured to:
检测所述人脸表情对应的对象是否与目标对象相匹配;Detecting whether the object corresponding to the facial expression matches the target object;
若检测到所述人脸表情对应的对象与所述目标对象相匹配,则获取所述目标对象对应的表情与提示信息的对应关系。If it is detected that the object corresponding to the facial expression matches the target object, the corresponding relationship between the expression corresponding to the target object and the prompt information is acquired.
在一种实现方式中,所述处理器501,具体用于:In an implementation manner, the processor 501 is specifically configured to:
检测所述人脸表情是否与任意一个所述参考人脸表情匹配;Detecting whether the facial expression matches any one of the reference facial expressions;
如果匹配,将与所述人脸表情相匹配的参考人脸表情对应的提示信息确定为目标提示信息。If there is a match, the prompt information corresponding to the reference facial expression matched with the facial expression is determined as the target prompt information.
在一种实现方式中,所述处理器501,具体用于:In an implementation manner, the processor 501 is specifically configured to:
获取当前时间;get the current time;
根据时间与推荐控制应用信息的对应关系,从所述至少一个推荐控制应用信息中确定出目标推荐控制应用信息;Determine the target recommended control application information from the at least one recommended control application information according to the corresponding relationship between the time and the recommended control application information;
输出所述目标推荐控制应用信息。The target recommendation control application information is output.
在一种实现方式中,所述处理器501,还用于:In an implementation manner, the processor 501 is further configured to:
终端接收用户操作,所述用户操作包括手势操作和/或表情操作;The terminal receives a user operation, where the user operation includes a gesture operation and/or an expression operation;
控制所述推荐控制应用信息对应的推荐控制应用。A recommended control application corresponding to the recommended control application information is controlled.
本发明实施例中,处理器501获取针对终端输入设备503输入的人脸图像,并识别所述人脸图像中的人脸表情,进一步的,根据所述人脸表情获取对应的目标提示信息,输出设备504输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。通过实施上述方式,可以使得终端根据用户的表情做出相应的响应,增加终端的智能性。In this embodiment of the present invention, the processor 501 obtains a face image input to the terminal input device 503, and recognizes the face expression in the face image, and further, obtains corresponding target prompt information according to the face expression, The output device 504 outputs the target prompt information, where the target prompt information includes caring words and/or recommended control application information. By implementing the above manner, the terminal can make a corresponding response according to the user's expression, thereby increasing the intelligence of the terminal.
本发明实施例中所述模块,可以通过通用集成电路,例如CPU(CentralProcessing Unit,中央处理器),或通过ASIC(Application Specific IntegratedCircuit,专用集成电路)来实现。The modules in the embodiments of the present invention may be implemented by a general-purpose integrated circuit, such as a CPU (Central Processing Unit, central processing unit), or an ASIC (Application Specific Integrated Circuit, an application-specific integrated circuit).
应当理解,在本发明实施例中,所称处理器501可以是中央处理单元(CentralProcessing Unit,CPU),该处理器501还可以是其他通用处理器、数字信号处理器(DigitalSignal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立元件门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。It should be understood that, in this embodiment of the present invention, the processor 501 may be a central processing unit (Central Processing Unit, CPU), and the processor 501 may also be other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
总线502可以是工业标准体系结构(Industry Standard Architecture,ISA)总线、外部设备互联(Peripheral Component,PCI)总线或扩展工业标准体系结构(ExtendedIndustry Standard Architecture,EISA)总线等,该总线502可以分为地址总线、数据总线、控制总线等,为便于表示,图5仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。The bus 502 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus 502 can be divided into addresses The bus, the data bus, the control bus, etc. are only represented by a thick line in FIG. 5 for convenience of representation, but it does not mean that there is only one bus or one type of bus.
具体实现中,本发明实施例中所描述的处理器501,输入设备503,输出设备504和存储器505可执行本发明实施例提供的图1或者图2所述的方法实施例所描述的实现方式,也可执行本发明实施例所描述的信息输出装置的实现方式,在此不再赘述。In a specific implementation, the processor 501, the input device 503, the output device 504, and the memory 505 described in the embodiments of the present invention may execute the implementations described in the method embodiments described in FIG. 1 or FIG. 2 provided in the embodiments of the present invention , the implementation manner of the information output apparatus described in the embodiments of the present invention can also be implemented, and details are not described herein again.
在本发明的另一实施例中提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序包括程序指令,所述程序指令被处理器执行时实现:终端获取人脸图像,并识别所述人脸图像中的人脸表情,进一步的,根据所述人脸表情获取对应的目标提示信息,输出所述目标提示信息,所述目标提示信息包括关怀用语和/或推荐控制应用信息。In another embodiment of the present invention, a computer-readable storage medium is provided, and the computer-readable storage medium stores a computer program, and the computer program includes program instructions, and the program instructions are executed by a processor to realize: a terminal Obtain a face image, and identify the facial expression in the face image, further, obtain corresponding target prompt information according to the facial expression, and output the target prompt information, and the target prompt information includes caring words and / or recommended control application information.
所述计算机可读存储介质可以是前述任一实施例所述的服务器的内部存储单元,例如服务器的硬盘或内存。所述计算机可读存储介质也可以是所述服务器的外部存储设备,例如所述服务器上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步的,所述计算机可读存储介质还可以既包括所述服务器的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述服务器所需的其他程序和数据。所述计算机可读存储介质还可以用于暂时地存储已经输出或者将要输出的数据。The computer-readable storage medium may be an internal storage unit of the server described in any of the foregoing embodiments, such as a hard disk or a memory of the server. The computer-readable storage medium may also be an external storage device of the server, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) card equipped on the server. , Flash Card (Flash Card) and so on. Further, the computer-readable storage medium may also include both an internal storage unit of the server and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the server. The computer-readable storage medium can also be used to temporarily store data that has been or will be output.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random AccessMemory,RAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. During execution, the processes of the embodiments of the above-mentioned methods may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM) or the like.
以上所揭露的仅为本发明的部分实施例而已,当然不能以此来限定本发明之权利范围,本领域普通技术人员可以理解实现上述实施例的全部或部分流程,并依本发明权利要求所作的等同变化,仍属于发明所涵盖的范围。The above disclosures are only part of the embodiments of the present invention, and of course, the scope of the rights of the present invention cannot be limited by this. Those of ordinary skill in the art can understand all or part of the procedures for realizing the above embodiments, and make according to the claims of the present invention. The equivalent changes of the invention still belong to the scope covered by the invention.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910956118.4A CN110737334A (en) | 2019-10-09 | 2019-10-09 | Information output method, device, terminal and computer-readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910956118.4A CN110737334A (en) | 2019-10-09 | 2019-10-09 | Information output method, device, terminal and computer-readable storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110737334A true CN110737334A (en) | 2020-01-31 |
Family
ID=69269903
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910956118.4A Pending CN110737334A (en) | 2019-10-09 | 2019-10-09 | Information output method, device, terminal and computer-readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110737334A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111626253A (en) * | 2020-06-02 | 2020-09-04 | 上海商汤智能科技有限公司 | Expression detection method and device, electronic equipment and storage medium |
CN112346352A (en) * | 2020-11-20 | 2021-02-09 | 深圳Tcl新技术有限公司 | Control prompting method and device for terminal equipment and computer readable storage medium |
CN113065456A (en) * | 2021-03-30 | 2021-07-02 | 上海商汤智能科技有限公司 | Information prompting method and device, electronic equipment and computer storage medium |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103246879A (en) * | 2013-05-13 | 2013-08-14 | 苏州福丰科技有限公司 | Expression-recognition-based intelligent robot system |
CN103699547A (en) * | 2012-09-28 | 2014-04-02 | 北京三星通信技术研究有限公司 | Application program recommendation method and terminal |
CN107329760A (en) * | 2017-06-30 | 2017-11-07 | 珠海市魅族科技有限公司 | Information cuing method, device, terminal and storage medium |
CN107491380A (en) * | 2017-07-27 | 2017-12-19 | 珠海市魅族科技有限公司 | Information output method and device, computer installation and readable storage medium storing program for executing |
CN107633098A (en) * | 2017-10-18 | 2018-01-26 | 维沃移动通信有限公司 | A kind of content recommendation method and mobile terminal |
CN108509660A (en) * | 2018-05-29 | 2018-09-07 | 维沃移动通信有限公司 | A kind of broadcasting object recommendation method and terminal device |
CN108632446A (en) * | 2018-03-13 | 2018-10-09 | 维沃移动通信有限公司 | An information prompt method and mobile terminal |
CN109640119A (en) * | 2019-02-21 | 2019-04-16 | 百度在线网络技术(北京)有限公司 | Method and apparatus for pushed information |
CN109683709A (en) * | 2018-12-17 | 2019-04-26 | 苏州思必驰信息科技有限公司 | Man-machine interaction method and system based on Emotion identification |
CN110032945A (en) * | 2019-03-21 | 2019-07-19 | 阿里巴巴集团控股有限公司 | Method and device based on recognition of face |
-
2019
- 2019-10-09 CN CN201910956118.4A patent/CN110737334A/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103699547A (en) * | 2012-09-28 | 2014-04-02 | 北京三星通信技术研究有限公司 | Application program recommendation method and terminal |
CN103246879A (en) * | 2013-05-13 | 2013-08-14 | 苏州福丰科技有限公司 | Expression-recognition-based intelligent robot system |
CN107329760A (en) * | 2017-06-30 | 2017-11-07 | 珠海市魅族科技有限公司 | Information cuing method, device, terminal and storage medium |
CN107491380A (en) * | 2017-07-27 | 2017-12-19 | 珠海市魅族科技有限公司 | Information output method and device, computer installation and readable storage medium storing program for executing |
CN107633098A (en) * | 2017-10-18 | 2018-01-26 | 维沃移动通信有限公司 | A kind of content recommendation method and mobile terminal |
CN108632446A (en) * | 2018-03-13 | 2018-10-09 | 维沃移动通信有限公司 | An information prompt method and mobile terminal |
CN108509660A (en) * | 2018-05-29 | 2018-09-07 | 维沃移动通信有限公司 | A kind of broadcasting object recommendation method and terminal device |
CN109683709A (en) * | 2018-12-17 | 2019-04-26 | 苏州思必驰信息科技有限公司 | Man-machine interaction method and system based on Emotion identification |
CN109640119A (en) * | 2019-02-21 | 2019-04-16 | 百度在线网络技术(北京)有限公司 | Method and apparatus for pushed information |
CN110032945A (en) * | 2019-03-21 | 2019-07-19 | 阿里巴巴集团控股有限公司 | Method and device based on recognition of face |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111626253A (en) * | 2020-06-02 | 2020-09-04 | 上海商汤智能科技有限公司 | Expression detection method and device, electronic equipment and storage medium |
CN112346352A (en) * | 2020-11-20 | 2021-02-09 | 深圳Tcl新技术有限公司 | Control prompting method and device for terminal equipment and computer readable storage medium |
CN113065456A (en) * | 2021-03-30 | 2021-07-02 | 上海商汤智能科技有限公司 | Information prompting method and device, electronic equipment and computer storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110113646B (en) | AI voice-based intelligent interactive processing method, system and storage medium | |
CN109478106B (en) | Utilizing environmental context for enhanced communication throughput | |
WO2020207413A1 (en) | Content pushing method, apparatus, and device | |
KR102591555B1 (en) | Selective detection of visual cues for automated assistants | |
CN110737334A (en) | Information output method, device, terminal and computer-readable storage medium | |
WO2021120690A1 (en) | Speech recognition method and apparatus, and medium | |
WO2018006374A1 (en) | Function recommending method, system, and robot based on automatic wake-up | |
CN109101517B (en) | Information processing method, information processing apparatus, and medium | |
CN105335498A (en) | Method and system for information recommendation based on voice information | |
WO2016061930A1 (en) | Web page coding identification method and device | |
CN111565143A (en) | Instant messaging method, device and computer-readable storage medium | |
CN111797304A (en) | Content pushing method, device and equipment | |
CN112000766B (en) | A data processing method, device and medium | |
CN109274825A (en) | A kind of message prompt method and device | |
CN111951787A (en) | Voice output method, device, storage medium and electronic device | |
CN110865790A (en) | Working method of electronic painted screen and electronic painted screen | |
CN103905837A (en) | Image processing method and device and terminal | |
CN119360842A (en) | Voice interaction method, device, electronic device and computer storage medium | |
WO2021243507A1 (en) | Interactive interface display method and system for recommended behavior | |
CN108632461A (en) | Method, apparatus, terminal and the computer readable storage medium of alarm clock calling | |
CN118277609A (en) | Video annotation method, device, electronic device and storage medium | |
CN117153156A (en) | Voice control method, system, electronic device and readable storage medium | |
US20220269880A1 (en) | Method and device for generating emoticon, and storage medium | |
CN104699668B (en) | Determine the method and device of Words similarity | |
CN117636861A (en) | Device wake-up method and device, electronic device, readable storage medium and chip |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |