WO2020135334A1 - Television application theme switching method, television, readable storage medium, and device - Google Patents

Television application theme switching method, television, readable storage medium, and device Download PDF

Info

Publication number
WO2020135334A1
WO2020135334A1 PCT/CN2019/127426 CN2019127426W WO2020135334A1 WO 2020135334 A1 WO2020135334 A1 WO 2020135334A1 CN 2019127426 W CN2019127426 W CN 2019127426W WO 2020135334 A1 WO2020135334 A1 WO 2020135334A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
voice information
target user
emotion
application theme
Prior art date
Application number
PCT/CN2019/127426
Other languages
French (fr)
Chinese (zh)
Inventor
张俊
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Publication of WO2020135334A1 publication Critical patent/WO2020135334A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/458Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration

Definitions

  • the present application relates to the technical field of television applications, in particular to a method for switching theme of television applications, television, readable storage medium and equipment.
  • the application themes on TV are generally fixed after development, even if some weather applications can dynamically switch with the changes of the weather, but they can not achieve the intelligent effect. Due to the current intelligent development, users have higher requirements for changing the theme of TV applications, and the focus of the existing intelligent development is still the user experience. If the user's mood changes while watching TV programs, the current TV application The theme can be switched to the corresponding mood soothing theme, which can improve the user experience to a certain extent, but the prior art TV has not yet achieved the effect of switching the application theme according to the user's mood.
  • the main purpose of the present application is to provide a method for switching theme of TV application, TV, readable storage medium and device.
  • the aim is to solve the technical problem that the prior art television cannot switch the application theme according to the user's mood, and thus cannot achieve the effect of comforting the user's mood.
  • this application provides a method for switching theme of TV application, including the following contents:
  • the method before the step of collecting facial expressions and voice information of the target user, the method further includes:
  • the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
  • the method before the step of collecting facial expressions and voice information of the target user, the method further includes:
  • the television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
  • the step of collecting facial expressions and voice information of the target user includes:
  • the step of collecting facial expressions and voice information of the target user includes:
  • a voice information collection operation is initiated.
  • the step of calculating the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data includes:
  • the emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
  • the step of optimizing the emotion recognition data according to the collected heart rate data of the target user, and confirming the target emotion of the target user by the optimized emotion recognition data includes:
  • the step of comparing the emotion recognition data with a preset emotion threshold and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold includes:
  • the step of collecting facial expressions and voice information of the target user includes:
  • the step of initiating the prompt information of voice information collection includes:
  • a prompt hovering box based on the prompt information collected by the voice information is output.
  • the step of collecting voice information initiated by the target user based on the prompt information includes:
  • a step of collecting voice information initiated by the target user based on the prompt information is performed.
  • the step of reading the collected voice information and confirming the source of the voice information according to the reading result includes:
  • the method further includes:
  • the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
  • the method before the step of acquiring the target application theme corresponding to the target emotion and switching the current application theme on the TV side to the target application theme, the method further includes:
  • a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
  • the method before the step of collecting facial expressions and voice information of the target user, the method further includes:
  • the method before the step of acquiring the common emotional expressions of the target user and storing the common emotional expressions in a preset emotional expression storage area, the method further includes:
  • the step of acquiring the common emotional expression of the target user is performed.
  • the present application also provides a TV
  • the TV includes:
  • the collection module is set to collect facial expressions and voice information of the target user
  • the confirmation module is configured to calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user according to the emotion recognition data;
  • the switching module is configured to obtain a target application theme corresponding to the target emotion, and switch a current application theme on the TV side to the target application theme.
  • the present application also provides a readable storage medium that stores a TV application theme switching program, and the TV application theme switching program includes the following steps when executed:
  • the present application also provides a TV application theme switching device.
  • the TV application theme switching device includes a memory, a processor, and a TV application theme switching program stored on the memory and executable on the processor.
  • the TV application theme switching program The implementation includes the following steps:
  • FIG. 1 is a schematic diagram of a terminal ⁇ device structure of a hardware operating environment involved in an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a first embodiment of a method for switching theme of a TV application of the present application
  • FIG. 3 is a schematic flowchart of a second embodiment of a method for switching theme of a TV application of the present application.
  • the main solutions of the embodiments of the present application are: collecting the facial expressions and voice information of the target user; calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target with the emotion recognition data The user's target emotion; obtain the target application theme corresponding to the target emotion, and switch the current TV application theme to the target application theme.
  • This application provides a solution to determine the user's emotions by turning on the camera of the TV to collect the user's facial expressions and user's voice information, and then switch the current TV application theme to the preset comfort theme according to the user's emotions, , To achieve the purpose of comforting users' emotions.
  • FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application.
  • the terminal may be a PC, or may be a mobile or non-removable terminal device such as a smart phone, tablet computer, e-book reader, or portable computer.
  • the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection communication between these components.
  • the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as a magnetic disk memory.
  • the memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
  • FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than those illustrated, or combine certain components, or have different component arrangements.
  • the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a TV application theme switching application program.
  • the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server;
  • the user interface 1003 is mainly used to connect to the client (user side) and perform data communication with the client; and the processor 1001 can be used to call the TV application theme switching application stored in the memory 1005 and perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • the television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • a voice information collection operation is initiated.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • the emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • a prompt hovering box based on the prompt information collected by the voice information is output.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • a step of collecting voice information initiated by the target user based on the prompt information is performed.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
  • the step of acquiring the common emotional expression of the target user is performed.
  • FIG. 2 is a schematic flowchart of a first embodiment of a method for switching a theme of a TV application of the present application.
  • the method for switching a theme of a TV application includes:
  • Step S10 Collect facial expressions and voice information of the target user
  • the target user refers to a user currently watching a TV program of a TV terminal, and a user whose location is within a fixed/unfixed target range may be defined as the target user.
  • the facial expression of the target user is used to capture/photograph the facial expression of the target user by enabling the camera device of the TV terminal.
  • the camera device of the TV terminal may include, but is not limited to, a camera built into the TV terminal, or The camera of the other electronic device associated with the television terminal, in this way, captures the facial expression of the target user according to the camera of the electronic device controllable or connected to the television terminal.
  • the steps of collecting the facial expressions and voice information of the target user include:
  • the prompt information for collecting voice information is initiated.
  • humans have abnormal emotions, in addition to their facial expressions, they are also reflected in the voice information. Therefore, in practical applications, this application further collects the target user's voice information to further determine the target user's current emotions to improve the target user The accuracy of emotion recognition.
  • the prompt information for voice information collection it can be initiated by displaying a small floating frame on the screen of the TV terminal to buffer the target user to avoid scaring the user.
  • a prompt message for initiating voice information collection is displayed in the target area of the TV terminal by a small floating frame.
  • the prompt information for initiating the collection of voice information may be expressed in the form of an inquiry or a dialogue to guide the target user to issue voice information.
  • the small floating frame may also be represented in an anthropomorphic form, such as Small robots, etc. In this way, according to the initiated voice information collection prompt information, the voice information triggered by the target user based on the prompt information is collected.
  • the step of collecting voice information initiated by the target user based on the prompt information includes:
  • a step of collecting voice information initiated by the target user based on the prompt information is performed.
  • the confirmation method can be performed by comparing the received voice information with the pre-stored voice information of the target user.
  • the voice information of the target user is historical voice information of the target user stored in advance in a preset voice storage area, and it is confirmed whether the received voice information is the voice information of the target user according to the comparison result.
  • the received voice information is confirmed to be the voice of the target user, and the collection of the target user is performed based on the prompt Message-initiated voice message steps.
  • Step S20 Calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user with the emotion recognition data;
  • the target user After collecting the facial expressions and voice information of the target user, calculate the emotion recognition data of the target user based on the facial expressions and voice information, wherein, when determining the emotion recognition data with the facial expressions and voice information, Determined by the emotion recognition data calculation formula or emotion analysis formula that has been set by the relevant technicians.
  • the target user determines target emotion of the target user
  • there may be a related emotion threshold and the target emotion of the target user is determined according to the threshold range of the emotion threshold calculated by the emotion recognition data, and the emotion The threshold is related to the set emotion recognition formula or emotion analysis formula.
  • the target user’s emotional changes can be further accurately obtained by acquiring the target user’s heart rate value, and the heart rate data needs to be measured by human touch heart rate Equipment, the heart rate measuring equipment includes but is not limited to bracelets and heart rate detection equipment, etc.
  • the heart rate detection device needs to have a data transmission channel with the TV terminal , That is, there is a connection relationship. Therefore, in the method of the present application, it is recommended that the user configure a special remote control, and the user's heart rate can be monitored by the user holding the remote control. Therefore, the step of calculating the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirming the target emotion of the target user with the emotion recognition data includes:
  • the emotion recognition data is optimized with the collected heart rate data of the target user, and the optimized emotion recognition data confirms the target emotion of the target user.
  • the user's heart rate data Collect the user's heart rate data through the heart rate detection device, and optimize the emotion recognition data with the heart rate data.
  • the emotion recognition data calculated by the collected heart rate data of the user may be optimized, and the target emotion of the target user may be confirmed by the optimized emotion recognition data.
  • the optimization method may be by confirming the heart rate data Whether the target emotion corresponding to the emotional heart rate threshold is consistent with the target emotion corresponding to the emotion recognition data; or input the preset emotion recognition data calculation formula or emotion analysis formula through the collected heart rate data to calculate new emotion recognition data To achieve the goal of optimizing the emotion recognition data through the heart rate data.
  • the target emotion of the target user is directly confirmed with the calculated emotion recognition data.
  • Step S30 Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
  • the preset application theme storage area is a storage area of application themes that can be applied or stored by the television terminal divided by the television terminal.
  • the target application theme identifier can be generated by generating a predetermined format to use the target application theme before the step of directly acquiring the corresponding target application theme, that is, acquiring the target application theme corresponding to the target emotion, and switching the current application theme on the TV side to the target application theme, the method further includes:
  • a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
  • the corresponding target application theme is obtained through the confirmed target emotion
  • the operation of switching the application theme is generally achieved through the relevant function of the current TV terminal application system
  • it can be based on The application theme switching function permits a preset format to acquire the target application theme.
  • the confirmed target mood is generated through the preset format operation to generate the target application theme logo
  • the target application theme logo can be limited to the most economical The format of the memory, such as digital implementation.
  • the user's emotion is determined by turning on the camera of the TV to collect the user's facial expression and the user's voice information, and then switching the current TV application theme to the preset comfort theme according to the user emotion, so as to achieve the comfort of the user by switching the TV application theme according to the user emotion Emotional purpose.
  • FIG. 2 is a schematic flowchart of a first embodiment of a method for switching theme of a TV application according to the present application. Based on the first embodiment shown above, before the step of collecting facial expressions and voice information of a target user, also includes:
  • Step S40 Detect the target user and determine whether the target user is a new user
  • Step S50 When it is confirmed that the target user is a new user, a step of acquiring common emotion expressions of the target user is performed.
  • Step S60 Obtain the common emotion expressions of the target user, and store the common emotion expressions into a preset emotion expression storage area.
  • the emotion data displayed by the facial expression of the target user may be stored in the preset emotional expression storage area in advance.
  • the confirmation method thereof may be by confirming whether the detected target user has stored historical facial expression data.
  • the facial expression and the represented emotional information are stored in a preset emotional expression storage area.
  • the common emotional expressions can be stored separately according to the identification content. For example, when the collected facial expression of the user is joy, the joy can be used as the identification The facial expression is stored in the preset emotional expression storage area.
  • the user when collecting the common emotional expressions of the target user, the user can issue a prompt voice to guide the user to display the facial expressions of the specified emotion for the operation of collecting and storing the facial expressions.
  • Expression recognition process which in turn improves the storage efficiency of facial expressions.
  • an embodiment of the present application further proposes a readable storage medium on which a TV application theme switching program is stored.
  • the TV application theme switching program is executed by a processor, the following operations are implemented:
  • the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
  • the television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
  • a voice information collection operation is initiated.
  • the emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
  • a prompt hovering box based on the prompt information collected by the voice information is output.
  • a step of collecting voice information initiated by the target user based on the prompt information is performed.
  • the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
  • a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
  • the step of acquiring the common emotional expression of the target user is performed.
  • the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation.
  • the technical solution of the present application can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above , Disk, CD), including several instructions to make a terminal device (which can be a mobile phone, computer, server, air conditioner, or network equipment, etc.) to perform the method described in each embodiment of the present application.

Abstract

The present application discloses a television application theme switching method. Said method comprises: acquiring a facial expression and voice information of a target user; calculating, according to the acquired facial expression and voice information, emotion recognition data of the target user, and using the emotion recognition data to determine a target emotion of the target user; and acquiring a target application theme corresponding to the target emotion, and switching the current application theme of a television terminal to the target application theme. The present application further discloses a television, a readable storage medium, and a device.

Description

电视应用主题切换方法、电视、可读存储介质及设备TV application theme switching method, TV, readable storage medium and equipment
本申请要求2018年12月28日申请的,申请号201811632356.1,名称为“电视应用主题切换方法、电视、可读存储介质及系统”的中国专利申请的优先权,在此将其全文引入作为参考。This application requires the priority of the Chinese patent application with the application number 201811632356.1, entitled "TV application theme switching method, TV, readable storage medium and system", which was applied on December 28, 2018, and the entire content is hereby incorporated by reference .
技术领域Technical field
本申请涉及电视应用技术领域,尤其涉及一种电视应用主题切换方法、电视、可读存储介质及设备。The present application relates to the technical field of television applications, in particular to a method for switching theme of television applications, television, readable storage medium and equipment.
背景技术Background technique
目前,电视上的应用主题一般都是开发好后固定不变的,即使有些天气类应用可以跟随天气的变化动态切换,但是都达不到智能化的效果。由于现在智能化的发展,用户对电视的应用主题切换的要求更改的需求更高,并且,现有智能化发展的着重点还是用户体验,若是用户在观看电视节目发生心情变化,当前电视的应用主题可切换至对应的心情抚慰主题,则可在一定程度上提高用户体验,但现有技术的电视还无法实现根据用户心情切换应用主题的效果。At present, the application themes on TV are generally fixed after development, even if some weather applications can dynamically switch with the changes of the weather, but they can not achieve the intelligent effect. Due to the current intelligent development, users have higher requirements for changing the theme of TV applications, and the focus of the existing intelligent development is still the user experience. If the user's mood changes while watching TV programs, the current TV application The theme can be switched to the corresponding mood soothing theme, which can improve the user experience to a certain extent, but the prior art TV has not yet achieved the effect of switching the application theme according to the user's mood.
技术解决方案Technical solution
本申请的主要目的在于提供一种电视应用主题切换方法、电视、可读存储介质及设备。旨在解决现有技术的电视还无法实现根据用户心情切换应用主题的技术问题,进而无法达到安慰观看用户的心情的效果。The main purpose of the present application is to provide a method for switching theme of TV application, TV, readable storage medium and device. The aim is to solve the technical problem that the prior art television cannot switch the application theme according to the user's mood, and thus cannot achieve the effect of comforting the user's mood.
为实现上述目的,本申请提供一种电视应用主题切换方法,包括以下内容:In order to achieve the above purpose, this application provides a method for switching theme of TV application, including the following contents:
采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:In some embodiments, before the step of collecting facial expressions and voice information of the target user, the method further includes:
确认所述目标用户的历史面部表情数据;Confirm the historical facial expression data of the target user;
若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。If the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:In some embodiments, before the step of collecting facial expressions and voice information of the target user, the method further includes:
启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。The television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤,包括:In some embodiments, the step of collecting facial expressions and voice information of the target user includes:
确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。Determine the target position of the collecting user, and collect the facial expressions and voice information of the target user in the confirmed target position.
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤,包括:In some embodiments, the step of collecting facial expressions and voice information of the target user includes:
根据采集到的目标用户的面部表情确定用户情绪;Determine user emotions based on the collected facial expressions of the target user;
在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。When it is determined that the user's emotion is abnormal according to the facial expression, a voice information collection operation is initiated.
在一些实施方式中,所述根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:In some embodiments, the step of calculating the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data includes:
采集目标用户的心率数据;Collect the heart rate data of the target user;
根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。The emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
在一些实施方式中,所述根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:In some embodiments, the step of optimizing the emotion recognition data according to the collected heart rate data of the target user, and confirming the target emotion of the target user by the optimized emotion recognition data includes:
将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。Comparing the emotion recognition data with a preset emotion threshold, and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold.
在一些实施方式中,所述将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪的步骤之后,包括:In some embodiments, the step of comparing the emotion recognition data with a preset emotion threshold and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold includes:
确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。Confirm a threshold range of the emotion threshold where the emotion recognition data is located, and confirm the target emotion according to the threshold range.
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤,包括:In some embodiments, the step of collecting facial expressions and voice information of the target user includes:
发起语音信息采集的提示信息;Prompt information for initiating voice information collection;
采集所述目标用户基于所述提示信息发起的语音信息。Collect voice information initiated by the target user based on the prompt information.
在一些实施方式中,所述发起语音信息采集的提示信息的步骤,包括:In some embodiments, the step of initiating the prompt information of voice information collection includes:
输出基于所述语音信息采集的提示信息的提示悬浮框。A prompt hovering box based on the prompt information collected by the voice information is output.
在一些实施方式中,所述采集所述目标用户基于所述提示信息发起的语音信息的步骤,包括:In some embodiments, the step of collecting voice information initiated by the target user based on the prompt information includes:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;Reading the collected voice information, and confirming the source of the voice information according to the reading result;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。If it is confirmed that the voice information is the voice information of the target user, a step of collecting voice information initiated by the target user based on the prompt information is performed.
在一些实施方式中,所述读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源的步骤,包括:In some embodiments, the step of reading the collected voice information and confirming the source of the voice information according to the reading result includes:
将所述语音信息与预存的所述目标用户的历史语音信息比对;Compare the voice information with pre-stored historical voice information of the target user;
根据比对结果确认所述语音信息的来源。Confirm the source of the voice information according to the comparison result.
在一些实施方式中,所述将所述语音信息与预存的所述目标用户的历史语音信息比对的步骤之后,还包括:In some embodiments, after the step of comparing the voice information with the pre-stored historical voice information of the target user, the method further includes:
在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。When it is confirmed that the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
在一些实施方式中,所述获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题的步骤之前,还包括:In some embodiments, before the step of acquiring the target application theme corresponding to the target emotion and switching the current application theme on the TV side to the target application theme, the method further includes:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。A target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:In some embodiments, before the step of collecting facial expressions and voice information of the target user, the method further includes:
获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。Obtain the common emotional expressions of the target user, and store the common emotional expressions in a preset emotional expression storage area.
在一些实施方式中,所述获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域的步骤之前,还包括:In some embodiments, before the step of acquiring the common emotional expressions of the target user and storing the common emotional expressions in a preset emotional expression storage area, the method further includes:
检测目标用户,并确认所述目标用户是否为新用户;Detect the target user and confirm whether the target user is a new user;
若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。If it is confirmed that the target user is a new user, the step of acquiring the common emotional expression of the target user is performed.
此外,为实现上述目的,本申请还提供一种电视,所述电视包括:In addition, in order to achieve the above object, the present application also provides a TV, the TV includes:
采集模块,设置为采集目标用户的面部表情及语音信息;The collection module is set to collect facial expressions and voice information of the target user;
确认模块,设置为根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;The confirmation module is configured to calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user according to the emotion recognition data;
切换模块,设置为获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。The switching module is configured to obtain a target application theme corresponding to the target emotion, and switch a current application theme on the TV side to the target application theme.
本申请还提供一种可读存储介质,所述可读存储介质存储有电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下步骤:The present application also provides a readable storage medium that stores a TV application theme switching program, and the TV application theme switching program includes the following steps when executed:
采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
本申请还提供一种电视应用主题切换设备,所述电视应用主题切换设备包括存储器、处理器及存储在存储器上并可在处理器上运行的电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下的步骤:The present application also provides a TV application theme switching device. The TV application theme switching device includes a memory, a processor, and a TV application theme switching program stored on the memory and executable on the processor. The TV application theme switching program The implementation includes the following steps:
采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
附图说明BRIEF DESCRIPTION
图1是本申请实施例方案涉及的硬件运行环境的终端\装置结构示意图;FIG. 1 is a schematic diagram of a terminal\device structure of a hardware operating environment involved in an embodiment of the present application;
图2为本申请电视应用主题切换方法第一实施例的流程示意图;2 is a schematic flowchart of a first embodiment of a method for switching theme of a TV application of the present application;
图3为本申请电视应用主题切换方法第二实施例的流程示意图。FIG. 3 is a schematic flowchart of a second embodiment of a method for switching theme of a TV application of the present application.
本发明的实施方式Embodiments of the invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.
本申请实施例的主要解决方案是:采集目标用户的面部表情及语音信息;根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪;获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。The main solutions of the embodiments of the present application are: collecting the facial expressions and voice information of the target user; calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target with the emotion recognition data The user's target emotion; obtain the target application theme corresponding to the target emotion, and switch the current TV application theme to the target application theme.
由于现有技术电视还无法实现根据用户心情切换应用主题的技术问题。Because the prior art televisions cannot yet achieve the technical problem of switching the application theme according to the user's mood.
本申请提供一种解决方案,通过开启电视的摄像头采集用户面部表情及用户语音信息确定用户情绪,进而根据用户情绪切换电视当前应用主题至预设的安慰主题,通过实现通过用户情绪切换电视应用主题,达到安慰用户情绪的目的。This application provides a solution to determine the user's emotions by turning on the camera of the TV to collect the user's facial expressions and user's voice information, and then switch the current TV application theme to the preset comfort theme according to the user's emotions, , To achieve the purpose of comforting users' emotions.
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图。As shown in FIG. 1, FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application.
本申请实施例终端可以是PC,也可以是智能手机、平板电脑、电子书阅读器,便携计算机等可移动式或不可移动式终端设备。In this embodiment of the present application, the terminal may be a PC, or may be a mobile or non-removable terminal device such as a smart phone, tablet computer, e-book reader, or portable computer.
如图1所示,该终端可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as a magnetic disk memory. The memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
本领域技术人员可以理解,图1中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。A person skilled in the art may understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than those illustrated, or combine certain components, or have different component arrangements.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及电视应用主题切换应用程序。As shown in FIG. 1, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a TV application theme switching application program.
在图1所示的终端中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的电视应用主题切换应用程序,并执行以下操作:In the terminal shown in FIG. 1, the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server; the user interface 1003 is mainly used to connect to the client (user side) and perform data communication with the client; and the processor 1001 can be used to call the TV application theme switching application stored in the memory 1005 and perform the following operations:
采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
确认所述目标用户的历史面部表情数据;Confirm the historical facial expression data of the target user;
若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。If the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。The television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。Determine the target position of the collecting user, and collect the facial expressions and voice information of the target user in the confirmed target position.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
根据采集到的目标用户的面部表情确定用户情绪;Determine user emotions based on the collected facial expressions of the target user;
在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。When it is determined that the user's emotion is abnormal according to the facial expression, a voice information collection operation is initiated.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
采集目标用户的心率数据;Collect the heart rate data of the target user;
根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。The emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。Comparing the emotion recognition data with a preset emotion threshold, and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。Confirm a threshold range of the emotion threshold where the emotion recognition data is located, and confirm the target emotion according to the threshold range.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
发起语音信息采集的提示信息;Prompt information for initiating voice information collection;
采集所述目标用户基于所述提示信息发起的语音信息。Collect voice information initiated by the target user based on the prompt information.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
输出基于所述语音信息采集的提示信息的提示悬浮框。A prompt hovering box based on the prompt information collected by the voice information is output.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;Reading the collected voice information, and confirming the source of the voice information according to the reading result;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。If it is confirmed that the voice information is the voice information of the target user, a step of collecting voice information initiated by the target user based on the prompt information is performed.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
将所述语音信息与预存的所述目标用户的历史语音信息比对;Compare the voice information with pre-stored historical voice information of the target user;
根据比对结果确认所述语音信息的来源。Confirm the source of the voice information according to the comparison result.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。When it is confirmed that the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。A target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。Obtain the common emotional expressions of the target user, and store the common emotional expressions in a preset emotional expression storage area.
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:Further, the processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
检测目标用户,并确认所述目标用户是否为新用户;Detect the target user and confirm whether the target user is a new user;
若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。If it is confirmed that the target user is a new user, the step of acquiring the common emotional expression of the target user is performed.
参照图2,图2为本申请电视应用主题切换方法第一实施例的流程示意图,所述电视应用主题切换方法包括:Referring to FIG. 2, FIG. 2 is a schematic flowchart of a first embodiment of a method for switching a theme of a TV application of the present application. The method for switching a theme of a TV application includes:
步骤S10,采集目标用户的面部表情及语音信息;Step S10: Collect facial expressions and voice information of the target user;
根据当前的电视终端应用,采集目标用户的面部表情及语音信息。在采集所述目标用户的面部表情及语音信息时,所述目标用户指当前观看电视终端的电视节目的用户,可限定位置在固定/不固定的目标范围内的用户为所述目标用户。其目标用户的面部表情通过启用所述电视终端的摄像装置进行目标用户的面部表情抓取/拍摄,所述电视终端的摄像装置,可包括但不限于内置于所述电视终端的摄像头,或者与所述电视终端关联的其他电子设备的摄像头,如此,根据所述电视终端可控或者连接的电子设备的摄像头拍摄目标用户的面部表情。另外,在通过所述摄像头采集目标用户的面部表情时,根据采集到的面部表情确定用户是否存在情绪异常的问题,其情绪异常可定义为目标用户是否存在哭泣、愤怒或者其他已定义的情绪类型,可通过采集到的目标用户的面部表情进行情绪类型的初步确认,其确认方式可通过抓取到的目标用户的面部表情与预设的面部表情信息匹配确认,在根据所述面部表情确认目标用户的当前情绪异常时,由于通过面部表情确认用户情绪异常的方式可能存在用户情绪识别精确度低的问题,因此,可发起语音信息的采集操作,以通过采集目标用户的语音信息的方式进一步确认所述目标用户的情绪。其语音信息采集的方式可通过发起语音信息的采集提示信息实现,如此,所述采集目标用户的面部表情及语音信息的步骤,包括:According to the current TV terminal application, collect the facial expressions and voice information of the target user. When collecting facial expressions and voice information of the target user, the target user refers to a user currently watching a TV program of a TV terminal, and a user whose location is within a fixed/unfixed target range may be defined as the target user. The facial expression of the target user is used to capture/photograph the facial expression of the target user by enabling the camera device of the TV terminal. The camera device of the TV terminal may include, but is not limited to, a camera built into the TV terminal, or The camera of the other electronic device associated with the television terminal, in this way, captures the facial expression of the target user according to the camera of the electronic device controllable or connected to the television terminal. In addition, when collecting the facial expressions of the target user through the camera, it is determined whether the user has abnormal emotions based on the collected facial expressions. The abnormal emotions can be defined as whether the target user has crying, anger, or other defined emotion types , The initial confirmation of the emotion type can be performed by the collected facial expressions of the target user, and the confirmation method can be confirmed by matching the captured facial expressions of the target user with preset facial expression information, and then confirming the target according to the facial expressions When the user's current emotion is abnormal, since the method of confirming the user's emotional abnormality through facial expressions may have a problem of low accuracy of user emotion recognition, a voice information collection operation may be initiated to further confirm by collecting the target user's voice information The emotion of the target user. The way of collecting voice information can be achieved by initiating the collection of prompt information of voice information. Thus, the steps of collecting the facial expressions and voice information of the target user include:
发起语音信息采集的提示信息;Prompt information for initiating voice information collection;
采集所述目标用户基于所述提示信息发起的语音信息。Collect voice information initiated by the target user based on the prompt information.
在根据采集到的目标用户的面部表情确定用户情绪异常时,发起语音信息采集的提示信息。由于人类在情绪异常时,除了通过面部表情展现,还反映在语音信息上,因此,在实际应用中,本申请还通过采集目标用户语音信息的方式进一步确定目标用户的当前情绪,以提高目标用户情绪识别的精确度。另外,在发起语音信息采集的提示信息时,可通过在电视终端的屏幕上显示小悬浮框的形式发起,给目标用户缓冲时间避免吓到用户。如此,在根据采集到的面部表情确定用户情绪可能存在异常时,在电视终端的目标区域显示小悬浮框发起语音信息采集的提示信息。另外,考虑到用户体验,其发起采集语音信息的提示信息可通过询问或者对话的形式表现,以引导目标用户发出语音信息,进一步的,所述小悬浮框也可表现为拟人化的形式,例如小机器人等。如此,根据发起的语音信息采集提示信息,采集所述目标用户基于所述提示信息触发的语音信息。When it is determined that the user's emotion is abnormal according to the collected facial expressions of the target user, the prompt information for collecting voice information is initiated. When humans have abnormal emotions, in addition to their facial expressions, they are also reflected in the voice information. Therefore, in practical applications, this application further collects the target user's voice information to further determine the target user's current emotions to improve the target user The accuracy of emotion recognition. In addition, when the prompt information for voice information collection is initiated, it can be initiated by displaying a small floating frame on the screen of the TV terminal to buffer the target user to avoid scaring the user. In this way, when it is determined that the user's emotion may be abnormal according to the collected facial expressions, a prompt message for initiating voice information collection is displayed in the target area of the TV terminal by a small floating frame. In addition, considering the user experience, the prompt information for initiating the collection of voice information may be expressed in the form of an inquiry or a dialogue to guide the target user to issue voice information. Further, the small floating frame may also be represented in an anthropomorphic form, such as Small robots, etc. In this way, according to the initiated voice information collection prompt information, the voice information triggered by the target user based on the prompt information is collected.
另外,在采集用户语音信息时,若是存在环境声音可能会导致目标用户的语音采集出现问题,因此所述采集所述目标用户基于所述提示信息发起的语音信息的步骤,包括:In addition, when collecting user voice information, if there is environmental sound, it may cause problems for the target user's voice collection. Therefore, the step of collecting voice information initiated by the target user based on the prompt information includes:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;Reading the collected voice information, and confirming the source of the voice information according to the reading result;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。If it is confirmed that the voice information is the voice information of the target user, a step of collecting voice information initiated by the target user based on the prompt information is performed.
采集语音信息,并判断所述语音信息是否为所述目标用户的语音,所述确认方式可通过将接收到的所述语音信息与预存的所述目标用户的语音信息进行比对,其预存的所述目标用户的语音信息为提前存储在预设的语音存储区域的所述目标用户的历史语音信息,根据比对结果确认接收到的所述语音信息是否为所述目标用户的语音信息。在确认接收到的所述语音信息与预存的所述目标用户的语音信息比对一致时,确认接收到的所述语音信息为所述目标用户的语音,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。Collect voice information and determine whether the voice information is the voice of the target user. The confirmation method can be performed by comparing the received voice information with the pre-stored voice information of the target user. The voice information of the target user is historical voice information of the target user stored in advance in a preset voice storage area, and it is confirmed whether the received voice information is the voice information of the target user according to the comparison result. When it is confirmed that the received voice information is consistent with the pre-stored voice information of the target user, the received voice information is confirmed to be the voice of the target user, and the collection of the target user is performed based on the prompt Message-initiated voice message steps.
步骤S20,根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪;Step S20: Calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user with the emotion recognition data;
在采集到目标用户的面部表情及语音信息后,根据所述面部表情及语音信息计算所述目标用户的情绪识别数据,其中,以所述面部表情及语音信息决定所述情绪识别数据时,可通过相关的技术人员已设定的情绪识别数据计算公式或者情绪解析公式确定,如此,根据面部表情及语音信息计算到的所述目标用户的情绪识别数据确定所述目标用户的目标情绪,在通过情绪识别数据确定目标用户的目标情绪时,可能还存在相关的情绪阈值,根据计算到的情绪识别数据所处的所述情绪阈值的阈值范围,确定所述目标用户的目标情绪,而所述情绪阈值与已设定的情绪识别公式或情绪解析公式相关。After collecting the facial expressions and voice information of the target user, calculate the emotion recognition data of the target user based on the facial expressions and voice information, wherein, when determining the emotion recognition data with the facial expressions and voice information, Determined by the emotion recognition data calculation formula or emotion analysis formula that has been set by the relevant technicians. In this way, the target user’s target emotion is determined based on the facial recognition and voice information of the target user’s emotion recognition data. When the emotion recognition data determines the target emotion of the target user, there may be a related emotion threshold, and the target emotion of the target user is determined according to the threshold range of the emotion threshold calculated by the emotion recognition data, and the emotion The threshold is related to the set emotion recognition formula or emotion analysis formula.
进一步的,在人类产生情绪变化时,其情绪变化还会表现在心率上,如此,还可通过获取目标用户的心率数值进一步的精确目标用户的情绪变化,而心率的数据需要通过人体触摸心率测量设备进行获取,其心率测量设备包括但不限于手环及心率检测装备等,另外,考虑到电视终端需要通过获取心率进一步确定用户情绪如此所述心率检测设备需与所述电视终端存在数据传输通道,即存在连接关系,因此,在本申请方法中,建议用户配置一个特殊遥控器,可通过用户手握遥控器的方式监测到用户的心率。因此,所述根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:Furthermore, when humans produce emotional changes, their emotional changes will also be reflected in the heart rate. In this way, the target user’s emotional changes can be further accurately obtained by acquiring the target user’s heart rate value, and the heart rate data needs to be measured by human touch heart rate Equipment, the heart rate measuring equipment includes but is not limited to bracelets and heart rate detection equipment, etc. In addition, considering that the TV terminal needs to further determine the user's emotions by acquiring the heart rate, the heart rate detection device needs to have a data transmission channel with the TV terminal , That is, there is a connection relationship. Therefore, in the method of the present application, it is recommended that the user configure a special remote control, and the user's heart rate can be monitored by the user holding the remote control. Therefore, the step of calculating the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirming the target emotion of the target user with the emotion recognition data includes:
采集目标用户的心率数据;Collect the heart rate data of the target user;
以采集到的所述目标用户的心率数据优化所述情绪识别数据,以优化后的所述情绪识别数据确认所述目标用户的目标情绪。The emotion recognition data is optimized with the collected heart rate data of the target user, and the optimized emotion recognition data confirms the target emotion of the target user.
通过心率检测设备采集用户心率数据,以所述心率数据优化所述情绪识别数据,由于用户情绪变化时,不同的任务情绪会导致心率变化,而相同情绪的心率会保持在一定的情绪心率阈值中。因此,可通过采集的用户心率数据优化以计算到的所述情绪识别数据,并以优化后的所述情绪识别数据确认所述目标用户的目标情绪,其优化方式,可通过确认所述心率数据所在情绪心率阈值对应的目标情绪是否与所述情绪识别数据对应的目标情绪是否一致;或者通过采集到的所述心率数据输入预设的情绪识别数据计算公式或者情绪解析公式计算新的情绪识别数据,以实现通过所述心率数据优化所述情绪识别数据的目的。其中,在未能获取到所述目标用户的心率数据时,直接以计算到的所述情绪识别数据确认所述目标用户的目标情绪。Collect the user's heart rate data through the heart rate detection device, and optimize the emotion recognition data with the heart rate data. When the user's emotion changes, different task emotions will cause the heart rate to change, and the heart rate of the same emotion will remain at a certain emotional heart rate threshold . Therefore, the emotion recognition data calculated by the collected heart rate data of the user may be optimized, and the target emotion of the target user may be confirmed by the optimized emotion recognition data. The optimization method may be by confirming the heart rate data Whether the target emotion corresponding to the emotional heart rate threshold is consistent with the target emotion corresponding to the emotion recognition data; or input the preset emotion recognition data calculation formula or emotion analysis formula through the collected heart rate data to calculate new emotion recognition data To achieve the goal of optimizing the emotion recognition data through the heart rate data. When the heart rate data of the target user cannot be obtained, the target emotion of the target user is directly confirmed with the calculated emotion recognition data.
步骤S30,获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Step S30: Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
根据已计算到的所述情绪识别数据已确认的目标情绪,在预设的应用主题存储区域获取对应的目标应用主题,并将当前电视终端当前应用的应用主题切换至获取到的所述目标应用主题,其切换应用主题的方式与当前电视终端的应用主题切换方式相关,在此不多赘述。另外,所述预设的应用主题存储区域为所述电视终端划分的所述电视终端可应用或者已存储的应用主题的存储区域。Obtain the corresponding target application theme in the preset application theme storage area according to the calculated target emotion confirmed by the emotion recognition data, and switch the application theme currently applied by the current TV terminal to the acquired target application The theme, the method of switching the application theme is related to the current application terminal switching method of the TV terminal, and will not be repeated here. In addition, the preset application theme storage area is a storage area of application themes that can be applied or stored by the television terminal divided by the television terminal.
另外,考虑到电视终端的终端应用时内存消耗,在通过已确认的目标情绪获取对应的目标应用主题时,为降低内存消耗,可通过生成预定格式的目标应用主题标识,以所述目标应用主题标识直接获取对应的目标应用主题,即所述获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题的步骤之前,还包括:In addition, considering the memory consumption of the terminal application of the TV terminal, when acquiring the corresponding target application theme through the confirmed target emotion, in order to reduce the memory consumption, the target application theme identifier can be generated by generating a predetermined format to use the target application theme Before the step of directly acquiring the corresponding target application theme, that is, acquiring the target application theme corresponding to the target emotion, and switching the current application theme on the TV side to the target application theme, the method further includes:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。A target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
如上所示,在通过已确认的目标情绪获取对应的目标应用主题时,由于切换应用主题的操作一般是通过当前电视终端应用系统的相关功能实现,如此,在执行应用主题切换操作时,可根据所述应用主题切换功能许可的预设格式进行目标应用主题的获取,如此,将已确认的目标情绪通过预设格式的操作生成所述目标应用主题标识,其目标应用主题标识可限定于最节省内存的格式,例如数字等实现。根据已生成的目标应用主题标识,获取对应的目标应用主题,如此,在获取到对应的目标应用主题时,将电视终端当前的应用主题切换为所述目标应用主题。As shown above, when the corresponding target application theme is obtained through the confirmed target emotion, since the operation of switching the application theme is generally achieved through the relevant function of the current TV terminal application system, in this way, when performing the application theme switching operation, it can be based on The application theme switching function permits a preset format to acquire the target application theme. In this way, the confirmed target mood is generated through the preset format operation to generate the target application theme logo, the target application theme logo can be limited to the most economical The format of the memory, such as digital implementation. Acquire the corresponding target application theme according to the generated target application theme identifier. In this way, when the corresponding target application theme is acquired, the current application theme of the television terminal is switched to the target application theme.
本实施例中,通过开启电视的摄像头采集用户面部表情及用户语音信息确定用户情绪,进而根据用户情绪切换电视当前应用主题至预设的安慰主题,以实现根据用户情绪切换电视应用主题达到安慰用户情绪的目的。In this embodiment, the user's emotion is determined by turning on the camera of the TV to collect the user's facial expression and the user's voice information, and then switching the current TV application theme to the preset comfort theme according to the user emotion, so as to achieve the comfort of the user by switching the TV application theme according to the user emotion Emotional purpose.
进一步的,参照图3,图2为本申请电视应用主题切换方法第一实施例的流程示意图,基于上述所示的第一实施例,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:Further, referring to FIG. 3, FIG. 2 is a schematic flowchart of a first embodiment of a method for switching theme of a TV application according to the present application. Based on the first embodiment shown above, before the step of collecting facial expressions and voice information of a target user, Also includes:
步骤S40、检测目标用户,并判断所述目标用户是否为新用户;Step S40: Detect the target user and determine whether the target user is a new user;
步骤S50、在确认所述目标用户为新用户时,执行获取所述目标用户的常见情绪表情的步骤。Step S50: When it is confirmed that the target user is a new user, a step of acquiring common emotion expressions of the target user is performed.
步骤S60、获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。Step S60: Obtain the common emotion expressions of the target user, and store the common emotion expressions into a preset emotion expression storage area.
在本实施例中,为提高目标用户的面部表情识别精确度,可预先将目标用户的面部表情所展现的情绪数据存储在预设的情绪表情存储区域。如此,在初次使用摄像头采集用户面部表情进而确认用户情绪时,判断所述目标用户是否为新用户,其确认方式可通过确认检测到的所述目标用户是否有存储历史面部表情数据。在确认所述目标用户未存储历史面部表情数据时,确认所述目标用户为新用户,发出面部表情采集的提示信息,以引导用户面对摄像头展现各种情绪的面部表情,继而采集所述目标用户的面部表情,且识别所述面部表情所代表的情绪后,将所述面部表情及代表的情绪信息存储至预设的情绪表情存储区域。进一步的,在采集所述目标用户的常见情绪表情时,可通过所述常见情绪表情的表情内容为标识分别进行存储操作,例如采集到的用户的面部表情为喜悦时,以喜悦为标识将所述面部表情存储在所述预设的情绪表情存储区域。进一步的,为提高用户的面部表情的存储效率,在采集目标用户的常见情绪表情时,可通过发出提示语音引导用户展现指定情绪的面部表情进行面部表情采集及存储的操作,如此,可省略面部表情的识别过程,进而提高面部表情的存储效率。In this embodiment, in order to improve the accuracy of the facial expression recognition of the target user, the emotion data displayed by the facial expression of the target user may be stored in the preset emotional expression storage area in advance. In this way, when the camera is used for the first time to collect facial expressions of the user to confirm the user's emotions, it is determined whether the target user is a new user, and the confirmation method thereof may be by confirming whether the detected target user has stored historical facial expression data. When confirming that the target user does not store historical facial expression data, confirm that the target user is a new user, and issue a prompt message for facial expression collection to guide the user to display facial expressions of various emotions in front of the camera, and then collect the target After the user's facial expression and the emotion represented by the facial expression are recognized, the facial expression and the represented emotional information are stored in a preset emotional expression storage area. Further, when collecting the common emotional expressions of the target user, the common emotional expressions can be stored separately according to the identification content. For example, when the collected facial expression of the user is joy, the joy can be used as the identification The facial expression is stored in the preset emotional expression storage area. Further, in order to improve the storage efficiency of the user's facial expressions, when collecting the common emotional expressions of the target user, the user can issue a prompt voice to guide the user to display the facial expressions of the specified emotion for the operation of collecting and storing the facial expressions. Expression recognition process, which in turn improves the storage efficiency of facial expressions.
此外,本申请实施例还提出一种可读存储介质,所述可读存储介质上存储有电视应用主题切换程序,所述电视应用主题切换程序被处理器执行时实现如下操作:In addition, an embodiment of the present application further proposes a readable storage medium on which a TV application theme switching program is stored. When the TV application theme switching program is executed by a processor, the following operations are implemented:
采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
确认所述目标用户的历史面部表情数据;Confirm the historical facial expression data of the target user;
若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。If the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。The television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。Determine the target position of the collecting user, and collect the facial expressions and voice information of the target user in the confirmed target position.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
根据采集到的目标用户的面部表情确定用户情绪;Determine user emotions based on the collected facial expressions of the target user;
在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。When it is determined that the user's emotion is abnormal according to the facial expression, a voice information collection operation is initiated.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
采集目标用户的心率数据;Collect the heart rate data of the target user;
根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。The emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。Comparing the emotion recognition data with a preset emotion threshold, and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。Confirm a threshold range of the emotion threshold where the emotion recognition data is located, and confirm the target emotion according to the threshold range.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
发起语音信息采集的提示信息;Prompt information for initiating voice information collection;
采集所述目标用户基于所述提示信息发起的语音信息。Collect voice information initiated by the target user based on the prompt information.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
输出基于所述语音信息采集的提示信息的提示悬浮框。A prompt hovering box based on the prompt information collected by the voice information is output.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;Reading the collected voice information, and confirming the source of the voice information according to the reading result;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。If it is confirmed that the voice information is the voice information of the target user, a step of collecting voice information initiated by the target user based on the prompt information is performed.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
将所述语音信息与预存的所述目标用户的历史语音信息比对;Compare the voice information with pre-stored historical voice information of the target user;
根据比对结果确认所述语音信息的来源。Confirm the source of the voice information according to the comparison result.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。When it is confirmed that the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。A target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。Obtain the common emotional expressions of the target user, and store the common emotional expressions in a preset emotional expression storage area.
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:Further, when the TV application theme switching program is executed by the processor, the following operations are also implemented:
检测目标用户,并确认所述目标用户是否为新用户;Detect the target user and confirm whether the target user is a new user;
若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。If it is confirmed that the target user is a new user, the step of acquiring the common emotional expression of the target user is performed.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、药品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、药品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、药品或者系统中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, medicine or system that includes a series of elements includes not only those elements, It also includes other elements that are not explicitly listed, or include elements inherent to this process, method, drug, or system. Without more restrictions, the element defined by the sentence "include one..." does not exclude that there are other identical elements in the process, method, medicine, or system that includes the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The sequence numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above , Disk, CD), including several instructions to make a terminal device (which can be a mobile phone, computer, server, air conditioner, or network equipment, etc.) to perform the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only preferred embodiments of the present application, and do not limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by the description and drawings of this application, or directly or indirectly used in other related technical fields The same reason is included in the patent protection scope of this application.

Claims (19)

  1. 一种电视应用主题切换方法,其中,所述电视应用主题切换方法包括以下步骤: A TV application theme switching method, wherein the TV application theme switching method includes the following steps:
    采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
    根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
    获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
  2. 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括: The TV application theme switching method of claim 1, wherein before the step of collecting facial expressions and voice information of the target user, the method further comprises:
    确认所述目标用户的历史面部表情数据;Confirm the historical facial expression data of the target user;
    若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。If the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
  3. 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括: The TV application theme switching method of claim 1, wherein before the step of collecting facial expressions and voice information of the target user, the method further comprises:
    启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。The television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
  4. 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤,包括:The TV application theme switching method according to claim 1, wherein the step of collecting facial expressions and voice information of the target user includes:
    确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。Determine the target position of the collecting user, and collect the facial expressions and voice information of the target user in the confirmed target position.
  5. 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤,包括: The TV application theme switching method according to claim 1, wherein the step of collecting facial expressions and voice information of the target user includes:
    根据采集到的目标用户的面部表情确定用户情绪;Determine user emotions based on the collected facial expressions of the target user;
    在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。When it is determined that the user's emotion is abnormal according to the facial expression, a voice information collection operation is initiated.
  6. 如权利要求1所述的电视应用主题切换方法,其中,所述根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括: The TV application theme switching method according to claim 1, wherein the emotion recognition data of the target user is calculated based on the collected facial expressions and voice information, and the goal of the target user is confirmed according to the emotion recognition data Emotional steps include:
    采集目标用户的心率数据;Collect the heart rate data of the target user;
    根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。The emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
  7. 如权利要求6所述的电视应用主题切换方法,其特征在于,所述根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括: The TV application theme switching method according to claim 6, wherein the emotion recognition data is optimized according to the collected heart rate data of the target user, and the goal is confirmed by the optimized emotion recognition data The steps of the user's target emotions include:
    将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。Comparing the emotion recognition data with a preset emotion threshold, and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold.
  8. 如权利要求7所述的电视应用主题切换方法,其中,所述将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪的步骤之后,包括: The TV application theme switching method according to claim 7, wherein the step of comparing the emotion recognition data with a preset emotion threshold and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold After that, including:
    确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。Confirm a threshold range of the emotion threshold where the emotion recognition data is located, and confirm the target emotion according to the threshold range.
  9. 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤,包括: The TV application theme switching method according to claim 1, wherein the step of collecting facial expressions and voice information of the target user includes:
    发起语音信息采集的提示信息;Prompt information for initiating voice information collection;
    采集所述目标用户基于所述提示信息发起的语音信息。Collect voice information initiated by the target user based on the prompt information.
  10. 如权利要求9所述的电视应用主题切换方法,其中,所述发起语音信息采集的提示信息的步骤,包括: The TV application theme switching method according to claim 9, wherein the step of initiating prompt information for collecting voice information includes:
    输出基于所述语音信息采集的提示信息的提示悬浮框。A prompt hovering box based on the prompt information collected by the voice information is output.
  11. 如权利要求9所述的电视应用主题切换方法,其中,所述采集所述目标用户基于所述提示信息发起的语音信息的步骤,包括: The TV application theme switching method according to claim 9, wherein the step of collecting voice information initiated by the target user based on the prompt information includes:
    读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;Reading the collected voice information, and confirming the source of the voice information according to the reading result;
    若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。If it is confirmed that the voice information is the voice information of the target user, a step of collecting voice information initiated by the target user based on the prompt information is performed.
  12. 如权利要求11所述的电视应用主题切换方法,其中,所述读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源的步骤,包括: The TV application theme switching method according to claim 11, wherein the step of reading the collected voice information and confirming the source of the voice information according to the reading result includes:
    将所述语音信息与预存的所述目标用户的历史语音信息比对;Compare the voice information with pre-stored historical voice information of the target user;
    根据比对结果确认所述语音信息的来源。Confirm the source of the voice information according to the comparison result.
  13. 如权利要求12所述的电视应用主题切换方法,其中,所述将所述语音信息与预存的所述目标用户的历史语音信息比对的步骤之后,还包括:The TV application theme switching method according to claim 12, wherein after the step of comparing the voice information with pre-stored historical voice information of the target user, the method further comprises:
    在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。When it is confirmed that the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
  14. 如权利要求1所述的电视应用主题切换方法,其中,所述获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题的步骤之前,还包括:The TV application theme switching method according to claim 1, wherein before the step of acquiring the target application theme corresponding to the target emotion and switching the current application theme on the TV side to the target application theme, further comprising:
    通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。A target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
  15. 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:The TV application theme switching method of claim 1, wherein before the step of collecting facial expressions and voice information of the target user, the method further comprises:
    获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。Obtain the common emotional expressions of the target user, and store the common emotional expressions in a preset emotional expression storage area.
  16. 如权利要求15所述的电视应用主题切换方法,其中,所述获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域的步骤之前,还包括:The TV application theme switching method according to claim 15, wherein before the step of acquiring the common emotional expressions of the target user and storing the common emotional expressions into a preset emotional expression storage area, the method further comprises:
    检测目标用户,并确认所述目标用户是否为新用户;Detect the target user and confirm whether the target user is a new user;
    若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。If it is confirmed that the target user is a new user, the step of acquiring the common emotional expression of the target user is performed.
  17. 一种电视,其中,所述电视包括:A TV, wherein the TV includes:
    采集模块,设置为采集目标用户的面部表情及语音信息;The collection module is set to collect facial expressions and voice information of the target user;
    确认模块,设置为根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;The confirmation module is configured to calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user according to the emotion recognition data;
    切换模块,设置为获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。The switching module is configured to obtain a target application theme corresponding to the target emotion, and switch a current application theme on the TV side to the target application theme.
  18. 一种可读存储介质,其中,所述可读存储介质存储有电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下步骤:A readable storage medium, wherein the readable storage medium stores a TV application theme switching program, and the TV application theme switching program includes the following steps when executed:
    采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
    根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
    获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
  19. 一种电视应用主题切换设备,其中,所述电视应用主题切换设备包括存储器、处理器及存储在存储器上并可在处理器上运行的电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下的步骤:A TV application theme switching device, wherein the TV application theme switching device includes a memory, a processor, and a TV application theme switching program stored on the memory and running on the processor, when the TV application theme switching program is executed It includes the following steps:
    采集目标用户的面部表情及语音信息;Collect facial expressions and voice information of target users;
    根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;Calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data;
    获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
PCT/CN2019/127426 2018-12-28 2019-12-23 Television application theme switching method, television, readable storage medium, and device WO2020135334A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811632356.1 2018-12-28
CN201811632356.1A CN109672937A (en) 2018-12-28 2018-12-28 TV applications method for switching theme, TV, readable storage medium storing program for executing and system

Publications (1)

Publication Number Publication Date
WO2020135334A1 true WO2020135334A1 (en) 2020-07-02

Family

ID=66146627

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/127426 WO2020135334A1 (en) 2018-12-28 2019-12-23 Television application theme switching method, television, readable storage medium, and device

Country Status (2)

Country Link
CN (1) CN109672937A (en)
WO (1) WO2020135334A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109672937A (en) * 2018-12-28 2019-04-23 深圳Tcl数字技术有限公司 TV applications method for switching theme, TV, readable storage medium storing program for executing and system
CN110298242A (en) * 2019-05-22 2019-10-01 深圳壹账通智能科技有限公司 APP method for switching theme, device, equipment and storage medium based on research and development management
CN110502609B (en) * 2019-07-11 2022-03-08 江苏心涧康科技有限公司 Method and device for adjusting emotion and accompanying robot
CN110598611B (en) * 2019-08-30 2023-06-09 深圳智慧林网络科技有限公司 Nursing system, patient nursing method based on nursing system and readable storage medium
CN110825503B (en) * 2019-10-12 2024-03-19 平安科技(深圳)有限公司 Theme switching method and device, storage medium and server
CN111772648A (en) * 2020-06-10 2020-10-16 南京七岩电子科技有限公司 Method and device for judging emotion by combining HRV signal and facial expression
CN112667129B (en) * 2020-12-17 2022-12-02 展讯通信(天津)有限公司 Interface theme switching method and device, terminal and storage medium
CN113485557A (en) * 2021-07-20 2021-10-08 浙江工商职业技术学院 Virtual reality emotion control method and device
CN115695638B (en) * 2022-12-28 2023-06-06 深圳市心流科技有限公司 APP theme scene control method and device, terminal equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102523502A (en) * 2011-12-15 2012-06-27 四川长虹电器股份有限公司 Intelligent television interaction system and interaction method
CN103618918A (en) * 2013-11-27 2014-03-05 青岛海信电器股份有限公司 Method and device for controlling display of smart television
WO2014119900A1 (en) * 2013-01-29 2014-08-07 Lee Jong Sik Smart device having user interface based on human emotions or inclinations, and user interface method
CN105549841A (en) * 2015-12-02 2016-05-04 小天才科技有限公司 Voice interaction method, device and equipment
CN106658129A (en) * 2016-12-27 2017-05-10 上海智臻智能网络科技股份有限公司 Emotion-based terminal control method and apparatus, and terminal
CN107992199A (en) * 2017-12-19 2018-05-04 广东小天才科技有限公司 A kind of Emotion identification method, system and electronic equipment for electronic equipment
CN108491244A (en) * 2018-03-20 2018-09-04 深圳市万普拉斯科技有限公司 A kind of Desktop-scene switching method, device and user terminal
CN109672937A (en) * 2018-12-28 2019-04-23 深圳Tcl数字技术有限公司 TV applications method for switching theme, TV, readable storage medium storing program for executing and system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103530912A (en) * 2013-09-27 2014-01-22 深圳市迈瑞思智能技术有限公司 Attendance recording system having emotion identification function, and method thereof
KR101480668B1 (en) * 2014-03-21 2015-01-26 충남대학교산학협력단 Mobile Terminal Having Emotion Recognition Application using Voice and Method for Controlling thereof
US20150310760A1 (en) * 2014-04-24 2015-10-29 Mobilify Technology, Inc. System and method for smoking cessation
CN104023125A (en) * 2014-05-14 2014-09-03 上海卓悠网络科技有限公司 Method and terminal capable of automatically switching system scenes according to user emotion
CN107479801B (en) * 2017-07-31 2020-06-02 Oppo广东移动通信有限公司 Terminal display method and device based on user expression and terminal
CN108960024A (en) * 2017-09-19 2018-12-07 炬大科技有限公司 A kind of Emotion identification method based on personal user
CN107765852A (en) * 2017-10-11 2018-03-06 北京光年无限科技有限公司 Multi-modal interaction processing method and system based on visual human

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102523502A (en) * 2011-12-15 2012-06-27 四川长虹电器股份有限公司 Intelligent television interaction system and interaction method
WO2014119900A1 (en) * 2013-01-29 2014-08-07 Lee Jong Sik Smart device having user interface based on human emotions or inclinations, and user interface method
CN103618918A (en) * 2013-11-27 2014-03-05 青岛海信电器股份有限公司 Method and device for controlling display of smart television
CN105549841A (en) * 2015-12-02 2016-05-04 小天才科技有限公司 Voice interaction method, device and equipment
CN106658129A (en) * 2016-12-27 2017-05-10 上海智臻智能网络科技股份有限公司 Emotion-based terminal control method and apparatus, and terminal
CN107992199A (en) * 2017-12-19 2018-05-04 广东小天才科技有限公司 A kind of Emotion identification method, system and electronic equipment for electronic equipment
CN108491244A (en) * 2018-03-20 2018-09-04 深圳市万普拉斯科技有限公司 A kind of Desktop-scene switching method, device and user terminal
CN109672937A (en) * 2018-12-28 2019-04-23 深圳Tcl数字技术有限公司 TV applications method for switching theme, TV, readable storage medium storing program for executing and system

Also Published As

Publication number Publication date
CN109672937A (en) 2019-04-23

Similar Documents

Publication Publication Date Title
WO2020135334A1 (en) Television application theme switching method, television, readable storage medium, and device
CN107370649B (en) Household appliance control method, system, control terminal and storage medium
TWI665584B (en) A voice controlling system and method
CN105471705B (en) Intelligent control method, equipment and system based on instant messaging
US9804822B2 (en) Electronic apparatus and control method thereof
CN108023934B (en) Electronic device and control method thereof
CN108351890B (en) Electronic device and operation method thereof
CN107544272B (en) Terminal control method, device and storage medium
WO2020168571A1 (en) Device control method, apparatus, system, electronic device and cloud server
WO2020192222A1 (en) Method and device for intelligent analysis of user context and storage medium
KR102481486B1 (en) Method and apparatus for providing audio
KR101978299B1 (en) Apparatus for service contents in contents service system
US20190051147A1 (en) Remote control method, apparatus, terminal device, and computer readable storage medium
KR102549570B1 (en) Image text broadcasting method and device, electronic circuit and storage medium
JP2021034003A (en) Human object recognition method, apparatus, electronic device, storage medium, and program
WO2019223056A1 (en) Gesture recognition-based teaching and learning method and apparatus
KR102437135B1 (en) Electronic device for processing image and method for controlling thereof
CN110822641A (en) Air conditioner, control method and device thereof and readable storage medium
CN111984180B (en) Terminal screen reading method, device, equipment and computer readable storage medium
WO2022222510A1 (en) Interaction control method, terminal device, and storage medium
WO2020192215A1 (en) Interactive method and wearable interactive device
US10691717B2 (en) Method and apparatus for managing data
WO2019119643A1 (en) Interaction terminal and method for mobile live broadcast, and computer-readable storage medium
JP6973380B2 (en) Information processing device and information processing method
CN103905837A (en) Image processing method and device and terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19903720

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 19/10/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19903720

Country of ref document: EP

Kind code of ref document: A1