WO2020135334A1 - 电视应用主题切换方法、电视、可读存储介质及设备 - Google Patents
电视应用主题切换方法、电视、可读存储介质及设备 Download PDFInfo
- Publication number
- WO2020135334A1 WO2020135334A1 PCT/CN2019/127426 CN2019127426W WO2020135334A1 WO 2020135334 A1 WO2020135334 A1 WO 2020135334A1 CN 2019127426 W CN2019127426 W CN 2019127426W WO 2020135334 A1 WO2020135334 A1 WO 2020135334A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target
- voice information
- target user
- emotion
- application theme
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
Definitions
- the present application relates to the technical field of television applications, in particular to a method for switching theme of television applications, television, readable storage medium and equipment.
- the application themes on TV are generally fixed after development, even if some weather applications can dynamically switch with the changes of the weather, but they can not achieve the intelligent effect. Due to the current intelligent development, users have higher requirements for changing the theme of TV applications, and the focus of the existing intelligent development is still the user experience. If the user's mood changes while watching TV programs, the current TV application The theme can be switched to the corresponding mood soothing theme, which can improve the user experience to a certain extent, but the prior art TV has not yet achieved the effect of switching the application theme according to the user's mood.
- the main purpose of the present application is to provide a method for switching theme of TV application, TV, readable storage medium and device.
- the aim is to solve the technical problem that the prior art television cannot switch the application theme according to the user's mood, and thus cannot achieve the effect of comforting the user's mood.
- this application provides a method for switching theme of TV application, including the following contents:
- the method before the step of collecting facial expressions and voice information of the target user, the method further includes:
- the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
- the method before the step of collecting facial expressions and voice information of the target user, the method further includes:
- the television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
- the step of collecting facial expressions and voice information of the target user includes:
- the step of collecting facial expressions and voice information of the target user includes:
- a voice information collection operation is initiated.
- the step of calculating the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirming the target emotion of the target user according to the emotion recognition data includes:
- the emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
- the step of optimizing the emotion recognition data according to the collected heart rate data of the target user, and confirming the target emotion of the target user by the optimized emotion recognition data includes:
- the step of comparing the emotion recognition data with a preset emotion threshold and confirming the target emotion of the emotion recognition data according to the comparison result of the emotion threshold includes:
- the step of collecting facial expressions and voice information of the target user includes:
- the step of initiating the prompt information of voice information collection includes:
- a prompt hovering box based on the prompt information collected by the voice information is output.
- the step of collecting voice information initiated by the target user based on the prompt information includes:
- a step of collecting voice information initiated by the target user based on the prompt information is performed.
- the step of reading the collected voice information and confirming the source of the voice information according to the reading result includes:
- the method further includes:
- the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
- the method before the step of acquiring the target application theme corresponding to the target emotion and switching the current application theme on the TV side to the target application theme, the method further includes:
- a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
- the method before the step of collecting facial expressions and voice information of the target user, the method further includes:
- the method before the step of acquiring the common emotional expressions of the target user and storing the common emotional expressions in a preset emotional expression storage area, the method further includes:
- the step of acquiring the common emotional expression of the target user is performed.
- the present application also provides a TV
- the TV includes:
- the collection module is set to collect facial expressions and voice information of the target user
- the confirmation module is configured to calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user according to the emotion recognition data;
- the switching module is configured to obtain a target application theme corresponding to the target emotion, and switch a current application theme on the TV side to the target application theme.
- the present application also provides a readable storage medium that stores a TV application theme switching program, and the TV application theme switching program includes the following steps when executed:
- the present application also provides a TV application theme switching device.
- the TV application theme switching device includes a memory, a processor, and a TV application theme switching program stored on the memory and executable on the processor.
- the TV application theme switching program The implementation includes the following steps:
- FIG. 1 is a schematic diagram of a terminal ⁇ device structure of a hardware operating environment involved in an embodiment of the present application
- FIG. 2 is a schematic flowchart of a first embodiment of a method for switching theme of a TV application of the present application
- FIG. 3 is a schematic flowchart of a second embodiment of a method for switching theme of a TV application of the present application.
- the main solutions of the embodiments of the present application are: collecting the facial expressions and voice information of the target user; calculating the emotion recognition data of the target user according to the collected facial expressions and voice information, and confirming the target with the emotion recognition data The user's target emotion; obtain the target application theme corresponding to the target emotion, and switch the current TV application theme to the target application theme.
- This application provides a solution to determine the user's emotions by turning on the camera of the TV to collect the user's facial expressions and user's voice information, and then switch the current TV application theme to the preset comfort theme according to the user's emotions, , To achieve the purpose of comforting users' emotions.
- FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution of an embodiment of the present application.
- the terminal may be a PC, or may be a mobile or non-removable terminal device such as a smart phone, tablet computer, e-book reader, or portable computer.
- the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
- the communication bus 1002 is used to implement connection communication between these components.
- the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface and a wireless interface.
- the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
- the memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory), such as a magnetic disk memory.
- the memory 1005 may optionally be a storage device independent of the foregoing processor 1001.
- FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than those illustrated, or combine certain components, or have different component arrangements.
- the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a TV application theme switching application program.
- the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server;
- the user interface 1003 is mainly used to connect to the client (user side) and perform data communication with the client; and the processor 1001 can be used to call the TV application theme switching application stored in the memory 1005 and perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- the television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- a voice information collection operation is initiated.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- the emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- a prompt hovering box based on the prompt information collected by the voice information is output.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- a step of collecting voice information initiated by the target user based on the prompt information is performed.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- processor 1001 may call the TV application theme switching application stored in the memory 1005, and also perform the following operations:
- the step of acquiring the common emotional expression of the target user is performed.
- FIG. 2 is a schematic flowchart of a first embodiment of a method for switching a theme of a TV application of the present application.
- the method for switching a theme of a TV application includes:
- Step S10 Collect facial expressions and voice information of the target user
- the target user refers to a user currently watching a TV program of a TV terminal, and a user whose location is within a fixed/unfixed target range may be defined as the target user.
- the facial expression of the target user is used to capture/photograph the facial expression of the target user by enabling the camera device of the TV terminal.
- the camera device of the TV terminal may include, but is not limited to, a camera built into the TV terminal, or The camera of the other electronic device associated with the television terminal, in this way, captures the facial expression of the target user according to the camera of the electronic device controllable or connected to the television terminal.
- the steps of collecting the facial expressions and voice information of the target user include:
- the prompt information for collecting voice information is initiated.
- humans have abnormal emotions, in addition to their facial expressions, they are also reflected in the voice information. Therefore, in practical applications, this application further collects the target user's voice information to further determine the target user's current emotions to improve the target user The accuracy of emotion recognition.
- the prompt information for voice information collection it can be initiated by displaying a small floating frame on the screen of the TV terminal to buffer the target user to avoid scaring the user.
- a prompt message for initiating voice information collection is displayed in the target area of the TV terminal by a small floating frame.
- the prompt information for initiating the collection of voice information may be expressed in the form of an inquiry or a dialogue to guide the target user to issue voice information.
- the small floating frame may also be represented in an anthropomorphic form, such as Small robots, etc. In this way, according to the initiated voice information collection prompt information, the voice information triggered by the target user based on the prompt information is collected.
- the step of collecting voice information initiated by the target user based on the prompt information includes:
- a step of collecting voice information initiated by the target user based on the prompt information is performed.
- the confirmation method can be performed by comparing the received voice information with the pre-stored voice information of the target user.
- the voice information of the target user is historical voice information of the target user stored in advance in a preset voice storage area, and it is confirmed whether the received voice information is the voice information of the target user according to the comparison result.
- the received voice information is confirmed to be the voice of the target user, and the collection of the target user is performed based on the prompt Message-initiated voice message steps.
- Step S20 Calculate the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirm the target emotion of the target user with the emotion recognition data;
- the target user After collecting the facial expressions and voice information of the target user, calculate the emotion recognition data of the target user based on the facial expressions and voice information, wherein, when determining the emotion recognition data with the facial expressions and voice information, Determined by the emotion recognition data calculation formula or emotion analysis formula that has been set by the relevant technicians.
- the target user determines target emotion of the target user
- there may be a related emotion threshold and the target emotion of the target user is determined according to the threshold range of the emotion threshold calculated by the emotion recognition data, and the emotion The threshold is related to the set emotion recognition formula or emotion analysis formula.
- the target user’s emotional changes can be further accurately obtained by acquiring the target user’s heart rate value, and the heart rate data needs to be measured by human touch heart rate Equipment, the heart rate measuring equipment includes but is not limited to bracelets and heart rate detection equipment, etc.
- the heart rate detection device needs to have a data transmission channel with the TV terminal , That is, there is a connection relationship. Therefore, in the method of the present application, it is recommended that the user configure a special remote control, and the user's heart rate can be monitored by the user holding the remote control. Therefore, the step of calculating the emotion recognition data of the target user based on the collected facial expressions and voice information, and confirming the target emotion of the target user with the emotion recognition data includes:
- the emotion recognition data is optimized with the collected heart rate data of the target user, and the optimized emotion recognition data confirms the target emotion of the target user.
- the user's heart rate data Collect the user's heart rate data through the heart rate detection device, and optimize the emotion recognition data with the heart rate data.
- the emotion recognition data calculated by the collected heart rate data of the user may be optimized, and the target emotion of the target user may be confirmed by the optimized emotion recognition data.
- the optimization method may be by confirming the heart rate data Whether the target emotion corresponding to the emotional heart rate threshold is consistent with the target emotion corresponding to the emotion recognition data; or input the preset emotion recognition data calculation formula or emotion analysis formula through the collected heart rate data to calculate new emotion recognition data To achieve the goal of optimizing the emotion recognition data through the heart rate data.
- the target emotion of the target user is directly confirmed with the calculated emotion recognition data.
- Step S30 Obtain the target application theme corresponding to the target emotion, and switch the current application theme on the TV side to the target application theme.
- the preset application theme storage area is a storage area of application themes that can be applied or stored by the television terminal divided by the television terminal.
- the target application theme identifier can be generated by generating a predetermined format to use the target application theme before the step of directly acquiring the corresponding target application theme, that is, acquiring the target application theme corresponding to the target emotion, and switching the current application theme on the TV side to the target application theme, the method further includes:
- a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
- the corresponding target application theme is obtained through the confirmed target emotion
- the operation of switching the application theme is generally achieved through the relevant function of the current TV terminal application system
- it can be based on The application theme switching function permits a preset format to acquire the target application theme.
- the confirmed target mood is generated through the preset format operation to generate the target application theme logo
- the target application theme logo can be limited to the most economical The format of the memory, such as digital implementation.
- the user's emotion is determined by turning on the camera of the TV to collect the user's facial expression and the user's voice information, and then switching the current TV application theme to the preset comfort theme according to the user emotion, so as to achieve the comfort of the user by switching the TV application theme according to the user emotion Emotional purpose.
- FIG. 2 is a schematic flowchart of a first embodiment of a method for switching theme of a TV application according to the present application. Based on the first embodiment shown above, before the step of collecting facial expressions and voice information of a target user, also includes:
- Step S40 Detect the target user and determine whether the target user is a new user
- Step S50 When it is confirmed that the target user is a new user, a step of acquiring common emotion expressions of the target user is performed.
- Step S60 Obtain the common emotion expressions of the target user, and store the common emotion expressions into a preset emotion expression storage area.
- the emotion data displayed by the facial expression of the target user may be stored in the preset emotional expression storage area in advance.
- the confirmation method thereof may be by confirming whether the detected target user has stored historical facial expression data.
- the facial expression and the represented emotional information are stored in a preset emotional expression storage area.
- the common emotional expressions can be stored separately according to the identification content. For example, when the collected facial expression of the user is joy, the joy can be used as the identification The facial expression is stored in the preset emotional expression storage area.
- the user when collecting the common emotional expressions of the target user, the user can issue a prompt voice to guide the user to display the facial expressions of the specified emotion for the operation of collecting and storing the facial expressions.
- Expression recognition process which in turn improves the storage efficiency of facial expressions.
- an embodiment of the present application further proposes a readable storage medium on which a TV application theme switching program is stored.
- the TV application theme switching program is executed by a processor, the following operations are implemented:
- the target user does not store historical facial expression data, it is confirmed that the target user is a new user, and prompt information for facial expression collection is output.
- the television-enabled camera device executes the step of collecting facial expressions and voice information of the target user through the activated camera device.
- a voice information collection operation is initiated.
- the emotion recognition data is optimized according to the collected heart rate data of the target user, and the target emotion of the target user is confirmed by the optimized emotion recognition data.
- a prompt hovering box based on the prompt information collected by the voice information is output.
- a step of collecting voice information initiated by the target user based on the prompt information is performed.
- the voice information is consistent with the pre-stored historical voice information, it is confirmed that the voice information is the voice information of the target user.
- a target application theme identifier in a preset format is generated through the target emotion, and a corresponding target application theme is obtained through the target application theme identifier.
- the step of acquiring the common emotional expression of the target user is performed.
- the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware, but in many cases the former is better Implementation.
- the technical solution of the present application can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above , Disk, CD), including several instructions to make a terminal device (which can be a mobile phone, computer, server, air conditioner, or network equipment, etc.) to perform the method described in each embodiment of the present application.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本申请公开了一种电视应用主题切换方法,包括:采集目标用户的面部表情及语音信息;根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪;获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。本申请还公开了一种电视、可读存储介质及设备。
Description
本申请要求2018年12月28日申请的,申请号201811632356.1,名称为“电视应用主题切换方法、电视、可读存储介质及系统”的中国专利申请的优先权,在此将其全文引入作为参考。
本申请涉及电视应用技术领域,尤其涉及一种电视应用主题切换方法、电视、可读存储介质及设备。
目前,电视上的应用主题一般都是开发好后固定不变的,即使有些天气类应用可以跟随天气的变化动态切换,但是都达不到智能化的效果。由于现在智能化的发展,用户对电视的应用主题切换的要求更改的需求更高,并且,现有智能化发展的着重点还是用户体验,若是用户在观看电视节目发生心情变化,当前电视的应用主题可切换至对应的心情抚慰主题,则可在一定程度上提高用户体验,但现有技术的电视还无法实现根据用户心情切换应用主题的效果。
本申请的主要目的在于提供一种电视应用主题切换方法、电视、可读存储介质及设备。旨在解决现有技术的电视还无法实现根据用户心情切换应用主题的技术问题,进而无法达到安慰观看用户的心情的效果。
为实现上述目的,本申请提供一种电视应用主题切换方法,包括以下内容:
采集目标用户的面部表情及语音信息;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:
确认所述目标用户的历史面部表情数据;
若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:
启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤,包括:
确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤,包括:
根据采集到的目标用户的面部表情确定用户情绪;
在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。
在一些实施方式中,所述根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:
采集目标用户的心率数据;
根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。
在一些实施方式中,所述根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:
将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。
在一些实施方式中,所述将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪的步骤之后,包括:
确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤,包括:
发起语音信息采集的提示信息;
采集所述目标用户基于所述提示信息发起的语音信息。
在一些实施方式中,所述发起语音信息采集的提示信息的步骤,包括:
输出基于所述语音信息采集的提示信息的提示悬浮框。
在一些实施方式中,所述采集所述目标用户基于所述提示信息发起的语音信息的步骤,包括:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。
在一些实施方式中,所述读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源的步骤,包括:
将所述语音信息与预存的所述目标用户的历史语音信息比对;
根据比对结果确认所述语音信息的来源。
在一些实施方式中,所述将所述语音信息与预存的所述目标用户的历史语音信息比对的步骤之后,还包括:
在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。
在一些实施方式中,所述获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题的步骤之前,还包括:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。
在一些实施方式中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:
获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。
在一些实施方式中,所述获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域的步骤之前,还包括:
检测目标用户,并确认所述目标用户是否为新用户;
若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。
此外,为实现上述目的,本申请还提供一种电视,所述电视包括:
采集模块,设置为采集目标用户的面部表情及语音信息;
确认模块,设置为根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;
切换模块,设置为获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
本申请还提供一种可读存储介质,所述可读存储介质存储有电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下步骤:
采集目标用户的面部表情及语音信息;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
本申请还提供一种电视应用主题切换设备,所述电视应用主题切换设备包括存储器、处理器及存储在存储器上并可在处理器上运行的电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下的步骤:
采集目标用户的面部表情及语音信息;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
图1是本申请实施例方案涉及的硬件运行环境的终端\装置结构示意图;
图2为本申请电视应用主题切换方法第一实施例的流程示意图;
图3为本申请电视应用主题切换方法第二实施例的流程示意图。
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。
本申请实施例的主要解决方案是:采集目标用户的面部表情及语音信息;根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪;获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
由于现有技术电视还无法实现根据用户心情切换应用主题的技术问题。
本申请提供一种解决方案,通过开启电视的摄像头采集用户面部表情及用户语音信息确定用户情绪,进而根据用户情绪切换电视当前应用主题至预设的安慰主题,通过实现通过用户情绪切换电视应用主题,达到安慰用户情绪的目的。
如图1所示,图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图。
本申请实施例终端可以是PC,也可以是智能手机、平板电脑、电子书阅读器,便携计算机等可移动式或不可移动式终端设备。
如图1所示,该终端可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。
本领域技术人员可以理解,图1中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及电视应用主题切换应用程序。
在图1所示的终端中,网络接口1004主要用于连接后台服务器,与后台服务器进行数据通信;用户接口1003主要用于连接客户端(用户端),与客户端进行数据通信;而处理器1001可以用于调用存储器1005中存储的电视应用主题切换应用程序,并执行以下操作:
采集目标用户的面部表情及语音信息;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
确认所述目标用户的历史面部表情数据;
若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
根据采集到的目标用户的面部表情确定用户情绪;
在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
采集目标用户的心率数据;
根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
发起语音信息采集的提示信息;
采集所述目标用户基于所述提示信息发起的语音信息。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
输出基于所述语音信息采集的提示信息的提示悬浮框。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
将所述语音信息与预存的所述目标用户的历史语音信息比对;
根据比对结果确认所述语音信息的来源。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。
进一步地,处理器1001可以调用存储器1005中存储的电视应用主题切换应用程序,还执行以下操作:
检测目标用户,并确认所述目标用户是否为新用户;
若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。
参照图2,图2为本申请电视应用主题切换方法第一实施例的流程示意图,所述电视应用主题切换方法包括:
步骤S10,采集目标用户的面部表情及语音信息;
根据当前的电视终端应用,采集目标用户的面部表情及语音信息。在采集所述目标用户的面部表情及语音信息时,所述目标用户指当前观看电视终端的电视节目的用户,可限定位置在固定/不固定的目标范围内的用户为所述目标用户。其目标用户的面部表情通过启用所述电视终端的摄像装置进行目标用户的面部表情抓取/拍摄,所述电视终端的摄像装置,可包括但不限于内置于所述电视终端的摄像头,或者与所述电视终端关联的其他电子设备的摄像头,如此,根据所述电视终端可控或者连接的电子设备的摄像头拍摄目标用户的面部表情。另外,在通过所述摄像头采集目标用户的面部表情时,根据采集到的面部表情确定用户是否存在情绪异常的问题,其情绪异常可定义为目标用户是否存在哭泣、愤怒或者其他已定义的情绪类型,可通过采集到的目标用户的面部表情进行情绪类型的初步确认,其确认方式可通过抓取到的目标用户的面部表情与预设的面部表情信息匹配确认,在根据所述面部表情确认目标用户的当前情绪异常时,由于通过面部表情确认用户情绪异常的方式可能存在用户情绪识别精确度低的问题,因此,可发起语音信息的采集操作,以通过采集目标用户的语音信息的方式进一步确认所述目标用户的情绪。其语音信息采集的方式可通过发起语音信息的采集提示信息实现,如此,所述采集目标用户的面部表情及语音信息的步骤,包括:
发起语音信息采集的提示信息;
采集所述目标用户基于所述提示信息发起的语音信息。
在根据采集到的目标用户的面部表情确定用户情绪异常时,发起语音信息采集的提示信息。由于人类在情绪异常时,除了通过面部表情展现,还反映在语音信息上,因此,在实际应用中,本申请还通过采集目标用户语音信息的方式进一步确定目标用户的当前情绪,以提高目标用户情绪识别的精确度。另外,在发起语音信息采集的提示信息时,可通过在电视终端的屏幕上显示小悬浮框的形式发起,给目标用户缓冲时间避免吓到用户。如此,在根据采集到的面部表情确定用户情绪可能存在异常时,在电视终端的目标区域显示小悬浮框发起语音信息采集的提示信息。另外,考虑到用户体验,其发起采集语音信息的提示信息可通过询问或者对话的形式表现,以引导目标用户发出语音信息,进一步的,所述小悬浮框也可表现为拟人化的形式,例如小机器人等。如此,根据发起的语音信息采集提示信息,采集所述目标用户基于所述提示信息触发的语音信息。
另外,在采集用户语音信息时,若是存在环境声音可能会导致目标用户的语音采集出现问题,因此所述采集所述目标用户基于所述提示信息发起的语音信息的步骤,包括:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。
采集语音信息,并判断所述语音信息是否为所述目标用户的语音,所述确认方式可通过将接收到的所述语音信息与预存的所述目标用户的语音信息进行比对,其预存的所述目标用户的语音信息为提前存储在预设的语音存储区域的所述目标用户的历史语音信息,根据比对结果确认接收到的所述语音信息是否为所述目标用户的语音信息。在确认接收到的所述语音信息与预存的所述目标用户的语音信息比对一致时,确认接收到的所述语音信息为所述目标用户的语音,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。
步骤S20,根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪;
在采集到目标用户的面部表情及语音信息后,根据所述面部表情及语音信息计算所述目标用户的情绪识别数据,其中,以所述面部表情及语音信息决定所述情绪识别数据时,可通过相关的技术人员已设定的情绪识别数据计算公式或者情绪解析公式确定,如此,根据面部表情及语音信息计算到的所述目标用户的情绪识别数据确定所述目标用户的目标情绪,在通过情绪识别数据确定目标用户的目标情绪时,可能还存在相关的情绪阈值,根据计算到的情绪识别数据所处的所述情绪阈值的阈值范围,确定所述目标用户的目标情绪,而所述情绪阈值与已设定的情绪识别公式或情绪解析公式相关。
进一步的,在人类产生情绪变化时,其情绪变化还会表现在心率上,如此,还可通过获取目标用户的心率数值进一步的精确目标用户的情绪变化,而心率的数据需要通过人体触摸心率测量设备进行获取,其心率测量设备包括但不限于手环及心率检测装备等,另外,考虑到电视终端需要通过获取心率进一步确定用户情绪如此所述心率检测设备需与所述电视终端存在数据传输通道,即存在连接关系,因此,在本申请方法中,建议用户配置一个特殊遥控器,可通过用户手握遥控器的方式监测到用户的心率。因此,所述根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并以所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:
采集目标用户的心率数据;
以采集到的所述目标用户的心率数据优化所述情绪识别数据,以优化后的所述情绪识别数据确认所述目标用户的目标情绪。
通过心率检测设备采集用户心率数据,以所述心率数据优化所述情绪识别数据,由于用户情绪变化时,不同的任务情绪会导致心率变化,而相同情绪的心率会保持在一定的情绪心率阈值中。因此,可通过采集的用户心率数据优化以计算到的所述情绪识别数据,并以优化后的所述情绪识别数据确认所述目标用户的目标情绪,其优化方式,可通过确认所述心率数据所在情绪心率阈值对应的目标情绪是否与所述情绪识别数据对应的目标情绪是否一致;或者通过采集到的所述心率数据输入预设的情绪识别数据计算公式或者情绪解析公式计算新的情绪识别数据,以实现通过所述心率数据优化所述情绪识别数据的目的。其中,在未能获取到所述目标用户的心率数据时,直接以计算到的所述情绪识别数据确认所述目标用户的目标情绪。
步骤S30,获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
根据已计算到的所述情绪识别数据已确认的目标情绪,在预设的应用主题存储区域获取对应的目标应用主题,并将当前电视终端当前应用的应用主题切换至获取到的所述目标应用主题,其切换应用主题的方式与当前电视终端的应用主题切换方式相关,在此不多赘述。另外,所述预设的应用主题存储区域为所述电视终端划分的所述电视终端可应用或者已存储的应用主题的存储区域。
另外,考虑到电视终端的终端应用时内存消耗,在通过已确认的目标情绪获取对应的目标应用主题时,为降低内存消耗,可通过生成预定格式的目标应用主题标识,以所述目标应用主题标识直接获取对应的目标应用主题,即所述获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题的步骤之前,还包括:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。
如上所示,在通过已确认的目标情绪获取对应的目标应用主题时,由于切换应用主题的操作一般是通过当前电视终端应用系统的相关功能实现,如此,在执行应用主题切换操作时,可根据所述应用主题切换功能许可的预设格式进行目标应用主题的获取,如此,将已确认的目标情绪通过预设格式的操作生成所述目标应用主题标识,其目标应用主题标识可限定于最节省内存的格式,例如数字等实现。根据已生成的目标应用主题标识,获取对应的目标应用主题,如此,在获取到对应的目标应用主题时,将电视终端当前的应用主题切换为所述目标应用主题。
本实施例中,通过开启电视的摄像头采集用户面部表情及用户语音信息确定用户情绪,进而根据用户情绪切换电视当前应用主题至预设的安慰主题,以实现根据用户情绪切换电视应用主题达到安慰用户情绪的目的。
进一步的,参照图3,图2为本申请电视应用主题切换方法第一实施例的流程示意图,基于上述所示的第一实施例,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:
步骤S40、检测目标用户,并判断所述目标用户是否为新用户;
步骤S50、在确认所述目标用户为新用户时,执行获取所述目标用户的常见情绪表情的步骤。
步骤S60、获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。
在本实施例中,为提高目标用户的面部表情识别精确度,可预先将目标用户的面部表情所展现的情绪数据存储在预设的情绪表情存储区域。如此,在初次使用摄像头采集用户面部表情进而确认用户情绪时,判断所述目标用户是否为新用户,其确认方式可通过确认检测到的所述目标用户是否有存储历史面部表情数据。在确认所述目标用户未存储历史面部表情数据时,确认所述目标用户为新用户,发出面部表情采集的提示信息,以引导用户面对摄像头展现各种情绪的面部表情,继而采集所述目标用户的面部表情,且识别所述面部表情所代表的情绪后,将所述面部表情及代表的情绪信息存储至预设的情绪表情存储区域。进一步的,在采集所述目标用户的常见情绪表情时,可通过所述常见情绪表情的表情内容为标识分别进行存储操作,例如采集到的用户的面部表情为喜悦时,以喜悦为标识将所述面部表情存储在所述预设的情绪表情存储区域。进一步的,为提高用户的面部表情的存储效率,在采集目标用户的常见情绪表情时,可通过发出提示语音引导用户展现指定情绪的面部表情进行面部表情采集及存储的操作,如此,可省略面部表情的识别过程,进而提高面部表情的存储效率。
此外,本申请实施例还提出一种可读存储介质,所述可读存储介质上存储有电视应用主题切换程序,所述电视应用主题切换程序被处理器执行时实现如下操作:
采集目标用户的面部表情及语音信息;
根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;
获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
确认所述目标用户的历史面部表情数据;
若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
根据采集到的目标用户的面部表情确定用户情绪;
在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
采集目标用户的心率数据;
根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
发起语音信息采集的提示信息;
采集所述目标用户基于所述提示信息发起的语音信息。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
输出基于所述语音信息采集的提示信息的提示悬浮框。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;
若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
将所述语音信息与预存的所述目标用户的历史语音信息比对;
根据比对结果确认所述语音信息的来源。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。
进一步地,所述电视应用主题切换程序被处理器执行时还实现如下操作:
检测目标用户,并确认所述目标用户是否为新用户;
若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、药品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、药品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、药品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。
Claims (19)
- 一种电视应用主题切换方法,其中,所述电视应用主题切换方法包括以下步骤:采集目标用户的面部表情及语音信息;根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
- 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:确认所述目标用户的历史面部表情数据;若所述目标用户未存储有历史面部表情数据,确认所述目标用户为新用户,输出面部表情采集的提示信息。
- 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:启用电视的摄像装置,通过已启用的所述摄像装置执行采集目标用户的面部表情及语音信息的步骤。
- 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤,包括:确定采集用户的目标位置,在已确认的目标位置中采集目标用户的面部表情及语音信息。
- 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤,包括:根据采集到的目标用户的面部表情确定用户情绪;在根据面部表情确定用户情绪异常时,发起语音信息的采集操作。
- 如权利要求1所述的电视应用主题切换方法,其中,所述根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:采集目标用户的心率数据;根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪。
- 如权利要求6所述的电视应用主题切换方法,其特征在于,所述根据采集到的所述目标用户的心率数据优化所述情绪识别数据,通过优化后的所述情绪识别数据确认所述目标用户的目标情绪的步骤,包括:将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪。
- 如权利要求7所述的电视应用主题切换方法,其中,所述将所述情绪识别数据与预设的情绪阈值比对,根据情绪阈值的比对结果确认所述情绪识别数据的目标情绪的步骤之后,包括:确认所述情绪识别数据所在情绪阈值的阈值范围,根据所述阈值范围确认所述目标情绪。
- 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤,包括:发起语音信息采集的提示信息;采集所述目标用户基于所述提示信息发起的语音信息。
- 如权利要求9所述的电视应用主题切换方法,其中,所述发起语音信息采集的提示信息的步骤,包括:输出基于所述语音信息采集的提示信息的提示悬浮框。
- 如权利要求9所述的电视应用主题切换方法,其中,所述采集所述目标用户基于所述提示信息发起的语音信息的步骤,包括:读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源;若确认所述语音信息为所述目标用户的语音信息,执行采集所述目标用户基于所述提示信息发起的语音信息的步骤。
- 如权利要求11所述的电视应用主题切换方法,其中,所述读取采集到的所述语音信息,根据读取结果确认所述语音信息的来源的步骤,包括:将所述语音信息与预存的所述目标用户的历史语音信息比对;根据比对结果确认所述语音信息的来源。
- 如权利要求12所述的电视应用主题切换方法,其中,所述将所述语音信息与预存的所述目标用户的历史语音信息比对的步骤之后,还包括:在确认所述语音信息与预存的历史语音信息一致时,确认所述语音信息为所述目标用户的语音信息。
- 如权利要求1所述的电视应用主题切换方法,其中,所述获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题的步骤之前,还包括:通过所述目标情绪生成预设格式的目标应用主题标识,并通过所述目标应用主题标识获取对应的目标应用主题。
- 如权利要求1所述的电视应用主题切换方法,其中,所述采集目标用户的面部表情及语音信息的步骤之前,还包括:获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域。
- 如权利要求15所述的电视应用主题切换方法,其中,所述获取目标用户的常见情绪表情,并将所述常见情绪表情存储至预设的情绪表情存储区域的步骤之前,还包括:检测目标用户,并确认所述目标用户是否为新用户;若确认所述目标用户为新用户,执行获取所述目标用户的常见情绪表情的步骤。
- 一种电视,其中,所述电视包括:采集模块,设置为采集目标用户的面部表情及语音信息;确认模块,设置为根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;切换模块,设置为获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
- 一种可读存储介质,其中,所述可读存储介质存储有电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下步骤:采集目标用户的面部表情及语音信息;根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
- 一种电视应用主题切换设备,其中,所述电视应用主题切换设备包括存储器、处理器及存储在存储器上并可在处理器上运行的电视应用主题切换程序,所述电视应用主题切换程序执行时包括如下的步骤:采集目标用户的面部表情及语音信息;根据采集到的面部表情及语音信息计算所述目标用户的情绪识别数据,并根据所述情绪识别数据确认所述目标用户的目标情绪;获取所述目标情绪对应的目标应用主题,切换当前电视端的应用主题至所述目标应用主题。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811632356.1 | 2018-12-28 | ||
| CN201811632356.1A CN109672937A (zh) | 2018-12-28 | 2018-12-28 | 电视应用主题切换方法、电视、可读存储介质及系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020135334A1 true WO2020135334A1 (zh) | 2020-07-02 |
Family
ID=66146627
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/127426 Ceased WO2020135334A1 (zh) | 2018-12-28 | 2019-12-23 | 电视应用主题切换方法、电视、可读存储介质及设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109672937A (zh) |
| WO (1) | WO2020135334A1 (zh) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672937A (zh) * | 2018-12-28 | 2019-04-23 | 深圳Tcl数字技术有限公司 | 电视应用主题切换方法、电视、可读存储介质及系统 |
| CN110298242A (zh) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | 基于研发管理的app主题切换方法、装置、设备及存储介质 |
| CN110502609B (zh) * | 2019-07-11 | 2022-03-08 | 江苏心涧康科技有限公司 | 一种调节情绪的方法、装置及陪伴机器人 |
| CN110598611B (zh) * | 2019-08-30 | 2023-06-09 | 深圳智慧林网络科技有限公司 | 看护系统、基于看护系统的病人看护方法和可读存储介质 |
| CN110825503B (zh) * | 2019-10-12 | 2024-03-19 | 平安科技(深圳)有限公司 | 主题切换方法、装置及存储介质、服务器 |
| CN111772648A (zh) * | 2020-06-10 | 2020-10-16 | 南京七岩电子科技有限公司 | 一种结合hrv信号和面部表情判断情绪的方法及设备 |
| CN112667129B (zh) * | 2020-12-17 | 2022-12-02 | 展讯通信(天津)有限公司 | 界面主题切换方法及装置、终端、存储介质 |
| CN113485557A (zh) * | 2021-07-20 | 2021-10-08 | 浙江工商职业技术学院 | 虚拟现实情绪控制的方法及装置 |
| CN115695638B (zh) * | 2022-12-28 | 2023-06-06 | 深圳市心流科技有限公司 | App主题场景控制方法、装置、终端设备及存储介质 |
| CN116563829A (zh) * | 2023-05-26 | 2023-08-08 | 北京好心情互联网医院有限公司 | 一种驾驶员情绪识别方法、装置、电子设备和存储介质 |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102523502A (zh) * | 2011-12-15 | 2012-06-27 | 四川长虹电器股份有限公司 | 智能电视交互系统及交互方法 |
| CN103618918A (zh) * | 2013-11-27 | 2014-03-05 | 青岛海信电器股份有限公司 | 一种智能电视的显示控制方法及装置 |
| WO2014119900A1 (ko) * | 2013-01-29 | 2014-08-07 | Lee Jong Sik | 인간의 감정 또는 성향 기반으로 한 사용자 인터페이스를 구비한 스마트 기기 및 사용자 인터페이스 방법 |
| CN105549841A (zh) * | 2015-12-02 | 2016-05-04 | 小天才科技有限公司 | 一种语音交互方法、装置及设备 |
| CN106658129A (zh) * | 2016-12-27 | 2017-05-10 | 上海智臻智能网络科技股份有限公司 | 基于情绪的终端控制方法、装置及终端 |
| CN107992199A (zh) * | 2017-12-19 | 2018-05-04 | 广东小天才科技有限公司 | 一种用于电子设备的情绪识别方法、系统及电子设备 |
| CN108491244A (zh) * | 2018-03-20 | 2018-09-04 | 深圳市万普拉斯科技有限公司 | 一种桌面场景切换方法、装置和用户终端 |
| CN109672937A (zh) * | 2018-12-28 | 2019-04-23 | 深圳Tcl数字技术有限公司 | 电视应用主题切换方法、电视、可读存储介质及系统 |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103530912A (zh) * | 2013-09-27 | 2014-01-22 | 深圳市迈瑞思智能技术有限公司 | 一种具有情绪识别功能的考勤系统及方法 |
| KR101480668B1 (ko) * | 2014-03-21 | 2015-01-26 | 충남대학교산학협력단 | 음성을 이용한 감정 인식 어플리케이션이 구비된 단말기 및 그 제어방법 |
| US20150310760A1 (en) * | 2014-04-24 | 2015-10-29 | Mobilify Technology, Inc. | System and method for smoking cessation |
| CN104023125A (zh) * | 2014-05-14 | 2014-09-03 | 上海卓悠网络科技有限公司 | 根据用户情绪自动切换系统场景的方法及终端 |
| CN107479801B (zh) * | 2017-07-31 | 2020-06-02 | Oppo广东移动通信有限公司 | 基于用户表情的终端显示方法、装置及终端 |
| CN108960024A (zh) * | 2017-09-19 | 2018-12-07 | 炬大科技有限公司 | 一种基于个人用户的情绪识别方法 |
| CN107765852A (zh) * | 2017-10-11 | 2018-03-06 | 北京光年无限科技有限公司 | 基于虚拟人的多模态交互处理方法及系统 |
-
2018
- 2018-12-28 CN CN201811632356.1A patent/CN109672937A/zh active Pending
-
2019
- 2019-12-23 WO PCT/CN2019/127426 patent/WO2020135334A1/zh not_active Ceased
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102523502A (zh) * | 2011-12-15 | 2012-06-27 | 四川长虹电器股份有限公司 | 智能电视交互系统及交互方法 |
| WO2014119900A1 (ko) * | 2013-01-29 | 2014-08-07 | Lee Jong Sik | 인간의 감정 또는 성향 기반으로 한 사용자 인터페이스를 구비한 스마트 기기 및 사용자 인터페이스 방법 |
| CN103618918A (zh) * | 2013-11-27 | 2014-03-05 | 青岛海信电器股份有限公司 | 一种智能电视的显示控制方法及装置 |
| CN105549841A (zh) * | 2015-12-02 | 2016-05-04 | 小天才科技有限公司 | 一种语音交互方法、装置及设备 |
| CN106658129A (zh) * | 2016-12-27 | 2017-05-10 | 上海智臻智能网络科技股份有限公司 | 基于情绪的终端控制方法、装置及终端 |
| CN107992199A (zh) * | 2017-12-19 | 2018-05-04 | 广东小天才科技有限公司 | 一种用于电子设备的情绪识别方法、系统及电子设备 |
| CN108491244A (zh) * | 2018-03-20 | 2018-09-04 | 深圳市万普拉斯科技有限公司 | 一种桌面场景切换方法、装置和用户终端 |
| CN109672937A (zh) * | 2018-12-28 | 2019-04-23 | 深圳Tcl数字技术有限公司 | 电视应用主题切换方法、电视、可读存储介质及系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109672937A (zh) | 2019-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113170000B (zh) | 设备控制方法、装置、系统、电子设备以及云服务器 | |
| TWI665584B (zh) | 語音控制系統及方法 | |
| CN104360736B (zh) | 基于手势的终端控制方法和系统 | |
| CN106782526B (zh) | 语音控制方法和装置 | |
| CN107703872B (zh) | 家电设备的终端控制方法、装置及终端 | |
| CN105471705B (zh) | 一种基于即时通讯的智能控制方法、设备及系统 | |
| CN107544272B (zh) | 终端控制方法、装置及存储介质 | |
| CN108132805A (zh) | 语音交互方法、装置及计算机可读存储介质 | |
| WO2020192222A1 (zh) | 用户场景智能分析方法、装置和存储介质 | |
| CN108351890A (zh) | 电子装置及其操作方法 | |
| KR20160055337A (ko) | 텍스트 표시 방법 및 그 전자 장치 | |
| CN110822641A (zh) | 空调器及其控制方法、装置和可读存储介质 | |
| CN105629750A (zh) | 一种智能家居控制方法及系统 | |
| CN111984180B (zh) | 终端读屏方法、装置、设备及计算机可读存储介质 | |
| WO2019223056A1 (zh) | 基于手势识别的教学互动方法以及装置 | |
| WO2020192215A1 (zh) | 一种交互方法及可穿戴交互设备 | |
| EP2960816A1 (en) | Method and apparatus for managing data | |
| Ruminski et al. | Interactions with recognized objects | |
| WO2020017296A1 (ja) | 端末装置、情報処理方法、及びプログラム | |
| CN115527527A (zh) | 基于行为分析的主动对话方法、装置、设备及存储介质 | |
| JP6973380B2 (ja) | 情報処理装置、および情報処理方法 | |
| KR102209729B1 (ko) | 인식 영역에 기반하여 콘텐트를 검출하는 전자 장치 및 방법 | |
| CN113419652A (zh) | 智能设备交互方法、服务端和客户端 | |
| WO2019119643A1 (zh) | 移动直播的互动终端、方法及计算机可读存储介质 | |
| CN103905837A (zh) | 图像处理方法、装置及终端 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19903720 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 19/10/2021) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19903720 Country of ref document: EP Kind code of ref document: A1 |