WO2017096979A1 - Program playing method and system based on emotion of user - Google Patents

Program playing method and system based on emotion of user Download PDF

Info

Publication number
WO2017096979A1
WO2017096979A1 PCT/CN2016/097971 CN2016097971W WO2017096979A1 WO 2017096979 A1 WO2017096979 A1 WO 2017096979A1 CN 2016097971 W CN2016097971 W CN 2016097971W WO 2017096979 A1 WO2017096979 A1 WO 2017096979A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
emotional
emotion
mode
physiological
Prior art date
Application number
PCT/CN2016/097971
Other languages
French (fr)
Chinese (zh)
Inventor
王振宇
Original Assignee
乐视控股(北京)有限公司
乐视移动智能信息技术(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 乐视控股(北京)有限公司, 乐视移动智能信息技术(北京)有限公司 filed Critical 乐视控股(北京)有限公司
Publication of WO2017096979A1 publication Critical patent/WO2017096979A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A61B5/02055Simultaneously evaluating both cardiovascular condition and temperature
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021Measuring pressure in heart or blood vessels
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/053Measuring electrical impedance or conductance of a portion of the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/08Detecting, measuring or recording devices for evaluating the respiratory organs
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones

Definitions

  • the present application relates to multimedia playback technologies, and in particular, to a program playback method and system based on user emotions.
  • the current music playback ignores the relationship between music and people, and there is no media playback method that can play corresponding style music according to the user's emotions.
  • an object of the present application is to provide a playing method and a playing system capable of playing a media program according to the emotion of the user.
  • the present application provides a multimedia program playing method based on user emotion, the method comprising the following steps: Step 110: detecting a physiological parameter of a user; Step 120, determining a mood mode of the user according to the physiological parameter; Step 130, according to the The emotional mode plays a specific multimedia program.
  • step 110 includes detecting a physiological parameter of the user by a mobile phone, a wristband or a wearable device.
  • the physiological parameter includes any one or more of heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
  • step 120 includes comparing the physiological parameter with a parameter value or waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result.
  • step 130 includes: each multimedia program has an emotion identifier, and when the emotion identifier matches the emotion pattern, the multimedia program having the emotion identifier is played.
  • the present application also provides a multimedia program playing system based on user emotion, the system comprising a physiological index detecting unit, an emotional mode determining unit, and a program playing unit.
  • the physiological indicator detecting unit is configured to detect a physiological parameter of the user
  • the emotional mode determining unit is configured to determine an emotional mode of the user according to the physiological parameter
  • the program playing unit is configured to play a specific one according to the emotional mode Multimedia program.
  • the physiological indicator detecting unit is a mobile phone, a wristband or a wearable device.
  • the physiological parameter includes any one or more of heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
  • the emotion mode determining unit comprises a parameter comparison module, configured to compare the physiological parameter with a parameter value or a waveform in the preset emotional mode, and determine the emotional mode of the user according to the comparison result.
  • a parameter comparison module configured to compare the physiological parameter with a parameter value or a waveform in the preset emotional mode, and determine the emotional mode of the user according to the comparison result.
  • the program playing unit comprises an emotion identification matching module: the emotion identification matching module is configured to match the emotion identifier with the emotion pattern to play a multimedia program having the emotion identifier.
  • An embodiment of the present application further provides a multimedia program playing system based on user emotion, including:
  • the processor, the memory, and the communication interface complete communication with each other through the bus;
  • the communication interface is used for information transmission between the system and a mobile phone, a wristband or a wearable device;
  • the processor is configured to invoke logic instructions in the memory to perform the following method
  • Step 110 Detect physiological parameters of the user
  • Step 120 Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
  • An embodiment of the present application also provides a computer program, including program code, for performing the following operations:
  • Step 110 Detect physiological parameters of the user
  • Step 120 Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
  • Embodiments of the present application also provide a storage medium for storing the above computer program.
  • some suitable songs or multimedia files can be automatically played according to the emotion of the user, so that the mood of the user is more comfortable.
  • the application enhances the artificial intelligence capability of the mobile phone and achieves a good user experience.
  • FIG. 1 is a flowchart of a specific implementation manner of a program playing method based on user emotion according to the present application
  • FIG. 3 is a schematic structural diagram of a program playing system based on user emotions according to another embodiment of the present application.
  • the device can be utilized by a mobile phone or an external device such as a wristband.
  • the sensor detects the user's heartbeat, blood oxygenation index and other physiological parameters, and compares with the medical or physiological standard reference value to evaluate the user's emotional state, such as sadness, calmness, excitement and the like.
  • the emotional state the corresponding type of music in the mobile music application is played. For example, when a person is sad, some cheerful songs are automatically played, and when the person is calm and may need to sleep, some soothing songs are automatically played to facilitate the user to fall asleep. .
  • the application enhances the artificial intelligence capability of the mobile phone and achieves a good user experience.
  • the present application can be applied not only to the playing of music but also to the playing of other multimedia programs such as movies, televisions, animations, pictures and the like.
  • the present application can be used not only for multimedia playback on a user's mobile phone, but also for multimedia playback on other types of user terminals, such as smart TV, multimedia playback software on a PC, and the like.
  • the present application provides a multimedia program playing method based on user emotion, and the method includes the following steps:
  • the physiological parameters of the user are detected.
  • the physiological parameter may include any one or more of parameters such as heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
  • the physiological parameters not only reflect the physical state of the user, but also reflect the psychological state of the user. For example, when the user is emotionally excited, the user's heart rate will increase, the blood pressure will increase, and the body temperature will rise slightly. When the mood is tense, the body will reduce the skin resistance due to sweating, and the heart rate will increase and the breathing will increase.
  • the user's mobile phone is connected to a wristband via Bluetooth.
  • the wristband is worn on the user's hand.
  • the wristband is integrated with various sensors, and the user's various physiological parameters can be detected through the wristband.
  • the physiological parameter determining whether the user's emotion is calm only includes the heart rate, that is, when the heart rate is greater than the predetermined value, the user's emotion is considered to be in an excited state, and when the heart rate is less than or equal to the predetermined value, it is considered The user's emotions are in a calm state;
  • the physiological parameters determining whether the user's emotions are calm include heart rate and blood pressure, that is, when the measured heart rate is greater than the predetermined heart rate, and the measured blood pressure is greater than the predetermined value of the blood pressure, the user's emotion is considered to be excited.
  • the state of the user is considered to be calm when the measured heart rate is less than or equal to the predetermined heart rate and the measured blood pressure is less than or equal to the predetermined value of the blood pressure. status.
  • step 110 includes detecting the physiological parameters of the user through a wristband or wearable equipment.
  • the Samsung Galaxy S5 uses infrared sensors to detect heart rate, motion bracelets or temperature sensors in wearable helmets or glasses, accelerometers, skin electrical response sensors, optical heart rate monitors, bioelectrical impedance sensors, etc.
  • the measured physical quantity is converted into physiological parameters such as body temperature, heart rate, respiration rate and skin resistance.
  • Step 120 Determine an emotional mode of the user according to the physiological parameter. Human emotions are usually reflected in the physiological response of the human body. Therefore, by analyzing the physiological parameters obtained by measurement, the user's emotion can be judged to some extent.
  • step 120 includes comparing the physiological parameter with a parameter value or waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result.
  • one or more standard numerical values or standard waveforms are preset for each physiological parameter, and after acquiring the physiological parameters of the user in step 110, the acquired physiological parameters and the set standard numerical values or standard waveforms are obtained.
  • the acquired physiological parameter is within the range of the standard value or the standard waveform, the user's emotion at this time is considered to belong to the standard value or the standard waveform corresponding to the emotional mode.
  • the emotional pattern can be excitement, calmness, nervousness, sadness, joy, and the like.
  • the parameter values or waveforms in the preset mood mode are set according to the corresponding medical and physiological research results or statistical laws.
  • the present application aims to use the measured values of the physiological parameters of the human body to trigger the corresponding program play, and improve the intelligence of the user's terminal device, instead of studying specific medical or physiological laws.
  • Step 130 Play a specific multimedia program according to the emotional mode. After the emotional mode of the user is determined in step 120, the multimedia program of the corresponding style is played according to the emotional mode.
  • step 130 includes each multimedia program having an emotional identity, and when the emotional identity matches the emotional mode, playing a multimedia program having the emotional identity.
  • the multimedia program may include a program type such as music, a television program, a movie program, an animation, and the like.
  • Multiple multimedia programs can be stored in a suitable data format In a network or database, wherein each multimedia program has an emotion identifier indicating its style, the emotion identifier corresponding to the user's emotion pattern, for example, an emotion pattern corresponding to the user's "joy”, and the emotion identifier of the multimedia program is " Cheerful or "joy".
  • the emotional identification of the multimedia program can be marked before the user's emotional mode is determined, so that the corresponding playing can be performed after determining the emotional mode of the user.
  • the multimedia program having the corresponding emotional identifier is retrieved in the database according to the emotional mode, and after the multimedia program having the corresponding emotional identifier is retrieved, the multimedia program is played.
  • the program with the most playback times can be selected for playback. Since the program with the most playback times is likely to be the program most interesting to the user, the intelligence of the user terminal is further improved.
  • other playback modes such as sequential playback, can also be used for multiple multimedia programs that meet the requirements.
  • the user can manually set the emotional identifier of the multimedia program.
  • a plurality of emotion identifiers have been preset for the user to select, such as sadness, excitement, calmness, and the like.
  • the user selects a program with a different emotional identity and plays it on a mobile phone or other user terminal.
  • the emotion identification may be defined in a data structure corresponding to each program, in the form of an index item or other data item.
  • the database for storing a plurality of multimedia programs may be a local database located on a user's mobile phone or a smart TV, or may be a network database located in a network server or a cloud, and the user may access the network database via a mobile phone or other user terminal via the Internet. .
  • the user wears a sports bracelet, and uses the sensors on the sports bracelet to measure the user's heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, and respiratory rate.
  • the normal fluctuation range of heart rate is 70-90 times/min; the normal fluctuation of blood oxygen saturation is 95-98% of arterial blood Hb saturation; the normal fluctuation range of body temperature is 36-38 °C; the normal fluctuation range of blood pressure is systolic blood pressure 100-150mmHg; the normal fluctuation range of skin resistance is 1k-2k ohm; the normal fluctuation range of respiratory rate is 15-20 times/min.
  • the user's heart rate was 105 beats/min
  • blood oxygen saturation was Hb saturation 96%
  • body temperature was 37 ° C
  • blood pressure was systolic blood pressure 160 mmHg
  • skin resistance was 300 ohms
  • respiration rate was 30 beats/min.
  • the present application further provides a multimedia program playing system 200 based on user emotions, the system comprising a physiological index detecting unit 210, an emotion mode determining unit 220, and a program playing unit 230. among them:
  • the physiological index detecting unit 210 is configured to detect a physiological parameter of the user.
  • the physiological index detecting unit 210 can be implemented by a corresponding sensor and a corresponding data transmission software module.
  • the physiological parameters of the user can be detected by a wristband or a wearable device.
  • a wearable device In sports bracelets or wearable helmets or glasses, there are temperature sensors, accelerometers, electrodermal response sensors, optical heart rate monitors, bioelectrical impedance sensors, etc. These sensors can convert the detected physical quantities into body temperature, heart rate, respiration rate and Physiological parameters such as skin resistance.
  • the emotion mode determining unit 220 is configured to determine an emotional mode of the user according to the physiological parameter. Human emotions are usually reflected in the physiological response of the human body. Therefore, by analyzing the physiological parameters obtained by measurement, the user's emotion can be judged to some extent.
  • the emotion mode determining unit 220 includes a parameter comparison module 221 for comparing the physiological parameter with a parameter value or a waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result. After obtaining the physiological parameter of the user, comparing the acquired physiological parameter with the set standard value or standard waveform, and when the acquired physiological parameter is within the range of the standard value or the standard waveform, the user's emotion at the time is considered to belong to the standard.
  • the numerical or standard waveform corresponds to the emotional mode.
  • the program playing unit 230 is configured to play a specific multimedia program according to the mood mode.
  • the program playing unit 230 includes an emotion identification matching module 231, and the emotion identification matching module 231 is configured to match the emotion identifier with the emotion pattern to play a multimedia program having the emotion identifier. After determining the emotional mode of the user, the multimedia program having the corresponding emotional identifier is retrieved in the database according to the emotional mode, and after the multimedia program having the corresponding emotional identifier is retrieved, the multimedia program is played.
  • the physiological indicator detecting unit 210 can be integrated with the program playing unit 230 on the same hardware device.
  • the physiological indicator detecting unit 210 can be integrated with the program playing unit 230 on the user's mobile phone.
  • the physiological indicator detecting unit 210 can also be integrated with the program playing unit 230 on different hardware devices.
  • the physiological index detecting unit 210 is disposed on the wearable helmet worn by the user, and the program playing unit 230 is disposed on the user's mobile phone. on.
  • an embodiment of the present application further provides a multimedia program playing system based on user emotion, and the system includes:
  • processor 301 a processor 301, a memory 302, a communication interface 303, and a bus 304; wherein
  • the processor 301, the memory 302, and the communication interface 303 complete communication with each other through the bus 304;
  • the communication interface 303 is used for information transmission between the system and a mobile phone, a wristband or a wearable device;
  • the processor 301 is configured to invoke logic instructions in the memory 302 to perform the following methods;
  • Step 110 Detect physiological parameters of the user
  • Step 120 Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
  • An embodiment of the present application also provides a computer program, including program code, for performing the following operations:
  • Step 110 Detect physiological parameters of the user
  • Step 120 Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
  • Embodiments of the present application also provide a storage medium for storing the above computer program.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the embodiments of the vehicle platform and the intelligent transportation system described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be Physical units can be located in one place or distributed to multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Abstract

Disclosed in the present application are a multimedia program playing method and system based on emotion of a user. The method comprises the following steps: detecting a physiological parameter of a user; determining an emotion mode of the user according to the physiological parameter; and playing a specific multimedia program according to the emotion mode. Also disclosed in the present application is a multimedia program playing system based on emotion of a user. The system comprises a physiological indicator detection unit, an emotion mode determining unit, and a program playing unit. By using the technical solution of the present application, some suitable songs or multimedia files can be automatically played according to emotion of a user, so that the user feels more comfortable in emotion. The present application enhances the artificial intelligence capability of a mobile phone, thereby achieving the effect of good user experience.

Description

基于用户情绪的节目播放方法和系统Program playing method and system based on user emotion
交叉引用cross reference
本申请引用于2015年12月8日提交的专利名称为“基于用户情绪的节目播放方法和系统”的第2015108974726号中国专利申请,其通过引用被全部并入本申请。The present application is hereby incorporated by reference in its entirety in its entirety in its entirety in its entirety in its entirety in the the the the the the the the the
技术领域Technical field
本申请涉及多媒体播放技术,尤其涉及一种基于用户情绪的节目播放方法和系统。The present application relates to multimedia playback technologies, and in particular, to a program playback method and system based on user emotions.
背景技术Background technique
随着智能手机的普及,手机已经取代了很多其他的消费电子产品的功能。人们很多时候在路途中都用手机来听歌或者看视频,手机作为随身听的功能是手机几个主要功能之一。With the popularity of smartphones, mobile phones have replaced many other consumer electronics features. People often use their mobile phones to listen to songs or watch videos on the road. The function of the mobile phone as a Walkman is one of the main functions of the mobile phone.
让音乐播放更加专业化、智能化一直是手机厂商发展的动力。目前有一些智能手机具有音乐播放功能,例如通过置入手机的专用功放芯片及音乐播放软件进行音乐播放。Making music playback more professional and intelligent has always been the driving force for the development of mobile phone manufacturers. At present, some smart phones have music playing functions, such as music playback by placing a dedicated power amplifier chip and music playing software of the mobile phone.
但是目前的音乐播放忽略了音乐与人的关系,还没有一种能够根据用户的情绪对播放相应风格音乐的媒体播放方法。However, the current music playback ignores the relationship between music and people, and there is no media playback method that can play corresponding style music according to the user's emotions.
发明内容Summary of the invention
针对现有技术的缺陷,本申请的目的是提供一种能够根据用户的情绪播放媒体节目的播放方法和播放系统。In view of the deficiencies of the prior art, an object of the present application is to provide a playing method and a playing system capable of playing a media program according to the emotion of the user.
本申请提供了一种基于用户情绪的多媒体节目播放方法,所述方法包括以下步骤:步骤110,检测用户的生理参数;步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。 The present application provides a multimedia program playing method based on user emotion, the method comprising the following steps: Step 110: detecting a physiological parameter of a user; Step 120, determining a mood mode of the user according to the physiological parameter; Step 130, according to the The emotional mode plays a specific multimedia program.
优选地,步骤110包括:通过手机、手环或穿戴式装备检测用户的生理参数。Preferably, step 110 includes detecting a physiological parameter of the user by a mobile phone, a wristband or a wearable device.
优选地,所述生理参数包括心率、血氧饱和度、体温、血压、皮肤电阻、脑电波、呼吸率中的任意一项或多项。Preferably, the physiological parameter includes any one or more of heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
优选地,步骤120包括:将生理参数与预设情绪模式中的参数值或波形进行比较,根据比较结果,确定用户的情绪模式。Preferably, step 120 includes comparing the physiological parameter with a parameter value or waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result.
优选地,步骤130包括:各个多媒体节目具有情绪标识,当所述情绪标识与所述情绪模式相匹配时,则播放具有该情绪标识的多媒体节目。Preferably, step 130 includes: each multimedia program has an emotion identifier, and when the emotion identifier matches the emotion pattern, the multimedia program having the emotion identifier is played.
本申请还提供了一种基于用户情绪的多媒体节目播放系统,所述系统包括生理指标检测单元、情绪模式判定单元、节目播放单元。其中:所述生理指标检测单元用于检测用户的生理参数;所述情绪模式判定单元用于根据所述生理参数确定用户的情绪模式;所述节目播放单元用于根据所述情绪模式播放特定的多媒体节目。The present application also provides a multimedia program playing system based on user emotion, the system comprising a physiological index detecting unit, an emotional mode determining unit, and a program playing unit. Wherein: the physiological indicator detecting unit is configured to detect a physiological parameter of the user; the emotional mode determining unit is configured to determine an emotional mode of the user according to the physiological parameter; and the program playing unit is configured to play a specific one according to the emotional mode Multimedia program.
优选地,所述生理指标检测单元为手机、手环或穿戴式装备。Preferably, the physiological indicator detecting unit is a mobile phone, a wristband or a wearable device.
优选地,所述生理参数包括心率、血氧饱和度、体温、血压、皮肤电阻、脑电波、呼吸率中的任意一项或多项。Preferably, the physiological parameter includes any one or more of heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
优选地,所述情绪模式判定单元包括参数比较模块,用于将生理参数与预设情绪模式中的参数值或波形进行比较,根据比较结果,确定用户的情绪模式。Preferably, the emotion mode determining unit comprises a parameter comparison module, configured to compare the physiological parameter with a parameter value or a waveform in the preset emotional mode, and determine the emotional mode of the user according to the comparison result.
优选地,所述节目播放单元包括情绪标识匹配模块:情绪标识匹配模块用于将所述情绪标识与所述情绪模式相匹配,以播放具有该情绪标识的多媒体节目。Preferably, the program playing unit comprises an emotion identification matching module: the emotion identification matching module is configured to match the emotion identifier with the emotion pattern to play a multimedia program having the emotion identifier.
本申请的实施例还提供了一种基于用户情绪的多媒体节目播放系统,包括:An embodiment of the present application further provides a multimedia program playing system based on user emotion, including:
处理器、存储器、通信接口和总线;其中,a processor, a memory, a communication interface, and a bus; wherein
所述处理器、存储器、通信接口通过所述总线完成相互间的通信;The processor, the memory, and the communication interface complete communication with each other through the bus;
所述通信接口用于所述系统与手机、手环或穿戴式装备之间的信息传输;The communication interface is used for information transmission between the system and a mobile phone, a wristband or a wearable device;
所述处理器用于调用所述存储器中的逻辑指令,以执行如下方法;The processor is configured to invoke logic instructions in the memory to perform the following method;
步骤110,检测用户的生理参数; Step 110: Detect physiological parameters of the user;
步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。Step 120: Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
本申请的实施例还提供了一种计算机程序,包括程序代码,所述程序代码用于执行如下操作:An embodiment of the present application also provides a computer program, including program code, for performing the following operations:
步骤110,检测用户的生理参数;Step 110: Detect physiological parameters of the user;
步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。Step 120: Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
本申请的实施例还提供了一种存储介质,用于存储上述计算机程序。Embodiments of the present application also provide a storage medium for storing the above computer program.
相对现有技术,采用本申请的技术方案,能够根据用户的情绪,自动播放一些适合的歌曲或多媒体文件,以便于用户的情绪更加舒适。本申请增强了手机的人工智能能力,达到良好的用户体验效果。Compared with the prior art, according to the technical solution of the present application, some suitable songs or multimedia files can be automatically played according to the emotion of the user, so that the mood of the user is more comfortable. The application enhances the artificial intelligence capability of the mobile phone and achieves a good user experience.
附图说明DRAWINGS
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请中记载的一些实施例,对于本领域普通技术人员来讲,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only These are some of the embodiments described in this application, and other figures can be obtained from those of ordinary skill in the art in view of these drawings.
图1是本申请一种基于用户情绪的节目播放方法的具体实施方式的流程图;1 is a flowchart of a specific implementation manner of a program playing method based on user emotion according to the present application;
图2是本申请一种基于用户情绪的节目播放系统的具体实施方式;2 is a specific implementation manner of a program playing system based on user emotion according to the present application;
图3是本申请另一实施例提供的一种基于用户情绪的节目播放系统的结构示意图。FIG. 3 is a schematic structural diagram of a program playing system based on user emotions according to another embodiment of the present application.
具体实施方式detailed description
为了使本领域的人员更好地理解本申请中的技术方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员所获得的所有其他实施例,都应当属于本申请保护的范围。In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. The examples are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments in the present application should fall within the scope of the present application.
下面结合本申请附图进一步说明本申请具体实现。The specific implementation of the present application is further described below in conjunction with the drawings of the present application.
在本申请中,可以通过手机或者例如手环等外部设备,利用所述设备 的传感器检测使用者的心跳、血氧指数等生理参数,通过与医学或生理学上的标准参考值进行对比,评估出用户的情绪状态,例如悲伤,平静,兴奋等等。根据情绪状态对手机音乐应用中相应类型音乐进行播放,例如,在人悲伤的时候,自动播放一些欢快的歌曲,在人平静而且可能需要睡觉的时候,自动播放一些舒缓的歌曲,以便于用户入睡。本申请增强了手机的人工智能能力,达到良好的用户体验效果。In the present application, the device can be utilized by a mobile phone or an external device such as a wristband. The sensor detects the user's heartbeat, blood oxygenation index and other physiological parameters, and compares with the medical or physiological standard reference value to evaluate the user's emotional state, such as sadness, calmness, excitement and the like. According to the emotional state, the corresponding type of music in the mobile music application is played. For example, when a person is sad, some cheerful songs are automatically played, and when the person is calm and may need to sleep, some soothing songs are automatically played to facilitate the user to fall asleep. . The application enhances the artificial intelligence capability of the mobile phone and achieves a good user experience.
本领域技术人员可以理解,本申请不仅可以用于音乐的播放,还可以应用于其他多媒体节目,例如电影、电视、动画、图片等内容的播放。本领域技术人员还可以理解,本申请不仅可以用于用户手机上的多媒体播放,还可以用于其他类型用户终端上的多媒体播放,例如智能电视、PC机上的多媒体播放软件等。Those skilled in the art can understand that the present application can be applied not only to the playing of music but also to the playing of other multimedia programs such as movies, televisions, animations, pictures and the like. Those skilled in the art can also understand that the present application can be used not only for multimedia playback on a user's mobile phone, but also for multimedia playback on other types of user terminals, such as smart TV, multimedia playback software on a PC, and the like.
如图1所示,本申请提供了一种基于用户情绪的多媒体节目播放方法,所述方法包括以下步骤:As shown in FIG. 1 , the present application provides a multimedia program playing method based on user emotion, and the method includes the following steps:
步骤110,检测用户的生理参数。所述生理参数可以包括心率、血氧饱和度、体温、血压、皮肤电阻、脑电波、呼吸率等参数中的任意一项或多项。生理参数不仅反映了用户的身体状态,而且还反映了用户的心理状态,例如,在用户的情绪激动时,用户的心率会加快、血压会升高、体温会略有升高;而在用户的心情比较紧张时,人体会由于出汗而使得皮肤电阻降低,同时心率加快、呼吸增加。在一个优选实施例中,用户的手机通过蓝牙连接到一个手环,该手环戴在用户的手上,手环上集成有多种传感器,通过手环可以检测到用户的多种生理参数。In step 110, the physiological parameters of the user are detected. The physiological parameter may include any one or more of parameters such as heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate. The physiological parameters not only reflect the physical state of the user, but also reflect the psychological state of the user. For example, when the user is emotionally excited, the user's heart rate will increase, the blood pressure will increase, and the body temperature will rise slightly. When the mood is tense, the body will reduce the skin resistance due to sweating, and the heart rate will increase and the breathing will increase. In a preferred embodiment, the user's mobile phone is connected to a wristband via Bluetooth. The wristband is worn on the user's hand. The wristband is integrated with various sensors, and the user's various physiological parameters can be detected through the wristband.
本领域技术人员应该理解,对于情绪的分析与判断,有可能采取不同的模型,各种模型所采用的生理参数有可能是不同的。例如:Those skilled in the art should understand that for the analysis and judgment of emotions, it is possible to adopt different models, and the physiological parameters adopted by various models may be different. E.g:
在第一种模型中,确定用户的情绪是否平静的生理参数只包含心率,即,当心率大于预定值时,就认为用户的情绪处于激动的状态,当心率小于或等于预定值时,则认为用户的情绪处于平静的状态;In the first model, the physiological parameter determining whether the user's emotion is calm only includes the heart rate, that is, when the heart rate is greater than the predetermined value, the user's emotion is considered to be in an excited state, and when the heart rate is less than or equal to the predetermined value, it is considered The user's emotions are in a calm state;
在第二种模型中,确定用户的情绪是否平静的生理参数包括心率和血压,即,当测得的心率大于心率预定值、测得的血压大于血压预定值时,则认为用户的情绪处于激动的状态;当测得的心率小于或等于心率预定值、测得的血压小于或等于血压预定值时,则认为用户的情绪处于平静的 状态。In the second model, the physiological parameters determining whether the user's emotions are calm include heart rate and blood pressure, that is, when the measured heart rate is greater than the predetermined heart rate, and the measured blood pressure is greater than the predetermined value of the blood pressure, the user's emotion is considered to be excited. The state of the user is considered to be calm when the measured heart rate is less than or equal to the predetermined heart rate and the measured blood pressure is less than or equal to the predetermined value of the blood pressure. status.
对于上述生理参数的测量,可以通过相应的传感器来实现,在一种优选实施方式中,步骤110包括:通过手环或穿戴式装备检测用户的生理参数。例如,三星Galaxy S5中利用红外线检测心率的传感器、运动手环或可穿戴式头盔或眼镜中的温度传感器、加速度计、皮电反应传感器、光学心率监测器、生物电阻抗传感器等,这些传感器可以将检测的物理量转换为体温、心率、呼吸率及皮肤电阻等等生理参数。The measurement of the physiological parameters described above can be achieved by a corresponding sensor. In a preferred embodiment, step 110 includes detecting the physiological parameters of the user through a wristband or wearable equipment. For example, the Samsung Galaxy S5 uses infrared sensors to detect heart rate, motion bracelets or temperature sensors in wearable helmets or glasses, accelerometers, skin electrical response sensors, optical heart rate monitors, bioelectrical impedance sensors, etc. The measured physical quantity is converted into physiological parameters such as body temperature, heart rate, respiration rate and skin resistance.
步骤120,根据所述生理参数确定用户的情绪模式。人的情绪通常会反映在人体的生理反应上,因此,通过对测量获得生理参数进行分析可以在一定程度上判断出用户的情绪。Step 120: Determine an emotional mode of the user according to the physiological parameter. Human emotions are usually reflected in the physiological response of the human body. Therefore, by analyzing the physiological parameters obtained by measurement, the user's emotion can be judged to some extent.
在一种具体实施方式中,步骤120包括:将生理参数与预设情绪模式中的参数值或波形进行比较,根据比较结果,确定用户的情绪模式。首先,根据医学和生理学的规律,对各生理参数预先设定一个或多个标准数值或标准波形,在步骤110获取用户的生理参数后,将获取的生理参数与设定的标准数值或标准波形进行比较,当获取的生理参数位于标准数值或标准波形的范围内,则认为该用户此时的情绪属于该标准数值或标准波形对应情绪模式。所述情绪模式可以是激动、平静、紧张、悲伤、喜悦等等。预设情绪模式中的参数值或波形则根据相应的医学与生理学研究成果或统计规律设定。In a specific implementation, step 120 includes comparing the physiological parameter with a parameter value or waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result. First, according to the laws of medicine and physiology, one or more standard numerical values or standard waveforms are preset for each physiological parameter, and after acquiring the physiological parameters of the user in step 110, the acquired physiological parameters and the set standard numerical values or standard waveforms are obtained. For comparison, when the acquired physiological parameter is within the range of the standard value or the standard waveform, the user's emotion at this time is considered to belong to the standard value or the standard waveform corresponding to the emotional mode. The emotional pattern can be excitement, calmness, nervousness, sadness, joy, and the like. The parameter values or waveforms in the preset mood mode are set according to the corresponding medical and physiological research results or statistical laws.
需要说明的是,对于各项生理参数的情绪波动正常范围和异常范围,在医学或生理学领域均有具体的论述,本领域技术人员可以参考相关的文献进行限定。本申请旨在利用对人体的生理参数的测量值来触发相应的节目播放,提高用户的终端设备的智能性,而并非对具体的医学或生理学规律进行研究。It should be noted that the normal range and the abnormal range of mood fluctuations of various physiological parameters are specifically discussed in the medical or physiological field, and those skilled in the art can refer to relevant literatures for definition. The present application aims to use the measured values of the physiological parameters of the human body to trigger the corresponding program play, and improve the intelligence of the user's terminal device, instead of studying specific medical or physiological laws.
步骤130,根据所述情绪模式播放特定的多媒体节目。在步骤120判断出用户的情绪模式后,则根据情绪模式播放相应风格的多媒体节目。Step 130: Play a specific multimedia program according to the emotional mode. After the emotional mode of the user is determined in step 120, the multimedia program of the corresponding style is played according to the emotional mode.
在一种优选实施方式中,步骤130包括:各个多媒体节目具有情绪标识,当所述情绪标识与所述情绪模式相匹配时,则播放具有该情绪标识的多媒体节目。在本实施方式中,多媒体节目可以包括音乐、电视节目、电影节目、动画等节目类型。多个多媒体节目可以通过适合的数据格式存储 在网络或数据库中,其中,每个多媒体节目都具有表示其风格的情绪标识,所述情绪标识与用户情绪模式相对应,例如对应于用户“喜悦”的情绪模式,多媒体节目的情绪标识为“欢快”或“喜悦”。多媒体节目的情绪标识可以在判断出用户的情绪模式之前就被标记,从而能够在确定用户的情绪模式后进行相应的播放。在步骤120判断出用户的情绪模式后,则根据情绪模式在数据库中检索具有相应情绪标识的多媒体节目,在检索到具有相应情绪标识的多媒体节目后,对所述多媒体节目进行播放。在一个具体实施例中,如果具有相应情绪标识的多媒体节目有多个,则可以选择播放次数最多的节目进行播放。由于播放次数最多的节目有可能是用户最感兴趣的节目,因此进一步提高了用户终端的智能性。当然,本领域技术人员可以理解,对于有多个符合条件的多媒体节目,也可以采用其他的播放方式,例如顺序播放。In a preferred embodiment, step 130 includes each multimedia program having an emotional identity, and when the emotional identity matches the emotional mode, playing a multimedia program having the emotional identity. In the present embodiment, the multimedia program may include a program type such as music, a television program, a movie program, an animation, and the like. Multiple multimedia programs can be stored in a suitable data format In a network or database, wherein each multimedia program has an emotion identifier indicating its style, the emotion identifier corresponding to the user's emotion pattern, for example, an emotion pattern corresponding to the user's "joy", and the emotion identifier of the multimedia program is " Cheerful or "joy". The emotional identification of the multimedia program can be marked before the user's emotional mode is determined, so that the corresponding playing can be performed after determining the emotional mode of the user. After determining the emotional mode of the user in step 120, the multimedia program having the corresponding emotional identifier is retrieved in the database according to the emotional mode, and after the multimedia program having the corresponding emotional identifier is retrieved, the multimedia program is played. In a specific embodiment, if there are multiple multimedia programs having corresponding emotion identifiers, the program with the most playback times can be selected for playback. Since the program with the most playback times is likely to be the program most interesting to the user, the intelligence of the user terminal is further improved. Of course, those skilled in the art can understand that other playback modes, such as sequential playback, can also be used for multiple multimedia programs that meet the requirements.
在一种具体实施方式中,用户可以通过手动设置多媒体节目的情绪标识,在具体应用中,已经预置多种情绪标识供用户选择,比如悲伤、兴奋、平静等。用户选择具有不同情绪标识的节目,在手机或其他用户终端上播放。所述情绪标识可以在每个节目所对应数据结构中定义,以索引项或其他数据项的形式出现。In a specific implementation manner, the user can manually set the emotional identifier of the multimedia program. In the specific application, a plurality of emotion identifiers have been preset for the user to select, such as sadness, excitement, calmness, and the like. The user selects a program with a different emotional identity and plays it on a mobile phone or other user terminal. The emotion identification may be defined in a data structure corresponding to each program, in the form of an index item or other data item.
用于存储多个多媒体节目的数据库可以是位于用户手机或智能电视上的本地数据库,也可以是位于网络服务器或云端的网络数据库,用户可以通过手机或其他用户终端经由互联网去访问所述网络数据库。The database for storing a plurality of multimedia programs may be a local database located on a user's mobile phone or a smart TV, or may be a network database located in a network server or a cloud, and the user may access the network database via a mobile phone or other user terminal via the Internet. .
在一个具体实施例中:用户佩戴运动手环,利用运动手环上的各传感器对该用户的心率、血氧饱和度、体温、血压、皮肤电阻、呼吸率共六项生理参数进行了测量,其中,预先设定:心率的情绪正常波动范围为70-90次/分钟;血氧饱和度的情绪正常波动范是动脉血Hb饱和度95-98%;体温的情绪正常波动范围为36-38℃;血压的情绪正常波动范围为收缩压100-150mmHg;皮肤电阻的情绪正常波动范围为1k-2k欧姆;呼吸率的情绪正常波动范围为15-20次/分钟。经过测量,该用户的心率为105次/分钟、血氧饱和度为Hb饱和度96%、体温为37℃、血压为收缩压160mmHg、皮肤电阻为300欧姆、呼吸率为30次/分钟。而根据预设情绪模式中的参数值,当用户的心率、血压、呼吸率均高于正常范围高于正常范围、皮肤 电阻低于正常范围时,则认为用户处于紧张状态。In a specific embodiment, the user wears a sports bracelet, and uses the sensors on the sports bracelet to measure the user's heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, and respiratory rate. Among them, it is preset: the normal fluctuation range of heart rate is 70-90 times/min; the normal fluctuation of blood oxygen saturation is 95-98% of arterial blood Hb saturation; the normal fluctuation range of body temperature is 36-38 °C; the normal fluctuation range of blood pressure is systolic blood pressure 100-150mmHg; the normal fluctuation range of skin resistance is 1k-2k ohm; the normal fluctuation range of respiratory rate is 15-20 times/min. After measurement, the user's heart rate was 105 beats/min, blood oxygen saturation was Hb saturation 96%, body temperature was 37 ° C, blood pressure was systolic blood pressure 160 mmHg, skin resistance was 300 ohms, and respiration rate was 30 beats/min. According to the parameter values in the preset mood mode, when the user's heart rate, blood pressure, and respiratory rate are higher than the normal range, the skin is higher than the normal range, and the skin When the resistance is below the normal range, the user is considered to be in a state of tension.
相应地,本申请还提供了一种基于用户情绪的多媒体节目播放系统200,所述系统包括生理指标检测单元210、情绪模式判定单元220、节目播放单元230。其中:Correspondingly, the present application further provides a multimedia program playing system 200 based on user emotions, the system comprising a physiological index detecting unit 210, an emotion mode determining unit 220, and a program playing unit 230. among them:
所述生理指标检测单元210用于检测用户的生理参数。生理指标检测单元210可以通过相应的传感器以及相应的数据传输软件模块来实现,在具体实施方式中,可以通过手环或穿戴式装备来检测用户的生理参数。运动手环或可穿戴式头盔或眼镜中具有温度传感器、加速度计、皮电反应传感器、光学心率监测器、生物电阻抗传感器等,这些传感器可以将检测的物理量转换为体温、心率、呼吸率及皮肤电阻等生理参数。The physiological index detecting unit 210 is configured to detect a physiological parameter of the user. The physiological index detecting unit 210 can be implemented by a corresponding sensor and a corresponding data transmission software module. In a specific embodiment, the physiological parameters of the user can be detected by a wristband or a wearable device. In sports bracelets or wearable helmets or glasses, there are temperature sensors, accelerometers, electrodermal response sensors, optical heart rate monitors, bioelectrical impedance sensors, etc. These sensors can convert the detected physical quantities into body temperature, heart rate, respiration rate and Physiological parameters such as skin resistance.
所述情绪模式判定单元220用于根据所述生理参数确定用户的情绪模式。人的情绪通常会反映在人体的生理反应上,因此,通过对测量获得生理参数进行分析可以在一定程度上判断出用户的情绪。The emotion mode determining unit 220 is configured to determine an emotional mode of the user according to the physiological parameter. Human emotions are usually reflected in the physiological response of the human body. Therefore, by analyzing the physiological parameters obtained by measurement, the user's emotion can be judged to some extent.
所述情绪模式判定单元220包括参数比较模块221,参数比较模块221用于将生理参数与预设情绪模式中的参数值或波形进行比较,根据比较结果,确定用户的情绪模式。获取用户的生理参数后,将获取的生理参数与设定的标准数值或标准波形进行比较,当获取的生理参数位于标准数值或标准波形的范围内,则认为该用户此时的情绪属于该标准数值或标准波形对应情绪模式。The emotion mode determining unit 220 includes a parameter comparison module 221 for comparing the physiological parameter with a parameter value or a waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result. After obtaining the physiological parameter of the user, comparing the acquired physiological parameter with the set standard value or standard waveform, and when the acquired physiological parameter is within the range of the standard value or the standard waveform, the user's emotion at the time is considered to belong to the standard. The numerical or standard waveform corresponds to the emotional mode.
所述节目播放单元230用于根据所述情绪模式播放特定的多媒体节目。所述节目播放单元230包括情绪标识匹配模块231,情绪标识匹配模块231用于将所述情绪标识与所述情绪模式相匹配,以播放具有该情绪标识的多媒体节目。判断出用户的情绪模式后,则根据情绪模式在数据库中检索具有相应情绪标识的多媒体节目,在检索到具有相应情绪标识的多媒体节目后,对所述多媒体节目进行播放。The program playing unit 230 is configured to play a specific multimedia program according to the mood mode. The program playing unit 230 includes an emotion identification matching module 231, and the emotion identification matching module 231 is configured to match the emotion identifier with the emotion pattern to play a multimedia program having the emotion identifier. After determining the emotional mode of the user, the multimedia program having the corresponding emotional identifier is retrieved in the database according to the emotional mode, and after the multimedia program having the corresponding emotional identifier is retrieved, the multimedia program is played.
其中,所述生理指标检测单元210可以与节目播放单元230集成在同一个硬件设备上,例如,所述生理指标检测单元210可以与节目播放单元230集成在用户的手机上。所述生理指标检测单元210也可以与节目播放单元230集成在不同的硬件设备上,例如,生理指标检测单元210设置在用户头戴的穿戴式头盔上,而节目播放单元230设置在用户的手机上。 The physiological indicator detecting unit 210 can be integrated with the program playing unit 230 on the same hardware device. For example, the physiological indicator detecting unit 210 can be integrated with the program playing unit 230 on the user's mobile phone. The physiological indicator detecting unit 210 can also be integrated with the program playing unit 230 on different hardware devices. For example, the physiological index detecting unit 210 is disposed on the wearable helmet worn by the user, and the program playing unit 230 is disposed on the user's mobile phone. on.
如图3所示,本申请的实施例还提供了一种基于用户情绪的多媒体节目播放系统,该系统包括:As shown in FIG. 3, an embodiment of the present application further provides a multimedia program playing system based on user emotion, and the system includes:
处理器301、存储器302、通信接口303和总线304;其中,a processor 301, a memory 302, a communication interface 303, and a bus 304; wherein
所述处理器301、存储器302、通信接口303通过所述总线304完成相互间的通信;The processor 301, the memory 302, and the communication interface 303 complete communication with each other through the bus 304;
所述通信接口303用于所述系统与手机、手环或穿戴式装备之间的信息传输;The communication interface 303 is used for information transmission between the system and a mobile phone, a wristband or a wearable device;
所述处理器301用于调用所述存储器302中的逻辑指令,以执行如下方法;The processor 301 is configured to invoke logic instructions in the memory 302 to perform the following methods;
步骤110,检测用户的生理参数;Step 110: Detect physiological parameters of the user;
步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。Step 120: Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
本申请的实施例还提供了一种计算机程序,包括程序代码,所述程序代码用于执行如下操作:An embodiment of the present application also provides a computer program, including program code, for performing the following operations:
步骤110,检测用户的生理参数;Step 110: Detect physiological parameters of the user;
步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。Step 120: Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
本申请的实施例还提供了一种存储介质,用于存储上述计算机程序。Embodiments of the present application also provide a storage medium for storing the above computer program.
本申请是参照根据本申请实施例的方法、装置(设备)和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of a method, apparatus, and computer program product according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。 The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
以上所描述的车载平台以及智能交通系统等实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。The embodiments of the vehicle platform and the intelligent transportation system described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be Physical units can be located in one place or distributed to multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.
最后应说明的是:以上实施例仅用以说明本申请的实施例的技术方案,而非对其限制;尽管参照前述实施例对本申请的实施例进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。 It should be noted that the above embodiments are only used to explain the technical solutions of the embodiments of the present application, and are not limited thereto; although the embodiments of the present application are described in detail with reference to the foregoing embodiments, those skilled in the art It should be understood that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present application. The spirit and scope of the programme.

Claims (13)

  1. 一种基于用户情绪的多媒体节目播放方法,其特征在于,所述方法包括以下步骤:A multimedia program playing method based on user emotion, characterized in that the method comprises the following steps:
    步骤110,检测用户的生理参数;Step 110: Detect physiological parameters of the user;
    步骤120,根据所述生理参数确定用户的情绪模式;Step 120: Determine an emotional mode of the user according to the physiological parameter;
    步骤130,根据所述情绪模式播放特定的多媒体节目。Step 130: Play a specific multimedia program according to the emotional mode.
  2. 根据权利要求1所述的方法,其特征在于,步骤110包括:通过手机、手环或穿戴式装备检测用户的生理参数。The method of claim 1 wherein step 110 comprises detecting a physiological parameter of the user via a cell phone, a wristband or a wearable device.
  3. 根据权利要求2所述的方法,其特征在于,所述生理参数包括心率、血氧饱和度、体温、血压、皮肤电阻、脑电波、呼吸率中的任意一项或多项。The method according to claim 2, wherein the physiological parameter comprises any one or more of heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
  4. 根据权利要求1-3中任意一项所述的方法,其特征在于,步骤120包括:将生理参数与预设情绪模式中的参数值或波形进行比较,根据比较结果,确定用户的情绪模式。The method according to any one of claims 1 to 3, wherein the step 120 comprises: comparing the physiological parameter with a parameter value or a waveform in the preset emotional mode, and determining the emotional mode of the user according to the comparison result.
  5. 根据权利要求4所述的方法,其特征在于,步骤130包括:各个多媒体节目具有情绪标识,当所述情绪标识与所述情绪模式相匹配时,则播放具有该情绪标识的多媒体节目。The method of claim 4, wherein the step 130 comprises: each multimedia program having an emotional identity, and when the emotional identity matches the emotional mode, playing the multimedia programming having the emotional identity.
  6. 一种基于用户情绪的多媒体节目播放系统,其特征在于,所述系统包括生理指标检测单元、情绪模式判定单元、节目播放单元,其中:A multimedia program playing system based on user emotion, characterized in that the system comprises a physiological index detecting unit, an emotional mode determining unit, and a program playing unit, wherein:
    所述生理指标检测单元用于检测用户的生理参数;The physiological indicator detecting unit is configured to detect a physiological parameter of the user;
    所述情绪模式判定单元用于根据所述生理参数确定用户的情绪模式;The emotion mode determining unit is configured to determine an emotional mode of the user according to the physiological parameter;
    所述节目播放单元用于根据所述情绪模式播放特定的多媒体节目。The program playing unit is configured to play a specific multimedia program according to the mood mode.
  7. 根据权利要求6所述的系统,其特征在于,所述生理指标检测单元为手机、手环或穿戴式装备。The system according to claim 6, wherein the physiological indicator detecting unit is a mobile phone, a wristband or a wearable device.
  8. 根据权利要求7所述的系统,其特征在于,所述生理参数包括心率、血氧饱和度、体温、血压、皮肤电阻、脑电波、呼吸率中的任意一项或多项。The system according to claim 7, wherein the physiological parameter comprises any one or more of heart rate, blood oxygen saturation, body temperature, blood pressure, skin resistance, brain wave, and respiratory rate.
  9. 根据权利要求6-8中任意一项所述的系统,其特征在于,所述情绪模式判定单元包括参数比较模块,用于将生理参数与预设情绪模式中的参数值或波形进行比较,根据比较结果,确定用户的情绪模式。The system according to any one of claims 6-8, wherein the emotional mode determining unit comprises a parameter comparing module for comparing the physiological parameter with a parameter value or waveform in the preset emotional mode, according to Compare the results to determine the user's emotional patterns.
  10. 根据权利要求9所述的系统,其特征在于,所述节目播放单元包括情绪标识匹配模块:情绪标识匹配模块用于将所述情绪标识与所述情绪模式 相匹配,以播放具有该情绪标识的多媒体节目。The system according to claim 9, wherein said program playing unit comprises an emotion identification matching module: said emotion identification matching module is configured to use said emotion identification and said emotional mode Matching to play a multimedia program with the emotional identity.
  11. 一种基于用户情绪的多媒体节目播放系统,其特征在于,包括:A multimedia program playing system based on user emotion, characterized in that it comprises:
    处理器、存储器、通信接口和总线;其中,a processor, a memory, a communication interface, and a bus; wherein
    所述处理器、存储器、通信接口通过所述总线完成相互间的通信;The processor, the memory, and the communication interface complete communication with each other through the bus;
    所述通信接口用于所述系统与手机、手环或穿戴式装备之间的信息传输;The communication interface is used for information transmission between the system and a mobile phone, a wristband or a wearable device;
    所述处理器用于调用所述存储器中的逻辑指令,以执行如下方法;The processor is configured to invoke logic instructions in the memory to perform the following method;
    步骤110,检测用户的生理参数;Step 110: Detect physiological parameters of the user;
    步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。Step 120: Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
  12. 一种计算机程序,其特征在于,包括程序代码,所述程序代码用于执行如下操作:A computer program comprising program code for performing the following operations:
    步骤110,检测用户的生理参数;Step 110: Detect physiological parameters of the user;
    步骤120,根据所述生理参数确定用户的情绪模式;步骤130,根据所述情绪模式播放特定的多媒体节目。Step 120: Determine an emotional mode of the user according to the physiological parameter; and step 130, play a specific multimedia program according to the emotional mode.
  13. 一种存储介质,其特征在于,用于存储权利要求12所述的计算机程序。 A storage medium characterized by storing the computer program of claim 12.
PCT/CN2016/097971 2015-12-08 2016-09-02 Program playing method and system based on emotion of user WO2017096979A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510897472.6A CN105898567A (en) 2015-12-08 2015-12-08 Program playing method based on user's emotion and system
CN201510897472.6 2015-12-08

Publications (1)

Publication Number Publication Date
WO2017096979A1 true WO2017096979A1 (en) 2017-06-15

Family

ID=57002832

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/097971 WO2017096979A1 (en) 2015-12-08 2016-09-02 Program playing method and system based on emotion of user

Country Status (2)

Country Link
CN (1) CN105898567A (en)
WO (1) WO2017096979A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112380363A (en) * 2020-11-02 2021-02-19 中国第一汽车股份有限公司 Multimedia content recommendation method, device, vehicle and storage medium
CN113724544A (en) * 2021-08-30 2021-11-30 安徽淘云科技股份有限公司 Playing method and related equipment thereof

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105898567A (en) * 2015-12-08 2016-08-24 乐视移动智能信息技术(北京)有限公司 Program playing method based on user's emotion and system
US10529379B2 (en) * 2016-09-09 2020-01-07 Sony Corporation System and method for processing video content based on emotional state detection
CN106373444B (en) * 2016-11-15 2018-11-30 滨州学院 A kind of Multifunctional English classroom with English teaching aid
CN106776835A (en) * 2016-11-25 2017-05-31 青岛海信移动通信技术股份有限公司 A kind of media information processing method, apparatus and system
CN107837088A (en) * 2017-09-08 2018-03-27 深圳市云中飞电子有限公司 A kind of mood monitoring method, device and mood monitoring bracelet
CN107564550A (en) * 2017-10-27 2018-01-09 安徽硕威智能科技有限公司 A kind of card machine people that music is played according to detection children's heartbeat
WO2019109289A1 (en) * 2017-12-07 2019-06-13 深圳市柔宇科技有限公司 Emotion-based content recommendation method, apparatus, head-mounted device, and storage medium
CN108512995B (en) * 2018-03-01 2020-08-18 Oppo广东移动通信有限公司 Electronic device, brain wave control method and related product
CN109491499B (en) * 2018-11-05 2022-05-24 创维集团智能科技有限公司 Electric equipment control method and device, electric equipment and medium
CN110200616A (en) * 2019-05-29 2019-09-06 泰康保险集团股份有限公司 Heart rate characteristic processing method, device, medium and electronic equipment
CN110620945A (en) * 2019-09-05 2019-12-27 佛山市云米电器科技有限公司 Intelligent 5G television storage system based on biological signals
CN111414883A (en) * 2020-03-27 2020-07-14 深圳创维-Rgb电子有限公司 Program recommendation method, terminal and storage medium based on face emotion
CN111616722A (en) * 2020-06-03 2020-09-04 吕丹青 Method and system for detecting emotion change and wearable device
CN112206394A (en) * 2020-10-09 2021-01-12 安徽美心信息科技有限公司 Psychological training interactive system and training method based on VR technology
CN112669882A (en) * 2021-01-07 2021-04-16 上海龙旗科技股份有限公司 Media playing method and device based on pressure detection
CN113793578B (en) * 2021-08-12 2023-10-20 咪咕音乐有限公司 Method, device and equipment for generating tune and computer readable storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090156887A1 (en) * 2007-12-12 2009-06-18 Institute For Information Industry System and method for perceiving and relaxing emotions
CN101822863A (en) * 2010-01-28 2010-09-08 深圳先进技术研究院 Emotion regulating device and method thereof
CN102446533A (en) * 2010-10-15 2012-05-09 盛乐信息技术(上海)有限公司 Music player
CN104338228A (en) * 2014-10-15 2015-02-11 惠州Tcl移动通信有限公司 Emotion regulation method and terminal
CN104548309A (en) * 2015-01-05 2015-04-29 浙江工业大学 Device and method for adjusting driver emotional state through different affective characteristic music
CN104851437A (en) * 2015-04-28 2015-08-19 广东欧珀移动通信有限公司 Song playing method and terminal
CN105487654A (en) * 2015-11-23 2016-04-13 联想(北京)有限公司 Method and device for executing multimedia files
CN105516468A (en) * 2015-11-27 2016-04-20 上海与德通讯技术有限公司 Mobile terminal and music play control method thereof
CN105898567A (en) * 2015-12-08 2016-08-24 乐视移动智能信息技术(北京)有限公司 Program playing method based on user's emotion and system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103916540B (en) * 2014-03-31 2018-03-16 惠州Tcl移动通信有限公司 The method and mobile terminal of a kind of feedback of the information
CN104008764A (en) * 2014-04-30 2014-08-27 小米科技有限责任公司 Multimedia information marking method and relevant device
CN104491969A (en) * 2014-12-10 2015-04-08 深圳市量子智慧文化发展有限公司 Body and mind regulation method and system based on sound

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090156887A1 (en) * 2007-12-12 2009-06-18 Institute For Information Industry System and method for perceiving and relaxing emotions
CN101822863A (en) * 2010-01-28 2010-09-08 深圳先进技术研究院 Emotion regulating device and method thereof
CN102446533A (en) * 2010-10-15 2012-05-09 盛乐信息技术(上海)有限公司 Music player
CN104338228A (en) * 2014-10-15 2015-02-11 惠州Tcl移动通信有限公司 Emotion regulation method and terminal
CN104548309A (en) * 2015-01-05 2015-04-29 浙江工业大学 Device and method for adjusting driver emotional state through different affective characteristic music
CN104851437A (en) * 2015-04-28 2015-08-19 广东欧珀移动通信有限公司 Song playing method and terminal
CN105487654A (en) * 2015-11-23 2016-04-13 联想(北京)有限公司 Method and device for executing multimedia files
CN105516468A (en) * 2015-11-27 2016-04-20 上海与德通讯技术有限公司 Mobile terminal and music play control method thereof
CN105898567A (en) * 2015-12-08 2016-08-24 乐视移动智能信息技术(北京)有限公司 Program playing method based on user's emotion and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112380363A (en) * 2020-11-02 2021-02-19 中国第一汽车股份有限公司 Multimedia content recommendation method, device, vehicle and storage medium
CN113724544A (en) * 2021-08-30 2021-11-30 安徽淘云科技股份有限公司 Playing method and related equipment thereof
CN113724544B (en) * 2021-08-30 2023-08-22 安徽淘云科技股份有限公司 Playing method and related equipment thereof

Also Published As

Publication number Publication date
CN105898567A (en) 2016-08-24

Similar Documents

Publication Publication Date Title
WO2017096979A1 (en) Program playing method and system based on emotion of user
US11672430B2 (en) System and method for health monitoring
Frey et al. Breeze: Sharing biofeedback through wearable technologies
US9086884B1 (en) Utilizing analysis of content to reduce power consumption of a sensor that measures affective response to the content
US9069380B2 (en) Media device, application, and content management using sensory input
US20140059066A1 (en) System and method for obtaining and using user physiological and emotional data
US20120317024A1 (en) Wearable device data security
US20130245396A1 (en) Mental state analysis using wearable-camera devices
JP2018521381A (en) Emotion detection system
CN104545951A (en) Body state monitoring platform based on functional near-infrared spectroscopy and motion detection
Martin et al. Virtual reality sickness detection: An approach based on physiological signals and machine learning
TWI714926B (en) Method for constructing dream reproduction model, method and device for dream reproduction
JP2009142634A (en) System and method for perceiving and relaxing emotion
WO2017069644A2 (en) Wireless eeg headphones for cognitive tracking and neurofeedback
US20160374578A1 (en) Contextual heart health monitoring with integrated ecg (electrocardiogram)
CN108888277A (en) Psychological test method, system and terminal device
WO2020257354A1 (en) Wearable device operable to detect and/or manage user emotion
Kim et al. Interactive emotional lighting system using physiological signals
CN114007497A (en) Device for monitoring a subject
WO2018222589A1 (en) System and method for treating disorders with a virtual reality system
Kang et al. Sinabro: Opportunistic and unobtrusive mobile electrocardiogram monitoring system
CN108903956A (en) It detects a lie device and method
JP7288064B2 (en) visual virtual agent
CA2820092A1 (en) Wearable device data security
Novak Engineering issues in physiological computing

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16872175

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16872175

Country of ref document: EP

Kind code of ref document: A1