WO2014119900A1 - Dispositif intelligent possédant une interface utilisateur basée sur des émotions humaines ou des penchants humains et procédé d'interface utilisateur - Google Patents

Dispositif intelligent possédant une interface utilisateur basée sur des émotions humaines ou des penchants humains et procédé d'interface utilisateur Download PDF

Info

Publication number
WO2014119900A1
WO2014119900A1 PCT/KR2014/000792 KR2014000792W WO2014119900A1 WO 2014119900 A1 WO2014119900 A1 WO 2014119900A1 KR 2014000792 W KR2014000792 W KR 2014000792W WO 2014119900 A1 WO2014119900 A1 WO 2014119900A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
smart device
user interface
information
inclinations
Prior art date
Application number
PCT/KR2014/000792
Other languages
English (en)
Korean (ko)
Inventor
이종식
Original Assignee
Lee Jong Sik
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020130012809A external-priority patent/KR20140096935A/ko
Application filed by Lee Jong Sik filed Critical Lee Jong Sik
Priority to CN201480006469.4A priority Critical patent/CN104969563A/zh
Publication of WO2014119900A1 publication Critical patent/WO2014119900A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user

Definitions

  • the present invention relates to a user interface device and a user interface method, and more particularly, to a smart device and a user interface method having a user interface based on human emotion or disposition.
  • Smart TV is a multi-functional TV that combines Internet access function with TV and installs various applications such as surfing the web, watching VOD, Social Networking Service (SNS), and games. to be.
  • SNS Social Networking Service
  • the biggest feature of smart TV is that user and TV have the function to exchange information with each other. This is the biggest difference from existing TVs that only unilaterally transmit information.
  • voice recognition technology is representative.
  • a user-friendly interface such as voice recognition
  • the present invention is to solve the problems of the prior art as described above, a smart device and a user interface method that can provide content suitable for the user by reflecting the user's disposition or the current emotional state of the user using the smart device
  • the purpose is to provide.
  • the present invention obtains the face image information of the user through a camera or the like, generates information on the emotion or propensity of the user from the acquired image, and outputs the necessary screen or sound according to the generated information.
  • the present invention has the effect of providing the user with suitable content according to the user's disposition or the current emotional state of the user.
  • FIG. 1 is a block diagram showing an embodiment of a smart device capable of recognizing a user's feelings / tendencies according to the present invention.
  • FIG. 2 is a flowchart illustrating an interface method according to an emotion of a user using a smart device according to the present invention.
  • FIG. 3 is a flowchart illustrating an interface method according to a user's disposition using a smart device according to the present invention.
  • a smart device includes: a camera unit obtaining face image information of a user, a recognition unit generating information on at least one of an emotion or a propensity of a user using an image obtained through the camera unit, and the camera; And a control unit for controlling the unit and the recognition unit and selecting which screen or sound to output based on the information transmitted from the recognition unit, and an output unit for outputting the screen or sound according to the selection of the controller.
  • a user interface method of a smart device comprising: recognizing at least one of an emotional state of a user and a user's disposition using the face image information of a user acquired through a camera unit provided in the smart device; And performing any one of content provision, channel change, application driving, and advertisement provision corresponding to the result.
  • FIG. 1 is a block diagram showing an embodiment of a smart device capable of recognizing a user's feelings / tendencies according to the present invention.
  • a smart device 10 capable of recognizing a user's emotion / inclination includes a camera unit 11, a recognition unit 12, a control unit 13, and an output unit 14.
  • the smart device 10 is an electronic device capable of driving contents or applications under the control of a user, and includes a smart TV, a smart phone, a smart advertisement display device, a notebook computer, and a robot capable of playing / educating. .
  • the camera unit 11 included in the smart device 10 according to the present invention acquires face image information of the current user in real time.
  • the camera unit 11 may be mounted on the front surface of the smart device 10 so that the face image information of the user who uses the smart device 10 may be easily obtained.
  • the face image information of the user acquired through the camera unit 11 is transmitted to the recognition unit 12.
  • the recognition unit 12 derives the user's current emotion or disposition by analyzing the face image of the user acquired through the camera unit 11. For example, emotions that people generally have can be divided into five categories: expressionlessness, joy, sadness, anger, and surprise. In addition, a person's disposition can be classified into an introvert, an extrovert, or a mixture of the two.
  • the recognition unit 12 analyzes the face image information of the user transmitted through the camera unit 11 to determine what emotional state the user currently has. That is, the recognition unit 12 determines whether the user is currently in an expressionless state, a happy state, a sad state, an angry state, or a surprised state based on the expression of the user transmitted through the camera unit 11. .
  • the recognition unit 12 whether the user is an introvert, an outgoing person, or a mixture of two inclinations through the change of the face from the expressionless state of the user in the joyous state, sad state, angry state, surprised state Determine if you are a person.
  • the emotion / propensity information of the user determined in real time through the recognition unit 12 is transmitted to the control unit 13.
  • the controller 13 selects content to be displayed to the user, an application to be run (application), or an advertisement based on the information transmitted through the recognition unit.
  • the controller 13 may control the comedy program or content corresponding to the entertainment to be output through the output unit 14.
  • the control unit 13 may control to output good music, drama or advertisement that can stabilize the mind through the output unit 14. have.
  • the current state of the user is recognized as a sad state, it may be controlled to output a movie, a game application or an advertisement that can be impressed through the output unit 14.
  • control unit 13 may output content such as a movie or music that may impress and / or an advertisement (eg, a classic performance advertisement) suitable for the user's disposition. It can be controlled to output through (14).
  • the controller 13 controls the output unit 14 to output content such as sports and / or advertisements (eg, sports advertisements) suitable for the user's disposition. can do.
  • the output unit 14 outputs a screen and / or sound under the control of the controller 13.
  • FIG. 2 is a flowchart illustrating an interface method according to an emotion of a user using a smart device according to the present invention.
  • the smart device When the user appears in front of the smart device to use the smart device 10, the smart device recognizes the appearance of the user (S21), and displays a question to ask the user whether to turn on the smart device 10 (S22). ). For example, you can display a question such as "Would you like to turn on the TV?" In response to this, when the user instructs to turn on the smart device 10 by using a voice or a remote controller, the smart device 10 is operated (S23).
  • the recognition unit 12 analyzes the face image information of the user transmitted through the camera unit 11 to determine the current emotional state of the user (S24). According to the emotional state of the user, the smart device 10 provides a content list determined to be helpful to the user, or provides a channel list or an application program list (S25). In this case, an advertisement related to a service or a product which is determined to be helpful to the emotional state of the user together with the list or separately may be provided.
  • the smart device 10 may not directly provide a list to the user, but may directly select the required content, channel, and application program and output the same to the user.
  • the smart device 10 executes the recommended content, sets a channel, or drives the application ( S27).
  • FIG. 3 is a flowchart illustrating an interface method according to a user's disposition using a smart device according to the present invention.
  • the smart device 10 When the smart device 10 is operated and the content is displayed to the user (S31), the smart device 10 obtains information on the expression change of the user according to the displayed content (S32).
  • the smart device 10 detects the user's disposition on the basis of the information on the user's facial expression change (S33). For example, it may be determined that the disposition of the user is outward, inward, or a mixture of both dispositions.
  • the determined user information is stored in the memory of the smart device 10 (S34).
  • the smart device 10 recommends a content / channel / application suitable for the user by using stored user's propensity information and / or user's current emotional state information acquired in real time (S35).
  • an advertisement regarding a service or a product corresponding to the user's propensity and / or emotional state information may be provided.
  • the user selects any one of the recommended content / channel / application (S36), the selected content is output, the channel is set, or the application is driven (S37).
  • the present invention can be used for the interface of the electronic device.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Social Psychology (AREA)
  • Signal Processing (AREA)
  • Biomedical Technology (AREA)
  • Physics & Mathematics (AREA)
  • Neurosurgery (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Biophysics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un dispositif intelligent possédant une interface utilisateur basée sur des émotions humaines ou des penchants humains, ainsi qu'un procédé d'interface utilisateur. L'invention a pour effet de fournir un contenu à un utilisateur ; de permettre à l'utilisateur de changer des canaux ; de permettre à l'utilisateur de commander un programme d'application ; et de fournir à l'utilisateur des publicités en fonction de l'émotion ou du penchant de l'utilisateur.
PCT/KR2014/000792 2013-01-29 2014-01-28 Dispositif intelligent possédant une interface utilisateur basée sur des émotions humaines ou des penchants humains et procédé d'interface utilisateur WO2014119900A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201480006469.4A CN104969563A (zh) 2013-01-29 2014-01-28 具有基于人的感情或性情的用户接口的智能设备及用户接口方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2013-0009568 2013-01-29
KR20130009568 2013-01-29
KR1020130012809A KR20140096935A (ko) 2013-01-29 2013-02-05 인간의 감정 또는 성향 기반으로 한 사용자 인터페이스를 구비한 스마트 기기 및 사용자 인터페이스 방법
KR10-2013-0012809 2013-02-05

Publications (1)

Publication Number Publication Date
WO2014119900A1 true WO2014119900A1 (fr) 2014-08-07

Family

ID=51262557

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/000792 WO2014119900A1 (fr) 2013-01-29 2014-01-28 Dispositif intelligent possédant une interface utilisateur basée sur des émotions humaines ou des penchants humains et procédé d'interface utilisateur

Country Status (1)

Country Link
WO (1) WO2014119900A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106610990A (zh) * 2015-10-22 2017-05-03 北京国双科技有限公司 情感倾向性分析的方法及装置
CN110908340A (zh) * 2018-09-14 2020-03-24 珠海格力电器股份有限公司 智能家居的控制方法及装置
WO2020135334A1 (fr) * 2018-12-28 2020-07-02 深圳Tcl数字技术有限公司 Procédé de commutation de thème d'application de télévision, télévision, support de stockage lisible et dispositif

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003060956A (ja) * 2001-08-20 2003-02-28 Fuji Photo Film Co Ltd デジタルカメラ
KR20050025552A (ko) * 2004-01-17 2005-03-14 주식회사 헬스피아 이동통신 단말기
KR20060099182A (ko) * 2005-03-10 2006-09-19 엘지전자 주식회사 프로그램 권장 기능을 갖는 디지털 티브이 및 그 제어방법
KR20110100061A (ko) * 2010-03-03 2011-09-09 엘지전자 주식회사 영상표시장치 및 그 동작 방법.

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003060956A (ja) * 2001-08-20 2003-02-28 Fuji Photo Film Co Ltd デジタルカメラ
KR20050025552A (ko) * 2004-01-17 2005-03-14 주식회사 헬스피아 이동통신 단말기
KR20060099182A (ko) * 2005-03-10 2006-09-19 엘지전자 주식회사 프로그램 권장 기능을 갖는 디지털 티브이 및 그 제어방법
KR20110100061A (ko) * 2010-03-03 2011-09-09 엘지전자 주식회사 영상표시장치 및 그 동작 방법.

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106610990A (zh) * 2015-10-22 2017-05-03 北京国双科技有限公司 情感倾向性分析的方法及装置
CN106610990B (zh) * 2015-10-22 2020-12-29 北京国双科技有限公司 情感倾向性分析的方法及装置
CN110908340A (zh) * 2018-09-14 2020-03-24 珠海格力电器股份有限公司 智能家居的控制方法及装置
WO2020135334A1 (fr) * 2018-12-28 2020-07-02 深圳Tcl数字技术有限公司 Procédé de commutation de thème d'application de télévision, télévision, support de stockage lisible et dispositif

Similar Documents

Publication Publication Date Title
CN111372109B (zh) 一种智能电视以及信息交互方法
CN111787375B (zh) 显示设备及信息显示方法
WO2021031809A1 (fr) Procédé d'affichage d'interface et dispositif d'affichage
US11924513B2 (en) Display apparatus and method for display user interface
CN111510788B (zh) 一种双屏双系统屏幕切换动画的显示方法及显示设备
CN112383802B (zh) 焦点切换方法、投影显示设备及系统
Saleme et al. Coping with the challenges of delivering multiple sensorial media
US20170289633A1 (en) Information processing device
CN109302631B (zh) 视频界面显示方法及装置
WO2014119900A1 (fr) Dispositif intelligent possédant une interface utilisateur basée sur des émotions humaines ou des penchants humains et procédé d'interface utilisateur
WO2020248697A1 (fr) Dispositif d'affichage et procédé de traitement des données de communication vidéo
US20220291752A1 (en) Distributed Application Platform Projected on a Secondary Display for Entertainment, Gaming and Learning with Intelligent Gesture Interactions and Complex Input Composition for Control
KR20150013394A (ko) 인간의 감정 또는 성향 기반으로 한 사용자 인터페이스를 구비한 스마트 기기 및 사용자 인터페이스 방법
KR20140096935A (ko) 인간의 감정 또는 성향 기반으로 한 사용자 인터페이스를 구비한 스마트 기기 및 사용자 인터페이스 방법
WO2020248682A1 (fr) Dispositif d'affichage et procédé de génération de scène virtuelle
CN112073803B (zh) 一种声音再现方法及显示设备
CN113015023A (zh) Html5网页中的视频控制的方法及装置
CN112927653A (zh) 显示设备与背光亮度的控制方法
CN112883144A (zh) 一种信息交互方法
CN112786036B (zh) 显示设备与内容显示方法
CN112752159B (zh) 一种互动方法和相关装置
CN113630633B (zh) 显示设备及交互控制方法
von Bruhn Hinné et al. Using motion-sensing remote controls with older adults
WO2023029049A1 (fr) Procédé de commutation de sous-titres, dispositif terminal et support de stockage
CN117651180A (zh) 视频播放方法、装置及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14745374

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 12/11/2015)

122 Ep: pct application non-entry in european phase

Ref document number: 14745374

Country of ref document: EP

Kind code of ref document: A1