EP3913473A4 - Human-machine interaction control method, apparatus and system, and electronic device - Google Patents

Human-machine interaction control method, apparatus and system, and electronic device Download PDF

Info

Publication number
EP3913473A4
EP3913473A4 EP20913063.2A EP20913063A EP3913473A4 EP 3913473 A4 EP3913473 A4 EP 3913473A4 EP 20913063 A EP20913063 A EP 20913063A EP 3913473 A4 EP3913473 A4 EP 3913473A4
Authority
EP
European Patent Office
Prior art keywords
human
electronic device
control method
machine interaction
interaction control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP20913063.2A
Other languages
German (de)
French (fr)
Other versions
EP3913473A1 (en
Inventor
Zhun WU
Shiyu WU
Shiyan Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Publication of EP3913473A1 publication Critical patent/EP3913473A1/en
Publication of EP3913473A4 publication Critical patent/EP3913473A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
    • G06F1/1605—Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231—Monitoring the presence, absence or movement of users
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/4401—Bootstrapping
    • G06F9/4418—Suspend and resume; Hibernate and awake
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
EP20913063.2A 2020-03-25 2020-12-11 Human-machine interaction control method, apparatus and system, and electronic device Withdrawn EP3913473A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010220639.6A CN111273833B (en) 2020-03-25 2020-03-25 Man-machine interaction control method, device and system and electronic equipment
PCT/CN2020/135719 WO2021189967A1 (en) 2020-03-25 2020-12-11 Human-machine interaction control method, apparatus and system, and electronic device

Publications (2)

Publication Number Publication Date
EP3913473A1 EP3913473A1 (en) 2021-11-24
EP3913473A4 true EP3913473A4 (en) 2022-12-07

Family

ID=70999656

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20913063.2A Withdrawn EP3913473A4 (en) 2020-03-25 2020-12-11 Human-machine interaction control method, apparatus and system, and electronic device

Country Status (6)

Country Link
US (1) US20210349526A1 (en)
EP (1) EP3913473A4 (en)
JP (1) JP7345551B2 (en)
KR (1) KR20220010580A (en)
CN (1) CN111273833B (en)
WO (1) WO2021189967A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111273833B (en) * 2020-03-25 2022-02-01 北京百度网讯科技有限公司 Man-machine interaction control method, device and system and electronic equipment
CN111309153B (en) * 2020-03-25 2024-04-09 北京百度网讯科技有限公司 Man-machine interaction control method and device, electronic equipment and storage medium
CN111918106A (en) * 2020-07-07 2020-11-10 胡飞青 Multimedia playing system and method for application scene recognition
CN111538456A (en) * 2020-07-10 2020-08-14 深圳追一科技有限公司 Human-computer interaction method, device, terminal and storage medium based on virtual image
CN112967010A (en) * 2021-02-07 2021-06-15 中国工商银行股份有限公司 Service handling method and device based on digital human guide, electronic equipment and medium
CN114090166A (en) * 2021-11-29 2022-02-25 云知声智能科技股份有限公司 Interaction method and device
CN114356092B (en) * 2022-01-05 2022-09-09 花脸数字技术(杭州)有限公司 Multi-mode-based man-machine interaction system for digital human information processing

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170139471A1 (en) * 2015-11-12 2017-05-18 Microsoft Technology Licensing, Llc Adaptive user presence awareness for smart devices
US20170289766A1 (en) * 2016-03-29 2017-10-05 Microsoft Technology Licensing, Llc Digital Assistant Experience based on Presence Detection
US20180095524A1 (en) * 2016-09-30 2018-04-05 Intel Corporation Interaction mode selection based on detected distance between user and machine interface
US20190138330A1 (en) * 2017-11-08 2019-05-09 Alibaba Group Holding Limited Task Processing Method and Device
WO2019212566A1 (en) * 2018-05-04 2019-11-07 Google Llc Generating and/or adapting automated assistant content according to a distance between user(s) and an automated assistant interface

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4822319B2 (en) * 2005-10-27 2011-11-24 株式会社国際電気通信基礎技術研究所 Communication robot and attention control system using the same
JP4923876B2 (en) * 2006-09-01 2012-04-25 富士通株式会社 Information providing robot and information providing method using robot
CN103927091B (en) * 2013-01-15 2018-04-27 华为终端有限公司 The method, apparatus and system of a kind of human-computer interaction
CN105892829A (en) * 2016-04-02 2016-08-24 上海大学 Human-robot interactive device and method based on identity recognition
JP6447578B2 (en) * 2016-05-27 2019-01-09 トヨタ自動車株式会社 Voice dialogue apparatus and voice dialogue method
KR102391322B1 (en) * 2017-06-30 2022-04-26 엘지전자 주식회사 Moving robot
CN107765852A (en) * 2017-10-11 2018-03-06 北京光年无限科技有限公司 Multi-modal interaction processing method and system based on visual human
CN107825438A (en) * 2017-12-06 2018-03-23 山东依鲁光电科技有限公司 City intelligent integrated service machine people and its operation method
CN107861626A (en) * 2017-12-06 2018-03-30 北京光年无限科技有限公司 The method and system that a kind of virtual image is waken up
JP6991051B2 (en) * 2017-12-11 2022-01-12 株式会社日立ビルシステム Guidance system
JP7130201B2 (en) * 2018-01-18 2022-09-05 株式会社ユピテル Equipment and programs, etc.
CN108833941A (en) * 2018-06-29 2018-11-16 北京百度网讯科技有限公司 Man-machine dialogue system method, apparatus, user terminal, processing server and system
CN110874137B (en) * 2018-08-31 2023-06-13 阿里巴巴集团控股有限公司 Interaction method and device
CN110096191B (en) * 2019-04-24 2021-06-29 北京百度网讯科技有限公司 Man-machine conversation method and device and electronic equipment
CN109940638B (en) * 2019-04-26 2021-04-16 北京猎户星空科技有限公司 Robot, robot control method, robot control device, storage medium, and controller
CN113110788B (en) * 2019-08-14 2023-07-04 京东方科技集团股份有限公司 Information display interaction method and device, computer equipment and medium
CN111273833B (en) * 2020-03-25 2022-02-01 北京百度网讯科技有限公司 Man-machine interaction control method, device and system and electronic equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170139471A1 (en) * 2015-11-12 2017-05-18 Microsoft Technology Licensing, Llc Adaptive user presence awareness for smart devices
US20170289766A1 (en) * 2016-03-29 2017-10-05 Microsoft Technology Licensing, Llc Digital Assistant Experience based on Presence Detection
US20180095524A1 (en) * 2016-09-30 2018-04-05 Intel Corporation Interaction mode selection based on detected distance between user and machine interface
US20190138330A1 (en) * 2017-11-08 2019-05-09 Alibaba Group Holding Limited Task Processing Method and Device
WO2019212566A1 (en) * 2018-05-04 2019-11-07 Google Llc Generating and/or adapting automated assistant content according to a distance between user(s) and an automated assistant interface

Also Published As

Publication number Publication date
JP2022529869A (en) 2022-06-27
WO2021189967A1 (en) 2021-09-30
CN111273833A (en) 2020-06-12
US20210349526A1 (en) 2021-11-11
EP3913473A1 (en) 2021-11-24
KR20220010580A (en) 2022-01-25
CN111273833B (en) 2022-02-01
JP7345551B2 (en) 2023-09-15

Similar Documents

Publication Publication Date Title
EP3913473A4 (en) Human-machine interaction control method, apparatus and system, and electronic device
EP4161050A4 (en) Photographing apparatus, electronic device, and control method
EP4145259A4 (en) Display control method and apparatus, and electronic device
EP4213473A4 (en) Electronic device, and control method and control apparatus therefor
EP4156620A4 (en) Interaction method and apparatus, and electronic device
EP4155887A4 (en) Application icon control method and apparatus, and electronic device
EP4280588A4 (en) Electronic device, and control method therefor and control apparatus thereof
EP4130954A4 (en) Terminal control method and apparatus, and terminal device
EP4231121A4 (en) Stylus and control method therefor, and electronic device
EP4141583A4 (en) Device control method and system
EP4171135A4 (en) Device control method, and related apparatus
EP4053707A4 (en) Electronic device, and electronic device interface control method and system
EP4109892A4 (en) Interaction method and apparatus, and electronic device
EP4160589A4 (en) Display apparatus, electronic device, and control method for electronic device
EP4270230A4 (en) Access control method, electronic device and system
EP4270908A4 (en) Electronic device, and control method and control device thereof
EP4174626A4 (en) Application program control method and apparatus, and electronic device
EP4203239A4 (en) Electronic device component and control method therefor, and control apparatus for electronic device
EP4175307A4 (en) Interaction method and apparatus, and electronic device
EP4130995A4 (en) Interaction method and apparatus, and electronic device
EP4221172A4 (en) Control method and apparatus for electronic device
EP4113986A4 (en) Interaction method and apparatus, and electronic device
EP4220627A4 (en) Control method and apparatus, and electronic device
EP4280035A4 (en) Screen control method and apparatus, and electronic device
EP4105765A4 (en) Device control method, apparatus and system

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210720

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0003048100

Ipc: G06F0003010000

A4 Supplementary search report drawn up and despatched

Effective date: 20221109

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 1/16 20060101ALI20221103BHEP

Ipc: G06F 3/03 20060101ALI20221103BHEP

Ipc: G06F 1/3231 20190101ALI20221103BHEP

Ipc: G06F 3/01 20060101AFI20221103BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20230610