WO2019119431A1 - Human-computer interaction method and apparatus, terminal device, and computer readable storage medium - Google Patents

Human-computer interaction method and apparatus, terminal device, and computer readable storage medium Download PDF

Info

Publication number
WO2019119431A1
WO2019119431A1 PCT/CN2017/118047 CN2017118047W WO2019119431A1 WO 2019119431 A1 WO2019119431 A1 WO 2019119431A1 CN 2017118047 W CN2017118047 W CN 2017118047W WO 2019119431 A1 WO2019119431 A1 WO 2019119431A1
Authority
WO
WIPO (PCT)
Prior art keywords
interaction
user profile
human
interaction object
computer
Prior art date
Application number
PCT/CN2017/118047
Other languages
French (fr)
Chinese (zh)
Inventor
张含波
Original Assignee
深圳前海达闼云端智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海达闼云端智能科技有限公司 filed Critical 深圳前海达闼云端智能科技有限公司
Priority to PCT/CN2017/118047 priority Critical patent/WO2019119431A1/en
Priority to CN201780002540.5A priority patent/CN108351707B/en
Publication of WO2019119431A1 publication Critical patent/WO2019119431A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • G06F9/4451User profiles; Roaming

Definitions

  • the present application relates to the field of robot technology, and in particular, to a human-computer interaction method, device, terminal device, and computer readable storage medium.
  • Human-computer interaction or Human-Machine Interaction is a study of the interaction between systems and users.
  • the system can be a wide variety of machines or computerized systems and software.
  • the robot can communicate with the user through a computer system.
  • context information continuous in a certain period of time.
  • the input information makes a reasonable understanding and response to achieve control and operation of the robot.
  • the inventor found that, in the existing technical solution of human-computer interaction, the robot can make a reasonable understanding and reply based on the context information, and realize a human-machine dialogue with the user.
  • the robot can only provide services for the current user in sequence during the interaction with the user. When the interaction is interrupted, the robot cannot continue. Therefore, the current robot can only be in the same time period. Realize the interaction with a user, that is, the robot can not face multiple users at the same time, and realize human-computer interaction with multiple users.
  • One technical problem to be solved by some embodiments of the present application is to provide a human-computer interaction method to solve the above technical problems.
  • An embodiment of the present application provides a human-computer interaction method, which is applied to a terminal device having a human-computer interaction function.
  • the human-computer interaction method includes: determining the identity information of the interaction object when the interaction object is identified; determining the user profile corresponding to the identity information based on the mapping relationship between the identity information of the interaction object and the user profile; and according to the user profile, Make a response that matches the interactive object.
  • the embodiment of the present application further provides a human-machine interaction device, which is applied to a terminal device having a human-computer interaction function.
  • the human-machine interaction device includes: an identification module, configured to identify whether there is an interaction object; and an information extraction module, configured to: when the identification module determines that the interaction object is recognized, extract identity information of the interaction object; and determine a module, configured to use the identity of the interaction object.
  • the mapping relationship between the information and the user profile determines a user profile corresponding to the identity information; and the response module is configured to perform a response matching the interaction object according to the user profile.
  • the embodiment of the present application further provides a terminal device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being processed by at least one
  • the apparatus is executed to enable at least one processor to perform the human-computer interaction method involved in any of the method embodiments of the present application.
  • the embodiment of the present application further provides a computer readable storage medium, which stores computer instructions for causing a computer to execute the human-computer interaction method involved in any method embodiment of the present application.
  • the embodiment of the present application can realize simultaneous interaction with different interaction objects.
  • the terminal device having the human-computer interaction function extracts the identity information of the interaction object, and then based on the identity information of the interaction object and the user profile.
  • the mapping relationship between the two determines the user profile corresponding to the identity information, so that a response matching the interaction object can be made according to the user profile corresponding to each interaction object, thereby implementing a face-to-face interaction object.
  • the function of machine interaction greatly enhances the user experience.
  • FIG. 1 is a specific flowchart of a human-computer interaction method according to a first embodiment of the present application
  • FIG. 2 is a specific flowchart of a human-computer interaction method according to a second embodiment of the present application
  • FIG. 3 is a specific flowchart of a human-computer interaction method according to a third embodiment of the present application.
  • FIG. 4 is a block diagram showing a human-machine interaction device according to a fourth embodiment of the present application.
  • Figure 5 is a block schematic diagram of a terminal device in a fifth embodiment of the present application.
  • the first embodiment of the present application relates to a human-computer interaction method, which is mainly applied to a terminal device having a human-computer interaction function.
  • the terminal device in the embodiment may be an interactive robot, and the interaction object may be any use group.
  • the limitation is not limited herein.
  • the following describes the human-computer interaction method shown in FIG. 1 . The specific process will be explained.
  • step 101 it is determined whether an interactive object is recognized.
  • step 102 is entered; otherwise, step 101 is continued until it is determined that the interactive object is identified, proceeds to step 102, or the terminal device exits the human-computer interaction mode.
  • an interaction object appears in the detection of the acquisition area, or when the sound information is recognized, it is determined that the interaction object is recognized. This is for illustrative purposes only and is not intended to limit the scope of protection of the present embodiment. Other ways of identifying the interactive object are also within the scope of the present embodiment.
  • the collection area mentioned in the embodiment may be appropriately set by a person skilled in the art according to various occasions such as the use occasion of the interactive robot and the use of the crowd, for example, the position of the interactive robot.
  • the center of the circle the area with a radius of 1 meter is used as the collection area. If a user (interactive object) appears in the area, or if the sound collection device determines that the user's voice information is recognized in the area, it is determined that the interaction is recognized.
  • Object the area with a radius of 1 meter
  • the sound information of the user is determined in the area according to the sound collection device, specifically, the position of the interaction object is determined by the speed of the sound, thereby determining the identified position. Whether the sound information comes from this area.
  • the user voice collected by the sound collection device may be at a certain frequency, and it may be determined that the interaction object is recognized.
  • Step 102 Extract identity information of the interaction object.
  • the identity information of the interaction object may be the voiceprint information of the interaction object and/or the face information of the interaction object, that is, after the interaction object enters the collection area, the voice recording device is opened, and the voiceprint of the interaction object is collected. Information, and/or open the image capture device to collect face information of the interactive object.
  • the embodiment may adopt the following specific implementation: Before determining the identification of the interactive object and extracting the identity information of the interactive object, the location information of the interaction object is further obtained, and the location information is reasonably judged, for example, determining whether the obtained location information is related to the preset location information. match.
  • the preset location information can satisfy the clear and complete collection of the face information of the interactive object and/or the voiceprint information collected to the interactive object.
  • the interactive robot is controlled to open the image capturing device, and the face information of the interactive object is collected, if the interactive robot can Clearly collecting the voiceprint information of the interactive object, then controlling the interactive robot to open the voice collection device, and collecting the voiceprint information of the interactive object.
  • the collected voiceprint information and/or face information is used as the identity information of the interactive object. Otherwise, a prompt message may be issued to prompt the interactive object to move the location until the location of the interactive object conforms to the conditional location for extracting the identity information.
  • Step 103 Determine a user profile corresponding to the identity information.
  • the operation of determining the user profile corresponding to the identity information is specifically determined based on the mapping relationship between the identity information of the interaction object and the user profile.
  • the interaction object and the user profile are in one-to-one correspondence. Since the identity information of each interaction object is unique, the identity information of the interaction object and the user profile are set by using one. Corresponding mapping relationship, so that after extracting the identity information of the interaction object, the user profile corresponding to the interaction object can be quickly determined.
  • the user profile in the embodiment is mainly used for storing the context interaction content of the corresponding interaction object, that is, recording the instruction and response made by the interaction object and the interaction robot in the human-computer interaction process. .
  • Step 104 According to the user profile, make a response that matches the interaction object, and end the interaction process.
  • the context interaction content of the interaction object is obtained from the user profile corresponding to the interaction object, and then the response matching the interaction object is made according to the context interaction content, so that the response of the interaction robot is made. It is in line with the interaction requirements of the current interactive object.
  • the interactive robot may sequentially extract according to the occurrence of the interactive object.
  • the identity information of each interactive object is sequentially entered into subsequent processing according to the order of completion until a matching response is made to each interactive object.
  • the identity information of the interaction object is extracted when the interaction object is determined to be recognized, Then, based on the mapping relationship between the identity information of the interaction object and the user profile, the user profile corresponding to the identity information is determined, so that a response matching the interaction object may be made according to the user profile corresponding to each interaction object, and then The function of man-machine interaction for multiple interactive objects is realized at the same time, which greatly improves the user experience.
  • a second embodiment of the present application relates to a human-computer interaction method.
  • the embodiment is further improved on the basis of the first embodiment.
  • the specific improvement is: after extracting the identity information of the interactive object, before determining the user profile corresponding to the identity information, it is also required to detect whether the terminal device exists and The user profile corresponding to the interaction object is used for subsequent operations according to the detection result.
  • the specific process is shown in Figure 2.
  • step 201 to step 206 are included, wherein steps 201 to 202 are substantially the same as steps 101 to 102 in the first embodiment, respectively, and steps 205 to 206 are respectively performed with the first implementation.
  • steps 103 to 104 in the example are roughly the same, and are not described here. The following mainly introduces the differences:
  • Step 203 Detect whether a user profile corresponding to the interaction object exists in the terminal device. If there is no user profile corresponding to the interaction object in the terminal device, the process proceeds to step 204; otherwise, the process proceeds to step 205.
  • Step 204 Create a user profile corresponding to the interaction object according to the identity information.
  • detecting whether a user profile corresponding to the interaction object exists in the terminal device may be implemented by: detecting whether a user profile corresponding to the interaction object exists in the cache space of the terminal device, which may be based on a confidence
  • the threshold value is used to determine whether there is a user profile corresponding to the interaction object in the cache space of the terminal device.
  • the preset confidence threshold is 90%. If the calculation is performed, the confidence value obtained is greater than or equal to the preset confidence. If the threshold is set, the user profile corresponding to the interaction object exists in the cache space of the terminal device, and the corresponding user profile is not created for the interaction object. If the calculation is performed, the confidence value obtained is less than the preset confidence threshold. Then, it is determined that the user profile corresponding to the interaction object does not exist in the cache space of the terminal device. At this time, it is necessary to further determine whether there is a user profile corresponding to the interaction object in the history database of the terminal device.
  • the terminal device determines whether there is a user profile corresponding to the interaction object in the identity information of the current interactive object with the voiceprint information stored in the terminal device. If the matching degree is greater than or equal to 90%, the terminal device is determined to be cached. If there is a user profile corresponding to the interaction object in the space, it is not necessary to create a corresponding user profile for the interaction object. If the matching degree of the two is less than 90%, it is determined that the user profile corresponding to the interaction object does not exist in the cache space of the terminal device. At this time, it is necessary to further determine whether there is a user profile corresponding to the interaction object in the history database of the terminal device.
  • the process of determining whether there is a user profile corresponding to the interaction object in the history database of the terminal device is substantially the same as the process of determining whether the user profile corresponding to the interaction object exists in the cache space of the terminal device. It can also be judged based on the confidence threshold. If it is determined that the user profile corresponding to the interaction object does not exist in the history database of the terminal device, according to the identity information, a corresponding user profile is created for the interaction object in the cache space, and if the terminal device is in the history database If there is a user profile corresponding to the interaction object, the user profile corresponding to the interaction object is obtained from the history database, and the user profile is transferred to the cache space.
  • the buffer space in the embodiment refers to a buffer of a terminal device, that is, a buffer for data exchange (referred to as a Cache), and the principle that the cache can help the hardware to run faster is in this embodiment.
  • the user profile corresponding to the interaction object exists in the cache of the terminal device, and the user profile corresponding to the interaction object exists in the cache space. Obtained, so as to ensure that the terminal device can respond quickly and give the user (interactive object) a better experience during the human-computer interaction process.
  • the historical database mentioned in this embodiment is specifically created in the memory of the terminal device, or a remote server, and is not limited herein. Therefore, by saving the user profile that is not used temporarily to the history database, it can be permanently protected to avoid data loss when abnormal conditions such as power failure occur.
  • the user profile stored in the cache space may be updated to the history database periodically during the interaction between the terminal device and the interaction object, and the technical personnel in the field may set the specific implementation as needed. Way, there is no limit here.
  • the degree of confidence usually referred to in the art as reliability, confidence level, confidence coefficient, etc., refers to the probability that an error may be made when the overall parameter falls within a certain interval. Therefore, by setting a reasonable confidence threshold, it is possible to ensure the accuracy of the detection result as much as possible within the allowable error range.
  • the extracted identity information of the interactive object may be voiceprint information and/or face information
  • the voiceprint information and the face information may be extracted by the location and voice of the interaction object.
  • the size and so on so you can set a confidence threshold for the voiceprint information, such as the probability that the requirement falls within the correct range is 90%, the probability of falling within the error range is 10%; the confidence level for the face information setting The threshold may be 95% for the requirement to fall within the correct range and 5% for the error range.
  • a confidence threshold for determining whether a user profile corresponding to the interaction object exists in the cache space of the terminal device can be the same or different, there is no limit here.
  • the third embodiment of the present application relates to a human-computer interaction method.
  • the embodiment is further improved on the basis of the first embodiment.
  • the specific improvement is: obtaining a user profile and making a response matching the interaction object. After that, it is further determined whether the interaction with the interaction object needs to be ended, and the subsequent operation is performed according to the judgment result, and the specific process is as shown in FIG. 3 .
  • the steps 301 to 306 are included, and the steps 301 to 304 are respectively the same as the steps 101 to 104 in the first embodiment, and are not described herein again.
  • step 305 it is determined whether it is necessary to end the interaction with the interactive object.
  • step 306 the response to the interaction object is continued according to the user profile, that is, the interaction between the interaction object and the terminal device is not completed yet, and keep going.
  • Step 306 Transfer the user profile from the cache space to the history database, and end the interaction process.
  • the context interaction content of the interaction operation needs to be saved to the user configuration file corresponding to the interaction object, and then the user configuration file is transferred from the cache space to the history database, so that the interaction object is next time.
  • the terminal device can make a response that conforms to the current interaction.
  • the occupation of the cache space of the terminal can be greatly reduced, thereby avoiding waste of resources, and enabling the terminal device to quickly process other instructions.
  • the embodiment of the present application determines whether it is necessary to end the interaction with the interaction object after determining the response matching the interaction object according to the user profile according to the prior art. It is necessary to end the interaction with the interactive object, save the context interaction content of the interaction operation to the user configuration file, and transfer the user configuration file from the cache space to the history database, thereby greatly reducing the occupation of the cache space of the terminal device. Avoid waste of resources, enabling the terminal device to quickly process other instructions.
  • the fourth embodiment of the present application relates to a human-machine interaction device.
  • the human-machine interaction device refer to the description of the method embodiment.
  • the specific structure is shown in FIG. 4 .
  • the human-machine interaction device 400 mainly includes an identification module 401, an information extraction module 402, a determination module 403, and a response module 404.
  • the human-machine interaction device 400 is mainly applied to a terminal device having a human-computer interaction function, and the human-machine interaction device 400 realizes the human-machine through the cooperation of the internal identification module 401, the information extraction module 402, the determination module 403, and the response module 404. Interaction.
  • the identification module 401 identifies whether there is an interaction object, and when the interaction object is identified, the information extraction module 402 is used to extract the identity information of the interaction object. After the identity information of the interaction object is extracted, the determination module 403 is used. The mapping relationship between the identity information of the interaction object and the user profile determines the user profile corresponding to the identity information, and finally the response module 404 makes a response matching the interaction object according to the user profile, and completes a human-computer interaction operation.
  • the embodiment of the present application uses the identification module to identify whether there is an interactive object, and when determining to identify the interactive object, extracts the identity information of the interactive object by using the information extraction module, and then The determining module determines the user profile corresponding to the identity information based on the mapping relationship between the identity information of the interaction object and the user profile, and finally uses the response module to make the interaction object according to the user profile corresponding to each interaction object.
  • the matching response realizes the function of man-machine interaction facing multiple interactive objects at the same time, which greatly improves the user experience.
  • a fifth embodiment of the present application relates to a terminal device, and the specific structure is as shown in FIG. 5.
  • the terminal device includes one or more processors 500 and a memory 600.
  • One processor 500 is exemplified in FIG.
  • each functional module in the human-machine interaction device involved in the foregoing embodiment is deployed on the processor 500, and the processor 500 and the memory 600 can be connected through a bus or other manner. Connection is an example.
  • the memory 600 is a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the human-computer interaction method involved in any method embodiment of the present application.
  • the processor 500 executes various functional applications and data processing of the server by executing software programs, instructions, and modules stored in the memory 600, that is, implementing the human-computer interaction method involved in any method embodiment of the present application.
  • the memory 600 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may establish a history database, store a user profile, and the like.
  • memory 600 can include high speed random access memory, and can also include memory, such as at least one magnetic disk storage device, flash memory device, or other solid state storage device.
  • memory 600 can optionally include memory remotely located relative to processor 500, which can be connected to the terminal device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • At least one processor 500 can be executed in the memory 600, and the instructions are executed by the at least one processor 500, so that the at least one processor 500 can perform the human-computer interaction method involved in any method embodiment of the present application.
  • a sixth embodiment of the present application is directed to a computer readable storage medium having stored therein computer instructions that enable a computer to perform the human-computer interaction method involved in any of the method embodiments of the present application.

Abstract

A human-computer interaction method and apparatus, a terminal device, and a computer readable storage medium, relating to the technical field of robots. The human-computer interaction method, applied to a terminal device having a human-computer interaction function, comprises: an identification module (401), configured to identify whether there is an interaction object; an information extraction module (402), configured to extract identity information of the interaction object when the identification module determines that the interaction object is recognized; a determining module (403), configured to determine a user profile corresponding to the identity information on the basis of a mapping relationship between the identity information of the interaction object and the user profile; and a response module (404), configured to make a response matching the interaction object according to the user profile. On the basis of the human-computer interaction method and apparatus, the terminal device, and the computer readable storage medium, cross interaction between the terminal device having a human-computer interaction function and multiple interaction objects can be realized, so that the human-computer interaction process is more friendly.

Description

人机交互方法、装置、终端设备及计算机可读存储介质Human-computer interaction method, device, terminal device and computer readable storage medium 技术领域Technical field
本申请涉及机器人技术领域,尤其涉及一种人机交互方法、装置、终端设备及计算机可读存储介质。The present application relates to the field of robot technology, and in particular, to a human-computer interaction method, device, terminal device, and computer readable storage medium.
背景技术Background technique
人机交互、人机互动(Human–Computer Interaction或Human–Machine Interaction,简称HCI或HMI),是一门研究系统与用户之间的交互关系的学问。系统可以是各种各样的机器,也可以是计算机化的系统和软件。以交互型机器人为例,该机器人能够通过计算机系统与用户进行人机对话,在现有的人机交互方案中,机器人与用户进行人机对话时,需要基于上下文信息(某一时间段内连续输入的信息)作出合理的理解与回复,从而实现对机器人的控制与操作。Human-computer interaction or Human-Machine Interaction (HCI or HMI) is a study of the interaction between systems and users. The system can be a wide variety of machines or computerized systems and software. Taking an interactive robot as an example, the robot can communicate with the user through a computer system. In the existing human-computer interaction scheme, when the robot and the user perform a human-machine dialogue, it needs to be based on context information (continuous in a certain period of time). The input information) makes a reasonable understanding and response to achieve control and operation of the robot.
发明人在实现本申请的过程中发现,虽然,现有人机交互的技术方案中,机器人能够基于上下文信息作出合理的理解与回复,实现与用户进行人机对话。但是,现有的技术方案,机器人在与用户进行交互过程中,只能顺序为当前用户提供服务,当该交互被打断后,无法再继续、因此,目前的机器人在同一时间段内只能实现与一位用户的交互,即机器人无法同时面对多个用户,实现与多用户的人机交互。In the process of implementing the present application, the inventor found that, in the existing technical solution of human-computer interaction, the robot can make a reasonable understanding and reply based on the context information, and realize a human-machine dialogue with the user. However, in the existing technical solution, the robot can only provide services for the current user in sequence during the interaction with the user. When the interaction is interrupted, the robot cannot continue. Therefore, the current robot can only be in the same time period. Realize the interaction with a user, that is, the robot can not face multiple users at the same time, and realize human-computer interaction with multiple users.
发明内容Summary of the invention
本申请部分实施例所要解决的一个技术问题在于提供一种人机交互方法,以解决上述技术问题。One technical problem to be solved by some embodiments of the present application is to provide a human-computer interaction method to solve the above technical problems.
本申请的一个实施例提供了一种人机交互方法,该人机交互方法应用于具有人机交互功能的终端设备。人机交互方法包括:确定识别到交互对象时,提取交互对象的身份信息;基于交互对象的身份信息与用户配置文件之间的映射关系,确定身份信息对应的用户配置文件;根据用户配置文件,作出与交互对象匹配的响应。An embodiment of the present application provides a human-computer interaction method, which is applied to a terminal device having a human-computer interaction function. The human-computer interaction method includes: determining the identity information of the interaction object when the interaction object is identified; determining the user profile corresponding to the identity information based on the mapping relationship between the identity information of the interaction object and the user profile; and according to the user profile, Make a response that matches the interactive object.
本申请实施例还提供了一种人机交互装置,该人机交互装置应用于具有人机交互功能的终端设备。人机交互装置包括:识别模块,用于识别是否有交互对象;信息提取模块,用于在识别模块确定识别到交互对象时,提取交互对 象的身份信息;确定模块,用于基于交互对象的身份信息与用户配置文件之间的映射关系,确定身份信息对应的用户配置文件;响应模块,用于根据用户配置文件,作出与交互对象匹配的响应。The embodiment of the present application further provides a human-machine interaction device, which is applied to a terminal device having a human-computer interaction function. The human-machine interaction device includes: an identification module, configured to identify whether there is an interaction object; and an information extraction module, configured to: when the identification module determines that the interaction object is recognized, extract identity information of the interaction object; and determine a module, configured to use the identity of the interaction object The mapping relationship between the information and the user profile determines a user profile corresponding to the identity information; and the response module is configured to perform a response matching the interaction object according to the user profile.
本申请实施例还提供了一种终端设备,包括:至少一个处理器;以及与至少一个处理器通信连接的存储器;其中,存储器存储有可被至少一个处理器执行的指令,指令被至少一个处理器执行,以使至少一个处理器能够执行本申请任意方法实施例中涉及的人机交互方法。The embodiment of the present application further provides a terminal device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being processed by at least one The apparatus is executed to enable at least one processor to perform the human-computer interaction method involved in any of the method embodiments of the present application.
本申请实施例还提供了一种计算机可读存储介质,存储有计算机指令,计算机指令用于使计算机执行本申请任意方法实施例中涉及的人机交互方法。The embodiment of the present application further provides a computer readable storage medium, which stores computer instructions for causing a computer to execute the human-computer interaction method involved in any method embodiment of the present application.
本申请实施例相对于现有技术而言,能够实现同时与不同交互对象交互,当具有人机交互功能的终端设备提取交互对象的身份信息后,然后基于交互对象的身份信息与用户配置文件之间的映射关系,确定身份信息对应的用户配置文件,从而可以根据每个交互对象各自所对应的用户配置文件,作出与该交互对象匹配的响应,进而实现了同时面对多个交互对象进行人机交互的功能,大大提升了用户体验。Compared with the prior art, the embodiment of the present application can realize simultaneous interaction with different interaction objects. When the terminal device having the human-computer interaction function extracts the identity information of the interaction object, and then based on the identity information of the interaction object and the user profile. The mapping relationship between the two determines the user profile corresponding to the identity information, so that a response matching the interaction object can be made according to the user profile corresponding to each interaction object, thereby implementing a face-to-face interaction object. The function of machine interaction greatly enhances the user experience.
附图说明DRAWINGS
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.
图1是根据本申请第一实施例中的人机交互方法的具体流程图;1 is a specific flowchart of a human-computer interaction method according to a first embodiment of the present application;
图2是根据本申请第二实施例中的人机交互方法的具体流程图;2 is a specific flowchart of a human-computer interaction method according to a second embodiment of the present application;
图3是根据本申请第三实施例中的人机交互方法的具体流程图;3 is a specific flowchart of a human-computer interaction method according to a third embodiment of the present application;
图4是根据本申请第四实施例中的人机交互方装置的方框示意图;4 is a block diagram showing a human-machine interaction device according to a fourth embodiment of the present application;
图5是根据本申请第五实施例中的终端设备的方框示意图。Figure 5 is a block schematic diagram of a terminal device in a fifth embodiment of the present application.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请部分实施例进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the objects, the technical solutions and the advantages of the present application more clear, some embodiments of the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.
本申请的第一实施例涉及一种人机交互方法,该人机交互方法主要应用 于具有人机交互功能的终端设备。The first embodiment of the present application relates to a human-computer interaction method, which is mainly applied to a terminal device having a human-computer interaction function.
需要说明的是,本实施例中所说的终端设备可以为交互型机器人、交互对象可以是任意使用人群,此处不做限制,为了便于理解,以下结合图1所示的人机交互方法的具体流程进行说明。It should be noted that the terminal device in the embodiment may be an interactive robot, and the interaction object may be any use group. The limitation is not limited herein. For the sake of easy understanding, the following describes the human-computer interaction method shown in FIG. 1 . The specific process will be explained.
步骤101,判断是否识别到交互对象。In step 101, it is determined whether an interactive object is recognized.
具体的说,如果确定识别到交互对象,则进入步骤102,;否则,继续执行步骤101,直到确定识别到交互对象,进入步骤102,或者终端设备退出人机交互模式为止。Specifically, if it is determined that the interactive object is identified, then step 102 is entered; otherwise, step 101 is continued until it is determined that the interactive object is identified, proceeds to step 102, or the terminal device exits the human-computer interaction mode.
在本实施例中,在检测到采集区域中有交互对象出现,或者,在识别到声音信息时,确定识别到交互对象。此处仅为举例说明,并不用于限制本实施例的保护范围,其它识别交互对象的方式也在本实施例的范围内。In this embodiment, an interaction object appears in the detection of the acquisition area, or when the sound information is recognized, it is determined that the interaction object is recognized. This is for illustrative purposes only and is not intended to limit the scope of protection of the present embodiment. Other ways of identifying the interactive object are also within the scope of the present embodiment.
需要说明的是,本实施例中所说的采集区域,具体可以由本领域的技术人员根据交互型机器人实际放置的使用场合、使用人群等多种因素合理设置,比如以交互型机器人所处的位置为圆心,半径为1米的区域作为采集区域,如果有用户(交互对象)出现在该区域中,或者根据声音采集装置确定在该区域内识别到用户的声音信息时,即可确定识别到了交互对象。It should be noted that the collection area mentioned in the embodiment may be appropriately set by a person skilled in the art according to various occasions such as the use occasion of the interactive robot and the use of the crowd, for example, the position of the interactive robot. As the center of the circle, the area with a radius of 1 meter is used as the collection area. If a user (interactive object) appears in the area, or if the sound collection device determines that the user's voice information is recognized in the area, it is determined that the interaction is recognized. Object.
需要说明的是,本实施例中所说的根据声音采集装置确定在该区域内识别到用户的声音信息,具体是指通过声音的传播速度,确定交互对象所处的位置,从而确定识别到的声音信息是否来自该区域内。It should be noted that, according to the sound collection device, the sound information of the user is determined in the area according to the sound collection device, specifically, the position of the interaction object is determined by the speed of the sound, thereby determining the identified position. Whether the sound information comes from this area.
另外,在识别到用户的声音信息,确定识别交互对象,也可以在声音采集装置采集到的用户声音处于某一频率,既可以确定识别到了交互对象。In addition, after identifying the user's voice information and determining to identify the interaction object, the user voice collected by the sound collection device may be at a certain frequency, and it may be determined that the interaction object is recognized.
需要说明的的是,以上仅为举例说明,并不对本申请的保护范围构成限定,本领域的技术人员可以根据需要设置确定识别到交互对象的条件,此处不做限制。It should be noted that the above is only an example, and does not limit the scope of protection of the present application. Those skilled in the art can set the conditions for determining the identified interactive object as needed, and no limitation is made herein.
另外,在实际应用中,为了保证交互操作的准确性,避免误操作,可以在确定进入采集区域的用户做出了特定的动作或者发出了特定的声音后,才确定识别到的用户为需要进行人机交互的交互对象。In addition, in practical applications, in order to ensure the accuracy of the interaction operation and avoid misoperation, it is determined that the identified user needs to perform after determining that the user entering the collection area has made a specific action or issued a specific sound. Interactive object of human-computer interaction.
需要说明的是,以上仅为举例说明,并不对本申请的保护范围构成限定,本领域的技术人员可以根据需要设置识别交互对象的具体条件,此处不做限制。It should be noted that the above is only an example, and does not limit the scope of protection of the present application. Those skilled in the art may set specific conditions for identifying an interactive object as needed, and are not limited herein.
步骤102,提取交互对象的身份信息。Step 102: Extract identity information of the interaction object.
具体的说,交互对象的身份信息具体可以是交互对象的声纹信息和/或交互对象的人脸信息,即在交互对象进入到采集区域后,通过开启语音采集装置, 采集交互对象的声纹信息,和/或开启图像采集装置,采集交互对象的人脸信息。Specifically, the identity information of the interaction object may be the voiceprint information of the interaction object and/or the face information of the interaction object, that is, after the interaction object enters the collection area, the voice recording device is opened, and the voiceprint of the interaction object is collected. Information, and/or open the image capture device to collect face information of the interactive object.
另外,为了提高提取到的交互对象的身份信息的准确性,避免出现由于采集到的人脸信息不清楚,声纹信息不清晰,影响交互对象身份的确认,本实施例可以采用以下具体实现:在确定识别到交互对象,提取交互对象的身份信息之前,还进一步获取了交互对象当前所处的位置信息,并对位置信息进行合理判断,比如判断获取到的位置信息是否与预设的位置信息匹配。In addition, in order to improve the accuracy of the extracted identity information of the interactive object, and avoiding the fact that the collected facial information is unclear, the voiceprint information is unclear, and the identification of the identity of the interactive object is affected, the embodiment may adopt the following specific implementation: Before determining the identification of the interactive object and extracting the identity information of the interactive object, the location information of the interaction object is further obtained, and the location information is reasonably judged, for example, determining whether the obtained location information is related to the preset location information. match.
需要说明的是,该预设的位置信息能够满足使交互型机器人清楚、完整的采集到交互对象的人脸信息和/或采集到所述交互对象的声纹信息。It should be noted that the preset location information can satisfy the clear and complete collection of the face information of the interactive object and/or the voiceprint information collected to the interactive object.
进一步地,如果该交互对象当前所处的位置信息能够清楚、完整的采集到交互对象的人脸信息,则控制交互型机器人开启图像采集装置,采集交互对象的人脸信息,如果交互型机器人能够清晰的采集到交互对象的声纹信息,则控制交互型机器人开启语音采集装置,采集交互对象的声纹信息。并将采集到的声纹信息和/或人脸信息作为交互对象的身份信息。否则,可以发出提示信息,提示交互对象移动位置,直到交互对象所处的位置符合提取身份信息的条件位置。Further, if the location information of the interactive object can be clearly and completely collected to the face information of the interactive object, the interactive robot is controlled to open the image capturing device, and the face information of the interactive object is collected, if the interactive robot can Clearly collecting the voiceprint information of the interactive object, then controlling the interactive robot to open the voice collection device, and collecting the voiceprint information of the interactive object. The collected voiceprint information and/or face information is used as the identity information of the interactive object. Otherwise, a prompt message may be issued to prompt the interactive object to move the location until the location of the interactive object conforms to the conditional location for extracting the identity information.
步骤103,确定身份信息对应的用户配置文件。Step 103: Determine a user profile corresponding to the identity information.
具体的说,在本实施例中,确定身份信息对应的用户配置文件的操作,具体是基于交互对象的身份信息与用户配置文件之间的映射关系进行确定的。Specifically, in this embodiment, the operation of determining the user profile corresponding to the identity information is specifically determined based on the mapping relationship between the identity information of the interaction object and the user profile.
需要说明的是,在本实施例中,交互对象与用户配置文件是一一对应的,由于每一个交互对象的身份信息都是唯一的,因此通过设置交互对象的身份信息与用户配置文件一一对应的映射关系,从而可以在提取到交互对象的身份信息后,能够快速确定与该交互对象对应的用户配置文件。It should be noted that, in this embodiment, the interaction object and the user profile are in one-to-one correspondence. Since the identity information of each interaction object is unique, the identity information of the interaction object and the user profile are set by using one. Corresponding mapping relationship, so that after extracting the identity information of the interaction object, the user profile corresponding to the interaction object can be quickly determined.
另外,本实施例中所说的用户配置文件主要是用于存储对应的交互对象的上下文交互内容,即记录该交互对象与交互型机器人在人机交互过程中交互双方做出的指令及响应等。In addition, the user profile in the embodiment is mainly used for storing the context interaction content of the corresponding interaction object, that is, recording the instruction and response made by the interaction object and the interaction robot in the human-computer interaction process. .
另外,需要说明的是,关于用户配置文件中记录的上下文交互内容的格式以及记录方式,本领域的技术人员可以根据实际需要合理设置,此处不做限制。In addition, it should be noted that, regarding the format of the contextual interaction content recorded in the user profile and the recording mode, those skilled in the art can appropriately set according to actual needs, and no limitation is made herein.
步骤104,根据用户配置文件,作出与交互对象匹配的响应,结束本次交互流程。Step 104: According to the user profile, make a response that matches the interaction object, and end the interaction process.
在本实施例中,通过从该交互对象对应的用户配置文件中,获取该交互对象的上下文交互内容,然后根据该上下文交互内容来作出与交互对象匹配的 响应,从而使得交互型机器人作出的响应是符合当前交互对象的交互要求的。In this embodiment, the context interaction content of the interaction object is obtained from the user profile corresponding to the interaction object, and then the response matching the interaction object is made according to the context interaction content, so that the response of the interaction robot is made. It is in line with the interaction requirements of the current interactive object.
另外,值得一提的是,为了进一步提升用户体验,在执行完一次人机交互后,如果交互型机器人收到交互对象反馈的内容与作出的响应存在差异,则根据交互对象反馈的内容,更新该交互对象对应的用户配置文件中的上下文交互内容,从而保证后续人机交互的准确性,关于如何更新用户配置文件,以及何时更新用户配置文件,本领域的技术人员可以根据实际需要设置,此处不做限制。In addition, it is worth mentioning that, in order to further enhance the user experience, after performing a human-computer interaction, if the interactive robot receives a difference between the content of the interactive object feedback and the response, the content is updated according to the content of the interaction object feedback. The contextual interaction content in the user profile corresponding to the interaction object, thereby ensuring the accuracy of subsequent human-computer interaction, how to update the user profile, and when to update the user profile, those skilled in the art can set according to actual needs. There are no restrictions here.
需要说明的是,上述人机交互是以一个交互对象为例进行说明的,在实际应用中,如果出现了采集区域中有多个交互对象出现,交互型机器人可以根据交互对象出现的先后依次提取每一个交互对象的身份信息,并根据完成的先后顺序依次进入后续处理,直到对每一个交互对象作出匹配的响应为止。It should be noted that the above-mentioned human-computer interaction is described by taking an interactive object as an example. In an actual application, if multiple interactive objects appear in the collection area, the interactive robot may sequentially extract according to the occurrence of the interactive object. The identity information of each interactive object is sequentially entered into subsequent processing according to the order of completion until a matching response is made to each interactive object.
另外,以上仅为举例说明,并不对本申请的保护范围构成限定,本领域的技术人员可以根据需要设置人机交互中,交互型机器人的对交互对象作出响应的执行方式,此处不做限制。In addition, the above is only an example, and does not limit the scope of protection of the present application. Those skilled in the art can set the execution manner of the interactive robot in response to the interactive object in the human-computer interaction according to the need, and the limitation is not limited herein. .
通过上述描述不难发现,本申请实施例相对于现有技术而言,当具有人机交互功能的终端设备启动人机交互功能后,在确定识别到交互对象时,提取交互对象的身份信息,然后基于交互对象的身份信息与用户配置文件之间的映射关系,确定身份信息对应的用户配置文件,从而可以根据每一个交互对象所对应的用户配置文件,作出与该交互对象匹配的响应,进而实现了同时面对多个交互对象进行人机交互的功能,大大提升了用户体验。With the above description, it is not difficult to find that, when the terminal device having the human-computer interaction function starts the human-computer interaction function, the identity information of the interaction object is extracted when the interaction object is determined to be recognized, Then, based on the mapping relationship between the identity information of the interaction object and the user profile, the user profile corresponding to the identity information is determined, so that a response matching the interaction object may be made according to the user profile corresponding to each interaction object, and then The function of man-machine interaction for multiple interactive objects is realized at the same time, which greatly improves the user experience.
本申请的第二实施例涉及一种人机交互方法。本实施例在第一实施例的基础上做了进一步改进,具体改进之处为:在提取交互对象的身份信息之后,确定身份信息对应的用户配置文件之前,还需要检测终端设备中是否存在与交互对象对应的用户配置文件,并根据检测结果进行后续操作,具体流程如图2所示。A second embodiment of the present application relates to a human-computer interaction method. The embodiment is further improved on the basis of the first embodiment. The specific improvement is: after extracting the identity information of the interactive object, before determining the user profile corresponding to the identity information, it is also required to detect whether the terminal device exists and The user profile corresponding to the interaction object is used for subsequent operations according to the detection result. The specific process is shown in Figure 2.
具体的说,在本实施例中,包含步骤201至步骤206,其中,步骤201至步骤202分别与第一实施例中的步骤101至步骤102大致相同,步骤205至步骤206分别与第一实施例中的步骤103至步骤104大致相同,此处不再赘述,下面主要介绍不同之处:Specifically, in this embodiment, step 201 to step 206 are included, wherein steps 201 to 202 are substantially the same as steps 101 to 102 in the first embodiment, respectively, and steps 205 to 206 are respectively performed with the first implementation. Steps 103 to 104 in the example are roughly the same, and are not described here. The following mainly introduces the differences:
步骤203,检测终端设备中是否存在与交互对象对应的用户配置文件。若终端设备中不存在与交互对象对应的用户配置文件,则进入步骤204;否则,进入步骤205。Step 203: Detect whether a user profile corresponding to the interaction object exists in the terminal device. If there is no user profile corresponding to the interaction object in the terminal device, the process proceeds to step 204; otherwise, the process proceeds to step 205.
步骤204,根据身份信息,创建交互对象对应的用户配置文件。Step 204: Create a user profile corresponding to the interaction object according to the identity information.
在本实施例中,检测终端设备中是否存在与交互对象对应的用户配置文件,具体可以通过以下方式实现:检测终端设备的缓存空间中是否存在与交互对象对应的用户配置文件,具体可以基于置信度阈值判断终端设备的缓存空间中是否存在与交互对象对应的用户配置文件,比如说,预设的置信度阈值为90%,如果通过计算,得出的置信度值大于或等于预设的置信度阈值,则判定终端设备的缓存空间中存在交互对象对应的用户配置文件,则无需为该交互对象创建对应的用户配置文件,如果通过计算,得出的置信度值小于预设的置信度阈值,则判定终端设备的缓存空间中不存在交互对象对应的用户配置文件。此时,需要进一步判断终端设备的历史数据库中是否存在与交互对象对应的用户配置文件。In this embodiment, detecting whether a user profile corresponding to the interaction object exists in the terminal device may be implemented by: detecting whether a user profile corresponding to the interaction object exists in the cache space of the terminal device, which may be based on a confidence The threshold value is used to determine whether there is a user profile corresponding to the interaction object in the cache space of the terminal device. For example, the preset confidence threshold is 90%. If the calculation is performed, the confidence value obtained is greater than or equal to the preset confidence. If the threshold is set, the user profile corresponding to the interaction object exists in the cache space of the terminal device, and the corresponding user profile is not created for the interaction object. If the calculation is performed, the confidence value obtained is less than the preset confidence threshold. Then, it is determined that the user profile corresponding to the interaction object does not exist in the cache space of the terminal device. At this time, it is necessary to further determine whether there is a user profile corresponding to the interaction object in the history database of the terminal device.
具体的说,比如说,通过将当前交互对象的身份信息中的声纹信息与终端设备中存储的声纹信息进行比对,若两者匹配度大于或等于90%,则判定终端设备的缓存空间中存在交互对象对应的用户配置文件,则无需为该交互对象创建对应的用户配置文件。若两者的匹配度小于90%,判定终端设备的缓存空间中不存在交互对象对应的用户配置文件。此时,需要进一步判断终端设备的历史数据库中是否存在与交互对象对应的用户配置文件。Specifically, for example, by comparing the voiceprint information in the identity information of the current interactive object with the voiceprint information stored in the terminal device, if the matching degree is greater than or equal to 90%, the terminal device is determined to be cached. If there is a user profile corresponding to the interaction object in the space, it is not necessary to create a corresponding user profile for the interaction object. If the matching degree of the two is less than 90%, it is determined that the user profile corresponding to the interaction object does not exist in the cache space of the terminal device. At this time, it is necessary to further determine whether there is a user profile corresponding to the interaction object in the history database of the terminal device.
需要说明的是,置信度值的计算,本领域的技术人员可以根据统计学算法进行合理计算,此处不再赘述。It should be noted that, for the calculation of the confidence value, a person skilled in the art can perform a reasonable calculation according to a statistical algorithm, and details are not described herein again.
在本实施例中,判断终端设备的历史数据库中是否存在与交互对象对应的用户配置文件的流程,与上述判断终端设备的缓存空间中是否存在与交互对象对应的用户配置文件的流程大致相同,同样可以基于置信度阈值进行判断。若判定终端设备的历史数据库中不存在与交互对象对应的用户配置文件,则根据身份信息,在缓存空间中为该交互对象创建一个与之对应的用户配置文件,若判定终端设备的历史数据库中存在与交互对象对应的用户配置文件,则从历史数据库中获取与该交互对象对应的用户配置文件,并将该用户配置文件转移到缓存空间。In this embodiment, the process of determining whether there is a user profile corresponding to the interaction object in the history database of the terminal device is substantially the same as the process of determining whether the user profile corresponding to the interaction object exists in the cache space of the terminal device. It can also be judged based on the confidence threshold. If it is determined that the user profile corresponding to the interaction object does not exist in the history database of the terminal device, according to the identity information, a corresponding user profile is created for the interaction object in the cache space, and if the terminal device is in the history database If there is a user profile corresponding to the interaction object, the user profile corresponding to the interaction object is obtained from the history database, and the user profile is transferred to the cache space.
需要说明的是,本实施例中所说的缓存空间,具体是指终端设备的缓存,即数据交换的缓冲区(称作Cache),基于缓存能够帮助硬件更快运行的原理,本实施例中在根据身份信息,创建交互对象对应的用户配置文件之前,通过优先判断终端设备缓存中是否存在该交互对象对应的用户配置文件,在缓存空间中存在该交互对象对应的用户配置文件时,可以直接获取,从而可以保证人机 交互过程中,终端设备能够快速作出响应,给用户(交互对象)一个更好的体验。It should be noted that the buffer space in the embodiment refers to a buffer of a terminal device, that is, a buffer for data exchange (referred to as a Cache), and the principle that the cache can help the hardware to run faster is in this embodiment. Before the user profile corresponding to the interaction object is created according to the identity information, the user profile corresponding to the interaction object exists in the cache of the terminal device, and the user profile corresponding to the interaction object exists in the cache space. Obtained, so as to ensure that the terminal device can respond quickly and give the user (interactive object) a better experience during the human-computer interaction process.
本实施例中所说的历史数据库具体是创建于终端设备的内存中,或者远端服务器,此处不做限制。因此,通过将暂时不使用的用户配置文件保存到历史数据库中,可以永久保护,避免出现断电等异常情况时丢失数据。The historical database mentioned in this embodiment is specifically created in the memory of the terminal device, or a remote server, and is not limited herein. Therefore, by saving the user profile that is not used temporarily to the history database, it can be permanently protected to avoid data loss when abnormal conditions such as power failure occur.
另外,在实际应用中,为了保证数据的安全,可以在终端设备与交互对象交互过程中,定时将缓存空间中存储的用户配置文件更新到历史数据库,本领域的技术人员可以根据需要设置具体实现方式,此处不做限制。In addition, in the actual application, in order to ensure the security of the data, the user profile stored in the cache space may be updated to the history database periodically during the interaction between the terminal device and the interaction object, and the technical personnel in the field may set the specific implementation as needed. Way, there is no limit here.
另外,值得一提的是,关于置信度,在本领域内通常又称可靠度、置信水平、置信系数等,它是指估计总体参数落在某一区间时,可能犯错误的概率。因此,通过设置合理的置信度阈值,能够在允许误差的范围内,尽可能的保证检测结果的准确性。In addition, it is worth mentioning that the degree of confidence, usually referred to in the art as reliability, confidence level, confidence coefficient, etc., refers to the probability that an error may be made when the overall parameter falls within a certain interval. Therefore, by setting a reasonable confidence threshold, it is possible to ensure the accuracy of the detection result as much as possible within the allowable error range.
另外,在本实施例中,由于提取的交互对象的身份信息可能为声纹信息和/或人脸信息,而声纹信息和人脸信息的提取可能会受到交互对象所处的位置、说话声音的大小等的影响,因此可以针对声纹信息设置一个置信度阈值,比如要求落在正确范围内的概率为90%,落在错误范围内的概率为10%;针对人脸信息设置的置信度阈值可以为要求落在正确范围内的概率为95%,落在错误范围内的概率为5%。In addition, in this embodiment, since the extracted identity information of the interactive object may be voiceprint information and/or face information, the voiceprint information and the face information may be extracted by the location and voice of the interaction object. The size and so on, so you can set a confidence threshold for the voiceprint information, such as the probability that the requirement falls within the correct range is 90%, the probability of falling within the error range is 10%; the confidence level for the face information setting The threshold may be 95% for the requirement to fall within the correct range and 5% for the error range.
另外,为了便于判断,减少判断逻辑,也可以根据声纹信息和人脸信息进行合理取舍,选取一个合理的置信度阈值,具体的实现方式,此处不再赘述。In addition, in order to facilitate the judgment and reduce the judgment logic, it is also possible to make a reasonable trade-off according to the voiceprint information and the face information, and select a reasonable confidence threshold, and the specific implementation manner will not be repeated here.
另外,用于判断终端设备的缓存空间中是否存在与交互对象对应的用户配置文件的置信度阈值,和用于判断终端设备的历史数据库中是否存在与交互对象对应的用户配置文件的置信度阈值,可以相同,也可以不相同,此处不做限制。In addition, a confidence threshold for determining whether a user profile corresponding to the interaction object exists in the cache space of the terminal device, and a confidence threshold for determining whether the user profile corresponding to the interaction object exists in the history database of the terminal device , can be the same or different, there is no limit here.
需要说明的是,以上仅为举例说明,并不对本申请的保护范围构成限定,本领域的技术人员可以根据需要设置具体置信度阈值,此处不做限制。It should be noted that the above is only an example, and does not limit the scope of protection of the present application. Those skilled in the art can set a specific confidence threshold as needed, and no limitation is made herein.
通过上述描述不难发现,本申请实施例相对于现有技术而言,在根据身份信息,创建交互对象对应的用户配置文件之前,检测终端设备中是否存在与交互对象对应的用户配置文件,在确定终端设备中不存在与交互对象对应的用户配置文件时,才执行根据身份信息创建交互对象对应的用户配置文件的步骤,从而避免了多次重复创建用户配置文件,节省了终端设备的存储空间,且便于管理。It is not difficult to find that, in the embodiment of the present application, before the user profile corresponding to the interaction object is created according to the identity information, whether the user profile corresponding to the interaction object exists in the terminal device is detected. When the user profile corresponding to the interaction object does not exist in the terminal device, the step of creating the user profile corresponding to the interaction object according to the identity information is performed, thereby avoiding repeatedly creating the user profile repeatedly, thereby saving the storage space of the terminal device. And easy to manage.
本申请的第三实施例涉及一种人机交互方法,本实施例在第一实施例的基础上做了进一步改进,具体改进之处为:在获取用户配置文件,作出与交互对象匹配的响应之后,进一步判断是否需要结束与交互对象的交互操作,并根据判断结果进行后续操作,具体流程如图3所示。The third embodiment of the present application relates to a human-computer interaction method. The embodiment is further improved on the basis of the first embodiment. The specific improvement is: obtaining a user profile and making a response matching the interaction object. After that, it is further determined whether the interaction with the interaction object needs to be ended, and the subsequent operation is performed according to the judgment result, and the specific process is as shown in FIG. 3 .
具体的说,在本实施例中,包含步骤301至步骤306,其中,步骤301至步骤304分别与第一实施例中的步骤101至步骤104大致相同,此处不再赘述,下面主要介绍不同之处:Specifically, in this embodiment, the steps 301 to 306 are included, and the steps 301 to 304 are respectively the same as the steps 101 to 104 in the first embodiment, and are not described herein again. Where:
步骤305,判断是否需要结束与交互对象的交互操作。In step 305, it is determined whether it is necessary to end the interaction with the interactive object.
具体的说,若判定需要结束与交互对象的交互操作,进入步骤306;否则,继续根据用户配置文件,作出与交互对象匹配的响应,即该交互对象与终端设备的交互还没有结束,还需要继续进行。Specifically, if it is determined that the interaction with the interaction object needs to be ended, the process proceeds to step 306; otherwise, the response to the interaction object is continued according to the user profile, that is, the interaction between the interaction object and the terminal device is not completed yet, and keep going.
步骤306,将用户配置文件从缓存空间转移到历史数据库中,结束本次交互流程。Step 306: Transfer the user profile from the cache space to the history database, and end the interaction process.
具体的说,需要先将本次交互操作的上下文交互内容保存到该交互对象对应的用户配置文件中,然后再将用户配置文件从缓存空间中转移到历史数据库中,从而在下次与该交互对象进行人机交互时,终端设备能够做出符合当前交互的响应。并且,将用户配置文件从缓存空间转移到历史数据库中后,可以大大减小终端缓存空间的占用,从而避免了资源浪费,使得终端设备能够快速处理其他指令。Specifically, the context interaction content of the interaction operation needs to be saved to the user configuration file corresponding to the interaction object, and then the user configuration file is transferred from the cache space to the history database, so that the interaction object is next time. When performing human-computer interaction, the terminal device can make a response that conforms to the current interaction. Moreover, after the user profile is transferred from the cache space to the history database, the occupation of the cache space of the terminal can be greatly reduced, thereby avoiding waste of resources, and enabling the terminal device to quickly process other instructions.
需要说明的是,以上仅为举例说明,并不对本申请的保护范围构成限定。It should be noted that the above is merely illustrative and does not limit the scope of protection of the present application.
通过上述描述不难发现,本申请实施例相对于现有技术而言,在根据用户配置文件,作出与交互对象匹配的响应之后,通过进一步判断是否需要结束与交互对象的交互操作,并在判定需要结束与交互对象的交互操作,将本次交互操作的上下文交互内容保存到用户配置文件中,并将用户配置文件从缓存空间转移到历史数据库中,大大减小了终端设备缓存空间的占用,避免资源浪费,使得终端设备能够快速处理其他指令。It is not difficult to find that the embodiment of the present application determines whether it is necessary to end the interaction with the interaction object after determining the response matching the interaction object according to the user profile according to the prior art. It is necessary to end the interaction with the interactive object, save the context interaction content of the interaction operation to the user configuration file, and transfer the user configuration file from the cache space to the history database, thereby greatly reducing the occupation of the cache space of the terminal device. Avoid waste of resources, enabling the terminal device to quickly process other instructions.
本申请的第四实施例涉及一种人机交互装置,该人机交互装置的具体实施可参见方法实施例的描述,具体结构如图4所示。The fourth embodiment of the present application relates to a human-machine interaction device. For a specific implementation of the human-machine interaction device, refer to the description of the method embodiment. The specific structure is shown in FIG. 4 .
如图4所示,人机交互装置400主要包括识别模块401、信息提取模块402、确定模块403和响应模块404。As shown in FIG. 4, the human-machine interaction device 400 mainly includes an identification module 401, an information extraction module 402, a determination module 403, and a response module 404.
其中,该人机交互装置400主要应用于具有人机交互功能的终端设备,人机交互装置400通过内部的识别模块401、信息提取模块402、确定模块403 和响应模块404的协同配合实现人机交互。The human-machine interaction device 400 is mainly applied to a terminal device having a human-computer interaction function, and the human-machine interaction device 400 realizes the human-machine through the cooperation of the internal identification module 401, the information extraction module 402, the determination module 403, and the response module 404. Interaction.
具体的说,通过识别模块401识别是否有交互对象,并在识别到有交互对象时,利用信息提取模块402提取交互对象的身份信息,在提取到交互对象的身份信息后,利用确定模块403基于交互对象的身份信息与用户配置文件之间的映射关系,确定身份信息对应的用户配置文件,最终使用响应模块404根据用户配置文件,作出与交互对象匹配的响应,完成一次人机交互操作。Specifically, the identification module 401 identifies whether there is an interaction object, and when the interaction object is identified, the information extraction module 402 is used to extract the identity information of the interaction object. After the identity information of the interaction object is extracted, the determination module 403 is used. The mapping relationship between the identity information of the interaction object and the user profile determines the user profile corresponding to the identity information, and finally the response module 404 makes a response matching the interaction object according to the user profile, and completes a human-computer interaction operation.
通过上述描述不难发现,本申请实施例相对于现有技术而言,通过利用识别模块识别是否存在交互对象,并在确定识别到交互对象时,利用信息提取模块提取交互对象的身份信息,然后由确定模块基于交互对象的身份信息与用户配置文件之间的映射关系,确定身份信息对应的用户配置文件,最终利用响应模块根据每一个交互对象各自所对应的用户配置文件,作出与该交互对象匹配的响应,进而实现了同时面对多个交互对象进行人机交互的功能,大大提升了用户体验。It is not difficult to find by the above description that the embodiment of the present application uses the identification module to identify whether there is an interactive object, and when determining to identify the interactive object, extracts the identity information of the interactive object by using the information extraction module, and then The determining module determines the user profile corresponding to the identity information based on the mapping relationship between the identity information of the interaction object and the user profile, and finally uses the response module to make the interaction object according to the user profile corresponding to each interaction object. The matching response, in turn, realizes the function of man-machine interaction facing multiple interactive objects at the same time, which greatly improves the user experience.
以上所描述的装置实施例仅仅是示意性的,并不对本申请的保护范围构成限定,在实际应用中,本领域的技术人员可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的,此处不做限制。The device embodiments described above are merely illustrative and do not limit the scope of the application. In practical applications, those skilled in the art may select some or all of the modules according to actual needs to implement the embodiment. The purpose of the program is not limited here.
本申请的第五实施例涉及一种终端设备,具体结构如图5所示。A fifth embodiment of the present application relates to a terminal device, and the specific structure is as shown in FIG. 5.
该终端设备包括一个或多个处理器500以及存储器600,图5中以一个处理器500为例。The terminal device includes one or more processors 500 and a memory 600. One processor 500 is exemplified in FIG.
在本实施例中,上述实施例中涉及到的人机交互装置中的各功能模块均部署在处理器500上,处理器500和存储器600可以通过总线或其他方式连接,图5中以通过总线连接为例。In this embodiment, each functional module in the human-machine interaction device involved in the foregoing embodiment is deployed on the processor 500, and the processor 500 and the memory 600 can be connected through a bus or other manner. Connection is an example.
存储器600作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本申请任意方法实施例中涉及的人机交互方法对应的程序指令/模块。处理器500通过运行存储在存储器600中的软件程序、指令以及模块,从而执行服务器的各种功能应用以及数据处理,即实现本申请任意方法实施例中涉及的人机交互方法。The memory 600 is a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the human-computer interaction method involved in any method embodiment of the present application. The processor 500 executes various functional applications and data processing of the server by executing software programs, instructions, and modules stored in the memory 600, that is, implementing the human-computer interaction method involved in any method embodiment of the present application.
存储器600可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可建立历史数据库,用于存储用户配置文件等。此外,存储器600可以包括高速随机存取存储器,还可以包括存储器,例如至少一个磁盘存储器件、闪存器件、或其他固态存储器件。在一些实施例中,存储器600可选包括相对于处理器500远程设置的存 储器,这些远程存储器可以通过网络连接至终端设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 600 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may establish a history database, store a user profile, and the like. Moreover, memory 600 can include high speed random access memory, and can also include memory, such as at least one magnetic disk storage device, flash memory device, or other solid state storage device. In some embodiments, memory 600 can optionally include memory remotely located relative to processor 500, which can be connected to the terminal device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
在实际应用中,存储器600中可以存储至少一个处理器500执行的指令,指令被至少一个处理器500执行,以使至少一个处理器500能够执行本申请任意方法实施例涉及的人机交互方法,控制人机交互装置400完成人机交互方法中的交互流程,未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的人机交互方法。In an actual application, at least one processor 500 can be executed in the memory 600, and the instructions are executed by the at least one processor 500, so that the at least one processor 500 can perform the human-computer interaction method involved in any method embodiment of the present application. The control of the human-computer interaction device 400 to complete the interaction process in the human-computer interaction method, and the technical details not described in detail in this embodiment, refer to the human-computer interaction method provided by the embodiment of the present application.
本申请的第六实施例涉及一种计算机可读存储介质,该计算机可读存储介质中存储有计算机指令,该计算机指令使计算机能够执行本申请任意方法实施例中涉及的人机交互方法。A sixth embodiment of the present application is directed to a computer readable storage medium having stored therein computer instructions that enable a computer to perform the human-computer interaction method involved in any of the method embodiments of the present application.
本领域的普通技术人员可以理解,上述各实施例是实现本申请的具体实施例,而在实际应用中,可以在形式上和细节上对其作各种改变,而不偏离本实用新型的精神和范围。A person skilled in the art can understand that the above embodiments are specific embodiments for implementing the present application, and in actual application, various changes can be made in form and detail without departing from the spirit of the present invention. And scope.

Claims (12)

  1. 一种人机交互方法,应用于具有人机交互功能的终端设备,所述人机交互方法包括:A human-computer interaction method is applied to a terminal device having a human-computer interaction function, and the human-computer interaction method includes:
    确定识别到交互对象时,提取所述交互对象的身份信息;Determining, when the interaction object is identified, extracting identity information of the interaction object;
    基于所述交互对象的身份信息与用户配置文件之间的映射关系,确定所述身份信息对应的所述用户配置文件;Determining, according to the mapping relationship between the identity information of the interaction object and the user profile, the user profile corresponding to the identity information;
    根据所述用户配置文件,作出与所述交互对象匹配的响应。A response matching the interactive object is made based on the user profile.
  2. 如权利要求1所述的人机交互方法,其中,所述确定识别到交互对象,具体包括:The human-computer interaction method according to claim 1, wherein the determining the recognition of the interaction object comprises:
    在检测到采集区域中有交互对象出现,或者,在识别到声音信息时,确定识别到所述交互对象。An interactive object appears in the detected acquisition area, or when the sound information is recognized, it is determined that the interactive object is recognized.
  3. 如权利要求1或2所述的人机交互方法,其中,所述提取所述交互对象的身份信息,具体包括:The human-computer interaction method according to claim 1 or 2, wherein the extracting the identity information of the interaction object specifically includes:
    获取所述交互对象所处的位置信息;Obtaining location information of the interaction object;
    根据所述位置信息,控制所述终端设备开启语音采集装置,采集所述交互对象的声纹信息,和/或开启图像采集装置,采集所述交互对象的人脸信息;Controlling, according to the location information, the terminal device to enable the voice collection device, collecting the voiceprint information of the interaction object, and/or opening the image collection device, and collecting the face information of the interaction object;
    将采集到的所述声纹信息和/或所述人脸信息作为所述交互对象的身份信息。The collected voiceprint information and/or the face information is used as identity information of the interactive object.
  4. 如权利要求1至3任意一项所述的人机交互方法,其中,所述交互对象与所述用户配置文件一一对应,所述用户配置文件用于存储对应的所述交互对象的上下文交互内容。The human-computer interaction method according to any one of claims 1 to 3, wherein the interaction object is in one-to-one correspondence with the user profile, and the user profile is used to store a corresponding context interaction of the interaction object. content.
  5. 如权利要求1至4任意一项所述的人机交互方法,其中,所述根据所述用户配置文件,作出与所述交互对象匹配的响应,具体包括:The human-computer interaction method according to any one of claims 1 to 4, wherein the responding to the interaction object according to the user profile includes:
    在所述用户配置文件中获取所述交互对象的上下文交互内容;Obtaining, in the user profile, context interaction content of the interaction object;
    根据所述上下文交互内容,作出与所述交互对象匹配的响应。A response matching the interactive object is made based on the contextual interaction content.
  6. 如权利要求1至5任意一项所述的人机交互方法,其中,在提取所述交互对象的身份信息之后,基于所述交互对象的身份信息与用户配置文件之间的映射关系,确定所述身份信息对应的所述用户配置文件之前,所述人机交互方法还包括:The human-computer interaction method according to any one of claims 1 to 5, wherein after extracting the identity information of the interaction object, based on a mapping relationship between the identity information of the interaction object and a user profile, Before the user profile corresponding to the identity information, the human-computer interaction method further includes:
    根据所述身份信息,创建并维护所述交互对象对应的所述用户配置文件;Creating and maintaining the user profile corresponding to the interaction object according to the identity information;
    其中,在根据所述身份信息,创建所述交互对象对应的所述用户配置文件之前,所述人机交互方法还包括:The human-computer interaction method further includes: before the user profile corresponding to the interaction object is created according to the identity information, the human-computer interaction method further includes:
    检测所述终端设备中是否存在与所述交互对象对应的所述用户配置文件;Detecting, in the terminal device, whether the user profile corresponding to the interaction object exists;
    若所述终端设备中不存在与所述交互对象对应的所述用户配置文件,则执行所述根据所述身份信息,创建所述交互对象对应的所述用户配置文件的步骤。If the user profile corresponding to the interaction object does not exist in the terminal device, the step of creating the user profile corresponding to the interaction object according to the identity information is performed.
  7. 如权利要求6所述的人机交互方法,其中,所述检测所述终端设备中是否存在与所述交互对象对应的所述用户配置文件,具体包括:The human-computer interaction method according to claim 6, wherein the detecting the presence of the user profile corresponding to the interaction object in the terminal device comprises:
    基于置信度阈值判断所述终端设备的缓存空间中是否存在与所述交互对象对应的所述用户配置文件。Determining, by the confidence threshold, whether the user profile corresponding to the interaction object exists in a cache space of the terminal device.
  8. 如权利要求7所述的人机交互方法,其中,所述根据所述身份信息,创建所述交互对象对应的所述用户配置文件,具体包括:The human-computer interaction method according to claim 7, wherein the creating the user profile corresponding to the interaction object according to the identity information includes:
    基于所述置信度阈值判断所述终端设备的历史数据库中是否存在与所述交互对象对应的所述用户配置文件;Determining, according to the confidence threshold, whether the user profile corresponding to the interaction object exists in a history database of the terminal device;
    若判定所述终端设备的历史数据库中不存在与所述交互对象对应的所述用户配置文件,根据所述身份信息,在所述缓存空间中创建所述交互对象对应的所述用户配置文件;If the user profile corresponding to the interaction object does not exist in the history database of the terminal device, the user profile corresponding to the interaction object is created in the cache space according to the identity information;
    若判定所述终端设备的历史数据库中存在与所述交互对象对应的所述用户配置文件,从所述历史数据库中获取与所述交互对象对应的所述用户配置文件,并将所述用户配置文件转移到所述缓存空间。If the user profile corresponding to the interaction object exists in the history database of the terminal device, the user profile corresponding to the interaction object is obtained from the history database, and the user configuration is configured. The file is transferred to the cache space.
  9. 如权利要求1至8任意一项所述的人机交互方法,其中,所述根据所述用户配置文件,作出与所述交互对象匹配的响应之后,所述人机交互方法还包括:The human-computer interaction method according to any one of claims 1 to 8, wherein after the responding to the interaction object is made according to the user profile, the human-computer interaction method further comprises:
    判断是否需要结束与所述交互对象的交互操作;Determining whether it is necessary to end the interaction with the interactive object;
    若判定需要结束与所述交互对象的交互操作,将本次交互操作的上下文交互内容保存到所述用户配置文件中,并将所述用户配置文件从所述缓存空间转移到所述历史数据库中。If it is determined that the interaction with the interaction object needs to be ended, the context interaction content of the current interaction operation is saved into the user profile, and the user profile is transferred from the cache space to the history database. .
  10. 一种人机交互装置,应用于具有人机交互功能的终端设备,所述人机交互装置包括:A human-machine interaction device is applied to a terminal device having a human-computer interaction function, and the human-machine interaction device includes:
    识别模块,用于识别是否有交互对象;An identification module for identifying whether there is an interactive object;
    信息提取模块,用于在所述识别模块确定识别到交互对象时,提取所述交互对象的身份信息;An information extraction module, configured to: when the identification module determines that the interaction object is identified, extract identity information of the interaction object;
    确定模块,用于基于所述交互对象的身份信息与用户配置文件之间的映射 关系,确定所述身份信息对应的所述用户配置文件;a determining module, configured to determine, according to a mapping relationship between the identity information of the interaction object and a user profile, the user profile corresponding to the identity information;
    响应模块,用于根据所述用户配置文件,作出与所述交互对象匹配的响应。And a response module, configured to make a response that matches the interaction object according to the user profile.
  11. 一种终端设备,包括:A terminal device comprising:
    至少一个处理器;以及,At least one processor; and,
    与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein
    所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1至9任意一项所述的人机交互方法。The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 9. Human-computer interaction method.
  12. 一种计算机可读存储介质,存储有计算机指令,所述计算机指令用于使所述计算机执行权利要求1至9任意一项所述的人机交互方法。A computer readable storage medium storing computer instructions for causing the computer to perform the human-computer interaction method of any one of claims 1 to 9.
PCT/CN2017/118047 2017-12-22 2017-12-22 Human-computer interaction method and apparatus, terminal device, and computer readable storage medium WO2019119431A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/118047 WO2019119431A1 (en) 2017-12-22 2017-12-22 Human-computer interaction method and apparatus, terminal device, and computer readable storage medium
CN201780002540.5A CN108351707B (en) 2017-12-22 2017-12-22 Man-machine interaction method and device, terminal equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/118047 WO2019119431A1 (en) 2017-12-22 2017-12-22 Human-computer interaction method and apparatus, terminal device, and computer readable storage medium

Publications (1)

Publication Number Publication Date
WO2019119431A1 true WO2019119431A1 (en) 2019-06-27

Family

ID=62961441

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/118047 WO2019119431A1 (en) 2017-12-22 2017-12-22 Human-computer interaction method and apparatus, terminal device, and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN108351707B (en)
WO (1) WO2019119431A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109062482A (en) * 2018-07-26 2018-12-21 百度在线网络技术(北京)有限公司 Man-machine interaction control method, device, service equipment and storage medium
CN109542216B (en) * 2018-10-11 2022-11-22 平安科技(深圳)有限公司 Man-machine interaction method, system, computer equipment and storage medium
CN111177329A (en) * 2018-11-13 2020-05-19 奇酷互联网络科技(深圳)有限公司 User interaction method of intelligent terminal, intelligent terminal and storage medium
CN110007765A (en) * 2019-04-11 2019-07-12 上海星视度科技有限公司 A kind of man-machine interaction method, device and equipment
CN110377722A (en) * 2019-07-29 2019-10-25 中国工商银行股份有限公司 Response method and device, electronic equipment and readable storage medium storing program for executing
CN110689889B (en) * 2019-10-11 2021-08-17 深圳追一科技有限公司 Man-machine interaction method and device, electronic equipment and storage medium
CN111817929A (en) * 2020-06-01 2020-10-23 青岛海尔智能技术研发有限公司 Equipment interaction method and device, household equipment and storage medium
CN112497217B (en) * 2020-12-02 2022-12-13 深圳市香蕉智能科技有限公司 Robot interaction method and device, terminal equipment and readable storage medium
CN113742027B (en) * 2021-11-05 2022-07-15 深圳传音控股股份有限公司 Interaction method, intelligent terminal and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023894A (en) * 2010-11-18 2011-04-20 华为终端有限公司 User operation interface transformation method and terminal
CN103957458A (en) * 2014-04-28 2014-07-30 京东方科技集团股份有限公司 Video playing device, control device, video playing system and control method
US20150026259A1 (en) * 2013-07-18 2015-01-22 Electronics And Telecommunications Research Institute Method and apparatus for providing coping service based on context-aware information
CN105554239A (en) * 2015-11-26 2016-05-04 东莞酷派软件技术有限公司 Working mode control method and mobile terminal
CN106113038A (en) * 2016-07-08 2016-11-16 纳恩博(北京)科技有限公司 Mode switching method based on robot and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8073681B2 (en) * 2006-10-16 2011-12-06 Voicebox Technologies, Inc. System and method for a cooperative conversational voice user interface
US9836177B2 (en) * 2011-12-30 2017-12-05 Next IT Innovation Labs, LLC Providing variable responses in a virtual-assistant environment
AU2013262488A1 (en) * 2012-05-18 2014-12-18 Apple Inc. Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs
US9104467B2 (en) * 2012-10-14 2015-08-11 Ari M Frank Utilizing eye tracking to reduce power consumption involved in measuring affective response
WO2016195908A1 (en) * 2015-06-05 2016-12-08 Apple Inc. Accessing and displaying information corresponding to past times and future times
CN107493353A (en) * 2017-10-11 2017-12-19 宁波感微知著机器人科技有限公司 A kind of intelligent robot cloud computing method based on contextual information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102023894A (en) * 2010-11-18 2011-04-20 华为终端有限公司 User operation interface transformation method and terminal
US20150026259A1 (en) * 2013-07-18 2015-01-22 Electronics And Telecommunications Research Institute Method and apparatus for providing coping service based on context-aware information
CN103957458A (en) * 2014-04-28 2014-07-30 京东方科技集团股份有限公司 Video playing device, control device, video playing system and control method
CN105554239A (en) * 2015-11-26 2016-05-04 东莞酷派软件技术有限公司 Working mode control method and mobile terminal
CN106113038A (en) * 2016-07-08 2016-11-16 纳恩博(北京)科技有限公司 Mode switching method based on robot and device

Also Published As

Publication number Publication date
CN108351707A (en) 2018-07-31
CN108351707B (en) 2021-07-30

Similar Documents

Publication Publication Date Title
WO2019119431A1 (en) Human-computer interaction method and apparatus, terminal device, and computer readable storage medium
WO2019134346A1 (en) Face recognition method, application server, and computer-readable storage medium
CN110096996B (en) Biological information identification method, device, terminal, system and storage medium
CN105427421A (en) Entrance guard control method based on face recognition
WO2019148491A1 (en) Human-computer interaction method and device, robot, and computer readable storage medium
JP2019513246A (en) Training method of random forest model, electronic device and storage medium
WO2017031837A1 (en) Disk capacity prediction method, device and apparatus
JP7104779B2 (en) Target recognition method, device and intelligent terminal
WO2016149985A1 (en) Direction control method, direction control system and terminal
WO2021104128A1 (en) Feature library update method and apparatus, inference server and storage medium
WO2018068422A1 (en) Method and system for improving kitchen ventilator voice recognition rate
CN110929555B (en) Face recognition method and electronic device using same
TWI728285B (en) Method, device, system, server and computer readable storage medium for identity recognition
CN115731684B (en) Control method and device of wireless key switch equipment
CN115567283A (en) Identity authentication method, device, electronic equipment, system and storage medium
CN115810228A (en) Face recognition access control management method and device, electronic equipment and storage medium
CN113420631A (en) Safety alarm method and device based on image recognition
CN111368721B (en) Identity recognition processing method and device, electronic equipment and storage medium
CN111339829B (en) User identity authentication method, device, computer equipment and storage medium
CN109976168B (en) Decentralized intelligent home control method and system
CN113840002A (en) Information processing method, system, equipment and medium for locker under weak network environment
CN109685550A (en) Smart machine control method, device, electronic equipment and storage medium
CN112435670A (en) Speech recognition method, speech recognition apparatus, and computer-readable storage medium
CN116311604A (en) Method and device for identifying intelligent door lock, electronic equipment and storage medium
CN112731816B (en) Device control method, system, device and readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17935597

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.10.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17935597

Country of ref document: EP

Kind code of ref document: A1