CN109920425B

CN109920425B - Robot voice control method and device, robot and medium

Info

Publication number: CN109920425B
Application number: CN201910266361.3A
Authority: CN
Inventors: 刘帅; 刘洋; 肖福建
Original assignee: Beijing Rockrobo Technology Co Ltd
Current assignee: Beijing Stone Innovation Technology Co ltd
Priority date: 2019-04-03
Filing date: 2019-04-03
Publication date: 2021-11-12
Anticipated expiration: 2039-04-03
Also published as: CN114010102B; CN114010102A; CN109920425A

Abstract

The embodiment of the application provides a robot voice control method, a device, a robot and a medium, wherein the robot voice control method comprises the following steps: receiving a first voice instruction; and recognizing the sound source direction of the first voice command and enabling the robot to turn to the sound source direction. According to the embodiment of the application, when the first voice command is received, the voice recognition system of the robot is enabled to be in the activated state, and the robot is controlled to turn to the voice source direction, so that the robot is in the standby state. And then receiving a control command for controlling the execution operation within a certain time, and carrying out expected action according to the control command. The voice recognition control method and the voice recognition control device can be accurately operated according to the indication, improve the voice recognition control effect under the noise state, improve the recognition rate of the voice command input by the user, can accurately work according to the voice command of the user, and also increase the interestingness of man-machine interaction.

Description

Robot voice control method and device, robot and medium

Technical Field

The present application relates to the field of control technologies, and in particular, to a method and an apparatus for controlling a robot by using voice, a robot, and a medium.

Background

With the development of technology, various robots having a voice recognition system have appeared, such as floor sweeping robots, floor mopping robots, dust collectors, weed trimmers, and the like. The robots can receive voice instructions input by a user through the voice recognition system to execute the operation indicated by the voice instructions, so that not only is labor saved, but also labor cost is saved.

In the related art, the robot may receive a voice command input by a user, and then recognize the input voice command through its own voice recognition system to control the robot to perform an operation instructed by the voice command. However, when a user controls a robot, the user still wants to be able to control the movement of the robot flexibly and freely as a control person, for example, the robot can respond to a corresponding language control command in real time by adopting more humanized language communication, but the current robot still does not have such a voice control mode, and still has the technical problems that the control is mechanical and the voice control cannot be carried out smoothly.

Disclosure of Invention

In view of the above, embodiments of the present disclosure provide a method and an apparatus for controlling a robot by voice, a robot, and a storage medium, so that the robot can flexibly receive a voice control command.

In a first aspect, an embodiment of the present application provides a robot voice control method, where the method includes:

receiving a first voice instruction;

and recognizing the sound source direction of the first voice command and enabling the robot to turn to the sound source direction.

In some possible implementations, the recognizing a sound source direction of the first voice instruction and steering the robot to the sound source direction further includes:

identifying a sound source direction of the first voice instruction;

turning the robot to the sound source direction without stopping the operation of the driving motor;

stopping the operation of the drive motor.

In some possible implementations, after the recognizing the sound source direction of the first voice instruction and turning the robot to the sound source direction, the method further includes:

judging whether a second voice instruction for indicating operation is received or not;

and if the second voice instruction is judged to be received, the robot executes the operation indicated by the second voice instruction.

In some possible implementations, the method further includes:

and if the second voice instruction is judged not to be received, the robot returns to the original direction and continues to execute the original operation.

In some possible implementations, the determining whether the second voice instruction for instructing the operation is received includes:

and judging whether a second voice instruction for indicating operation is received or not within preset time.

In some possible implementations, the first voice instruction is a wake-up voice instruction, and the second voice instruction is a control voice instruction.

In some possible implementations, the wake-up voice command and the control voice command are pre-stored in the robot or a cloud connected to the robot.

In a second aspect, an embodiment of the present application provides a robot voice control apparatus, including:

the receiving unit is used for receiving a first voice instruction;

a recognition unit for recognizing a sound source direction of the first voice instruction and steering the robot to the sound source direction.

In some possible implementations, the identification unit is further configured to:

identifying a sound source direction of the first voice instruction;

stopping the operation of the drive motor.

In some possible implementations, the method further includes:

the judging unit is used for judging whether a second voice instruction for indicating operation is received or not;

and the execution unit is used for executing the operation indicated by the second voice command by the robot if the second voice command is judged to be received.

In some possible implementations, the execution unit is further configured to:

In some possible implementations, the determining unit is further configured to:

In a third aspect, an embodiment of the present application provides a robot, including a processor and a memory, where the memory stores computer program instructions executable by the processor, and the processor implements the method steps of any one of the first aspect when executing the computer program instructions.

In a fourth aspect, embodiments of the present application provide a non-transitory computer-readable storage medium storing computer program instructions, which when invoked and executed by a processor, implement the method steps of any of the first aspects.

In a fifth aspect, embodiments of the present application provide a robot, including the robot control device according to any one of the second aspects.

Compared with the prior art, the invention at least has the following technical effects:

according to the embodiment of the application, when the first voice command is received, the voice recognition system of the robot is enabled to be in the activated state, and the robot is controlled to turn to the voice source direction, so that the robot is in the standby state. And then receiving a control command for controlling the execution operation within a certain time, and carrying out expected action according to the control command. The voice recognition control method and the voice recognition control device can be accurately operated according to the indication, improve the voice recognition control effect under the noise state, improve the recognition rate of the voice command input by the user, can accurately work according to the voice command of the user, and also increase the interestingness of man-machine interaction.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 2 is a top view of a robot structure provided in an embodiment of the present application;

fig. 3 is a bottom view of a robot structure provided in an embodiment of the present application;

FIG. 4 is a front view of a robot structure provided by an embodiment of the present application;

fig. 5 is a perspective view of a robot structure provided in an embodiment of the present application;

FIG. 6 is a block diagram of a robot according to an embodiment of the present disclosure;

fig. 7 is a schematic flowchart of a robot voice control method according to an embodiment of the present application;

fig. 8 is a schematic flowchart of a robot voice control method according to another embodiment of the present application;

fig. 9 is a schematic flowchart of a robot voice control method according to yet another embodiment of the present application;

fig. 10 is a schematic structural diagram of a robot voice control device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a robot voice control apparatus according to another embodiment of the present application;

fig. 12 is an electronic structural schematic diagram of a robot according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be understood that although the terms first, second, third, etc. may be used to describe … … in the embodiments of the present application, these … … should not be limited to these terms. These terms are used only to distinguish … … from each other. For example, the first … … can also be referred to as the second … …, and similarly the second … … can also be referred to as the first … … without departing from the scope of embodiments herein.

To describe the behavior of the robot more clearly, the following directional definitions are made:

as shown in fig. 5, the robot 100 may travel over the ground through various combinations of movements relative to the following three mutually perpendicular axes defined by the body 110: a front-back axis X, a lateral axis Y, and a central vertical axis Z. The forward driving direction along the forward-rearward axis X is denoted as "forward", and the rearward driving direction along the forward-rearward axis X is denoted as "rearward". The transverse axis Y extends substantially along the axis defined by the center points of the drive wheel modules 141 between the right and left wheels of the robot.

The robot 100 may rotate about the Y-axis. "pitch up" when the forward portion of the robot 100 is tilted up and the backward portion is tilted down, and "pitch down" when the forward portion of the robot 100 is tilted down and the backward portion is tilted up. In addition, the robot 100 may rotate about the Z-axis. In the forward direction of the robot, the robot 100 is tilted to the right of the X axis as "right turn", and the robot 100 is tilted to the left of the X axis as "left turn".

Referring to fig. 1, a possible application scenario provided in the embodiment of the present application includes a robot, such as a sweeping robot, a mopping robot, a dust collector, a weeding machine, and the like. In some embodiments, the robot may be a robot, in particular a sweeping robot, a mopping robot. In implementation, the robot may be provided with a voice recognition system to receive a voice command sent by a user, and rotate according to the voice command in the direction of the arrow to respond to the voice command of the user. The robot may also be provided with a voice output device to output a prompt voice. In other embodiments, the robot may be provided with a touch-sensitive display to receive operation instructions input by a user. The robot can also be provided with wireless communication modules such as WIFI module, Bluetooth module to be connected with intelligent terminal, and receive the operating instruction that the user utilized intelligent terminal to transmit through wireless communication module.

The structure of the relevant robot is described below, as shown in fig. 2-5:

the robot 100 includes a robot body 110, a sensing system 120, a control system, a drive system 140, a cleaning system, an energy system, and a human-machine interaction system 170. As shown in fig. 2.

The machine body 110 includes a forward portion 111 and a rearward portion 112 having an approximately circular shape (circular front to rear), and may have other shapes including, but not limited to, an approximately D-shape with a front to rear circle.

As shown in fig. 4, the sensing system 120 includes a position determining device 121 located above the machine body 110, a bumper 122 located at the forward portion 111 of the machine body 110, a cliff sensor 123, and an ultrasonic sensor, an infrared sensor, a magnetometer, an accelerometer, a gyroscope, a odometer, etc., and provides various position information and motion state information of the machine to the control system 130. The position determining device 121 includes, but is not limited to, a camera, a laser distance measuring device (LDS). The following describes how position determination is performed by taking a laser distance measuring device of the triangulation method as an example. The basic principle of the triangulation method is based on the geometric relation of similar triangles, and is not described herein.

The laser ranging device includes a light emitting unit and a light receiving unit. The light emitting unit may include a light source that emits light, and the light source may include a light emitting element, such as an infrared or visible Light Emitting Diode (LED) that emits infrared light or visible light. Preferably, the light source may be a light emitting element that emits a laser beam. In the present embodiment, a Laser Diode (LD) is taken as an example of the light source. In particular, a light source using a laser beam may make the measurement more accurate than other lights due to the monochromatic, directional, and collimation characteristics of the laser beam. For example, infrared or visible light emitted by a Light Emitting Diode (LED) is affected by ambient environmental factors (e.g., color or texture of an object) as compared to a laser beam, and may be reduced in measurement accuracy. The Laser Diode (LD) may be a spot laser for measuring two-dimensional position information of an obstacle, or a line laser for measuring three-dimensional position information of an obstacle within a certain range.

The light receiving unit may include an image sensor on which a light spot reflected or scattered by an obstacle is formed. The image sensor may be a set of a plurality of unit pixels of a single row or a plurality of rows. These light receiving elements can convert optical signals into electrical signals. The image sensor may be a Complementary Metal Oxide Semiconductor (CMOS) sensor or a Charge Coupled Device (CCD) sensor, and is preferably a Complementary Metal Oxide Semiconductor (CMOS) sensor due to cost advantages. Also, the light receiving unit may include a light receiving lens assembly. Light reflected or scattered by the obstruction may travel through a light receiving lens assembly to form an image on the image sensor. The light receiving lens assembly may comprise a single or multiple lenses.

The base may support the light emitting unit and the light receiving unit, which are disposed on the base and spaced apart from each other by a certain distance. In order to measure the obstacle situation in the 360 degree direction around the robot, the base may be rotatably disposed on the main body 110, or the base itself may be rotated without rotating the emitted light, the received light by providing a rotating element. The rotating angular speed of the rotating element can be obtained by arranging the optical coupling element and the coded disc, the optical coupling element senses tooth gaps on the coded disc, and instantaneous angular speed can be obtained by dividing the sliding time of the tooth gap distance and the tooth gap distance value. The higher the density of the tooth notches on the coded disc is, the higher the measurement accuracy and precision are correspondingly, but the structure is more precise, and the calculated amount is higher; on the contrary, the smaller the density of the tooth defects is, the lower the accuracy and precision of measurement are, but the structure can be relatively simple, the calculation amount is smaller, and the cost can be reduced.

The data processing device, e.g. DSP, connected to the light receiving unit records and transmits the obstacle distance values at all angles in the direction of 0 degrees with respect to the robot to the data processing unit in the control system 130, e.g. Application Processor (AP) comprising CPU running a particle filter based positioning algorithm to obtain the current position of the robot and to map it according to this position for navigation. The positioning algorithm preferably uses instant positioning and mapping (SLAM).

Although the laser distance measuring device based on the triangulation method can measure the distance value at an infinite distance beyond a certain distance in principle, in practice, the realization of the long-distance measurement, for example, more than 6 meters, is difficult, mainly because of the size limitation of the pixel unit on the sensor of the light receiving unit, and at the same time, the laser distance measuring device is also influenced by the photoelectric conversion speed of the sensor, the data transmission speed between the sensor and the connected DSP, and the calculation speed of the DSP. The measured value obtained by the laser ranging device under the influence of temperature can also have variation which cannot be tolerated by a system, mainly because the angle between incident light and emergent light is changed due to thermal expansion deformation of a structure between the light emitting unit and the light receiving unit, and the light emitting unit and the light receiving unit can also have the temperature drift problem. After the laser ranging device is used for a long time, the measurement result is also seriously influenced by deformation caused by accumulation of various factors such as temperature change, vibration and the like. The accuracy of the measuring result directly determines the accuracy of the map drawing, and is the basis for further strategy implementation of the robot, and is particularly important.

As shown in fig. 3, the forward portion 111 of the machine body 110 may carry a bumper 122, the bumper 122 detecting one or more events in the travel path of the robot 100 via a sensor system, such as an infrared sensor, as the drive wheel module 141 propels the robot across the floor during cleaning, and the robot may control the drive wheel module 141 to cause the robot to respond to the events, such as moving away from an obstacle, by detecting the events, such as an obstacle, a wall, by the bumper 122.

The control system 130 is disposed on a circuit board in the machine body 110, and includes a non-transitory memory, such as a hard disk, a flash memory, and a random access memory, a communication computing processor, such as a central processing unit, and an application processor, and the application processor uses a positioning algorithm, such as SLAM, to map an instant map of the environment where the robot is located according to the obstacle information fed back by the laser ranging device. And the current working state of the sweeper is comprehensively judged by combining distance information and speed information fed back by the buffer 122, the cliff sensor 123, the ultrasonic sensor, the infrared sensor, the magnetometer, the accelerometer, the gyroscope, the odometer and other sensing devices, for example, when the sweeper passes a threshold, a carpet is arranged at the cliff, the upper part or the lower part of the sweeper is clamped, a dust box is full, the sweeper is taken up and the like, and a specific next-step action strategy is provided according to different conditions, so that the robot can work more according with the requirements of an owner, and better user experience is achieved. Further, the control system 130 can plan the most efficient and reasonable cleaning path and cleaning mode based on map information drawn by the SLAM, thereby greatly improving the cleaning efficiency of the robot.

The drive system 140 may steer the robot 100 across the ground based on drive commands having distance and angle information, such as x, y, and theta components. The drive system 140 includes a drive wheel module 141, and the drive wheel module 141 can control both the left and right wheels, and in order to more precisely control the motion of the machine, it is preferable that the drive wheel module 141 includes a left drive wheel module and a right drive wheel module, respectively. The left and right drive wheel modules are opposed along a transverse axis defined by the body 110. In order for the robot to be able to move more stably or with greater mobility over the ground, the robot may include one or more driven wheels 142, including but not limited to universal wheels. The driving wheel module comprises a traveling wheel, a driving motor and a control circuit for controlling the driving motor, and can also be connected with a circuit for measuring driving current and a milemeter. The driving wheel module 141 may be detachably coupled to the main body 110 to facilitate disassembly and maintenance. The drive wheel may have a biased drop-type suspension system movably secured, e.g., rotatably attached, to the robot body 110 and receiving a spring bias biased downward and away from the robot body 110. The spring bias allows the drive wheels to maintain contact and traction with the floor with a certain landing force while the cleaning elements of the robot 100 also contact the floor 10 with a certain pressure.

The cleaning system may be a dry cleaning system and/or a wet cleaning system. As a dry cleaning system, the main cleaning function is derived from the sweeping system 151 constituted by the roll brush, the dust box, the blower, the air outlet, and the connecting members therebetween. The rolling brush with certain interference with the ground sweeps the garbage on the ground and winds the garbage to the front of a dust suction opening between the rolling brush and the dust box, and then the garbage is sucked into the dust box by air which is generated by the fan and passes through the dust box and has suction force. The dust removal capability of the sweeper can be represented by the sweeping efficiency DPU (dust pick up efficiency), which is influenced by the structure and the material of the rolling brush, the wind power utilization rate of an air duct formed by a dust suction port, a dust box, a fan, an air outlet and connecting parts among the dust suction port, the dust box, the fan, the air outlet and the dust box, the type and the power of the fan, and is a responsible system design problem. Compared with the common plug-in dust collector, the improvement of the dust removal capability is more significant for the cleaning robot with limited energy. Because the improvement of the dust removal capability directly and effectively reduces the energy requirement, namely the machine which can clean the ground of 80 square meters by charging once can be developed into the machine which can clean 100 square meters or more by charging once. And the service life of the battery, which reduces the number of times of charging, is also greatly increased, so that the frequency of replacing the battery by the user is also increased. More intuitively and importantly, the improvement of the dust removal capability is the most obvious and important user experience, and the user can directly draw a conclusion whether the sweeping/wiping is clean. The dry cleaning system may also include an edge brush 152 having an axis of rotation that is angled relative to the floor for moving debris into the roller brush area of the cleaning system.

Energy systems include rechargeable batteries, such as nickel metal hydride batteries and lithium batteries. The charging battery can be connected with a charging control circuit, a battery pack charging temperature detection circuit and a battery under-voltage monitoring circuit, and the charging control circuit, the battery pack charging temperature detection circuit and the battery under-voltage monitoring circuit are connected with the single chip microcomputer control circuit. The host computer is connected with the charging pile through the charging electrode arranged on the side or the lower part of the machine body for charging. If dust is attached to the exposed charging electrode, the plastic body around the electrode is melted and deformed due to the accumulation effect of electric charge in the charging process, even the electrode itself is deformed, and normal charging cannot be continued.

The human-computer interaction system 170 comprises keys on a panel of the host computer, and the keys are used for a user to select functions; the machine control system can further comprise a display screen and/or an indicator light and/or a loudspeaker, wherein the display screen, the indicator light and the loudspeaker show the current state or function selection item of the machine to a user; and a mobile phone client program can be further included. For the path navigation type cleaning equipment, a map of the environment where the equipment is located and the position of a machine can be displayed for a user at a mobile phone client, and richer and more humanized function items can be provided for the user.

Figure 6 is a block diagram of a sweeping robot according to the present invention.

The sweeping robot according to the current embodiment may include: a microphone array unit for recognizing a user's voice, a communication unit for communicating with a remote control device or other devices, a moving unit for driving the main body, a cleaning unit, and a memory unit for storing information. An input unit (a key of the sweeping robot, etc.), an object detection sensor, a charging unit, a microphone array unit, a direction detection unit, a position detection unit, a communication unit, a driving unit, and a memory unit may be connected to the control unit to transmit or receive predetermined information to or from the control unit.

The microphone array unit may compare the voice input through the receiving unit with information stored in the memory unit to determine whether the input voice corresponds to a specific command. If it is determined that the input voice corresponds to a specific command, the corresponding command is transmitted to the control unit. If the detected speech cannot be compared to the information stored in the memory unit, the detected speech may be treated as noise to ignore the detected speech.

For example, the detected voice corresponds to the word "come, go", and there is a word control command (come) corresponding to the word stored in the information of the memory unit. In this case, a corresponding command may be transmitted to the control unit.

The direction detecting unit may detect the direction of the voice by using a time difference or a level of the voice input to the plurality of receiving units. The direction detection unit transmits the detected direction of the voice to the control unit. The control unit may determine the moving path by using the voice direction detected by the direction detecting unit.

The position detection unit may detect coordinates of the subject within predetermined map information. In one embodiment, the information detected by the camera and the map information stored in the memory unit may be compared with each other to detect the current position of the subject. The position detection unit may use a Global Positioning System (GPS) in addition to the camera.

In a broad sense, the position detection unit may detect whether the main body is disposed at a specific position. For example, the position detection unit may include a unit for detecting whether the main body is disposed on the charging pile.

For example, in the method for detecting whether the main body is disposed on the charging pile, whether the main body is disposed at the charging position may be detected according to whether power is input into the charging unit. For another example, whether the main body is disposed at the charging position may be detected by a charging position detecting unit disposed on the main body or the charging pile.

The communication unit may transmit/receive predetermined information to/from a remote control device or other devices. The communication unit may update map information of the sweeping robot.

The driving unit may operate the moving unit and the cleaning unit. The driving unit may move the moving unit along the moving path determined by the control unit.

The memory unit stores therein predetermined information related to the operation of the sweeping robot. For example, map information of an area where the sweeping robot is arranged, control command information corresponding to a voice recognized by the microphone array unit, direction angle information detected by the direction detection unit, position information detected by the position detection unit, and obstacle information detected by the object detection sensor may be stored in the memory unit.

The control unit may receive information detected by the receiving unit, the camera, and the object detection sensor. The control unit may recognize a voice of the user, detect a direction in which the voice occurs, and detect a position of the sweeping robot based on the transmitted information. Further, the control unit may also operate the moving unit and the cleaning unit.

As shown in fig. 7, when applied to the robot in the application scenario of fig. 1, an embodiment of the present application provides a robot voice control method, including the following steps:

step S702: receiving a first voice instruction;

generally, a speech recognition system of a robot may have a sleep state and an active state. For example, when the robot is in a working state or an unused state, the voice recognition system is in a dormant state, and in the dormant state, the voice recognition system hardly occupies too much resources of the robot and does not recognize other voice commands except the first voice command.

If the speech recognition system in the dormant state receives the first speech instruction, the speech recognition system is switched from the dormant state to the activated state. In the activated state, the voice recognition system may recognize a voice instruction, such as a first voice instruction, a second voice instruction, and so on, configured in the voice recognition system.

Specifically, the first voice instruction: for waking up the speech recognition system, i.e. for indicating that the speech recognition system is in an active state. In implementation, if the speech recognition system is in the dormant state, when the robot receives the first speech command, the speech recognition system is switched from the dormant state to the activated state. If the voice recognition system is in the activated state, the voice recognition system may be controlled to continue to be in the activated state, or no operation may be performed. In a specific embodiment, the first voice command may be set by a user or by default, for example: the first voice command can be user-defined 'turn on voice', 'turn on', 'go here', etc. For convenience of description, the following description will take the first voice command as "come" as an example.

Step S704: and recognizing the sound source direction of the first voice command and enabling the robot to turn to the sound source direction.

After the robot has received the first activation instruction such as "come", the robot detects the direction of the voice by the direction detection unit, for example, by using the time difference or level of the voice input to the plurality of receiving units. The direction detection unit transmits the detected direction of the voice to the control unit. The control unit may control the driving system by using the voice direction detected by the direction detecting unit to make the robot perform a pivot rotation or the like so that the robot forward direction is turned toward the user's sound source direction. The man-machine interaction is similar to that after a dry and alive person is called by a person, the person stops working in the hand and turns to a conversation state, so that the man-machine interaction is more humanized.

In some possible implementations, as shown in fig. 8, the recognizing a sound source direction of the first voice command and turning the robot to the sound source direction specifically includes the following steps:

step S7042: identifying a sound source direction of the first voice instruction;

step S7044: turning the robot to the sound source direction without stopping the operation of the driving motor;

after the robot has received the first activation instruction such as "come", the robot detects the direction of the voice by the direction detection unit, for example, by using the time difference or level of the voice input to the plurality of receiving units. The direction detection unit transmits the detected direction of the voice to the control unit. The control unit may control the driving system by using the voice direction detected by the direction detecting unit to make the robot perform a pivot rotation or the like so that the robot forward direction is turned toward the user's sound source direction. In the process, the robot does not stop working, and the cleaning motor is still in a starting state.

Step S7046: stopping the operation of the drive motor.

After the robot rotates to the sound source direction, the robot only reserves the voice recognition system in the activated state for all the driving systems, and at the moment, the robot is in a complete standby state, and whether a control command is sent out is detected in real time.

In another embodiment, as shown in fig. 9, the robot voice control method according to the present invention includes the following steps:

step S902: a first voice instruction is received.

Specifically, the first voice instruction: for waking up the speech recognition system, i.e. for indicating that the speech recognition system is in an active state. In implementation, if the speech recognition system is in the dormant state, when the robot receives the first speech command, the speech recognition system is switched from the dormant state to the activated state. If the voice recognition system is in the activated state, the voice recognition system may be controlled to continue to be in the activated state, or no operation may be performed. In a specific embodiment, the first voice command may be set by a user or by default, for example: the first voice command can be user-defined 'turn on voice', 'turn on', 'go here', etc. The first voice instruction (awakening voice instruction) is stored in the robot or a cloud end connected with the robot in advance. For convenience of description, the following description will take the first voice command as "come" as an example.

Step S904: and recognizing the sound source direction of the first voice command and enabling the robot to turn to the sound source direction.

Step S906: and judging whether a second voice instruction for indicating operation is received or not.

The second voice instruction: for instructing operations, i.e. instructing the control robot to perform operations. The operation may be an operation of a custom setting, or may be a default setting of the system, for example: cleaning operations, mopping operations, weeding operations, and the like. In a specific embodiment, the second voice command may be set by a user or by default, for example: the second voice instruction may be a user-defined "sweep", "mopping" or "cleaning hygiene". The second voice instruction (control type voice instruction) is stored in the robot or a cloud end connected with the robot in advance. For convenience of description, the second voice command is described as "cleaning sanitation" as an example.

The determination of whether the second voice instruction for instructing the operation is received may be a determination within a preset time period, for example, 1 minute, 2 minutes, or the like, and the time period may be preset by the touch device. According to the situation monitored in the preset time range, the following two situations are respectively executed.

In the first case, step S908 is performed: and if the second voice instruction is judged to be received, the robot executes the operation indicated by the second voice instruction.

For example, a control command of "clean hygiene" is monitored within 1 minute, and the robot performs cleaning in a predetermined direction or position according to the user's command until another first voice control command is received.

In the second case, step S910 is performed: and if the second voice instruction is judged not to be received, the robot returns to the original direction and continues to execute the original operation.

For example, a "clean" control command is not monitored within 1 minute, and the robot performs cleaning in the original cleaning direction or position until receiving the first voice control command again.

In another embodiment, as shown in fig. 10, in combination with the robot applied to the application scenario of fig. 1, the embodiment of the present application provides a robot voice control apparatus, which includes a receiving unit 1002 and a recognition unit 1004, and the description of each unit is as follows. The apparatus shown in fig. 10 can perform the method of the embodiment shown in fig. 7, and reference may be made to the related description of the embodiment shown in fig. 7 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution are described in the embodiment shown in fig. 7, and are not described herein again.

A receiving unit 1002, configured to receive a first voice instruction;

the recognition unit 1004: for recognizing the sound source direction of the first voice command and steering the robot to the sound source direction.

In some possible implementations, the identifying unit 1004 is further configured to:

identifying a sound source direction of the first voice instruction;

stopping the operation of the drive motor.

In another embodiment, as shown in fig. 11, in combination with the robot applied to the application scenario of fig. 1, an embodiment of the present application provides a robot voice control apparatus, which includes a receiving unit 1002, a recognition unit 1004, a determination unit 1006, and an execution unit 1008. The description of each unit is as follows. The apparatus shown in fig. 11 can execute the method of the embodiment shown in fig. 9, and reference may be made to the related description of the embodiment shown in fig. 9 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution are described in the embodiment shown in fig. 9, and are not described herein again.

The receiving unit 1002 is configured to receive a first voice instruction.

A recognition unit 1004 for recognizing a sound source direction of the first voice instruction and steering the robot to the sound source direction.

A judging unit 1006, configured to judge whether a second voice instruction for instructing an operation is received.

The determination of whether the second voice instruction for instructing the operation is received may be a determination within a preset time period, for example, 1 minute, 2 minutes, or the like, and the time period may be preset by the touch device. According to the monitoring condition in the preset time range, the following two conditions are respectively executed by the execution unit 1008.

In the first case, if it is determined that the second voice command is received, the robot executes an operation instructed by the second voice command.

In the second case, if it is determined that the second voice command is not received, the robot returns to the original direction and continues to perform the original operation.

An embodiment of the present application provides a robot including the robot voice control apparatus described in any one of fig. 10 to 11.

The embodiment of the present application provides a robot, which includes a processor and a memory, where the memory stores computer program instructions capable of being executed by the processor, and when the processor executes the computer program instructions, the method steps of any of the foregoing embodiments are implemented.

Embodiments of the present application provide a non-transitory computer readable storage medium storing computer program instructions which, when invoked and executed by a processor, implement the method steps of any of the preceding embodiments.

As shown in fig. 12, the robot 1200 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 1201 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1202 or a program loaded from a storage device 1208 into a Random Access Memory (RAM) 1203. In the RAM 1203, various programs and data necessary for the operation of the electronic robot 1200 are also stored. The processing apparatus 1201, the ROM 1202, and the RAM 1203 are connected to each other by a bus 1204. An input/output (I/O) interface 1205 is also connected to bus 1204.

Generally, the following devices may be connected to the I/O interface 1205: input devices 1206 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, or the like; output devices 1207 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, or the like; storage devices 1208 including, for example, magnetic tape, hard disk, etc.; and a communication device 1209. The communication device 1209 can allow the electronic robot 1200 to perform wireless or wired communication with other robots to exchange data. While fig. 7 illustrates an electronic robot 1200 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device 1209, or installed from the storage device 1208, or installed from the ROM 1202. The computer program, when executed by the processing apparatus 1201, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer readable medium may be embodied in the robot; or may be separate and not assembled into the robot.

The computer readable medium carries one or more programs which, when executed by the robot, cause the robot to: acquiring at least two internet protocol addresses; sending a node evaluation request comprising the at least two internet protocol addresses to a node evaluation robot, wherein the node evaluation robot selects the internet protocol addresses from the at least two internet protocol addresses and returns the internet protocol addresses; receiving an internet protocol address returned by the node evaluation robot; wherein the obtained internet protocol address indicates an edge node in the content distribution network.

Alternatively, the computer readable medium carries one or more programs which, when executed by the robot, cause the robot to: receiving a node evaluation request comprising at least two internet protocol addresses; selecting an internet protocol address from the at least two internet protocol addresses; returning the selected internet protocol address; wherein the received internet protocol address indicates an edge node in the content distribution network.

Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A cleaning robot voice control method, characterized in that the method comprises:

receiving a first voice instruction;

recognizing the sound source direction of the first voice instruction and steering the robot to the sound source direction; the method specifically comprises the following steps:

identifying a sound source direction of the first voice instruction;

turning the robot to the sound source direction without stopping the operation of the cleaning motor; the operation of the cleaning motor is not stopped, namely the robot is not stopped in the working state, and the cleaning motor is still in the starting state; wherein, the robot turns to sound source direction specifically includes: detecting the sound source direction by using a time difference or level of the inputted voice, and turning the robot to the sound source direction in-situ by the sound source direction control driving system;

stopping the operation of the cleaning motor.

2. The method of claim 1, wherein after identifying the sound source direction of the first voice command and steering the robot to the sound source direction, further comprising:

3. The method of claim 2, further comprising:

4. The method of claim 2, wherein determining whether a second voice instruction is received for indicating an operation comprises:

5. The method of claim 2, wherein:

the first voice instruction is a wake-up voice instruction, and the second voice instruction is a control voice instruction.

6. The method of claim 5, wherein: the awakening voice instruction and the control voice instruction are stored in the robot or a cloud end connected with the robot in advance.

7. A voice control device for a cleaning robot, comprising:

the receiving unit is used for receiving a first voice instruction;

a recognition unit for recognizing a sound source direction of the first voice instruction and steering the robot to the sound source direction;

the identification unit is further configured to:

identifying a sound source direction of the first voice instruction;

stopping the operation of the cleaning motor.

8. The apparatus of claim 7, further comprising:

9. The apparatus of claim 8, wherein the execution unit is further configured to:

10. The apparatus of claim 8, wherein the determining unit is further configured to:

11. The apparatus of claim 8, wherein:

12. The apparatus of claim 11, wherein: the awakening voice instruction and the control voice instruction are stored in the robot or a cloud end connected with the robot in advance.

13. A robotic speech control device comprising a processor and a memory, said memory storing computer program instructions executable by said processor, said processor implementing the method steps of any of claims 1-6 when executing said computer program instructions.

14. A robot comprising a device according to any of claims 7-12.

15. A non-transitory computer readable storage medium having stored thereon computer program instructions which, when invoked and executed by a processor, perform the method steps of any of claims 1-6.