WO2018108176A1

WO2018108176A1 - Robot video call control method, device and terminal

Info

Publication number: WO2018108176A1
Application number: PCT/CN2017/116674
Authority: WO
Inventors: 何坚强
Original assignee: 北京奇虎科技有限公司
Priority date: 2016-12-15
Filing date: 2017-12-15
Publication date: 2018-06-21
Also published as: CN106791565A

Abstract

A robot video call control method, device and a terminal provided by the present invention mainly relate to an intelligent robot capable of realizing a video call via a remote control. The method comprises the following steps: establishing a video call with a calling party and transmitting video streams acquired natively to the calling party; receiving a homing instruction initiated by the calling party, parsing target object information contained therein, and using this as the basis to determine corresponding target feature information; starting a walking device to execute movement of the native when a target object is not captured, and performing image recognition on the video streams during the moving to determine an image containing the target feature information so as to capture the target object; and controlling the walking device to maintain a preset distance range between the native and the target object after capturing the target object. The walking device of the present invention cooperates with a camera unit to capture the target object quickly through the image recognition technology during the moving, performs the video call and reduces loneliness of children through a human-computer interaction function.

Description

Robot video call control method, device and terminal

Technical field

The present invention relates to the field of automatic control technologies, and in particular, to a robot video call control method, apparatus and terminal.

Background technique

Nowadays, people apply to the Internet in many aspects of daily life and work, and various intelligent products related to the Internet have emerged. In particular, intelligent robots, as one of the smart products, can replace or assist humans in some work, and are often used in all walks of life. At present, intelligent robots have gradually replaced thousands of households to deal with daily household chores. Although such robots have simple automatic control and movement functions, they cannot meet modern needs. In particular, modern young parents are always immersed in At work, the daily care of the child is only a diet, can not often accompany the child, miss the opportunity to accompany the child's growth and wisdom development, although the existing robot has penetrated into thousands of households, but often acts as a substitute for cleaning the housework, although there are Some robots will also implement simple child care companionship in the family, but with the child's growth and entertainment needs, the robot will gradually lose the meaning of nursing companionship. Therefore, in the existing robots, comprehensive intelligent processing such as remote video communication, mobile, human-computer interaction, etc. cannot be performed, and the existing robots have low intelligence and small IQ range cannot be freely adjusted, resulting in inconvenient practical use.

Summary of the invention

In order to solve the above problems, the present invention provides a robot video call control method and a corresponding device thereof.

Accordingly, it is another object of the present invention to provide a terminal for operating a program implemented in accordance with the method described in the previous object.

In order to achieve the above objectives, the present invention adopts the following technical solutions:

In a first aspect, a robot video call control method of the present invention includes the following steps: establishing a video call with a calling party, and transmitting a video stream obtained by the local camera unit to the calling party; Receiving the instruction of the calling by the calling party, parsing the target information included in the seeking instruction, determining the target feature information of the corresponding target object according to the target information; and starting the walking when the target object is not captured The device performs local movement, performs image recognition on the video stream of the camera unit during the movement, determines an image containing the target feature information to capture the target object, and controls the walking device to make the local device after capturing the target object Maintain a preset distance range from the target object.

In a second aspect, the present invention also provides a robot video call control apparatus comprising: at least one processor; and at least one memory communicably coupled to the at least one processor; the at least one memory including processing The instructions executable by the processor, when executed by the at least one processor, cause the apparatus to perform at least the following operations: establishing a video call with the calling party, transmitting the local camera unit to the calling party Obtaining a video stream; receiving an instruction of the calling party initiated by the calling party, parsing object information included in the seeking instruction, determining target feature information of the corresponding target object according to the target information; and not capturing the target When the object is activated, the walking device is activated to perform local movement, and the video stream of the camera unit is image-recognized during the movement, and the image containing the target feature information is determined to capture the target object; when the target object is captured, the control is performed. The walking device maintains a preset distance range between the unit and the target object.

In a third aspect, the present invention also provides a video callable mobile robot comprising a processor for running a program to perform the steps of the robot video call control method.

In a fourth aspect, the present invention also provides a computer program comprising computer readable code that causes the robotic video call control method to be executed when the video callable mobile robot runs the computer readable code.

In a fifth aspect, the invention provides a computer readable medium storing the computer program of the fourth aspect.

Compared with the prior art, the present invention has the following beneficial effects:

1. The method, device and terminal for controlling a video call of a robot provided by the present invention establish and initiate remote control through pre-stored images, relationship of characters, and contact information with a person to realize remote connection, and when remote control is transmitted remotely by a character. The video of the character and transfer the video stream to it, Image recognition technology is used to capture the target object specified by the remote character from the dynamic video stream, and realize the video call function of the remote character and the target object through the video camera unit.

2, in the process of capturing the target object, the image of the target object stored in advance is used as the feature information for identification, and after the target object is captured, the extended feature information of the target object is collected, so as to facilitate A fast capture of the target object can be achieved by extending the feature information when subsequently capturing the target object.

3. The voice reminder is provided in the invention to ensure that the child receives the video call initiated by the parent in time, which helps the parent to monitor the child's activity anytime and anywhere. In the process of capturing the target object, mainly adopted

4. The method involves voice and/or infrared positioning, so that the robot can locate the child's position more quickly while searching for children, greatly improving the time and accuracy of the person recognition, after capturing the child and with the child. During the interaction process, the distance measuring device is kept within a preset distance from the child, thereby ensuring the child's safe and clear reception of the child information and the maximum range of capturing the child's state.

5. The invention integrates the entertainment learning function of video communication, mobile and human-computer interaction, and any character stored in the robot database can initiate an instruction to start the robot, by receiving and parsing the instruction, completing and/or starting the instruction involved in the instruction. Tasks and functions, the robot provided by the present invention can also provide children with human-computer interaction activities matching their age and/or IQ through observation and learning, so that the machine can achieve the maximum possible development of children's intelligence in the process of accompanying children. To reduce the child's loneliness, it is more practical in real life.

DRAWINGS

1 is a flowchart of a method for controlling a video call of a robot according to an embodiment of the present invention;

2 is a flowchart of a method for controlling a video call of a robot according to another embodiment of the present invention;

3 is a flowchart of a method for controlling a video call of a robot according to still another embodiment of the present invention;

4 is a flowchart of a method for controlling a video call of a robot according to still another embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a video call control apparatus for a robot according to an embodiment of the present invention; FIG.

6 is a schematic structural diagram of a sub-frame of a robot video call control device according to another embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a method for controlling a video call of a robot according to still another embodiment of the present invention; FIG.

FIG. 8 is a schematic structural diagram of a method for controlling a video call of a robot according to still another embodiment of the present invention; FIG.

Figure 9 is a block diagram of a video callable mobile robot performing the method according to the present invention;

as well as

Figure 10 is a schematic diagram of a memory unit for holding or carrying program code implementing a method in accordance with the present invention.

detailed description

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

The singular forms "a", "an", "the" It is to be understood that the phrase "comprise" or "an" Integers, steps, operations, components, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element. Further, "connected" or "coupled" as used herein may include either a wireless connection or a wireless coupling. The phrase "and/or" used herein includes all or any one and all combinations of one or more of the associated listed.

Those skilled in the art will appreciate that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs, unless otherwise defined. It should also be understood that terms such as those defined in a general dictionary should be understood to have meaning consistent with the meaning in the context of the prior art, and will not be idealized or excessive unless specifically defined as here. The formal meaning is explained.

Those skilled in the art can understand that the "terminal" and "terminal device" used herein include both a wireless signal receiver device and a device having only a wireless signal receiver without a transmitting capability. A device comprising receiving and transmitting hardware having a receiving and transmitting hardware capable of two-way communication over a two-way communication link. Such devices may include cellular or other communication devices having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data Processing, fax, and/or data communication capabilities; PDA (Personal Digital Assistant), which can include radio frequency receivers, pagers, Internet/Intranet access, web browsers, notepads, calendars, and/or GPS (Global Positioning System (Global Positioning System) receiver; conventional laptop and/or palmtop computer or other device having a conventional laptop and/or palmtop computer or other device that includes and/or includes a radio frequency receiver. As used herein, "terminal", "terminal device" may be portable, transportable, installed in a vehicle (aviation, sea and/or land), or adapted and/or configured to operate locally, and/or Run in any other location on the Earth and/or space in a distributed form. The "terminal" and "terminal device" used herein may also be a communication terminal, an internet terminal, a music/video playing terminal, and may be, for example, a PDA, a MID 10 (Mobile Internet Device), and/or have a music/video playing function. Mobile phones can also be smart TVs, set-top boxes and other devices.

The robot involved in the present invention can understand the human language, talks with the operator in human language, and forms an external environment in which it can "survive" in its own "consciousness" through programming. It analyzes what is happening and adjusts its movements to meet the operator's requirements for robots. Robots can be programmed to make their intelligence reach the level of children. Robots can walk alone, "seeing" things and analyzing what they see, obeying instructions and answering questions in human language. More importantly, it has the ability to "understand".

The robot video call control method according to the present invention enables a family member to view the situation of the home at any time and anywhere in the home of the guardian through the communication terminal, and the child at home is thinking about the parents and/or other at home. When members are members, they can also send timely communication to them through the robot end. At the same time, in the process of capturing the target object, the robot can update the stored extended feature information in time by monitoring the change of the extended features of the extended part of the target object. Faster and more accurate capture of the target object, in particular the target feature of the target object, after the external family member issues an indicator to the robot, the robot can receive the message in time and transmit the video image of the situation at home, the robot of the present invention has Human-computer interaction function can also play, answer questions and help learn The role.

The robot video call control method disclosed in the following embodiments, as shown in FIG. 1, includes the following steps:

S100: Establish a video call with the calling party, and transmit the video stream obtained by the local camera unit to the calling party;

The information stored in the robot records the relationship between the robot and the family member, and establishes a connection mode with the direct communication terminal between the family members. The calling party in step S100 is a family member, for example, each mobile terminal of the family member, such as a mobile phone. Computers, ipads, etc. all store applications connected to the robot, wherein the application can be an app that controls the robot directly related to the robot, or a web link that controls the robot, in order to perform real-time monitoring of the role of the child, the family The member establishes and activates the video communication transmission function of the robot in advance, directly establishes a video call with the communication terminal of the family member, or establishes a video call with the family member when receiving the transmission instruction of the family member, and real-time Transmitting a video image to a terminal of a family member, or directly receiving a call from a family member who controls the bot's App application or entering a web application that controls the machine, and issues a video call request, directly accepts the family member's Video call request and to The family member who is the video call, that is, the calling party transmits the video stream acquired by the local machine, wherein the past video stream transmitted by the robot is also displayed on the calling mobile terminal of the calling party where the controlling robot is installed, or the webpage opened by the calling mobile terminal. Displayed on the app, real-time video calls are implemented.

S200: receiving an instruction of the calling party initiated by the calling party, parsing object information included in the seeking instruction, and determining target feature information of the corresponding target object according to the target information;

The robot accepts and sends back the video stream to the caller. The caller can directly observe the situation at home through the video. If the caller cannot see the target object in the video, the caller can be on his own side. The mobile terminal issues a seek instruction, and the search instruction includes information about the target object, and the information is stored in the robot or in the cloud connected to the robot. After the robot receives the seek instruction, the robot is in the local machine. The target object information included in the searched instruction is parsed, and the target feature information of the target object corresponding to the target object is determined according to the target object information, and the robot searches and determines the target object based on the basis in the subsequent process.

Specifically, for example, the mother initiates a search for “looking for a daughter” to the robot at the mobile terminal, and the robot receives the “seeking daughter” search command and parses the information in the seek instruction in the local machine, that is, parses and extracts “ "Daughter" message, sending the message "daughter" to the store "daughter" a database of target information and corresponding feature information, and determining the feature information of the daughter by storing the target information of the daughter, wherein the storage relationship between the specific target feature information and the target information is detailed later, and the feature information is the daughter's Facial features, such as the contour and position of the entire face and facial features, will be used by the robot to find and determine the daughter based on this.

Another embodiment of the present step is that after the robot receives the instruction of seeking, the robot sends the searched instruction to the cloud, and the cloud parses the target information contained in the searched instruction, and sends the target information to the robot, and the robot according to the target. The object information determines the target feature information of the target object corresponding to the target object, and the robot will find and determine the target object based on the basis in the subsequent process.

Specifically, for example, the above-mentioned mother initiates a search for “looking for a daughter” to the robot at the mobile terminal, and after receiving the instruction of “seeking the daughter”, the robot sends the instruction of “seeking the daughter” to the cloud, and the cloud analyzes the search. The information in the instruction, that is, parsing and extracting the information of "daughter", and sending the information to the robot, the robot receives the parsed information, and sends the message "daughter" to the target information storing "daughter" And a database corresponding to the characteristic information, and determining the characteristic information of the daughter by storing the target information of the daughter, the robot will find and determine the daughter based on the basis in the subsequent process.

Another embodiment of the present step is that after the robot receives the seek instruction, the robot sends the search command to the cloud, and the cloud parses the target information contained in the search command, and the cloud sends the target information to the storage target. The cloud and the target feature information are in the cloud database, and the target feature information of the target object corresponding to the target object is determined according to the target information in the cloud, and the cloud sends the target feature information to the robot, and the robot will use the target in the subsequent process. Based on finding and determining the target object.

Specifically, for example, the above-mentioned mother initiates a search for “looking for a daughter” to the robot at the mobile terminal, and after receiving the instruction of “seeking the daughter”, the robot sends the instruction of “seeking the daughter” to the cloud, and the cloud analyzes the search. The information in the instruction, that is, parsing and extracting the information of "daughter", determining the characteristic information of the daughter through the information, and transmitting the characteristic information to the robot, and the robot receives the characteristic information directly receiving the daughter, and based thereon Find and identify your daughter.

S300: when the target object is not captured, start the walking device to perform local movement, perform image recognition on the video stream of the imaging unit during the moving process, and determine an image including the target feature information to capture the target object;

After the feature information of the target object and the target object is determined in step S200, if it has been acquired In the video stream, image recognition is performed without image with target feature information, and the robot activates its own walking device to move the robot. During the moving process, the robot passes the acquired video stream of the camera unit and passes image recognition technology. Identifying the image in the video, determining whether the image contains the image of the target feature information, and capturing the target object, wherein the uncaptured object includes the following situations: 1. The robot does not recognize the image in the video stream. To the target feature information and the extended feature information corresponding to the target object, and after the robot locates the target object through audio and infrared, the distance between the target and the target object is greater than the preset distance range of the preset robot and the target object, and the walking is started. The device does not recognize the target feature information and the extended feature information corresponding to the target object in the image in the video stream, and after the robot locates the target object through audio and infrared, the distance between the target and the target object is less than the preset. Preset distance between the robot and the target object The robot starts the walking device; 3. When the robot captures the target feature of the target object, and the distance from the target object remains within the preset range, the robot does not start the walking device when the video image is unclear. After the outline of the video image is clear, if the target feature information and the extended feature information corresponding to the target object are not recognized in the image in the video stream, and the robot is positioned to the target object through audio and infrared, the walking device is activated; The robot captures the target feature of the target object, and the distance from the target object remains within the preset range. If the target object suddenly moves away from the target feature that causes the robot to fail to recognize the target object, the walking device is activated, if the target object is far away and Before the robot locates the position of the target object, the robot finds that the target object is gradually approaching by ranging, and does not activate the walking device. The robotic walking device receives the signal from the camera unit and converts it into an electrical signal of a controller that controls and electrically connects the traveling device, and the controller rotates the electrical signal to the driving device that activates the traveling device, and the driving device starts The walking device realizes the movement of the robot, wherein the driving device may be a motor, the walking device may be a wheel, a crawler or a wheel and the like; the image recognition is to first store a picture in the robot and use it as a model, the robot processor The model is first preprocessed, and the contour with lines, the angle between the lines and the lines, the relative position of the lines and the lines, the colors covered in the outline, etc. are extracted, after capturing a video image. In order to determine whether the target object needs to be captured in the current image, the robot processor sequentially preprocesses each frame of the image in the image, and extracts the contour with lines, the angle between the lines and the lines, and the line and The relative position of the lines, the colors covered in the outline, etc. Comparative fitting, the fitting when it reaches the set value is considered to exist in the video image captured target.

Specifically, if the mother views the daughter through the robot, the characteristic information of the daughter is determined in step S200, and the robot searches for the daughter at home based on the feature information, and the robot firstly at the position where he receives the instruction to seek. Positioning the daughter by each audio and/or infrared, if the daughter is within a preset distance range, and the robot cannot capture the target feature of the daughter in a partial frame or a continuous frame image of the current video stream, the walking device is activated to cooperate The camera unit captures the target feature information of the daughter. If the position of the daughter is positioned by each audio and/or infrared, if the daughter is not within the preset distance range, the walking device is activated, and the image is recognized by the video stream of the camera unit to capture the daughter. The target features are the contour features of the daughter's face.

S400: After capturing the target object, controlling the walking device to maintain a preset distance range between the local machine and the target object.

The robot can preset the distance range between the robot and the target object and is M. After the robot captures the target object, the distance between the robot and the target object is first measured by a measuring device such as an ultrasonic sensor mounted thereon, if M≤L, If the distance between the robot and the target object is far away and is not within the preset distance range, the robot moves to the preset distance range from the target object by the walking device, and the robot always keeps with the target object during the moving process of the target object. If the distance is set, if M≥L, the distance between the robot and the target object is relatively close. At this time, the robot only needs to maintain the preset distance range from the target object.

Specifically, if the mother searches for a daughter, in step S300, if the robot finds the daughter according to the characteristic information of the daughter, wherein the preset distance between the robot and the daughter is 3 m, the robot measures the distance between the robot and the daughter through its own measuring device. When 6m is greater than the preset distance of 3m, the robot moves to the preset distance range with the daughter through the walking device, and the robot always maintains a preset distance of 3m from the target object during the walking of the daughter.

S410: After capturing the target object, collecting extended feature information of the target object that belongs to the target feature information, and when the target feature information cannot be captured, positioning the target object according to the extended feature information The amplified part achieves the target object capture.

In order to quickly find and/or locate the target feature of the target object in a subsequent time, after the robot captures the target object, the extended feature information of the amplified part other than the target feature information on the target object is collected by the video, on the calling side. Video call via robot and target object In the process, due to the movement of the target object and/or the movement of the robot, the video of the robot cannot capture the target feature information of the target object, that is, the robot cannot clearly recognize in the partial frame or the continuous frame picture in the current video stream. When the target feature corresponds to the outline with lines, the angle between the line and the line, the relative position of the line and the line, the color covered in the outline, etc., the robot can expand through the amplification part other than the target feature information of the target object. The feature information quickly finds and focuses on the target feature information of the target object. After the target object captures the target object, the target feature information of the target object cannot be recognized because the target object suddenly moves away. In order to further capture the target object, the robot simultaneously identifies the target feature information and the extended feature information of the target object in the current video stream. If the augmented part of the target object is identified by the extended feature information, the target object is captured according to the augmented part, and the target feature of the target object is further determined based on the target object.

Specifically, after the robot captures the daughter as described above, the camera captures other extended feature information of the daughter other than the facial feature information, such as the color and style of the daughter's clothes, pants, shoes, and the color of the hair. Form, the color, shape, style of the hat, the outline of the body, arms, legs, etc., during the video call of the mother and daughter through the robot, if the daughter is sitting while sitting, in the process, it may lead to The robot can not locate and capture the facial feature information of the daughter, and the robot can locate the target feature information and capture the target object through the extended feature information of the extended part. For example, after the camera unit captures the daughter, when acquiring the features of the body part, the color of the body part wearing the part of the frame or the continuous frame picture is acquired, and then according to R:G:B=3:6:1. The ratio decolorizes part of the frame or the continuous frame image, processes it as a black and white picture, extracts the outline feature of the body contour, and determines the target object as the extended feature information in the process of capturing the target object.

Further, after the augmented portion of the target object is located according to the extended feature information, the walking device is started to continue searching for the target feature information around the augmented portion until the target feature information is acquired.

When the robot cannot capture the target feature information of the target object, the robot first compares the feature information captured by the camera unit with the previously acquired extended feature information and locates the extended portion captured by the camera unit, and the robot starts the walking device to move around. The amplified portion continues to search for the target feature information until the camera unit captures and locates the target feature information. Continue to capture the target in the video call.

Specifically, during the video call between the mother and the daughter through the robot, as the above is sitting, the robot can capture the facial features of the daughter. After the daughter stands up, the robot can only capture the body part of the daughter, the daughter. Wearing a pink dress, the style is a round neck, sleeveless tutu. At this time, the robot can determine the captured position by the extended feature information collected before, that is, the outline of the daughter's body, the color and style of the skirt. And determining, by the capturing part, the orientation of the rotation of the robot camera unit, that is, the collar of the skirt captured by the camera unit, the form of the shoulder, and the characteristic information of the body of the daughter, determining that the body part of the daughter is captured as the front chest and is raised by the lifting The camera unit can capture the facial features of the daughter; if the daughter stands up and turns over the body, so that the back of the camera is facing the camera unit of the robot, the camera unit of the robot captures the color of the skirt of the extension of the daughter's torso and The extended feature information of the style and the back profile, then the robot needs to start the walking device Moving around the torso and searching for the target feature information by changing the angle of the camera unit, until the camera unit searches for the target feature information, the robot adjusts the distance with the daughter, and locates the target feature information before continuing to capture the target object, such as a robot. When the target feature information of the daughter is captured, and the distance from the daughter is kept within the preset range, when the outline of the video image of the robot camera unit is unclear, the robot temporarily does not activate the walking device, and after the outline of the video image is clear, the video is passed. After the image recognition in the stream, the recognized extended feature information is derived from the amplified portion of the daughter's back of the body, and the walking device is activated to capture the facial feature information of the daughter around the feature portion.

Preferably, the extended feature information is collected from a moving scene image in which the image portion corresponding to the target feature information in the video stream moves together.

After the robot captures the target object, the target object belongs to the dynamic image in the video stream relative to other scenes. When the extended information is collected, the extended features on the target object in the video stream that move together with the target feature information are collected, such as a robot camera unit. After capturing the target object, wherein the facial feature information is used as the target feature information, the other line contours in the partial frame or the continuous frame picture change with the line contour of the face and may be surrounded by the face contour in a closed The part in the contour is used as an amplification site, and the contour of the amplified part, the relative position of each contour, and the color of the contour coating are collected after the amplification site is determined.

Specifically, after the robot captures the daughter, the daughter is relative to the home in the video stream. The static item belongs to the dynamic object. The daughter's torso, clothes, hair, etc. all move together following the daughter's movement. When the daughter's object is determined according to the facial feature information of the daughter in the video stream, some frames or consecutive frames in the video stream are collected. The outline of the part of the frame picture that changes with the contour of the other side of the daughter's face, the relative position of each outline, and the color of the outline, and other line outlines can be surrounded with the outline of the face and in a closed outline The location, and according to the position of other line contours and the contour of the face, it is determined that other contours belong to a certain part of the body, and according to whether the contour of the face in the partial frame or the continuous frame image changes relative to the position of other articles and the position of other parts follows the face. Whether the position of the part changes relative to the position of other items determines whether the daughter is in a state of motion, and if yes, it is exercise, otherwise the daughter is not in a state of motion. For example, during the process of the daughter walking, the contour features of the face in the partial or continuous frame image of the video stream of the camera unit are changed relative to other items, and the contour position of the face is changed according to the change of the face feature position. The change is changed with respect to the position of other items, the daughter is determined to be in a moving state, and the contours of other parts can be wrapped in a closed contour with the contour of the face, and the leg is determined according to the position of the contour of the other part relative to the face. For amplifying the part, and acquiring the extended feature information of the amplified part in the partial frame or the continuous frame picture.

Further, the target information and the target feature information are stored in a database in a mapping relationship, and the target feature information is determined according to the target information by querying the database.

The target information and the target feature information are all stored in the database in a one-to-one correspondence relationship. After the target information is determined, the target feature information can be queried through the target information, and the database can be a local database. It can be a cloud database connected to the robot. If it is a local database, after obtaining the target information, the target feature information can be directly determined locally. If it is a cloud database, the robot sends the target information to the cloud, and the cloud determines the target feature information corresponding to the target information. , return the target feature information to the robot.

Specifically, such as Xiaohong as the target, when storing, the mother will store the common name of Xiaohong (including other family members to Xiaohong) and Xiaohong's facial feature information, and also include the collected extension. The feature information, as shown in Table 1, is the storage relationship between the target information and the target feature information in the database.

Further, in the step of controlling the walking device to maintain the preset distance range between the local device and the target object after capturing the target object, acquiring the local distance sensor detection target and the target along with the running of the walking device The distance data between the objects, when the distance data exceeds the predetermined distance range, controls the walking device to start moving first, and otherwise controls the walking device to stop walking and pause the movement.

After capturing the target object, the distance sensor is always in the measurement state while maintaining the distance between the robot and the target object. The distance between the robot itself and the target object is measured. During the movement of the target object, the robot and the target When the distance between the objects exceeds the preset range, the robot automatically controls the walking device to start moving and moves. If the distance between the robot and the target object is measured by the distance sensor within a preset range, the robot automatically controls the walking device to stop the walking device. The robot pauses to move.

Specifically, after the robot captures the small red, the distance sensor is always in the measurement state while the robot's walking device maintains its distance from the small red, and the distance between the robot itself and the target object is measured. During the movement, when the distance between the robot and Xiaohong exceeds the preset range, the robot automatically controls the walking device to start walking and moves. If the distance between the robot and the red red is measured by the distance sensor, the distance is within a preset range. The robot automatically controls the walking device to stop the walking device to suspend the movement of the robot. When the distance range exceeds the preset range, the robot automatically controls the walking device to start walking and move, making the robot more intelligent.

The target information is a name or an indicator of the target object.

After receiving the instruction of the incoming caller in step S200, the target object information carried in the command is parsed, and the target object information is the name or indicator of the target object, such as the name of the person, the computer, and the like.

Specifically, the above-mentioned mother’s instruction as a calling party at the terminal is “looking for electricity”. "brain", in which "find computer" character information, step S200 parses out the computer in "find computer" and uses it as an indicator of the target object, such as a computer as an indicator, that is, target information; for example, the daughter's name is Xiaohong, the instruction issued by the mother is "Looking for Xiaohong", in which "Look for Xiaohong" character information, step S200 parses out the little red in "Look for Xiaohong" and uses it as an indicator of the target object, ie The target information Xiaohong is the name of the daughter's target object, that is, the target information; in addition, the indicator may also be the information stored by the calling party terminal and the target object, and the information of the target object is triggered at the calling party terminal, and the calling party terminal will The information of the target object generates an indicator corresponding to the target object, and sends an indicator of the target object to the robot, such as the mother as the calling party stores information related to the daughter Xiaohong on the terminal, such as the name Xiaohong. On behalf of Xiaohong’s image, the mother triggers the daughter’s name on the terminal or the image representing Xiaohong, and the caller’s terminal generates a search for Xiaohong. Character shown, and send the indicator to the robot.

Preferably, the target feature information is facial feature information of the target object.

The target feature information of the target object is entered in advance, and the facial feature change can best express a person's mood or express the state at the time. When entering, the facial feature is preferably used as the target feature information, which is convenient for the parent during the subsequent video call. Or the family members during the video call, or the video and/or photos taken, can first observe the emotions of the children and/or other family members at home through the facial expression.

In one embodiment, the method further includes the following steps: after detecting that the extended feature information of the target object changes, re-collecting the extended feature information of the extended part.

The robot can save the extended feature information of the target object to the next time the extended feature information changes, and after the robot detects that the extended feature information of the stored target object changes, the new extended feature information is re-acquired, so as to expand the feature in the target object. After the information changes, the target object needs to be captured, and the target feature information of the target object can be quickly located and the target object can be captured.

Specifically, as the above-mentioned Xiaohong wears a pink dress, the extended feature information stored in the database is also the information of the pink dress. After the red is replaced by a white dress, the robot determines the object wearing the white dress by capturing the target feature information. After red, and found that the clothing extension feature information has changed, the extended feature information of the small red body and the white dress is re-acquired.

Preferably, the distance sensor is an ultrasonic sensor, an infrared sensor, or a binocular ranging imaging device including the imaging unit.

The distance sensor involved in step S400 is an ultrasonic sensor, an infrared sensor, or a binocular ranging imaging device including the imaging unit, and the binocular ranging imaging device is convenient to use, and can initially determine the distance between the robot and the target object. Ultrasonic has small error in long distance ranging and good effect. The infrared sensor has small distance measurement error and good effect. The invention combines with each other to optimize the distance error of the robot in the distance.

Preferably, the extended feature information includes one or any of a plurality of features: a torso part feature, a clothing part feature, a facial contour feature, a hair outline feature information, or audio feature information.

In step S410, the extended feature information includes one or any of a plurality of features: a torso part feature, a clothing part feature, a face outline feature, a fur outline feature information, or audio feature information.

Further, the machine further includes an audio and/or infrared positioning unit, when the target object is captured, the local device turns on the audio and/or infrared positioning unit to acquire the target position to determine the starting direction of the walking device. .

Also included in the robot is an audio and/or infrared positioning unit that acquires the position of the target by turning on the audio and/or infrared positioning unit during capturing of the target object, and thereby determining the walking of the robotic walking device at the beginning direction.

Specifically, as described above, after determining that the target object is Xiaohong, Xiaohong laughs at the front of the robot at this time, and the robot acquires the audio of Xiaohong through the audio positioning unit, and locates the position of the red red as the robot. Directly forward, at this time, the robot directly activates the walking device to move the robot forward; if the robot radiates through the infrared light of the infrared positioning unit to sense the surrounding scenery and the infrared light reflected from the environment, the position of the small red is determined to be the right front of the robot. , the robot starts the walking device and moves to the right front to find the red.

Further, in the process of capturing the target object, when the obstacle is encountered, the local machine measures the distance between the local device and the obstacle through the distance sensor, and controls the walking device to bypass and/or stay away from the obstacle. The target object continues to be captured after being bypassed and/or away from the obstacle.

In the process of searching for Xiaohong, the robot will inevitably encounter obstacles, such as stools and walls in the home. It is also possible to measure the distance between the robot and the obstacles in the figure through the distance sensor, and find the orientation of the red. In this case, the walking device is controlled to bypass and/or move away from the stool, the wall, and continue to capture the red.

Further, the local machine further includes a voice reminding unit, when the local machine moves within a distance range from the target object, the voice reminding unit is activated, and a voice reminder is issued.

In order to ensure that the target object can receive the message sent by the parent in time when the calling party initiates the video call, the robot prompts the voice reminding unit when the robot captures the target object and moves to a preset distance from the target object. And send a voice reminder.

Specifically, if the above-mentioned robot finds Xiaohong and moves to the distance range from Xiaohong, it will send a voice reminder to Xiaohong. For example, if the mother calls, the mother calls, and the mother calls, fast. Answer the call, answer the call quickly, and answer the call quickly.

In one embodiment, as shown in FIG. 3, the method further includes the following steps:

S500: After the calling party hangs up the video call, the robot camera unit continuously collects a video of the target object;

In order to ensure that the caller can learn more about the state of the child and the child at home, after the caller hangs up the phone, the robot continuously collects the video of the child's home through the camera unit.

Specifically, as the above-mentioned mother hangs up a video call with her daughter Xiaohong as a caller, and the robot does not turn off the camera unit, but continuously collects videos of Xiaohong’s at home, learning, and the like.

S600: The robot sends the video to a terminal connected thereto, and sends a text reminder and/or a voice reminder to the terminal.

After a video capture is completed, the robot sends the collected video to the terminal and/or cloud of the family member connected to it, and sends a text reminder and/or a voice reminder to the terminal, and after collecting a video, the next video is continuously collected. .

Specifically, after the above-mentioned robot plays the video of Xiaohong at home, it is sent to the family member's terminal and/or the cloud, such as a mobile phone, a computer, an ipad, etc., and/or a cloud connected thereto, and the video is successfully transmitted. Send text reminders and/or voice reminders to the terminal of the family member, such as: there is a video with Xiaohong playing; if the robot is not connected to the cloud, it will only be sent to the terminal, and if it is sent to the cloud and the terminal, or the terminal is all When the status is off, only the cloud is sent, and when any terminal is turned on, an alert message is sent.

Preferably, when the robot acquires the target object, according to a change of the target object facial feature and/or audio feature and/or an interaction instruction issued by the target object, the local machine Initiating a voice interaction unit and/or initiating a video call to a mobile terminal connected to the local machine.

The robot changes the facial features of the target object through the camera unit during the process of collecting the target object. If the child is crying, the robot activates the human-computer interaction unit of the machine to make the child happy; according to the change of the audio characteristics of the target object, If the child is angry, the robot determines that the child belongs to the temper state through the audio characteristics, the robot activates the human-computer interaction unit of the machine to comfort the child; the robot sends an instruction according to the target object, such as the child submits flowers to the machine in English. Say, the robot answers according to the question raised by the child, the English of the flower is flower; and if the target child sends a call to the dad to the robot, the robot sends a video call request to the mobile terminal of the father.

Specifically, in the process of collecting the video of Xiaohong, the robot determines that Xiaohong is crying now by the change of the characteristics of the little red face and the change of the audio feature, and the robot starts the human-computer interaction unit to tell Xiaohong or tell the story. Jokes, etc., make Xiaohong happy; and Xiaohong gives the robot instructions to listen to the song, and the robot sings to Xiaohong. If Xiaohong says to the robot that I want to learn Tang poetry, the robot will ask questions based on Xiaohong’s usual time. Determine Xiaohong's intellectual development stage, and give Xiao Hongyan a Tang poem suitable for Xiaohong's intellectual stage learning and analyze it.

Further, in the process of collecting the target object video, the camera unit further includes a photographing function to change according to a facial feature and/or an audio feature of the target object and/or an interactive instruction issued by the target object. Taking a picture of the target object.

The camera unit of the robot further includes a photographing function. When the robot collects the target object video, the facial features of the target object change. If the target object smiles happily, the camera unit captures the state of the target object at this time. As in the target object has been silently talking to a person, the camera unit also captures the state of the target object at this time; and as the target object gives the robot a picture of me and the dog, the robot according to the target The object's command activates the camera function of the camera unit, and takes a picture of the target object and the dog.

In one embodiment, after the target object issues an interactive instruction, the method further includes the following steps:

S700: Receive an interaction instruction of the target object.

The target feature information of the family members at home can be stored in the local database of the robot and/or the cloud database connected to the robot, so members stored in the database can go to the machine. The person sends an interactive instruction, and the robot first receives the interactive instruction issued by the current target object.

Specifically, members of the Xiaohong family include Grandpa, Grandma, Dad, Mom, and Xiaohong himself, and the database stores the target feature information of all family members, that is, facial feature information. The current family members include grandfather, grandma, and small. Red three people, if the current target identified by Xiaohong is Xiaohong, when multiple people send interactive commands to the robot at the same time, only the interactive command sent by Xiaohong is accepted.

S800: Parse the interaction information included in the interaction instruction, and extract an indicator corresponding to the local function unit;

After the robot acquires the interactive instruction of the target object, it needs to parse the information contained in the interactive instruction, and parse the indicator corresponding to the local functional unit in the interactive instruction, so as to open the functional unit of the local machine.

Specifically, if the above-mentioned robot receives Xiaohong to send an interactive instruction, the interactive instruction is “Give me a story about the duckling”, and the robot analyzes the “Little Duck Story” and “Speak” in the instruction, and “The Story of the Little Duck” Change to search for "Little Duck's Story" in the database or network, and extract it, and change the "speak" to start the indicator of the speech unit.

S900: Start a functional unit corresponding to the indicator.

In the human-computer interaction, the interaction instruction issued by the target object includes a functional indication that can achieve the purpose of the target object, and according to the indicator parsed in step S800, the functional unit that realizes the purpose of the target object is started, and the target object is issued. instruction.

Specifically, the interactive instruction issued by Xiaohong, "tell me the story of the duckling", after the parsing of step S800, searches for "the story of the duckling" through the database and/or the network, and extracts it, and starts the robot. The voice function tells Xiaohong the story of "Little Duck". The database can be a local database or a cloud database. When searching, the database and the network can be searched at the same time, or only the local database can be searched when there is no network connection.

Further, the interactive instruction issues a voice instruction for the target and/or a button corresponding to the function unit that the target clicks on the local machine.

The robot has a sensor for receiving voice, and a physical function button for man-machine interaction is set on the robot. If the robot is provided with a touch screen, the function mortgage can also be a virtual touch button.

As shown in FIG. 5, the present invention also provides a robot video call control apparatus, including the following modes. Piece:

S10: a video module, configured to establish a video call with the calling party, and transmit the video stream obtained by the local camera unit to the calling party;

The information stored in the robot records the relationship between the robot and the family members, and establishes a connection mode with the direct communication terminal between the family members. The calling party is a family member, for example, various mobile terminals of the family members such as a mobile phone, a computer, an ipad, etc. There are stored applications connected to the robot, wherein the application can be an app that controls the robot directly related to the robot, or a web link that controls the robot. In order to perform the role of real-time monitoring of the child, the family members are set in advance. And turning on the function of the video communication transmission of the robot, the video module S10 directly establishes a video call with the communication terminal of the family member, or when receiving the transmission instruction of the family member, the video module S10 establishes a video call with the family member. And transmitting the video image to the family member's terminal in real time, or receiving a video call request by receiving a call from a family member who controls the bot's App application or entering the control machine's web application, and the video module S10 is Directly accepting family members The video call request transmits the video stream acquired by the local party to the calling party that initiates the video call, wherein the past video stream transmitted by the robot is also displayed on the calling mobile terminal of the calling party where the controlling robot is installed, or is in the call The mobile application opened by the mobile terminal displays the real-time video call.

S20: an analysis module, configured to receive an instruction of the calling party initiated by the calling party, parse target information included in the seeking instruction, and determine target feature information of the corresponding target object according to the target information;

The video module S10 establishes a video call with the calling party, and the robot accepts and sends back the video stream to the calling party, and the calling party can directly observe the situation at home through the video, if the calling party cannot see that he wants to see in the video. When the target object is used, the caller can issue a seek command on the mobile terminal on the side of the caller. The search command contains information about the target object, and the information is stored in the robot or in the cloud connected to the robot. After receiving the homing instruction, the robot analysis module S20 parses the target object information included in the homing instruction in the local machine, and then determines the target feature information of the target object corresponding to the target object according to the target object information, and the robot in the subsequent process, Based on this, the target object will be found and determined.

Specifically, for example, the mother initiated the search for the "seeking daughter" to the robot on the mobile terminal. So, the robot analysis module S20 receives the "seeking daughter" search command and parses the information in the seek command in the local machine, that is, parses and extracts the "daughter" information, and sends the "daughter" information to the storage. "Daughter" is a database of target information and corresponding feature information, and determines the daughter's feature information by storing the daughter's target information as the daughter's facial features, that is, the outline and position of the entire face and facial features, and the robot in the subsequent process. In this, based on this, find and determine the daughter.

Another embodiment of the present step is that after the robot analysis module S20 receives the instruction of searching, the instruction of the search is sent to the cloud, and the cloud parses the target information contained in the searched instruction, and sends the target information to the robot. The robot determines the target feature information of the target object corresponding to the target object according to the target object information, and the robot searches and determines the target object based on the basis in the subsequent process.

Specifically, for example, the above-mentioned mother initiates a search for “looking for a daughter” to the robot at the mobile terminal, and the robot analysis module S20 receives the instruction of “finding the daughter” and sends the instruction of “seeking the daughter” to the cloud. The cloud parses the information in the search instruction, that is, parses and extracts the information of "daughter", and sends the information to the robot. The robot receives the parsed information and sends the message "daughter" to the storage "daughter". a database of target information and corresponding feature information, wherein the storage relationship between the specific target feature information and the target information is detailed later, and the daughter's feature information is determined by storing the daughter's target information, and the robot is in the subsequent process. In this, based on this, find and determine the daughter.

Another embodiment of the present step is that after the robot analysis module S20 receives the instruction of searching, the instruction of the search is sent to the cloud, and the cloud parses the target information contained in the searched instruction, and the cloud sends the target information to the cloud. The cloud database storing the target information and the target feature information, and determining the target feature information of the target object corresponding to the target according to the target information in the cloud, the cloud transmitting the target feature information to the robot, and the robot in the subsequent process, Based on this, the target object will be found and determined.

Specifically, for example, the above-mentioned mother initiates a search for “looking for a daughter” to the robot at the mobile terminal, and the robot analysis module S20 receives the instruction of “finding the daughter” and sends the instruction of “seeking the daughter” to the cloud. The cloud parses the information in the search instruction, that is, parses and extracts the information of “daughter”, determines the feature information of the daughter through the information, and sends the feature information to the robot, and the robot receives the feature information directly receiving the daughter, and This is the basis for seeking Find and confirm your daughter.

S30: a capture module, configured to: when the target object is not captured, start the walking device to perform local movement, perform image recognition on the video stream of the image capturing unit during the moving process, and determine an image that includes the target feature information, Capture the target object;

After the analysis module S20 determines the feature information of the target object and the target object, if it is determined by the image recognition that there is no image with the target feature information in the acquired video stream, the robot starts its own walking device to move the robot, and moves In the process, the robot passes the acquired video stream of the camera unit, and through image recognition technology, identifies the image in the video, determines whether the image contains the image of the target feature information, and captures the target object, wherein the target object is not captured. The object includes the following situations: 1. The robot does not recognize the target feature information and the extended feature information corresponding to the target object in the image in the video stream, and the robot passes the audio and infrared to the target object, and then passes the measurement and the target object. The distance is greater than a preset distance range between the preset robot and the target object, and the walking device is activated; 2. the robot does not recognize the target feature information and the extended feature information corresponding to the target object in the image in the video stream, and the robot passes After the audio and infrared are positioned to the target object, The distance between the measured object and the target object is smaller than the preset distance range between the preset robot and the target object, and the robot starts the walking device; 3. The robot captures the target feature of the target object, and the distance from the target object remains within the preset range. During the process, when the outline of the video image of the robot camera unit is not clear, the robot does not start the walking device temporarily. After the outline of the video image is clear, if the target feature information and the extended feature corresponding to the target object are not recognized in the image in the video stream. Information, while the robot is positioned to the target object through audio and infrared, the walking device is activated; 4. The robot captures the target feature of the target object, and the distance from the target object remains within the preset range, such as the target object suddenly moving away When the robot cannot recognize the target feature of the target object, the walking device is activated. If the target object is far away and the robot finds that the target object is gradually approaching by the distance measurement before the robot locates the target object, the traveling device is not activated. The robotic walking device receives the signal from the camera unit and converts it into an electrical signal of a controller that controls and electrically connects the traveling device, and the controller rotates the electrical signal to the driving device that activates the traveling device, and the driving device starts The walking device realizes the movement of the robot, wherein the driving device may be a motor, the walking device may be a wheel, a crawler or a wheel and the like; the image recognition is to first store a picture in the robot and use it as a model, the robot processor The model is first preprocessed and extracted between the outlines with lines, lines and lines The relative position of the line, the line and the line, the color covered in the outline, etc. After capturing a video image, in order to determine whether the target object needs to be captured in the current image, the robot processor sequentially images each frame in the image. Pre-processing, and extracting the contour with lines, the angle between the lines and the lines, the relative position of the lines and the lines, the colors covered in the contour, etc., and the image models in the database are compared and fitted. When the fitness reaches the set value, the captured target object is considered to exist in the video image.

Specifically, if the mother views the daughter through the robot, the analysis module S20 determines the characteristic information of the daughter, and the robot searches for the daughter at home based on the feature information, and the robot first passes the position at which the instruction of the search is received. Each audio and/or infrared locates the position of the daughter. If the daughter is within a preset distance range and the robot cannot capture the target feature of the daughter in a partial frame or a continuous frame image of the current video stream, the walking device is activated to cooperate with the camera. The unit captures the target feature information of the daughter. If the position of the daughter is positioned by each audio and/or infrared, if the daughter is not within the preset distance range, the walking device is activated, and the video stream of the camera unit is used for image recognition to capture the daughter's Target features such as the contour features of the daughter's face.

S40: A maintenance module, configured to control the walking device to maintain a preset distance range between the local device and the target object after the target object is captured.

The robot can preset the distance range between the robot and the target object. After the robot step to the target object, the distance between the robot and the target object is first measured by the measuring device installed thereon, if the distance between the robot and the target object is far and not preset Within the distance range, the robot moves to a preset distance range from the target object by the walking device, and during the moving of the target object, the robot always maintains a preset distance range with the target object through the maintenance module S40.

Specifically, if the mother searches for a daughter, the robot finds the daughter according to the daughter's characteristic information through the capture module S30, and the robot measures the distance between the robot and the daughter through its own measuring device, if the robot is far away from the daughter and is not preset. Within the distance range, the robot moves to the preset distance range with the daughter by the walking device, and during the walking of the daughter, the robot always maintains a preset distance range with the target object through the maintenance module S40.

Further, the capturing module S10 further includes an acquiring unit S31: after capturing the target object, acquiring extended feature information of the target object other than the target feature information thereof, and failing to capture the target feature Positioning the information according to the extended feature information The target part is amplified by the target object.

In order to quickly find and/or locate the target feature of the target object in a subsequent time, after the robot captures the target object through the capture module S10, the expansion unit amplifies the expansion of the target object except the target feature information through the acquisition unit S31. Feature information, in the process of the caller's video call through the robot and the target object, due to the movement of the target object itself and/or the movement of the robot, the camera unit of the robot cannot capture the target feature information of the target object, and the robot is in the current video. When a partial frame or a continuous frame picture in the stream cannot clearly identify the contour with the line corresponding to the target feature, the angle between the line and the line, the relative position of the line and the line, the color covered in the outline, etc., the robot The target feature information of the target object can be quickly found and focused by the extended feature information of the augmented portion other than the target object target feature information. After the target object captures the target object, the target feature information of the target object cannot be recognized because the target object suddenly moves away. In order to further capture the target object, the robot simultaneously identifies the target feature information and the extended feature information of the target object in the current video stream. If the augmented part of the target object is identified by the extended feature information, the target object is captured according to the augmented part, and the target feature of the target object is further determined based on the target object.

Specifically, after the capturing module S10 captures the daughter, the robot collects other extended feature information of the daughter other than the facial feature information, such as the color and style of the daughter's clothes, pants, and shoes, through the collecting unit S31. The color and shape of the hair, the color, shape, style of the hat, the outline of the body, arms, legs, etc., during the process of the mother and daughter passing the robot video call, if the daughter is sitting while sitting, in the process, It is possible that the robot cannot locate and capture the facial feature information of the daughter, and the robot can locate the target feature information and capture the target object through the extended feature information of the extended part. For example, after the camera unit captures the daughter, when acquiring the features of the body part, the color of the body part wearing the part of the frame or the continuous frame picture is acquired, and then according to R:G:B=3:6:1. The ratio decolorizes part of the frame or the continuous frame image, processes it as a black and white picture, extracts the outline feature of the body contour, and determines the target object as the extended feature information in the process of capturing the target object.

Further, the acquiring unit S31 further includes a positioning unit S311: after positioning the augmented portion of the target object according to the extended feature information, the starting walking device continues to search for the target feature information around the augmented portion until the target feature information is continued. After targeting the target feature information The target object is now captured.

When the robot cannot capture the target feature information of the target object, the robot first compares the feature information captured by the capture module S30 with the extended feature information collected by the previous acquisition unit S31, and locates the current capture module S30 by the positioning unit S311. In the extended part, the robot initiates the walking device to continue to search for the target feature information around the augmented portion until the camera unit captures and locates the target feature information, and then continues to capture the target in the video call.

Specifically, in the process of the mother and the daughter passing the robot video call, the robot capture module S30 can capture the facial feature information of the daughter when the daughter is sitting as described above, and the robot capture module S30 can only capture after the daughter stands up. The daughter's body part, the daughter is wearing a pink dress, the style is a round neck, sleeveless tutu, at this time the robot can be determined by the extended feature information collected before the daughter's body contour, skirt color, style At this time, the captured portion is determined, and the orientation of the rotation of the robot camera unit is determined by the capturing portion, that is, the collar, the shoulder form, and the characteristic information of the daughter's body captured by the robot through the camera unit, and it is determined that the body part of the daughter is captured at this time. The chest, and by lifting the camera unit, can capture the facial features of the daughter; if the daughter stands up and turns over the body, so that the back of the camera is facing the camera unit of the robot, the camera unit of the robot captures the daughter's torso Extended skirt color and style, extended profile information of the back profile, then the machine Then, the walking device is required to move around the torso and search for the target feature information by changing the angle of the camera unit until the camera unit searches for the target feature information, the robot adjusts the distance with the daughter, and the target feature information is located by the positioning unit S311, and then the capture module The S30 continues to capture the target object. If the robot captures the target feature information of the daughter and the distance from the daughter remains within the preset range, the robot does not start the walking when the video image outline is unclear. The device, after the image of the video image is clear, after identifying the image in the video stream, the recognized extended feature information is derived from the amplified portion of the daughter's back of the body, and the walking device is activated to capture the facial feature information of the daughter around the feature portion.

After the robot captures the target object, the target object belongs to the dynamic image in the video stream relative to other scenes. When the extended information is collected, the collected video stream moves together with the target feature information. The extended feature on the target object, for example, after the robot camera unit captures the target object, wherein the facial feature information is used as the target feature information, and the other line contours in the partial frame or the continuous frame picture change with the line outline of the face occur. The portion that changes and can be surrounded by the contour of the face in a closed contour serves as an augmentation site. After the amplification site is determined, the contour of the augmentation site, the relative position of each contour, and the color of the contour coating are collected.

Specifically, after the robot captures the daughter, the daughter in the video stream is a dynamic object relative to the static item in the home, and the daughter's torso, clothes, hair, etc. are all following the movement of the daughter, according to the daughter in the video stream. When the facial feature information determines the daughter's object, the outline of the part of the video stream in which the partial or continuous frame picture changes with the contour of the daughter's face changes, the relative position of each contour and the outline are covered. The color, and other line contours can be surrounded with the contour of the face with a part of the closed contour, and according to the position of the other line contours and the contour of the face, it is determined that the other contour belongs to a certain part of the body, and according to the partial frame or the continuous frame Whether the contour of the face in the picture changes relative to the position of other items and the position of other parts follows whether the position of the face changes relative to the position of other items to determine whether the daughter is in a state of motion, and if yes, it is exercise, otherwise the daughter is not in motion. . For example, during the process of the daughter walking, the contour features of the face in the partial or continuous frame image of the video stream of the camera unit are changed relative to other items, and the contour position of the face is changed according to the change of the face feature position. The change is changed with respect to the position of other items, the daughter is determined to be in a moving state, and the contours of other parts can be wrapped in a closed contour with the contour of the face, and the leg is determined according to the position of the contour of the other part relative to the face. For amplifying the part, and acquiring the extended feature information of the amplified part in the partial frame or the continuous frame picture.

Further, the analysis module S20 further includes a query unit S21. The target information and the target feature information are stored in a database in a mapping relationship, and are used to query the database to determine target feature information according to the target information.

The target information and the target feature information are all stored in the database in a one-to-one correspondence relationship. After the target information is determined, the query unit S21 can query the target feature information through the target information, and the database can be local. The database can also be a cloud database connected to the robot. If it is a local database, after obtaining the target information, the target feature information can be directly determined locally, and if it is a cloud database, the robot sends the target information. After the cloud determines the target feature information corresponding to the target information, the target feature information is returned to the robot.

Specifically, if Xiaohong is the target, when storing, the mother will store the common name of Xiaohong (including the common name of other family members) and Xiaohong's facial feature information, and also include collecting. Extended feature information, as shown in Table 2.

Table 2 shows the storage relationship between the target information and the target feature information in the database.

Further, the maintaining module S40 further includes a measuring unit S41: in the step of controlling the walking device to maintain a preset distance range between the local device and the target object after capturing the target object, accompanied by the walking device The operation is to obtain the distance data detected by the local distance sensor and the target object. When the distance data exceeds the predetermined distance range, the control walking device starts to move first to perform the movement, otherwise the control walking device stops walking and pauses. mobile.

After the target object is captured, the distance sensor of the measuring unit S41 is always in the measurement state while maintaining the distance between the robot and the target object, and the distance between the robot itself and the target object is measured. During the movement of the target object, When the distance between the robot and the target object exceeds a preset range, the robot automatically controls the walking device to start moving and moves. If the distance between the robot and the target object is measured within a preset range by the distance sensor, the robot automatically controls the walking device. Stop the walking device to pause the robot.

Specifically, after the robot captures the small red, the distance between the measuring unit S41 and the target object is measured during the distance between the measuring unit S41 and the target object. In the process of Xiaohong sports, when the distance between the robot and Xiaohong exceeds the preset range, the robot automatically controls the walking device to start walking and move, if the distance between the robot and Xiaohong is measured by the distance sensor in a preset range. Inside, the robot automatically controls the walking device to stop the walking device so that the robot pauses and moves over the distance range When the range is preset, the robot automatically controls the walking device to start walking and move, making the robot more intelligent.

Further, the target information is a name or an indicator of the target object.

After the analysis module S20 receives the instruction of the incoming caller, the object information carried in the instruction is parsed, and the target object information is the name or indicator of the target object, such as the name of the person, the computer, and the like.

Specifically, specifically, the above-mentioned mother as the calling party sends a command in the terminal to "find the computer", wherein "find the computer" character information, the analysis module S20 parses out the computer in the "find computer" and As the target object indicator, such as the computer is the indicator, that is, the target information; if the daughter's name is Xiaohong, the mother's instruction to find is "Look for Xiaohong", in which "Look for Xiaohong" character information, analysis The module S20 parses out the red in the "find red" and uses it as an indicator of the target object, that is, the target information red is the name of the target object of the daughter, that is, the target information; in addition, the indicator may also be The information stored by the calling party terminal and the target object triggers the information of the target object at the calling party terminal, and the calling party terminal generates an indicator corresponding to the target object by the information of the target object, and issues an indicator of the target object to the robot. For example, the mother as the caller stores information related to her daughter Xiaohong on her terminal, such as the name Xiaohong, the image representing Xiaohong, mother Triggered on the terminal daughter Alice's name or image on behalf of the red, the caller terminal generates red looking indicator, and the indicator is sent to the robot.

In one embodiment, the collecting unit S31 further includes a monitoring unit S312: for monitoring the extended feature information of the extended part after detecting that the extended feature information of the target object is changed.

The robot can save the extended feature information of the target object to the next extended feature information. After the change of the target, the robot monitoring unit S312 detects that the extended feature information of the stored target object has changed, and then re-acquires the new extended feature information, so that after the target object is extended, the target information needs to be captured, and the target object can be quickly located. Go to the target object's target feature information and capture the target object.

Specifically, as the above-mentioned Xiaohong wears a pink dress, the extended feature information stored in the database is also the information of the pink dress. After the red is replaced by a white dress, the robot determines the object wearing the white dress by capturing the target feature information. After the red, the monitoring unit S312 finds that the extension feature information of the small red body and the white dress is re-acquired after the change of the clothing extension feature information is changed.

The distance sensor in the maintenance module S40 is an ultrasonic sensor, an infrared sensor, or a binocular ranging imaging device including the imaging unit, and the binocular ranging imaging device is convenient to use, and can initially determine the distance between the robot and the target object, and the ultrasonic wave. The error of long distance ranging is small and the effect is good. The infrared sensor has small distance measurement error and good effect. The invention combines with each other to optimize the distance error of the robot in the distance.

The extended feature information collected by the collecting unit S31 includes one or any of a plurality of features: a trunk part feature, a clothing part feature, a face outline feature, a hair outline feature information, or audio feature information.

Further, the capturing module S30 includes a positioning unit S311, and the local audio and/or infrared positioning unit acquires the target position when the target object is captured by the local audio and/or infrared positioning unit. To determine the starting direction of the walking device.

Specifically, as described above, after determining that the target object is Xiaohong, Xiaohong laughs at the front of the robot at this time, and the robot acquires the audio of Xiaohong through the audio positioning unit, and locates the small The red position is directly in front of the robot. At this time, the robot directly activates the walking device to move the robot forward. For example, the robot uses the infrared light of the infrared positioning unit to radiate the infrared light reflected by the surrounding scene and the environment to determine the location of Xiaohong. The position is the right front of the robot, and the robot activates the walking device and moves to the right front to find the red.

Further, the measuring unit S41 is further configured to: when capturing the target object, when the obstacle is encountered, the local machine measures the distance between the local device and the obstacle through the distance sensor, and controls the walking device to bypass and / or away from the obstacle, continue to capture the target object after detouring and / or away from the obstacle.

In the process of searching for Xiaohong, the robot will inevitably encounter obstacles, such as stools and walls in the home. It is also possible to measure the distance between the robot and the obstacles in the figure by the distance sensor of the measuring unit S41. With the orientation unchanged, the walking device is controlled to bypass and/or move away from the stool, the wall, and continue to capture the red.

Further, the maintenance module S40 further includes a voice module S50, as shown in FIG. 6, for starting the voice reminding unit and issuing a voice reminder when the local machine moves within a distance range from the target object.

Further, as shown in FIG. 7, the video module S10 further includes:

S11: a shooting unit, after the calling party hangs up the video call, the robot camera unit continuously collects a video of the target object;

In order to ensure that the caller can learn more about the state of the child and the child at home, after the caller hangs up the call, the robot continuously collects the child's home video by shooting the image unit S11.

Specifically, if the mom as the calling party hangs up the video call with the daughter Xiaohong, and the robot does not turn off the camera unit, the shooting unit S11 plays in the continuous collection of Xiaohong's home, learning and other videos.

S12: A transmission unit, the robot sends the video to a terminal connected thereto, and sends a text reminder and/or a voice reminder to the terminal.

After the video capture of the shooting unit S11 is completed, the robot sends the collected video to the terminal and/or the cloud of the family member connected thereto through the transmission unit S12, and sends a text reminder and/or a voice reminder to the terminal through the transmission unit S12, and collects the video. After a video, continue to capture the next video.

Specifically, after the video shooting unit S11 plays the video of Xiaohong at home, it is sent to the family member's terminal and/or the cloud through the transmission unit S12, such as a mobile phone, a computer, an ipad, etc., and/or connected thereto. In the cloud, after the video is successfully sent, a text reminder and/or a voice reminder is sent to the terminal of the family member through the transmission unit S12, for example, a video with a small red play; if the robot is not connected to the cloud, it is only sent to the terminal, and then When it is sent to the cloud and the terminal, or when the terminal is all turned off, only the cloud is sent, and when any terminal is turned on, an alert message is sent.

Preferably, the activation unit 60 is further configured to: when the robot acquires the target object, according to a change of the target object facial feature and/or audio feature and/or an interaction instruction issued by the target object, The local device initiates a voice interaction unit and/or initiates a video call to a mobile terminal connected to the local device.

The robot changes the facial features of the target object through the camera unit during the process of collecting the target object. If the child is crying, the robot starting unit 60 activates the human-computer interaction unit of the machine to make the child happy; according to the audio characteristics of the target object The change, such as the child is losing his temper, the robot determines that the child belongs to the temper state through the audio feature, the robot starting unit 60 activates the human-computer interaction unit of the machine to comfort the child; the robot sends an interactive instruction according to the target object, such as a child When the machine proposes a flower in English, the robot answers according to the question raised by the child, and the English of the flower is flower; and if the target child sends a call to the dad to the robot, the robot starting unit 50 activates the video module S10 to the mobile phone of the father. The terminal issues a video call request.

Specifically, in the process of collecting the video of Xiaohong, the robot determines that Xiaohong is crying now by the change of the characteristics of the little red face and the change of the audio feature, and the robot starting unit 60 activates the human-computer interaction unit to tell the story to Xiaohong. Or tell a joke, etc., to make a little red happy; and as Xiaohong gives the robot an instruction to listen to the song, the robot startup unit 60 activates the song function to sing to Xiaohong; Another example is Xiaohong and the robot saying that I want to learn Tang poetry. Then the robot determines the stage of intellectual development of Xiaohong according to the question of Xiao Hongping, and gives Xiao Hong the Tang poem that is suitable for the learning of Xiaohong intelligence stage.

Further, the photographing unit S11 is further configured to, during the process of acquiring the target object video, the photographing unit further includes a photographing function to change according to a facial feature and/or an audio feature of the target object and/or Or an interactive instruction issued by the target object takes a picture of the target object.

The shooting unit S11 of the robot further includes a photographing function. When the robot collects the target object video, the facial features of the target object change. If the target object smiles happily, the camera unit captures the target object at this time. State; as in the target object has been silently talking to a person, the camera unit also captures the state of the target object at this time; and as the target object gives the robot a picture of me and the dog, the robot is based on The instruction of the target object activates the camera function of the camera unit, and takes a picture of the target object and the dog.

In one embodiment, as shown in FIG. 8, the transmission unit S12 further includes:

S13: a receiving unit, configured to receive an interaction instruction of the target object;

The target feature information of the family members at home can be stored in the database local to the robot and/or the cloud database connected to the robot, so members stored in the database can send interactive instructions to the robot, and the robot first receives the current target object. The interactive instruction issued.

S14: an analyzing unit, configured to parse the interaction information included in the interaction instruction, and extract an indicator corresponding to the local function unit;

Specifically, if the above robot receives a small red to send an interactive instruction, the interactive instruction is "give me Telling the story of the duckling, the robot analyzes the "Little Duck Story" and "Speak" in the instruction, transforms the "Little Duck Story" into a database or network to search for "Little Duck Story" and extract it. , "talk" to change the indicator that initiates the speech unit.

S15: Activating unit, starting a functional unit corresponding to the indicator.

In the human-computer interaction, the interaction instruction issued by the target object includes a functional indication that can achieve the purpose of the target object, and according to the indicator parsed by the analysis unit S14, the functional unit that realizes the purpose of the target object is started, and the target object is issued. Instructions.

Specifically, the interactive instruction issued by Xiaohong mentioned above "tell me the story of the duckling", after parsing by the analyzing unit S14, searching for "the story of the duckling" through the database and/or the network and extracting it, starting the robot The voice function tells Xiaohong the story of "Little Duck". The database can be a local database or a cloud database. When searching, the database and the network can be searched at the same time, or only the local database can be searched when there is no network connection.

The present invention also provides a terminal, including a processor, for executing a program to execute various steps of the robot video call control method, for example, the robot establishes various mobile terminals with a mother such as a mobile phone, a computer, an ipad. Waiting for the connection application, and the terminal downloads a video stream that is connected to the control and connected to the robot, and transmits the home situation acquired by the local camera unit to the mother's mobile terminal, since the mother wants to see the daughter Xiaohong in the mobile terminal now In the state of the home, and the video stream does not contain the image of Xiaohong at this time, the mother initiated a search for the "find daughter" to the robot on the mobile terminal, and the robot receives the instruction of "finding the daughter" and is in the local machine. The information in the instruction of the search is parsed, that is, the information of "daughter" is parsed and extracted, and the characteristic information of the daughter is determined locally by the information, and the feature information is the facial feature of the daughter, that is, the outline of the entire face and the facial features. With the location, the robot finds the daughter at home based on this characteristic information. The robot first receives the finger in the search. At the position of the command, the camera unit of the robot rotates 360 degrees, and the image is recognized by the video stream of the camera unit to capture the target feature of the daughter. If the daughter is not captured, the robot starts its own walking device and moves, and the robot moves. Process At the same time, the video stream is acquired by the camera unit, and the image recognition technology is used to check whether there is a daughter's facial feature information in the current video image. If the robot finds the daughter according to the daughter's feature information, the robot passes its own measuring device. Measuring the distance between the robot and the daughter. If the robot is far away from the daughter and is not within the preset distance range, the robot moves to the preset distance from the daughter through the walking device, and during the walking of the daughter, the robot always Keep a preset distance range from your daughter Xiaohong.

Further, the processor of this embodiment may further implement other steps of the method in the foregoing embodiment. For the specific functions and implementation manners of the processor, refer to the embodiments in the foregoing method, and no further details are provided herein.

Fig. 9 shows a video callable mobile robot (hereinafter referred to as a video call mobile robot collectively referred to as a device) that can implement robot video call control according to the present invention. The device conventionally includes a processor 1010 and a computer program product or computer readable medium in the form of a memory 1020. The memory 1020 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. The memory 1020 has a memory space 1030 for executing program code 1031 of any of the above method steps. For example, storage space 1030 for program code may include various program code 1031 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have a storage section or a storage space or the like arranged similarly to the storage 1020 in FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit comprises program code 1031' for performing the steps of the method according to the invention, ie code that can be read by, for example, a processor such as 1010, which when executed by the device causes the device to perform the above Each step in the described method.

Those skilled in the art can understand that the technical solution is not only applied to a robot that is taken care of at home and learns with children, but also can be applied to a type of video and/or call and/or human interaction of robot monitoring, sweeping, and the like. The robot can also be applied to machines that simulate other creatures such as robot dogs, robot cats, etc. The target objects in this program can be humans, or animals and/or other items in the home, such as computers and mobile phones. Switches, etc., and computer program instructions can also be used to implement each of these blocks and/or block diagrams and/or flow diagrams and these block diagrams and/or block diagrams and / or a combination of boxes in the flow graph. Those skilled in the art will appreciate that these computer program instructions can be implemented by a general purpose computer, a professional computer, or a processor of other programmable data processing methods, such that the processor is executed by a computer or other programmable data processing method. The blocks of the disclosed structure and/or block diagrams and/or flow diagrams or blocks specified in the various blocks.

Those skilled in the art can understand that the steps, measures, and solutions in the various operations, methods, and processes that have been discussed in the present invention may be alternated, changed, combined, or deleted. Further, other steps, measures, and schemes of the various operations, methods, and processes that have been discussed in the present invention may be alternated, modified, rearranged, decomposed, combined, or deleted. Further, the steps, measures, and solutions in the prior art having various operations, methods, and processes disclosed in the present invention may also be alternated, changed, rearranged, decomposed, combined, or deleted.

The above is only a part of the embodiments of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention.

Claims

A robot video call control method includes the following steps:

Establishing a video call with the calling party, and transmitting the video stream obtained by the local camera unit to the calling party;

Receiving an instruction of the calling party initiated by the calling party, parsing target object information included in the seeking instruction, and determining target feature information of the corresponding target object according to the target object information;

When the target object is not captured, the walking device is activated to perform local movement, and the video stream of the imaging unit is image-recognized during the movement, and an image containing the target feature information is determined to capture the target object;

After capturing the target object, the walking device is controlled to maintain a preset distance range between the local machine and the target object.
The control method according to claim 1, further comprising the steps of:

After the target object is captured, the extended feature information of the target object that belongs to the target feature information is acquired, and when the target feature information cannot be captured, the extended target information is located according to the extended feature information. The target part captures the target.
The control method according to claim 2, wherein after the augmented portion of the target object is located according to the extended feature information, the walking device is started to continue searching for the target feature information around the augmented portion until the positioning is performed. The target object capture is achieved only after the target feature information.
The control method according to claim 2, wherein the extended feature information is collected from a moving scene image in which the image portion corresponding to the target feature information in the video stream moves together.
The control method according to claim 1, wherein the target object information and the target feature information are stored in a database in a mapping relationship, and the target feature information is determined according to the target information by querying the database.
The control method according to claim 1, wherein when the target object is captured, the step of controlling the walking device to maintain the preset distance range between the local machine and the target object is accompanied by the operation of the traveling device And acquiring distance data between the target and the target object detected by the local distance sensor, and when the distance data exceeds the predetermined distance range, controlling the walking device to start moving first, and then controlling the walking device to stop walking and suspending the movement.
The control method according to claim 1, wherein the target information is a name or an indicator of the target object.
The control method according to claim 1, wherein the target feature information is face feature information of the target object.
The control method according to claim 2, further comprising the step of: retrieving the extended feature information of the extended part after detecting that the extended feature information of the target object changes.
The control method according to claim 6, wherein the distance sensor is an ultrasonic sensor, an infrared sensor, or a binocular ranging imaging device including the imaging unit.
The control method according to claim 2, wherein the extended feature information comprises one or any of a plurality of features: a torso part feature, a clothing part feature, a face outline feature, a hair outline feature information, or audio feature information.
The control method according to claim 1, wherein the local machine further comprises an audio and/or infrared positioning unit, wherein the local audio and/or infrared positioning unit acquires the target while capturing the target object The position of the object to determine the starting direction of the walking device.
The control method according to claim 1, wherein in the process of capturing the target object, when the obstacle is encountered, the local machine measures the distance between the local machine and the obstacle through the distance sensor, and controls the walking of the walking device. And/or away from the obstacle, continuing to capture the target object after detouring and/or away from the obstacle.
The control method according to claim 1, wherein the local machine further comprises a voice reminding unit, when the local machine moves within a distance range from the target object, the voice reminding unit is activated, and a voice is emitted. remind.
The control method according to claim 1, further comprising the steps of:

After the calling party hangs up the video call, the robot camera unit continuously collects the video of the target object;

The robot transmits the video to a terminal connected thereto and transmits a text reminder and/or a voice reminder to the terminal.
The control method according to claim 15, wherein said robot is in the process of picking When the target object is set, the local device initiates a voice interaction unit and/or to the book according to a change in the target object facial feature and/or audio feature and/or an interaction instruction issued by the target object The mobile terminal connected to the machine initiates a video call.
The control method according to claim 15, wherein in the process of acquiring the target object video, the camera unit further comprises a photographing function to change according to facial features and/or audio features of the target object. And/or an interactive instruction issued by the target object takes a picture of the target object.
The control method according to claim 15, wherein after the target object issues an interactive instruction, the method further includes the following steps:

Receiving an interactive instruction of the target object;

Parsing the interaction information included in the interaction instruction, and extracting an indicator corresponding to the local function unit;

A functional unit corresponding to the indicator is activated.
The control method according to claim 18, wherein the interactive command issues a voice command for the target and/or a button corresponding to the function unit that the target clicks on the local device.
A robot video call control device includes:

At least one processor;

And at least one memory communicatively coupled to the at least one processor; the at least one memory comprising processor-executable instructions when the processor-executable instructions are executed by the at least one processor Causing the device to perform at least the following operations:

Establishing a video call with the calling party, and transmitting the video stream obtained by the local camera unit to the calling party;

Receiving an instruction of the calling party initiated by the calling party, parsing target object information included in the seeking instruction, and determining target feature information of the corresponding target object according to the target object information;

When the target object is not captured, the walking device is activated to perform local movement, and the video stream of the local camera unit is image-recognized during the movement, and an image containing the target feature information is determined to capture the target object;

After capturing the target object, the walking device is controlled to maintain a preset distance range between the local machine and the target object.
The control device according to claim 20, wherein the operation further comprises: after capturing the target object, acquiring extended feature information of the target object that belongs to the target feature information, and is unable to capture And the target feature information is obtained by positioning the augmented portion of the target object according to the extended feature information.
The control device according to claim 21, wherein the operation further comprises: after positioning the augmented portion of the target object according to the extended feature information, initiating the walking device to continue searching for the target around the augmented portion The feature information is not achieved until the target feature information is located.
The control device according to claim 21, wherein said extended feature information is collected from a moving scene image in which said image portion corresponding to said target feature information in said video stream moves together.
The control device according to claim 20, wherein the target information and the target feature information are stored in a database in a mapping relationship, the operation further comprising: querying the database to determine a target according to the target information. Feature information.
The control device according to claim 20, wherein said operation further comprises: in the step of controlling the walking device to maintain a predetermined distance range between the local device and the target object after capturing the target object, accompanied by The running of the walking device acquires distance data detected by the local distance sensor and the target object. When the distance data exceeds the predetermined distance range, the walking device is controlled to start moving first, otherwise the walking device is controlled. Stop walking and pause the move.
The control device according to claim 20, wherein the target information is a name or an indicator of the target object.
The control device according to claim 20, wherein the target feature information is face feature information of the target object.
The control device according to claim 21, wherein the operation further comprises: after detecting that the extended feature information of the target object changes, re-acquiring the extended feature information of the extended portion.
The control device according to claim 25, wherein the distance sensor is an ultrasonic sensor, an infrared sensor, or a binocular ranging imaging device including the imaging unit.
The control apparatus according to claim 21, wherein said extended feature information comprises one or any of a plurality of features: a trunk part feature, a clothing part feature, a face outline feature, hair outline feature information, or audio feature information.
The control device according to claim 20, wherein said operation further comprises: using a local audio and/or infrared positioning unit to locally turn on audio and/or infrared positioning while capturing said target object The unit acquires the target position to determine the starting direction of the walking device.
The control device according to claim 20, wherein the operation further comprises: in the process of capturing the target object, the local unit measures the locality and the obstacle by the distance sensor when encountering an obstacle The distance is controlled by the walking device and/or away from the obstacle, and the target object continues to be captured after being bypassed and/or away from the obstacle.
The control device according to claim 20, wherein the operation further comprises: when the local machine moves within a distance from the target object, activating the voice reminding unit and issuing a voice reminder.
The control device according to claim 20, wherein the operation further comprises: after the calling party hangs up the video call, the local camera unit continuously collects a video of the target object;

The robot transmits the video to a terminal connected thereto and transmits a text reminder and/or a voice reminder to the terminal.
The control device according to claim 34, further comprising:

When the robot acquires the target object, the local device initiates a voice interaction unit and/or according to a change of the target object facial feature and/or audio feature and/or an interaction instruction issued by the target object. The mobile terminal connected to the local device initiates a video call.
The control device according to claim 34, wherein the operation further comprises: in the process of acquiring the target object video, the local camera unit further comprises a photographing function, according to a facial feature of the target object And/or a change in an audio feature and/or an interactive instruction issued by the target object takes a picture of the target object.
The control device according to claim 34, wherein the operation further comprises:

Receiving an interactive instruction of the target object;

Parsing the interaction information included in the interaction instruction, and extracting an indicator corresponding to the local function unit;

A functional unit corresponding to the indicator is activated.
The control device according to claim 37, wherein said interactive command issues a voice command for said target and/or a button for said target to click on the device.
A video callable mobile robot comprising a processor for performing the robot video call control method according to any one of claims 1-19.
A computer program comprising computer readable code, when the video callable mobile robot runs the computer readable code, causing the method of any of claims 1-19 to be performed.
A computer readable medium storing the computer program of claim 40.