CN114200934A - Robot target following control method and device, electronic equipment and storage medium - Google Patents

Robot target following control method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN114200934A
CN114200934A CN202111477693.XA CN202111477693A CN114200934A CN 114200934 A CN114200934 A CN 114200934A CN 202111477693 A CN202111477693 A CN 202111477693A CN 114200934 A CN114200934 A CN 114200934A
Authority
CN
China
Prior art keywords
target
image
following
robot
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111477693.XA
Other languages
Chinese (zh)
Inventor
徐斌
崔潇
曾祥永
兰婷婷
吴凤娇
孙收余
支涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Yunji Technology Co Ltd
Original Assignee
Beijing Yunji Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Yunji Technology Co Ltd filed Critical Beijing Yunji Technology Co Ltd
Priority to CN202111477693.XA priority Critical patent/CN114200934A/en
Publication of CN114200934A publication Critical patent/CN114200934A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Manipulator (AREA)
  • Image Analysis (AREA)

Abstract

The embodiment of the invention discloses a robot target following control method and device, electronic equipment and a storage medium. Wherein, the method comprises the following steps: acquiring an environment image based on a camera, and identifying a region image in the environment image; determining a following target according to the personnel characteristics of the area image; and determining a moving path according to the position information of the following target, and controlling the robot to act according to the moving path. According to the embodiment of the invention, the wide-angle camera is used for collecting the regional image to reduce the influence of the environment on the following effect, the following target is identified according to the target characteristic, the target following accuracy is improved, and the robot motion safety can be enhanced.

Description

Robot target following control method and device, electronic equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of computer application, in particular to a robot target following control method and device, electronic equipment and a storage medium.
Background
With the advent of the world of everything interconnection, intelligent robots capable of autonomous movement are becoming important assistants of life, such as cleaning robots, delivery robots, and the like. At present, some robots have an intelligent following function so as to enable a mobile robot to follow a specific service target user, and the workload of workers is reduced. At present, the intelligent following function is mainly based on equipment such as an infrared sensor, a laser radar and a depth camera, and the equipment is easily influenced by the environment, so that the stability of the intelligent following function is poor, for example, the following effect of the intelligent following function is not ideal due to the fact that the reflection of a high-precision radar is limited in a narrow environment; for depth cameras, the field of view is small, and there is a problem of target loss when moving quickly following the target.
Disclosure of Invention
The invention provides a robot target following control method and device, electronic equipment and a storage medium, which are used for realizing intelligent following of an intelligent robot, reducing the influence of the environment on the following effect and improving the following accuracy.
In a first aspect, an embodiment of the present invention provides a robot target following control method, where the method includes:
acquiring an environment image based on a camera, and identifying a region image in the environment image;
determining a following target according to the personnel characteristics of the area image;
and determining a moving path according to the position information of the following target, and controlling the robot to act according to the moving path.
In a second aspect, an embodiment of the present invention further provides a robot target following control apparatus, where the apparatus includes:
the personnel identification module is used for acquiring an environment image based on a camera and identifying a region image in the environment image;
the target determining module is used for determining a following target according to the personnel characteristics of the area image;
and the target following module is used for determining a moving path according to the position information of the following target and controlling the robot to act according to the moving path.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a method as in any one of the embodiments of the invention.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is configured to, when executed by a processor, implement the method according to any one of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, the camera is used for collecting the environment image, the area image in the environment image is determined, the following target is determined according to the personnel characteristics of the area image, the moving path is generated according to the position information of the following target, and the action is carried out, so that the target following of the robot is realized, the influence of the environment on the following effect can be reduced, and the target following stability of the robot can be improved.
Drawings
Fig. 1 is a flowchart of a robot target following control method according to an embodiment of the present invention;
FIG. 2 is a flowchart of another robot target following control method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a robot target following control device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be noted that, for convenience of description, only a part of the structures related to the present invention, not all of the structures, are shown in the drawings, and furthermore, embodiments of the present invention and features of the embodiments may be combined with each other without conflict.
Example one
Fig. 1 is a flowchart of a robot target following control method according to an embodiment of the present invention, which is applicable to a robot following control situation. The method can be executed by a robot target following control device, which can be implemented in a hardware and/or software manner, and referring to fig. 1, the method provided by the embodiment of the invention specifically includes the following steps:
and step 110, acquiring an environment image based on a camera, and identifying a region image in the environment image.
Wherein, the camera can be the device that has the image acquisition function, and the camera can include monocular camera, two mesh cameras, many meshes camera and wide angle camera etc.. The environment image may be an image of an environment in which the robot is located, may include an image of an object located in front of or at a side of the robot, and the region image may be an image of the environment including a single human body, and it is understood that the region image may be located inside the environment image.
In the embodiment of the invention, the robot can use the camera to acquire the environment image of the environment where the robot is located, wherein the camera can be installed in the robot. The method for identifying the region image in the environment image may include identifying the environment image to obtain the region image including a single human body, where a manner of identifying the region image in the environment image is not limited, for example, determining whether a human face is in the environment image or identifying a human posture in the environment image, so as to determine the region image in the environment image.
And step 120, determining a following target according to the personnel characteristics of the area image.
The person feature may be a feature in the region image, and may include a pose feature, a biological feature, and the like.
Specifically, the person features in the region image can be extracted through a neural network model or image matching, the person features can be distinguished and determined, whether the person features meet the requirement of the target or not can be judged, and the region image meeting the requirement of the target can be used as the target.
And step 130, determining a moving path according to the position information of the following target, and controlling the robot to act according to the moving path.
The position information may be information of a position where the following target is located, and may include position coordinates and a direction, the moving path may be composed of one or more position points, and the robot may serve the following target along the moving path.
In the embodiment of the invention, the position information of the following target can be extracted, the moving path can be generated according to the position information, the robot can be controlled to move according to the moving path, and the following of the following target is realized. It is understood that the process of target following may be a dynamic process, and after the robot follows the moving path to the following template, the steps 110 to 130 may be executed again to achieve target following. Wherein the generation of the movement path may be determined by fitting the position information and the robot position.
According to the embodiment of the invention, the camera is used for acquiring the environment image, the area image in the environment image is determined, the following target is determined according to the personnel characteristics of the area image, the moving path is generated according to the position information of the following target and the action is carried out, so that the target following of the robot is realized, the influence of the environment on the following effect can be reduced, and the target following stability of the robot can be improved.
Example two
Fig. 2 is a flowchart of another robot target following control method provided in the second embodiment of the present invention, and the second embodiment of the present invention is embodied on the basis of the above-mentioned embodiment of the present invention, and referring to fig. 2, the method provided in the second embodiment of the present invention specifically includes the following steps:
and step 210, controlling a camera to acquire an environment image of the robot in a preset direction at regular time.
The preset direction may be a preset acquisition direction of the environment image, and the preset direction may include a front direction of the robot, a side direction of the robot, an upper direction of the robot, and the like.
In the embodiment of the invention, the robot can control the camera to acquire the environment image along the preset direction, and the preset direction can be set by a robot user or set by the robot according to the configuration file.
And step 220, extracting a region image in the environment image according to the person identification characteristics.
The character recognition features may be features for recognizing a human body, may include biological features of the human body, such as arms, a head, a chest, an abdomen, legs, and the like, may also include posture features of the human body, may include a skeleton architecture of the human body, and further may train a neural network model using the character recognition features, recognize an environmental image through the neural network model, and determine a region image existing in the environmental image.
Specifically, the person identification feature can be directly used for detecting the environment image to determine whether a single human body exists in the environment image, the area where the single human body is located can be determined as the area image, the person identification feature can also be used for training a neural network model, whether the single human body exists in the environment image is determined through detection of the neural network model on the environment image, and the area of the environment image where the single human body is located can be used as the area image. Further, in order to improve the accuracy of extracting the region images, when a plurality of human bodies exist in the environment image, feature information of each human body in the region images may be extracted, and whether the same person belongs to the same person may be determined using the feature information, so that a plurality of non-overlapping region images may be recognized.
And step 230, extracting the personnel features in the area image.
In the embodiment of the invention, the personnel features can be extracted from each region image and used for judging the following target, wherein the personnel features can comprise biological features, human body posture features or feature parameters generated by processing the region images by an artificial intelligence model.
And step 240, comparing the personnel characteristics with prestored target characteristics of the following targets.
The target feature may be feature information of the following target, the target feature may be stored in the robot in advance, and the target feature may be stored in the form of text or image.
Specifically, the person characteristic may be compared with a pre-stored target characteristic to determine whether the person characteristic is the same as the target characteristic, and the comparison may include comparison of text parameters or comparison of image pixel points.
And step 250, setting the region image with the same personnel characteristic and target characteristic as a follow target.
In the embodiment of the present invention, when the person feature is the same as the target feature, the region image corresponding to the person feature may be set as the following target, for example, mark information may be set for the region image or position information of the region image may be stored in a preset position.
And step 260, determining the distance and the direction between the following target and the robot as position information.
In the embodiment of the present invention, the region image may be processed, and the distance between the region image and the robot and the direction of the region image at the origin of the robot may be determined. The processing of the region image may include coordinate system conversion, converting the region image from a camera coordinate system to a world coordinate system, determining position coordinates of the region image in the world coordinate system, and determining a distance and a direction with a robot position as an origin.
And step 270, determining the position point and the moving speed of the moving path according to the distance and the direction.
The position point can be a component in a moving path, the position point can be located between the robot and the following target, the position point can be determined in a mode of inserting points on a connecting line between the robot and the following target, the moving speed can be the speed for controlling the robot to move, and the value of the moving speed can be preset or determined by the walking speed of the following target.
Specifically, one or more position points can be determined according to the distance and the direction of the following target to form a moving path for controlling the robot to walk. And determining the moving speed of the control robot together according to the following target and the preset speed.
And step 280, controlling the robot to act along the position points according to the moving speed.
Specifically, the moving speed of the robot may be set and the robot may be controlled to move according to one or more position points in the moving path.
And 290, generating notification information to remind the following target when the robot loses the following target.
Specifically, when the robot loses the following target, for example, the robot does not recognize the following target, or the robot fails to lock the following target in the moving process, notification information can be generated to remind the following target that the robot fails to follow, the notification information can be transmitted to the following target in a manner of including short messages or software information, and the specific form of the notification information can be voice, text, graphics or video.
According to the embodiment of the invention, the camera is controlled to collect the environment graph in the preset direction, the area image in the environment graph is extracted according to the character recognition characteristics, wherein the area image comprises the image area of a single human body, the personnel characteristics of the area image are extracted from the area image, the extracted personnel characteristics are compared with the target characteristics, the area image with the same comparison is set as the following target, the position point and the moving speed are determined according to the distance and the direction of the following target, the robot action is controlled according to the position point and the moving speed, and the notification information is generated to remind the following target when the following target is lost, so that the target following of the robot is realized, the influence of the environment on the following effect can be reduced, and the target following stability of the robot can be improved.
Further, on the basis of the above embodiment of the invention, the region image includes an image region of a single human body.
Further, on the basis of the above embodiment of the invention, the method further includes: and if the follow-up target does not exist in the environment image, controlling the camera to adjust the visual angle direction and reacquire the environment image.
In the embodiment of the present invention, when the following target is not identified in the environment image, the vision of the camera image may be controlled, for example, to move left or right, so that the camera acquires a new environment image.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a robot target following control device provided in the third embodiment of the present invention, which is capable of executing the robot target following control method provided in any embodiment of the present invention, and has corresponding functional modules and beneficial effects of the execution method. The device can be implemented by software and/or hardware, and specifically comprises: a person identification module 301, a target determination module 302 and a target following module 303.
The personnel identification module 301 is configured to acquire an environment image based on a camera and identify a region image in the environment image.
And the target determining module 302 is used for determining a following target according to the personnel characteristics of the area image.
And the target following module 303 is configured to determine a moving path according to the position information of the following target, and control the robot to act according to the moving path.
According to the technical scheme of the embodiment of the invention, the personnel identification module is used for acquiring the environment image by using the camera and determining the area image in the environment image, the target determination module is used for determining the following target according to the personnel characteristics of the area image, and the target following module is used for generating the moving path and performing actions according to the position information of the following target so as to realize target following of the robot, reduce the influence of the environment on the following effect and improve the stability of the target following of the robot.
Further, on the basis of the above embodiment of the invention, the image capturing module 301 in the apparatus includes:
and the image acquisition unit is used for controlling the camera to acquire the environmental image of the preset direction of the robot in real time.
And the personnel identification unit is used for extracting the area image in the environment image according to the person identification characteristics.
Further, on the basis of the above embodiment of the present invention, the target determining module 302 includes:
and the personnel feature unit is used for extracting the personnel features in the area image.
And the characteristic comparison unit is used for comparing the personnel characteristic with a prestored target characteristic of the following target.
A following determination unit configured to set the region image in which the person feature and the target feature are the same as a following target.
Further, on the basis of the above embodiment of the invention, the target following module 303 includes:
a position information unit for determining a distance and a direction of the following target from the robot as the position information.
And the parameter determining unit is used for determining the position point and the moving speed of the moving path according to the distance and the direction.
And the movement control unit is used for controlling the robot to act along the position points according to the movement speed.
Further, on the basis of the above embodiment of the invention, the apparatus further includes:
and the acquisition adjusting module is used for controlling the camera to adjust the visual angle direction and reacquire the environment image if the following target does not exist in the environment image.
Further, on the basis of the above embodiment of the invention, the apparatus further includes: and the alarm module is used for generating notification information to remind the following target when the robot loses the following target.
Example four
Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention. FIG. 4 illustrates a block diagram of an electronic device 312 suitable for use in implementing embodiments of the present invention. The electronic device 312 shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of the use of the embodiment of the present invention. The device 312 is typically a computing device that implements a robot target following control method.
As shown in fig. 4, electronic device 312 is in the form of a general purpose computing device. The components of the electronic device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that couples the various system components including the storage device 328 and the processors 316.
Bus 318 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
Electronic device 312 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by electronic device 312 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 328 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 330 and/or cache Memory 332. The electronic device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, and commonly referred to as a "hard drive"). Although not shown in FIG. 4, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk-Read Only Memory (CD-ROM), a Digital Video disk (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 318 by one or more data media interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
Program 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which may comprise an implementation of a network environment, or some combination thereof. Program modules 326 generally carry out the functions and/or methodologies of embodiments of the invention as described herein.
Electronic device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), with one or more devices that enable a user to interact with electronic device 312, and/or with any devices (e.g., network card, modem, etc.) that enable electronic device 312 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 322. Also, the electronic device 312 may communicate with one or more networks (e.g., a Local Area Network (LAN), Wide Area Network (WAN), and/or a public Network, such as the internet) via the Network adapter 320. As shown, a network adapter 320 communicates with the other modules of the electronic device 312 via the bus 318. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 312, including but not limited to: microcode, device drivers, Redundant processing units, external disk drive Arrays, disk array (RAID) systems, tape drives, and data backup storage systems, to name a few.
The processor 316 executes various functional applications and data processing by executing programs stored in the storage device 328, for example, to implement the robot target following control method provided by the above-described embodiment of the present invention.
EXAMPLE five
Embodiments of the present invention provide a computer-readable storage medium having stored thereon a computer program, which, when executed by a processing apparatus, implements a gesture recognition method as in embodiments of the present invention. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring an environment image based on a wide-angle camera, and identifying a region image in the environment image; determining a following target according to the personnel characteristics of the area image; and determining a moving path according to the position information of the following target, and controlling the robot to act according to the moving path.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of embodiments of the disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1. A robot target following control method, characterized in that the method comprises:
acquiring an environment image based on a camera, and identifying a region image in the environment image;
determining a following target according to the personnel characteristics of the area image;
and determining a moving path according to the position information of the following target, and controlling the robot to act according to the moving path.
2. The method of claim 1, wherein the camera-based capturing of the environmental image and the identification of the area image in the environmental image comprises:
controlling the camera to collect the environment image of the preset direction of the robot in real time;
and extracting the area image in the environment image according to the person identification characteristic.
3. The method of claim 1, wherein determining the following target according to the person feature of the region image comprises:
extracting the personnel features from the region image;
comparing the personnel characteristics with prestored target characteristics of the following targets;
setting the region image in which the person feature and the target feature are the same as a follow target.
4. The method of claim 3, wherein the region image comprises: an image area of a single human body.
5. The method of claim 1, wherein the determining a moving path according to the position information of the following target and controlling the robot to act according to the moving path comprises:
determining a distance and a direction of the following target from the robot as the position information;
determining a position point and a moving speed of the moving path according to the distance and the direction;
and controlling the robot to act according to the moving speed and along the position point.
6. The method of claim 1, further comprising:
and if the follow-up target does not exist in the environment image, controlling the camera to adjust the visual angle direction and reacquire the environment image.
7. The method of claim 1, further comprising:
generating notification information to remind the following target in case the robot loses the following target.
8. A robotic target following control apparatus, the apparatus comprising:
the personnel identification module is used for acquiring an environment image based on a camera and identifying a region image in the environment image;
the target determining module is used for determining a following target according to the personnel characteristics of the area image;
and the target following module is used for determining a moving path according to the position information of the following target and controlling the robot to act according to the moving path.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-7.
CN202111477693.XA 2021-12-06 2021-12-06 Robot target following control method and device, electronic equipment and storage medium Pending CN114200934A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111477693.XA CN114200934A (en) 2021-12-06 2021-12-06 Robot target following control method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111477693.XA CN114200934A (en) 2021-12-06 2021-12-06 Robot target following control method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114200934A true CN114200934A (en) 2022-03-18

Family

ID=80650928

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111477693.XA Pending CN114200934A (en) 2021-12-06 2021-12-06 Robot target following control method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114200934A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115509263A (en) * 2022-11-24 2022-12-23 广州疆海科技有限公司 Energy storage device following control method and device, energy storage device and readable storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108724178A (en) * 2018-04-13 2018-11-02 顺丰科技有限公司 The autonomous follower method of particular person and device, robot, equipment and storage medium
CN110515384A (en) * 2019-09-09 2019-11-29 深圳市三宝创新智能有限公司 A kind of the human body follower method and robot of view-based access control model mark
KR102063891B1 (en) * 2019-06-04 2020-01-08 영남대학교 산학협력단 Following robot control method and system and computing device for executing the system
CN110678822A (en) * 2018-07-23 2020-01-10 深圳市大疆创新科技有限公司 Control method and device of mobile robot and mobile robot system
CN112069879A (en) * 2020-07-22 2020-12-11 深圳市优必选科技股份有限公司 Target person following method, computer-readable storage medium and robot
CN113077493A (en) * 2021-05-11 2021-07-06 德鲁动力科技(成都)有限公司 Method and system for following target of mobile robot
CN113505753A (en) * 2021-07-30 2021-10-15 深兰盛视科技(苏州)有限公司 Control method and related device of intelligent following equipment
CN113628237A (en) * 2020-04-24 2021-11-09 北京灵汐科技有限公司 Trajectory tracking method, system, electronic device and computer readable medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108724178A (en) * 2018-04-13 2018-11-02 顺丰科技有限公司 The autonomous follower method of particular person and device, robot, equipment and storage medium
CN110678822A (en) * 2018-07-23 2020-01-10 深圳市大疆创新科技有限公司 Control method and device of mobile robot and mobile robot system
KR102063891B1 (en) * 2019-06-04 2020-01-08 영남대학교 산학협력단 Following robot control method and system and computing device for executing the system
CN110515384A (en) * 2019-09-09 2019-11-29 深圳市三宝创新智能有限公司 A kind of the human body follower method and robot of view-based access control model mark
CN113628237A (en) * 2020-04-24 2021-11-09 北京灵汐科技有限公司 Trajectory tracking method, system, electronic device and computer readable medium
CN112069879A (en) * 2020-07-22 2020-12-11 深圳市优必选科技股份有限公司 Target person following method, computer-readable storage medium and robot
CN113077493A (en) * 2021-05-11 2021-07-06 德鲁动力科技(成都)有限公司 Method and system for following target of mobile robot
CN113505753A (en) * 2021-07-30 2021-10-15 深兰盛视科技(苏州)有限公司 Control method and related device of intelligent following equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115509263A (en) * 2022-11-24 2022-12-23 广州疆海科技有限公司 Energy storage device following control method and device, energy storage device and readable storage medium
CN115509263B (en) * 2022-11-24 2023-03-10 广州疆海科技有限公司 Energy storage device following control method and device, energy storage device and readable storage medium

Similar Documents

Publication Publication Date Title
US11080520B2 (en) Automatic machine recognition of sign language gestures
US8525876B2 (en) Real-time embedded vision-based human hand detection
CN109934065B (en) Method and device for gesture recognition
CN109325456B (en) Target identification method, target identification device, target identification equipment and storage medium
US10762644B1 (en) Multiple object tracking in video by combining neural networks within a bayesian framework
CN111767853B (en) Lane line detection method and device
JP2021504848A (en) Image processing system and image processing method
CN113378770B (en) Gesture recognition method, device, equipment and storage medium
CN111611903B (en) Training method, using method, device, equipment and medium of motion recognition model
CN111738072A (en) Training method and device of target detection model and electronic equipment
US20220262093A1 (en) Object detection method and system, and non-transitory computer-readable medium
WO2022199360A1 (en) Moving object positioning method and apparatus, electronic device, and storage medium
CN112650300B (en) Unmanned aerial vehicle obstacle avoidance method and device
Pandey et al. Efficient 6-dof tracking of handheld objects from an egocentric viewpoint
CN114200934A (en) Robot target following control method and device, electronic equipment and storage medium
CN111709461A (en) Training method, device and equipment of animal recognition model and storage medium
CN111832611A (en) Training method, device and equipment of animal recognition model and storage medium
US20220351495A1 (en) Method for matching image feature point, electronic device and storage medium
CN116642490A (en) Visual positioning navigation method based on hybrid map, robot and storage medium
CN114429631B (en) Three-dimensional object detection method, device, equipment and storage medium
CN114419564B (en) Vehicle pose detection method, device, equipment, medium and automatic driving vehicle
CN115205806A (en) Method and device for generating target detection model and automatic driving vehicle
CN113516013B (en) Target detection method, target detection device, electronic equipment, road side equipment and cloud control platform
CN114461078A (en) Man-machine interaction method based on artificial intelligence
CN113378836A (en) Image recognition method, apparatus, device, medium, and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: LAN Ting Ting

Inventor after: Cui Xiao

Inventor after: Zeng Xiangyong

Inventor after: Zhi Tao

Inventor before: Xu Bin

Inventor before: Cui Xiao

Inventor before: Zeng Xiangyong

Inventor before: LAN Ting Ting

Inventor before: Wu Fengjiao

Inventor before: Sun Shouyu

Inventor before: Zhi Tao