CN117058743A - Data compatible transmission processing method and system based on DCIM platform - Google Patents

Data compatible transmission processing method and system based on DCIM platform Download PDF

Info

Publication number
CN117058743A
CN117058743A CN202311316360.8A CN202311316360A CN117058743A CN 117058743 A CN117058743 A CN 117058743A CN 202311316360 A CN202311316360 A CN 202311316360A CN 117058743 A CN117058743 A CN 117058743A
Authority
CN
China
Prior art keywords
camera
pixel coordinate
mechanical arm
mobile operation
operation equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311316360.8A
Other languages
Chinese (zh)
Other versions
CN117058743B (en
Inventor
兰满桔
吴俊刚
赵伟锋
张宇文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shanghang Information Technology Co ltd
Original Assignee
Guangzhou Shanghang Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shanghang Information Technology Co ltd filed Critical Guangzhou Shanghang Information Technology Co ltd
Priority to CN202311316360.8A priority Critical patent/CN117058743B/en
Publication of CN117058743A publication Critical patent/CN117058743A/en
Application granted granted Critical
Publication of CN117058743B publication Critical patent/CN117058743B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a data compatible transmission processing method and a system based on a DCIM platform, which are used for receiving video data of mobile operation equipment transmitted by a camera through the DCIM platform, selecting continuous frames with unchanged size as a plurality of target frames based on the size of each frame of the mobile operation equipment in the video data, stopping the mobile operation equipment at the moment, determining a target picture in the target frames, acquiring a first pixel coordinate and a second pixel coordinate based on the face center of the target picture and the target picture center, acquiring a movement track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment, controlling a mechanical arm to move the camera according to mechanical arm control data generated by the movement track, and finishing face recognition operation of the mobile operation equipment after the movement is finished. The invention greatly improves the user identification accuracy of the mobile operation equipment.

Description

Data compatible transmission processing method and system based on DCIM platform
Technical Field
The invention relates to the field of data processing, in particular to a data compatible transmission processing method and system based on a DCIM platform.
Background
With the increasing number of terminals of the internet of things equipment, more and more terminal systems need to perform data interaction, so that various functions are realized. However, since the data formats handled by different types of terminal systems are different, the prior art generally uses a DCIM platform (data center infrastructure management system) to connect with the terminal devices of the internet of things. In this case, terminal devices with different modes and different protocols are often accessed, and in order to access the terminal devices with different modes and different protocols, it is necessary to access SDKs (software development kits) of various manufacturers in different forms or perform network connection, device management and data analysis on the devices with different forms through different data ports and third-party open source components.
However, when the user ID card is stolen, the situation that the controller of the mobile operation device is not the user corresponding to the ID card easily occurs, which seriously threatens the property and safety of industrial production, so that the user identification accuracy of the mobile operation device needs to be improved from different modes.
Therefore, a data compatible transmission processing strategy based on the DCIM platform is needed, so as to solve the problem of inaccurate user identification of the mobile operation device.
Disclosure of Invention
The embodiment of the invention provides a data compatible transmission processing method and system based on a DCIM platform, which are used for improving the user identification accuracy of mobile operation equipment.
In order to solve the above problems, an embodiment of the present invention provides a data compatible transmission processing method based on a DCIM platform, which is applied to a DCIM platform, and the data compatible transmission processing method includes:
acquiring video data of mobile operation equipment transmitted by a camera;
acquiring the size of an operation device of each frame in the operation device video data, selecting a continuous frame with unchanged size of the mobile operation device as a plurality of target frames, and determining a target picture in the plurality of target frames;
extracting a first pixel coordinate of a face center and a second pixel coordinate of the target picture center from the target picture, and obtaining a moving track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment; the distance between the camera and the mobile operation equipment is measured through a range finder arranged on the camera;
Generating mechanical arm control data according to the movement track, and transmitting the mechanical arm control data to the mechanical arm so that the mechanical arm moves the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data; the mechanical arm is connected with the camera; and the camera acquires a facial picture of the face corresponding to the mobile operation equipment after the movement is finished.
As an improvement of the above solution, before the capturing of the video data of the mobile operation device transmitted by the camera, the method further includes:
receiving an infrared signal transmitted by the infrared sensor;
when receiving the infrared signal, transmitting a device dormancy instruction to the camera so that the camera enters a dormancy state according to the device dormancy instruction;
and when the infrared signal is not received, transmitting a device starting instruction to the camera so that the camera acquires the video data of the mobile operation device according to the device starting instruction.
As an improvement of the above solution, said determining a target picture among a plurality of said target frames includes:
performing binarization processing on each target frame to obtain a binarization image corresponding to each target frame;
Obtaining a main body area and a background area of each binarized image according to a preset binarization threshold;
and calculating the area difference value of the main area and the background area of each binarized image, and selecting a target frame corresponding to the binarized image with the minimum area difference value as a target picture.
As an improvement of the above solution, the obtaining the movement track of the camera according to the first pixel coordinates, the second pixel coordinates, the built-in parameters of the camera, and the distance between the camera and the mobile operation device includes:
according to the first pixel coordinates and the second pixel coordinates, calculating to obtain an x-axis pixel difference value and a y-axis pixel difference value;
generating a pixel difference vector and a pixel ratio according to the x-axis pixel difference value and the y-axis pixel difference value;
substituting the pixel difference vector, the built-in parameters of the camera and the distance between the camera and the mobile operation equipment into a preset coordinate conversion formula to obtain a moving distance; wherein the coordinate transformation formula includes:
；
in the method, in the process of the invention,for moving distance +.>For the inverse of the built-in parameter correspondence matrix, center is the pixel difference vector (X, Y, 1), X is the X-axis pixel difference, Y is the Y-axis pixel difference, < > >The distance between the camera and the mobile operation equipment is set;
obtaining an x-axis displacement distance and a y-axis displacement distance according to the moving distance and the pixel ratio;
and obtaining the moving track of the camera according to the azimuth of the first pixel coordinate and the second pixel coordinate, the x-axis displacement distance and the y-axis displacement distance.
As an improvement of the above-described aspect, the movement trajectory includes: a first movement track, a second movement track, a third movement track, a fourth movement track, a fifth movement track, a sixth movement track, a seventh movement track and an eighth movement track; the obtaining the movement track of the camera according to the azimuth of the first pixel coordinate and the second pixel coordinate, the x-axis displacement distance and the y-axis displacement distance includes:
judging the azimuth of the first pixel coordinate and the second pixel coordinate;
if the second pixel coordinate is positioned at the upper left of the first pixel coordinate, the moving track of the camera is a first moving track; the first moving track is moved leftwards by an x-axis displacement distance and upwards by a y-axis displacement distance;
if the second pixel coordinate is positioned at the upper right of the first pixel coordinate, the moving track of the camera is a second moving track; the second moving track is right-moving x-axis displacement distance and upward-moving y-axis displacement distance;
If the second pixel coordinate is positioned at the left lower part of the first pixel coordinate, the moving track of the camera is a third moving track; the third moving track is moved leftwards by an x-axis displacement distance and downwards by a y-axis displacement distance;
if the second pixel coordinate is positioned at the right lower part of the first pixel coordinate, the moving track of the camera is a fourth moving track; the fourth moving track is right-moving x-axis displacement distance and downward-moving y-axis displacement distance;
if the second pixel coordinate is positioned above the first pixel coordinate, the moving track of the camera is a fifth moving track; the fifth moving track is upward moving y-axis displacement distance;
if the second pixel coordinate is positioned below the first pixel coordinate, the moving track of the camera is a sixth moving track; the sixth moving track is downwards moved by a displacement distance of the y axis;
if the second pixel coordinate is positioned at the left side of the first pixel coordinate, the moving track of the camera is a seventh moving track; the seventh moving track is a displacement distance of moving the X-axis leftwards;
if the second pixel coordinate is positioned on the right side of the first pixel coordinate, the moving track of the camera is an eighth moving track; wherein the eighth movement track is a rightward movement x-axis displacement distance.
As an improvement of the above solution, after the camera obtains the face information of the face corresponding to the mobile operation device after the movement is finished, the method further includes:
receiving a face picture transmitted by the camera, and extracting face information of the face picture;
in a preset user face information base, carrying out pre-stored user face information feature matching based on the face information, and judging a matching result; the user face information base comprises: a plurality of pre-stored user facial information features and identity information corresponding to each pre-stored user facial information feature;
if the matching is successful, controlling the normal operation of the mobile operation equipment;
if the matching fails, a failure prompt tone is generated, and the mobile operation equipment is controlled to be powered off.
As an improvement of the above-mentioned solution, the mechanical arm includes: the camera is fixed at the telescopic rod; the mechanical arm moves the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data, and the method comprises the following steps:
the mechanical arm judges the control data of the mechanical arm;
if the mechanical arm control data comprise transverse movement control data, the mechanical arm controls the chassis driving equipment to move the camera along the sliding rail in the horizontal direction according to the transverse movement control data; wherein the lateral movement control data includes: left movement control data or right movement control data; the sliding rail is arranged on a stand which is at a preset distance from the mobile operation equipment;
If the mechanical arm control data comprise longitudinal movement control data, the mechanical arm controls the telescopic rod to move the camera in the vertical direction according to the longitudinal movement control data;
if the mechanical arm control data comprise transverse movement control data and longitudinal movement control data, the mechanical arm firstly controls the chassis driving device to move the camera along the sliding rail in the horizontal direction according to the transverse movement control data, and then controls the telescopic rod to move the camera in the vertical direction according to the longitudinal movement control data.
Correspondingly, an embodiment of the present invention further provides a data compatible transmission processing system based on the DCIM platform, including: the data compatible transmission processing system is applied to a DCIM platform, and comprises: the system comprises a data acquisition module, a picture selection module, a data calculation module and a mechanical arm control module;
the data acquisition module is used for acquiring the video data of the mobile operation equipment transmitted by the camera;
the picture selection module is used for acquiring the size of the operation equipment of each frame in the video data of the operation equipment, selecting continuous frames with unchanged size of the mobile operation equipment as a plurality of target frames, and determining target pictures in the plurality of target frames;
The data calculation module is used for extracting a first pixel coordinate of a face center and a second pixel coordinate of a target picture center from the target picture, and obtaining a moving track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment; the distance between the camera and the mobile operation equipment is measured through a range finder arranged on the camera;
the mechanical arm control module is used for generating mechanical arm control data according to the movement track, and transmitting the mechanical arm control data to the mechanical arm so that the mechanical arm can move the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data; the mechanical arm is connected with the camera; and the camera acquires a facial picture of the face corresponding to the mobile operation equipment after the movement is finished.
Correspondingly, an embodiment of the invention also provides a computer terminal device, which comprises a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, wherein the processor realizes the data compatible transmission processing method based on the DCIM platform when executing the computer program.
Correspondingly, an embodiment of the invention also provides a computer readable storage medium, which comprises a stored computer program, wherein the computer program controls equipment where the computer readable storage medium is located to execute the data compatible transmission processing method based on the DCIM platform according to the invention when running.
From the above, the invention has the following beneficial effects:
the invention provides a data compatible transmission processing method based on a DCIM platform, which is used for receiving video data of mobile operation equipment transmitted by a camera through the DCIM platform, selecting continuous frames with unchanged size as a plurality of target frames based on the size of each frame of the mobile operation equipment in the video data, stopping the mobile operation equipment at the moment, determining a target picture in the target frames, acquiring a first pixel coordinate and a second pixel coordinate based on the face center of the target picture and the target picture center, acquiring a movement track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment, and generating mechanical arm control data according to the movement track, so that the mechanical arm can move the camera according to the mechanical arm control data, and finally completing face recognition operation of the mobile operation equipment after the movement is finished. According to the invention, the DCIM platform is used for carrying out data interaction on the camera and the mechanical arm, based on the compatibility of the DCIM platform, the video data of the camera and the control data of the mechanical arm can be processed, and the problem of inaccurate face recognition caused by angles or shielding objects can be avoided by identifying the in-place condition of the mobile operation equipment and controlling the camera to move to the face of the driver facing the mobile operation equipment through the mechanical arm, so that the user identification accuracy of the mobile operation equipment is greatly improved.
Drawings
Fig. 1 is a schematic flow chart of a data compatible transmission processing method based on a DCIM platform according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a data compatible transmission processing system based on a DCIM platform according to an embodiment of the present invention;
FIG. 3 is a schematic illustration of an arrangement of a robot arm and a camera according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic flow chart of a data compatible transmission processing method based on a DCIM platform according to an embodiment of the present invention, as shown in fig. 1, the embodiment includes steps 101 to 104, where each step is specifically as follows:
step 101: and acquiring the video data of the mobile operation device transmitted by the camera.
In this embodiment, before the capturing the video data of the mobile operation device transmitted by the camera, the method further includes:
receiving an infrared signal transmitted by the infrared sensor;
when receiving the infrared signal, transmitting a device dormancy instruction to the camera so that the camera enters a dormancy state according to the device dormancy instruction;
and when the infrared signal is not received, transmitting a device starting instruction to the camera so that the camera acquires the video data of the mobile operation device according to the device starting instruction.
In a specific embodiment, the method further comprises: receiving a pressure signal transmitted by a pressure sensor;
when the pressure signal is not received, transmitting a device dormancy instruction to the camera so that the camera enters a dormancy state according to the device dormancy instruction;
and when the pressure signal is received, transmitting a device starting instruction to the camera so that the camera can acquire the video data of the mobile operation device according to the device starting instruction.
In a specific embodiment, the camera uploads the video data obtained by shooting to the cloud server through the communication chip.
Step 102: and acquiring the size of the mobile operation equipment of each frame in the video data of the mobile operation equipment, selecting continuous frames with unchanged size of the mobile operation equipment as a plurality of target frames, and determining target pictures in the plurality of target frames.
In this embodiment, the determining the target picture in the plurality of target frames includes:
performing binarization processing on each target frame to obtain a binarization image corresponding to each target frame;
obtaining a main body area and a background area of each binarized image according to a preset binarization threshold;
and calculating the area difference value of the main area and the background area of each binarized image, and selecting a target frame corresponding to the binarized image with the minimum area difference value as a target picture.
In a specific embodiment, when a continuous frame with a constant size of the mobile operation device is acquired, it may be indicated that the mobile operation device is stopped and remains stationary, which means that a stable face recognition can be performed, and thus, the continuous frame is selected as a plurality of target frames; when the plurality of target frames are selected, because the shooting range of the camera is larger and is easily influenced by other operation devices and backgrounds, the shooting picture is subject to the plurality of operation devices, at this time, the target frames are required to be subjected to binarization processing, each target frame is converted into a binarized picture, a target mobile operation device (namely, the subject region of the invention) and the background (namely, the background region of the invention) in the binarized picture are distinguished through a preset binarization threshold (the specific value of the binarization threshold is adaptively adjusted by a user according to the light brightness of the industrial production environment), when the area difference is smaller, the subject region area is smaller, the background region area is larger, which means that the target frame with the largest proportion in the picture is selected as the target picture. Through the operation, the mobile operation equipment can be ensured to remove the interference of different operation equipment at the rear to the greatest extent, so that a foundation is laid for improving the face recognition accuracy of the mobile operation equipment.
Step 103: extracting a first pixel coordinate of a face center and a second pixel coordinate of the target picture center from the target picture, and obtaining a moving track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment; the distance between the camera and the mobile operation device is measured through a range finder arranged on the camera.
In this embodiment, the obtaining the movement track of the camera according to the first pixel coordinates, the second pixel coordinates, the built-in parameters of the camera, and the distance between the camera and the mobile operation device includes:
according to the first pixel coordinates and the second pixel coordinates, calculating to obtain an x-axis pixel difference value and a y-axis pixel difference value;
generating a pixel difference vector and a pixel ratio according to the x-axis pixel difference value and the y-axis pixel difference value;
substituting the pixel difference vector, the built-in parameters of the camera and the distance between the camera and the mobile operation equipment into a preset coordinate conversion formula to obtain a moving distance; wherein the coordinate transformation formula includes:
；
in the method, in the process of the invention, For moving distance +.>For the inverse of the built-in parameter correspondence matrix, center is the pixel difference vector (X, Y, 1), X is the X-axis pixel difference, Y is the Y-axis pixel difference, < >>The distance between the camera and the mobile operation equipment is set;
obtaining an x-axis displacement distance and a y-axis displacement distance according to the moving distance and the pixel ratio;
and obtaining the moving track of the camera according to the azimuth of the first pixel coordinate and the second pixel coordinate, the x-axis displacement distance and the y-axis displacement distance.
In this embodiment, the movement track includes: a first movement track, a second movement track, a third movement track, a fourth movement track, a fifth movement track, a sixth movement track, a seventh movement track and an eighth movement track; the obtaining the movement track of the camera according to the azimuth of the first pixel coordinate and the second pixel coordinate, the x-axis displacement distance and the y-axis displacement distance includes:
judging the azimuth of the first pixel coordinate and the second pixel coordinate;
if the second pixel coordinate is positioned at the upper left of the first pixel coordinate, the moving track of the camera is a first moving track; the first moving track is moved leftwards by an x-axis displacement distance and upwards by a y-axis displacement distance;
If the second pixel coordinate is positioned at the upper right of the first pixel coordinate, the moving track of the camera is a second moving track; the second moving track is right-moving x-axis displacement distance and upward-moving y-axis displacement distance;
if the second pixel coordinate is positioned at the left lower part of the first pixel coordinate, the moving track of the camera is a third moving track; the third moving track is moved leftwards by an x-axis displacement distance and downwards by a y-axis displacement distance;
if the second pixel coordinate is positioned at the right lower part of the first pixel coordinate, the moving track of the camera is a fourth moving track; the fourth moving track is right-moving x-axis displacement distance and downward-moving y-axis displacement distance;
if the second pixel coordinate is positioned above the first pixel coordinate, the moving track of the camera is a fifth moving track; the fifth moving track is upward moving y-axis displacement distance;
if the second pixel coordinate is positioned below the first pixel coordinate, the moving track of the camera is a sixth moving track; the sixth moving track is downwards moved by a displacement distance of the y axis;
if the second pixel coordinate is positioned at the left side of the first pixel coordinate, the moving track of the camera is a seventh moving track; the seventh moving track is a displacement distance of moving the X-axis leftwards;
If the second pixel coordinate is positioned on the right side of the first pixel coordinate, the moving track of the camera is an eighth moving track; wherein the eighth movement track is a rightward movement x-axis displacement distance.
In a specific embodiment, a face of a mobile operation device is marked by a head-to-shoulder ratio recognition model commonly used in the prior art, a target picture is input to the head-to-shoulder ratio recognition model to mark the face, and a first pixel coordinate is obtained by calculating a center pixel position of the face in the target picture.
Step 104: generating mechanical arm control data according to the movement track, and transmitting the mechanical arm control data to the mechanical arm so that the mechanical arm moves the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data; the mechanical arm is connected with the camera; and the camera acquires a facial picture of the face corresponding to the mobile operation equipment after the movement is finished.
In this embodiment, after the camera obtains the face information of the face corresponding to the mobile operation device after the movement is completed, the method further includes:
receiving a face picture transmitted by the camera, and extracting face information of the face picture;
In a preset user face information base, carrying out pre-stored user face information feature matching based on the face information, and judging a matching result; the user face information base comprises: a plurality of pre-stored user facial information features and identity information corresponding to each pre-stored user facial information feature;
if the matching is successful, controlling the normal operation of the mobile operation equipment;
if the matching fails, a failure prompt tone is generated, and the mobile operation equipment is controlled to be powered off.
In this embodiment, the mechanical arm includes: the camera is fixed at the telescopic rod; the mechanical arm moves the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data, and the method comprises the following steps:
the mechanical arm judges the control data of the mechanical arm;
if the mechanical arm control data comprise transverse movement control data, the mechanical arm controls the chassis driving equipment to move the camera along the sliding rail in the horizontal direction according to the transverse movement control data; wherein the lateral movement control data includes: left movement control data or right movement control data; the sliding rail is arranged on a stand which is at a preset distance from the mobile operation equipment;
If the mechanical arm control data comprise longitudinal movement control data, the mechanical arm controls the telescopic rod to move the camera in the vertical direction according to the longitudinal movement control data;
if the mechanical arm control data comprise transverse movement control data and longitudinal movement control data, the mechanical arm firstly controls the chassis driving device to move the camera along the sliding rail in the horizontal direction according to the transverse movement control data, and then controls the telescopic rod to move the camera in the vertical direction according to the longitudinal movement control data.
In a specific embodiment, the invention is arranged in a management warehouse of the mobile operation equipment, and the safety identification is carried out on personnel before the mobile operation equipment is taken out of the warehouse, so that the non-operation personnel can be limited before the equipment is taken out of the warehouse.
In a specific embodiment, the stand at a preset distance from the mobile operation device can be a passing railing, and can be directly applied to the existing control system of the mobile operation device, and only the control system of the mobile operation device is required to be modified in software, so that the replacement of hardware of the mobile operation device is avoided; wherein the preset distance is adaptively adjusted by the user.
In a specific embodiment, for better illustration, please refer to fig. 3, fig. 3 discloses a schematic layout of a mechanical arm and a camera, including: a mechanical arm 301, a camera 302, a sliding rail 303 and a DCIM platform 304;
wherein, the arm includes: a chassis drive device 3011 and a telescopic link 3012;
one end of the telescopic rod is connected with the camera, and the other end of the telescopic rod is connected with the chassis driving device; wheels of the chassis driving device are arranged at the sliding rail and can move along the sliding rail; the sliding rail is arranged on a passing railing (namely a stand with a preset distance from the mobile operation equipment) of the mobile operation equipment management warehouse, and the edge of the sliding rail can clamp the wheels of the chassis driving equipment so as to avoid slipping of the mechanical arm; the DCIM platform is arranged in the box body connected with the railing.
In a specific embodiment, when the camera completes the acquisition of the facial pictures of the face, the DCIM platform controls the floor driving device to lock the tire, so that the whole mechanical arm and camera combined device cannot move, and equipment slipping collision caused by lifting of the railing after successful payment of a user is prevented.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a data compatible transmission processing system based on a DCIM platform according to an embodiment of the present invention, which is applied to a DCIM platform, and the data compatible transmission processing system includes: the system comprises a data acquisition module 201, a picture selection module 202, a data calculation module 203 and a mechanical arm control module 204;
The data acquisition module is used for acquiring the video data of the mobile operation equipment transmitted by the camera;
the picture selection module is used for acquiring the size of the operation equipment of each frame in the video data of the operation equipment, selecting continuous frames with unchanged size of the mobile operation equipment as a plurality of target frames, and determining target pictures in the plurality of target frames;
the data calculation module is used for extracting a first pixel coordinate of a face center and a second pixel coordinate of a target picture center from the target picture, and obtaining a moving track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment; the distance between the camera and the mobile operation equipment is measured through a range finder arranged on the camera;
the mechanical arm control module is used for generating mechanical arm control data according to the movement track, and transmitting the mechanical arm control data to the mechanical arm so that the mechanical arm can move the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data; the mechanical arm is connected with the camera; and the camera acquires a facial picture of the face corresponding to the mobile operation equipment after the movement is finished.
It can be understood that the above system item embodiment corresponds to the method item embodiment of the present invention, and may implement the data compatible transmission processing method based on the DCIM platform provided by any one of the method item embodiments of the present invention.
According to the embodiment, the video data of the mobile operation device transmitted by the camera is received through the DCIM platform, based on the size of the mobile operation device of each frame in the video data, a continuous frame with the size unchanged is selected as a plurality of target frames, at the moment, the mobile operation device can be considered to stop, a target picture is determined in the target frames, a first pixel coordinate and a second pixel coordinate are obtained based on the face center of the target picture and the target picture center, the movement track of the camera is obtained according to the first pixel coordinate, the second pixel coordinate, the built-in parameters of the camera and the distance between the camera and the mobile operation device, and the mechanical arm control data generated according to the movement track can enable the mechanical arm to move the camera according to the mechanical arm control data, and finally face recognition operation of the mobile operation device is completed after the movement is finished. According to the invention, the DCIM platform is used for carrying out data interaction on the camera and the mechanical arm, based on the compatibility of the DCIM platform, the video data of the camera and the control data of the mechanical arm can be processed, and the problem of inaccurate face recognition caused by angles or shielding objects can be avoided by identifying the in-place condition of the mobile operation equipment and controlling the camera to move to the face of the driver facing the mobile operation equipment through the mechanical arm, so that the user identification accuracy of the mobile operation equipment is greatly improved.
In the second embodiment, referring to fig. 4, fig. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
A terminal device of this embodiment includes: a processor 401, a memory 402 and a computer program stored in the memory 402 and executable on the processor 401. The processor 401, when executing the computer program, implements the steps of the foregoing embodiments of the data compatible transmission processing method based on the DCIM platform, for example, all the steps of the data compatible transmission processing method based on the DCIM platform shown in fig. 1. Alternatively, the processor may implement functions of each module in the above-described device embodiments when executing the computer program, for example: all modules of the DCIM platform-based data compatible transmission processing apparatus shown in fig. 2.
In addition, an embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium includes a stored computer program, and when the computer program runs, the device where the computer readable storage medium is controlled to execute the data compatible transmission processing method based on the DCIM platform according to any one of the embodiments.
It will be appreciated by those skilled in the art that the schematic diagram is merely an example of a terminal device and does not constitute a limitation of the terminal device, and may include more or less components than illustrated, or may combine certain components, or different components, e.g., the terminal device may further include an input-output device, a network access device, a bus, etc.
The processor 401 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 401 is a control center of the terminal device, and connects various parts of the entire terminal device using various interfaces and lines.
The memory 402 may be used to store the computer program and/or module, and the processor 401 may implement various functions of the terminal device by running or executing the computer program and/or module stored in the memory and invoking data stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
Wherein the terminal device integrated modules/units may be stored in a computer readable storage medium if implemented in the form of software functional units and sold or used as stand alone products. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.
It should be noted that the above-described apparatus embodiments are merely illustrative, and the units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the invention, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that changes and modifications may be made without departing from the principles of the invention, such changes and modifications are also intended to be within the scope of the invention.

Claims (10)

1. The data compatible transmission processing method based on the DCIM platform is characterized by being applied to the DCIM platform, and comprises the following steps:
Acquiring video data of mobile operation equipment transmitted by a camera;
acquiring the size of a mobile operation device of each frame in the video data of the mobile operation device, selecting continuous frames with unchanged size of the mobile operation device as a plurality of target frames, and determining a target picture in the plurality of target frames;
extracting a first pixel coordinate of a face center and a second pixel coordinate of the target picture center from the target picture, and obtaining a moving track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment; the distance between the camera and the mobile operation equipment is measured through a range finder arranged on the camera;
generating mechanical arm control data according to the movement track, and transmitting the mechanical arm control data to the mechanical arm so that the mechanical arm moves the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data; the mechanical arm is connected with the camera; and the camera acquires a facial picture of the face corresponding to the mobile operation equipment after the movement is finished.
2. The DCIM platform-based data compatible transmission processing method of claim 1, further comprising, prior to said obtaining the mobile operator device video data transmitted by the camera:
receiving an infrared signal transmitted by the infrared sensor;
when receiving the infrared signal, transmitting a device dormancy instruction to the camera so that the camera enters a dormancy state according to the device dormancy instruction;
and when the infrared signal is not received, transmitting a device starting instruction to the camera so that the camera acquires the video data of the mobile operation device according to the device starting instruction.
3. The DCIM platform-based data compatible transmission processing method of claim 2, wherein said determining a target picture among a plurality of said target frames comprises:
performing binarization processing on each target frame to obtain a binarization image corresponding to each target frame;
obtaining a main body area and a background area of each binarized image according to a preset binarization threshold;
and calculating the area difference value of the main area and the background area of each binarized image, and selecting a target frame corresponding to the binarized image with the minimum area difference value as a target picture.
4. The DCIM platform-based data compatible transmission processing method according to claim 2, wherein the obtaining the movement track of the camera according to the first pixel coordinates, the second pixel coordinates, the built-in parameters of the camera, and the distance between the camera and the mobile operation device includes:
according to the first pixel coordinates and the second pixel coordinates, calculating to obtain an x-axis pixel difference value and a y-axis pixel difference value;
generating a pixel difference vector and a pixel ratio according to the x-axis pixel difference value and the y-axis pixel difference value;
substituting the pixel difference vector, the built-in parameters of the camera and the distance between the camera and the mobile operation equipment into a preset coordinate conversion formula to obtain a moving distance; wherein the coordinate transformation formula includes:
；
in the method, in the process of the invention,for moving distance +.>For the inverse of the built-in parameter correspondence matrix, center is the pixel difference vector (X, Y, 1), X is the X-axis pixel difference, Y is the Y-axis pixel difference, < >>The distance between the camera and the mobile operation equipment is set;
obtaining an x-axis displacement distance and a y-axis displacement distance according to the moving distance and the pixel ratio;
and obtaining the moving track of the camera according to the azimuth of the first pixel coordinate and the second pixel coordinate, the x-axis displacement distance and the y-axis displacement distance.
5. The DCIM platform-based data compatible transmission processing method of claim 4, wherein the movement track comprises: a first movement track, a second movement track, a third movement track, a fourth movement track, a fifth movement track, a sixth movement track, a seventh movement track and an eighth movement track; the obtaining the movement track of the camera according to the azimuth of the first pixel coordinate and the second pixel coordinate, the x-axis displacement distance and the y-axis displacement distance includes:
judging the azimuth of the first pixel coordinate and the second pixel coordinate;
if the second pixel coordinate is positioned at the upper left of the first pixel coordinate, the moving track of the camera is a first moving track; the first moving track is moved leftwards by an x-axis displacement distance and upwards by a y-axis displacement distance;
if the second pixel coordinate is positioned at the upper right of the first pixel coordinate, the moving track of the camera is a second moving track; the second moving track is right-moving x-axis displacement distance and upward-moving y-axis displacement distance;
if the second pixel coordinate is positioned at the left lower part of the first pixel coordinate, the moving track of the camera is a third moving track; the third moving track is moved leftwards by an x-axis displacement distance and downwards by a y-axis displacement distance;
If the second pixel coordinate is positioned at the right lower part of the first pixel coordinate, the moving track of the camera is a fourth moving track; the fourth moving track is right-moving x-axis displacement distance and downward-moving y-axis displacement distance;
if the second pixel coordinate is positioned above the first pixel coordinate, the moving track of the camera is a fifth moving track; the fifth moving track is upward moving y-axis displacement distance;
if the second pixel coordinate is positioned below the first pixel coordinate, the moving track of the camera is a sixth moving track; the sixth moving track is downwards moved by a displacement distance of the y axis;
if the second pixel coordinate is positioned at the left side of the first pixel coordinate, the moving track of the camera is a seventh moving track; the seventh moving track is a displacement distance of moving the X-axis leftwards;
if the second pixel coordinate is positioned on the right side of the first pixel coordinate, the moving track of the camera is an eighth moving track; wherein the eighth movement track is a rightward movement x-axis displacement distance.
6. The DCIM platform-based data compatible transmission processing method according to claim 2, further comprising, after the camera acquires face information of a face corresponding to the mobile operation device after the movement is completed:
Receiving a face picture transmitted by the camera, and extracting face information of the face picture;
in a preset user face information base, carrying out pre-stored user face information feature matching based on the face information, and judging a matching result; the user face information base comprises: a plurality of pre-stored user facial information features and identity information corresponding to each pre-stored user facial information feature;
if the matching is successful, controlling the normal operation of the mobile operation equipment;
if the matching fails, a failure prompt tone is generated, and the mobile operation equipment is controlled to be powered off.
7. The DCIM platform-based data compatible transmission processing method of claim 2, wherein the robotic arm comprises: the camera is fixed at the telescopic rod; the mechanical arm moves the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data, and the method comprises the following steps:
the mechanical arm judges the control data of the mechanical arm;
if the mechanical arm control data comprise transverse movement control data, the mechanical arm controls the chassis driving equipment to move the camera along the sliding rail in the horizontal direction according to the transverse movement control data; wherein the lateral movement control data includes: left movement control data or right movement control data; the sliding rail is arranged on a stand which is at a preset distance from the mobile operation equipment;
If the mechanical arm control data comprise longitudinal movement control data, the mechanical arm controls the telescopic rod to move the camera in the vertical direction according to the longitudinal movement control data;
if the mechanical arm control data comprise transverse movement control data and longitudinal movement control data, the mechanical arm firstly controls the chassis driving device to move the camera along the sliding rail in the horizontal direction according to the transverse movement control data, and then controls the telescopic rod to move the camera in the vertical direction according to the longitudinal movement control data.
8. A DCIM platform-based data compatible transmission processing system, characterized in that it is applied to a DCIM platform, the data compatible transmission processing system comprising: the system comprises a data acquisition module, a picture selection module, a data calculation module and a mechanical arm control module;
the data acquisition module is used for acquiring the video data of the mobile operation equipment transmitted by the camera;
the picture selection module is used for acquiring the size of the operation equipment of each frame in the video data of the operation equipment, selecting continuous frames with unchanged size of the mobile operation equipment as a plurality of target frames, and determining target pictures in the plurality of target frames;
The data calculation module is used for extracting a first pixel coordinate of a face center and a second pixel coordinate of a target picture center from the target picture, and obtaining a moving track of the camera according to the first pixel coordinate, the second pixel coordinate, built-in parameters of the camera and the distance between the camera and the mobile operation equipment; the distance between the camera and the mobile operation equipment is measured through a range finder arranged on the camera;
the mechanical arm control module is used for generating mechanical arm control data according to the movement track, and transmitting the mechanical arm control data to the mechanical arm so that the mechanical arm can move the camera to a face position opposite to the mobile operation equipment according to the mechanical arm control data; the mechanical arm is connected with the camera; and the camera acquires a facial picture of the face corresponding to the mobile operation equipment after the movement is finished.
9. A DCIM platform, comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor implementing a DCIM platform-based data compatible transmission processing method according to any of claims 1 to 7 when the computer program is executed by the processor.
10. A computer readable storage medium, characterized in that the computer readable storage medium comprises a stored computer program, wherein the computer program when run controls a device in which the computer readable storage medium is located to execute a data compatible transmission processing method based on a DCIM platform according to any one of claims 1 to 7.
CN202311316360.8A 2023-10-12 2023-10-12 Data compatible transmission processing method and system based on DCIM platform Active CN117058743B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311316360.8A CN117058743B (en) 2023-10-12 2023-10-12 Data compatible transmission processing method and system based on DCIM platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311316360.8A CN117058743B (en) 2023-10-12 2023-10-12 Data compatible transmission processing method and system based on DCIM platform

Publications (2)

Publication Number Publication Date
CN117058743A true CN117058743A (en) 2023-11-14
CN117058743B CN117058743B (en) 2024-02-20

Family

ID=88663048

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311316360.8A Active CN117058743B (en) 2023-10-12 2023-10-12 Data compatible transmission processing method and system based on DCIM platform

Country Status (1)

Country Link
CN (1) CN117058743B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104125433A (en) * 2014-07-30 2014-10-29 西安冉科信息技术有限公司 Moving object video surveillance method based on multi-PTZ (pan-tilt-zoom)-camera linkage structure
CN110086992A (en) * 2019-04-29 2019-08-02 努比亚技术有限公司 Filming control method, mobile terminal and the computer storage medium of mobile terminal
CN112307912A (en) * 2020-10-19 2021-02-02 科大国创云网科技有限公司 Method and system for determining personnel track based on camera
CN113382304A (en) * 2021-06-07 2021-09-10 北博（厦门）智能科技有限公司 Video splicing method based on artificial intelligence technology
CN217081910U (en) * 2021-06-15 2022-07-29 南京林业大学 Novel camera support device
CN115567781A (en) * 2022-09-21 2023-01-03 湖南大学 Shooting method and device based on smart camera and computer equipment
CN116206019A (en) * 2023-02-27 2023-06-02 山东大学 Dynamic data generation method and system based on first person visual angle video

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104125433A (en) * 2014-07-30 2014-10-29 西安冉科信息技术有限公司 Moving object video surveillance method based on multi-PTZ (pan-tilt-zoom)-camera linkage structure
CN110086992A (en) * 2019-04-29 2019-08-02 努比亚技术有限公司 Filming control method, mobile terminal and the computer storage medium of mobile terminal
CN112307912A (en) * 2020-10-19 2021-02-02 科大国创云网科技有限公司 Method and system for determining personnel track based on camera
CN113382304A (en) * 2021-06-07 2021-09-10 北博（厦门）智能科技有限公司 Video splicing method based on artificial intelligence technology
CN217081910U (en) * 2021-06-15 2022-07-29 南京林业大学 Novel camera support device
CN115567781A (en) * 2022-09-21 2023-01-03 湖南大学 Shooting method and device based on smart camera and computer equipment
CN116206019A (en) * 2023-02-27 2023-06-02 山东大学 Dynamic data generation method and system based on first person visual angle video

Also Published As

Publication number Publication date
CN117058743B (en) 2024-02-20

Similar Documents

Publication Publication Date Title
CN108381549B (en) Binocular vision guide robot rapid grabbing method and device and storage medium
US11644841B2 (en) Robot climbing control method and robot
CN113345031A (en) Multi-camera external parameter calibration device and method, storage medium and electronic device
CN113907663B (en) Obstacle map construction method, cleaning robot, and storage medium
CN112200230B (en) Training board identification method and device and robot
CN112528807A (en) Method and device for predicting driving track, electronic equipment and storage medium
CN112017246A (en) Image acquisition method and device based on inverse perspective transformation
KR20200087354A (en) Data labeling apparatus and method for autonomous driving control
CN113601510B (en) Robot movement control method, device, system and equipment based on binocular vision
CN117058743B (en) Data compatible transmission processing method and system based on DCIM platform
CN111368711A (en) Method and device for adjusting lifting of display screen
CN110816522A (en) Vehicle attitude control method, apparatus, and computer-readable storage medium
CN117819383A (en) Container number identification method, system and front crane
CN114758163B (en) Forklift movement control method and device, electronic equipment and storage medium
WO2023213070A1 (en) Method and apparatus for obtaining goods pose based on 2d camera, device, and storage medium
CN114444529B (en) Machine vision-based testing method and device, electronic equipment and storage medium
CN110852278B (en) Ground identification line recognition method, ground identification line recognition equipment and computer-readable storage medium
CN111174706A (en) Floor installation detection method, electronic device and storage medium
CN112560606A (en) Trailer angle identification method and device
CN112184813B (en) Vehicle positioning method, device, equipment and storage medium
CN114332234B (en) Automatic calibration method and system based on checkerboard
CN110647890B (en) High-performance image feature extraction and matching method, system and storage medium
CN116520828A (en) Recharging control method and device of self-mobile device, readable medium and electronic device
CN117274563A (en) Photovoltaic panel pose recognition method and device and installation robot
KR20230077687A (en) Method for calculating distance to target object, and device and program using the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant