CN112784681A - Hand pulse input method, device, equipment and computer readable storage medium - Google Patents

Hand pulse input method, device, equipment and computer readable storage medium Download PDF

Info

Publication number
CN112784681A
CN112784681A CN202011547736.2A CN202011547736A CN112784681A CN 112784681 A CN112784681 A CN 112784681A CN 202011547736 A CN202011547736 A CN 202011547736A CN 112784681 A CN112784681 A CN 112784681A
Authority
CN
China
Prior art keywords
camera
hand
hand shape
image data
pulse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011547736.2A
Other languages
Chinese (zh)
Inventor
陈海波
程巍
吉文雅
盛沿桥
王帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenlan Shengshi Technology Suzhou Co ltd
Deep Blue Technology Shanghai Co Ltd
Original Assignee
Shenlan Shengshi Technology Suzhou Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenlan Shengshi Technology Suzhou Co ltd filed Critical Shenlan Shengshi Technology Suzhou Co ltd
Priority to CN202011547736.2A priority Critical patent/CN112784681A/en
Publication of CN112784681A publication Critical patent/CN112784681A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/24Aligning, centring, orientation detection or correction of the image
    • G06V10/245Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The application provides a hand pulse input method, a device, equipment and a computer readable storage medium, wherein the method comprises the following steps: receiving first image data sent by a camera, wherein the first image data is obtained by shooting with a first posture by the camera; detecting whether a hand shape exists according to the first image data; when the hand shape exists, judging whether the first image data meets a preset condition, wherein the preset condition is a condition which the position and/or the posture of the hand shape should meet; when the first image data does not meet the preset conditions, controlling the camera to adjust the position according to the first image data so that the camera shoots in a second position posture to obtain second image data; the second image data sent by the camera is received and used as the hand pulse information of the user, the posture of the hand of the user is not required to be adjusted, and the hand pulse input efficiency is improved.

Description

Hand pulse input method, device, equipment and computer readable storage medium
Technical Field
The present application relates to the field of image acquisition technologies, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for inputting a hand pulse.
Background
The hand vein recognition technology generally takes physical characteristics of hands as main recognition content, or takes a grain pattern matched with internal veins of the hands as a principle, vein authentication can sense blood flow and blood pressure conditions of the hands, and can carry out living body detection in the recognition process, so that the hand vein recognition technology is obviously superior to face recognition. In addition, because the sampling sample of hand vein recognition comes from the inside of the human body, the external interference in the matching process is very small, and because the hand vein distribution individuals are completely different from one another, the biological information has uniqueness and stability, and the modeling difficulty is high.
The existing hand vein recognition system irradiates veins through an infrared light emitting diode, then obtains images of finger veins or palm veins through an image sensor, stores the images of the veins in a database to realize characteristic value storage, and then compares and matches stored image data characteristics with the recorded vein characteristic values through a background server, namely, a user needs to input hand vein data before using the hand vein recognition device, and the current hand vein input device needs the user to cooperate to make actions such as translation or deflection when inputting user data.
Disclosure of Invention
The application aims to provide a hand pulse input method, a hand pulse input device and a computer readable storage medium, so that a user can input hand pulses efficiently only by fast movement of input equipment without moving a palm when inputting the hand pulses.
The purpose of the application is realized by adopting the following technical scheme:
in a first aspect, the present application provides a hand pulse recording method, including:
receiving first image data sent by a camera, wherein the first image data is obtained by shooting with a first posture by the camera;
detecting whether a hand shape exists according to the first image data;
when the hand shape exists, judging whether the first image data meets a preset condition, wherein the preset condition is a condition which is met by the position and/or the posture of the hand shape;
when the first image data does not meet the preset condition, controlling the camera to adjust the position according to the first image data so that the camera shoots in a second position posture to obtain second image data;
and receiving second image data sent by the camera as the hand pulse information of the user.
The technical scheme has the advantages that the hand shape is judged by detecting the first image data collected by the camera, whether the position and the posture of the hand shape meet requirements is judged, if not, the position and the posture of the hand shape meet the requirements by adjusting the position of the camera, then the hand shape of the second pose is shot by the camera, and the image data of the second pose is used as the hand vein information of the user.
In some optional embodiments, the preset condition includes at least one of:
the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the distance between the camera and the hand shape is within the preset range.
The technical scheme has the beneficial effects that the mirror surface of the camera is parallel or approximately parallel to the palm center surface of the hand shape, so that the accuracy of collecting hand pulse can be improved; and the camera and the hand shape are positioned at a proper position, so that the accuracy of hand pulse acquisition can be improved to a certain extent.
In some optional embodiments, the preset condition is that the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the controlling the camera adjusting position includes:
and controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape.
The beneficial effects of this technical scheme lie in, only through the position of adjustment camera, just can make the mirror surface of camera parallel with the face of palm of hand shape, do not need the user to adjust hand shape, improved the efficiency that hand pulse was gathered.
In some optional embodiments, the controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape includes:
establishing a space coordinate system of the hand shape according to the first image data, selecting a plurality of point values corresponding to the palm center of the hand shape in the space coordinate system, generating a plane where the palm center of the hand shape is located according to the plurality of point values, and comparing the plane data with the collected mirror surface data of the camera to generate deviation information of the palm center surface of the hand shape and the mirror surface of the camera;
and controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape according to the deviation information.
The technical scheme has the beneficial effects that the plane where the palm of the hand shape is located can be accurately positioned by establishing the space coordinate system, so that the deviation information between the palm surface and the mirror surface of the camera can be accurately obtained, then the mirror surface of the camera can be quickly adjusted to be parallel to the palm surface of the hand shape through the deviation information, and the hand pulse input efficiency is further improved.
In some optional embodiments, the preset condition is that a distance between the camera and the hand shape is within the preset range;
the controlling the camera adjusting position includes:
and controlling the camera to adjust that the distance between the camera and the hand shape is within the preset range.
The technical scheme has the advantages that the distance between the camera and the hand shape can be in a proper range only by adjusting the position of the camera, the hand shape does not need to be adjusted by a user, and the hand pulse acquisition efficiency is improved.
In some optional embodiments, the controlling the camera to adjust that the distance between the camera and the hand shape is within the preset range includes:
receiving the current distance between the camera and the hand shape sent by a distance sensor;
and controlling the camera to adjust the distance between the camera and the hand shape to be within the preset range according to the current distance.
The technical scheme has the advantages that the distance between the current position of the camera and the hand shape is calculated, whether the distance is in a proper range or not is judged, and if not, a corresponding instruction is generated and sent to the adjusting unit, so that the hand pulse recording efficiency is increased to a certain extent.
In some optional embodiments, the determining whether the first image data satisfies a preset condition when the hand shape exists includes:
when the hand shape exists, detecting whether the hand shape is complete;
and when the hand shape is complete, judging whether the first image data meets the preset condition.
The technical scheme has the beneficial effects that the judgment on the completeness of the hand shape is increased, so that the information of the incomplete hand shape is prevented from being acquired, and the incomplete hand vein information is avoided.
In some optional embodiments, the method further comprises:
continuously controlling the camera to adjust the position so that the camera shoots in a third posture to obtain third image data;
and receiving third image data sent by the camera and putting the hand pulse information of the user.
The beneficial effect of this technical scheme lies in that the camera can carry out diversified shooting to the hand shape to guarantee the complete comprehensiveness of hand pulse input.
In a second aspect, the present application provides a device for hand pulse entry, the device comprising:
the receiving module is used for receiving first image data sent by a camera, wherein the first image data is obtained by shooting the camera in a first position; the second image data is used for receiving the second image data sent by the camera and is used as hand pulse information of the user;
the detection module is used for detecting whether a hand shape exists according to the first image data;
the judging module is used for judging whether the first image data meets a preset condition when the hand shape exists, wherein the preset condition is a condition which is met by the position and/or the posture of the hand shape;
and the control module is used for controlling the camera to adjust the position according to the first image data when the first image data does not meet the preset condition, so that the camera shoots in a second position posture to obtain second image data.
In some optional embodiments, the preset condition includes at least one of:
the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the distance between the camera and the hand shape is within the preset range.
In some optional embodiments, the preset condition is that the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the control module is also used for controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape.
In some optional embodiments, the control module comprises:
the comparison unit is used for establishing a space coordinate system of the hand shape according to the first image data, selecting a plurality of point values corresponding to the palm center of the hand shape in the space coordinate system, generating a plane where the palm center of the hand shape is located according to the plurality of point values, and comparing the plane data with the collected mirror surface data of the camera to generate deviation information of the palm center surface of the hand shape and the mirror surface of the camera;
and the first control unit is used for controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape according to the deviation information.
In some optional embodiments, the preset condition is that a distance between the camera and the hand shape is within the preset range;
the control module is also used for controlling the camera to adjust the distance between the camera and the hand shape to be within the preset range.
In some optional embodiments, the control module comprises:
the distance receiving unit is used for receiving the current distance between the camera and the hand shape sent by the distance sensor;
and the second control unit is used for controlling the camera to adjust the distance between the camera and the hand shape to be within the preset range according to the current distance.
In some optional embodiments, the determining module includes:
the integrity detection unit is used for detecting whether the hand shape is complete or not when the hand shape exists;
and the pose judgment unit is used for judging whether the first image data meets the preset condition or not when the hand shape is complete.
In some optional embodiments, the apparatus further comprises a continuation adjustment module, the continuation adjustment module comprising:
the third control unit is used for continuously controlling the camera to adjust the position so as to enable the camera to shoot in a third posture to obtain third image data;
and the hand pulse receiving unit is used for receiving the third image data sent by the camera and putting the hand pulse information of the user into the third image data.
In a third aspect, the present application provides a hand pulse recording device comprising a memory storing a computer program and a processor implementing the steps of the hand pulse recording method of any one of the above when the computer program is executed.
In some optional embodiments, the apparatus further comprises:
a camera;
a base;
a first rotating part which is arranged on the base and can rotate around a first direction;
the second rotating part is arranged on the first rotating part and can rotate around a second direction;
the moving part is arranged between the second rotating part and the camera and is used for driving the camera to move;
wherein the camera is used for capturing a first image.
This technical scheme's beneficial effect lies in, through the cooperation of first rotation portion, second rotation portion and removal portion to make the camera that sets up in removal portion catch first image accurate, not only simple structure does not need artificial participation moreover, also need not the user to remove, has increased the efficiency that hand pulse was typeeed.
In some optional embodiments, the apparatus further comprises:
and the control part is respectively connected with the first rotating part, the second rotating part and the moving part, and respectively sends preset instructions to the first rotating part, the second rotating part and the moving part so that the camera captures the first image.
The technical scheme has the advantages that the control part is electrically connected with the first rotating part, the second rotating part and the moving part respectively, and the distance instruction of translation is sent to the moving part, so that the camera can accurately capture a first image, and the accuracy of capturing hand features by the camera is improved.
In some optional embodiments, the first rotating portion includes a first driving motor and a first transmission shaft, and the first driving motor is configured to drive the first rotating shaft to rotate.
This technical scheme's beneficial effect lies in, can drive the camera through first driving motor and first transmission shaft and carry out the efficient and rotate.
In some alternative embodiments, the first direction is a horizontal direction.
This technical scheme's beneficial effect lies in, can drive the camera through first driving motor and first transmission shaft and carry out the efficient rotation at the horizontal direction.
In some optional embodiments, the second rotating portion includes a second driving motor and a second rotating shaft, and the second driving motor is configured to drive the second rotating shaft to rotate.
The beneficial effect of this technical scheme lies in, can drive the camera through second driving motor and second transmission shaft and carry out the efficient and rotate.
In some alternative embodiments, the second direction is a vertical direction.
The beneficial effect of this technical scheme lies in, can drive the camera through second driving motor and second transmission shaft and carry out the efficient rotation in vertical direction.
In some optional embodiments, the moving portion includes a sliding track portion, and the sliding track portion includes at least two guide rails and a slider, the guide rails are fixedly connected with the second rotating portion, and the camera is fixed on the slider.
The beneficial effect of this technical scheme lies in, through the cooperation of guide rail and slider, can make the quick translation that carries on of camera.
In some optional embodiments, the moving portion includes a telescopic portion, the telescopic portion includes a telescopic rod and a micro motor, one end of the telescopic rod is fixedly connected to the second rotating portion, and the other end of the telescopic rod is used for fixing the camera.
The beneficial effects of this technical scheme lie in, use through telescopic link and micro motor's cooperation, can make the camera carry out the quick travel of accurate distance.
In a fourth aspect, the present application provides a computer program stored thereon for performing, when executed by a processor, the steps of any of the methods of hand pulse entry.
Drawings
The present application is further described below with reference to the drawings and examples.
Fig. 1 is a schematic flow chart of a hand pulse recording method provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of adjusting a camera according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of adjusting a camera according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of adjusting a camera according to an embodiment of the present disclosure;
fig. 5 is a schematic flowchart of adjusting a camera according to an embodiment of the present disclosure;
FIG. 6 is a schematic flowchart illustrating a process for detecting whether a hand shape is complete according to an embodiment of the present disclosure;
fig. 7 is a schematic flowchart of a method for inputting a hand pulse according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a hand pulse recording device provided in an embodiment of the present application;
FIG. 9 is a schematic structural diagram of a control module according to an embodiment of the present disclosure;
FIG. 10 is a schematic structural diagram of a control module according to an embodiment of the present disclosure;
fig. 11 is a schematic structural diagram of a determining module according to an embodiment of the present disclosure;
fig. 12 is a schematic structural diagram of a hand pulse recording device provided in an embodiment of the present application;
fig. 13 is a schematic structural diagram of a continuous adjustment module according to an embodiment of the present application;
fig. 14 is a schematic structural diagram of a hand pulse recording device provided in an embodiment of the present application;
fig. 15 is a schematic structural diagram of a hand pulse recording device provided in an embodiment of the present application;
fig. 16 is a schematic structural diagram of a program product for implementing a type selection method according to an embodiment of the present application.
Detailed Description
The present application is further described with reference to the accompanying drawings and the detailed description, and it should be noted that, in the present application, the embodiments or technical features described below may be arbitrarily combined to form a new embodiment without conflict.
Referring to fig. 1, the embodiment of the present application provides a hand pulse recording method, which includes steps S101 to S107.
Step S101: receiving first image data sent by a camera, wherein the first image data is obtained by shooting with a first posture by the camera; specifically, a vein collection sensor is arranged in the camera, the vein collection sensor is provided with an infrared light emitting diode, and veins can reflect infrared rays weakly, so that vein pattern images are formed; when the user carries out the type-in of hand arteries and veins, place the palm at first in the camera shooting region to supply the camera to shoot and carry out the collection of hand vein, and because the individual difference of user, the position of placing the hand to the camera is also different, consequently the camera of urgent need carries out timely adjustment, with the hand characteristic of catching. More specifically, the camera sends the captured area image, and the internal algorithm analyzes a large amount of data of the image to obtain whether the image includes hand features, but not limited to.
Step S102: and detecting whether a hand shape exists according to the first image data. Specifically, the hand pulse input device is provided with a machine learning model, the model can receive image data transmitted back by the camera, and whether the image contains a hand shape or not is judged through a large amount of data analysis, and the specific analysis process can refer to the prior art and is not repeated herein.
Step S103: when the hand shape exists, judging whether the first image data meets a preset condition, wherein the preset condition is a condition which is met by the position and/or the posture of the hand shape; specifically, when the image captured by the camera contains a hand, the gesture of the hand is verified, and the vein in the palm needs to be collected due to the hand vein input, so that the palm needs to be over against the camera, that is, the palm surface of the hand shape needs to be parallel to the mirror surface of the camera, and the verification of the hand shape posture needs to carry out a large amount of calculation on a machine learning model in the hand vein input equipment, if an angle exists between the palm surface of the hand shape and the mirror surface of the camera, the collection of the hand pulse is affected, so that the infrared rays reflected by veins from all parts of the palm are received by the hand pulse recording equipment and are calculated to construct a plan view of the hand, and then calculating a deviation value of the plane where the plane graph and the camera lens are located, so as to adjust the angle of the camera in time, so that the camera lens is parallel to the palm surface of the hand shape, but the method is not limited to this. In addition, after the palm center of the hand shape is parallel to the lens of the camera, the vein of the hand is not accurately collected because the camera is far away from the hand, and if the camera is too close to the hand, the vein of the hand cannot be collected, so that whether the distance between the camera and the hand shape is suitable needs to be judged.
Step S104: when the first image data does not meet the preset condition, controlling the camera to adjust the position according to the first image data so that the camera shoots in a second position posture to obtain second image data; specifically, if the position of the hand shape is deflected from the lens of the camera, or the distance between the camera and the hand shape is too close or too far, the camera needs to be controlled to adjust the position, and after the position is adjusted, the camera is used to shoot for the second time at the position, and the hand shape data at the position is acquired.
Step S105: receiving second image data sent by the camera as hand pulse information of a user; specifically, the second image data is hand shape data shot by the camera after the position is adjusted, the position at the moment is standard, and the collected hand vein data can be directly stored in the database.
Therefore, the hand shape is judged by detecting the first image data collected by the camera, whether the position and the posture of the hand shape meet the requirements is judged, if not, the position of the camera is adjusted to enable the position and the posture of the hand shape to meet the requirements, then the hand shape of the second pose is shot by the camera, and the image data of the second pose is used as the hand pulse information of the user.
In a specific implementation, the preset condition may include at least one of: the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape; the distance between the camera and the hand shape is within the preset range. Specifically, if there is an angle between the palm-shaped face and the lens surface of the camera, the collection of the hand veins may be affected, so that it is necessary to receive infrared rays reflected by veins from each part of the palm through a hand vein input device, calculate the infrared rays to construct a plan view of the hand, and then calculate a deviation value between the plan view and the plane where the lens surface of the camera is located, so as to adjust the angle of the camera in time, so that the lens surface of the camera is parallel to the palm-shaped face, but not limited thereto. In addition, after the palm center of the hand shape is parallel to the lens of the camera, the vein of the hand is not accurately collected because the camera is far away from the hand, and if the camera is too close to the hand, the vein of the hand cannot be collected, so that whether the distance between the camera and the hand shape is suitable needs to be judged.
Therefore, the accuracy of hand pulse acquisition can be improved by the parallel or approximately parallel of the lens surface of the camera and the palm surface of the hand shape; and the camera and the hand shape are positioned at a proper position, so that the accuracy of hand pulse acquisition can be improved to a certain extent.
In a specific implementation, referring to fig. 2, the step S104 may include a step S201.
The preset condition is that the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape, and the step S104 includes the step S201: and controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape. Specifically, the camera can receive the instruction and rotate and translate, so that the camera can be adjusted to be parallel to the palm surface of the hand shape according to the instruction.
Therefore, the mirror surface of the camera can be parallel to the palm surface of the hand shape only by adjusting the position of the camera, the hand shape does not need to be adjusted by a user, and the hand pulse acquisition efficiency is improved.
In a specific implementation, referring to fig. 3, the step S201 may include steps S301 to S302.
Step S301: establishing a space coordinate system of the hand shape according to the first image data, selecting a plurality of point values corresponding to the palm center of the hand shape in the space coordinate system, generating a plane where the palm center of the hand shape is located according to the plurality of point values, and comparing the plane data with the collected mirror surface data of the camera to generate deviation information of the palm center surface of the hand shape and the mirror surface of the camera; specifically, the hand vein input device receives infrared rays reflected by veins from each part of the palm, and performs a large amount of calculation on the received infrared ray data to construct a space coordinate system of the current hand shape, selects a plurality of point values of the palm center to generate a plane where the palm center is located through the plurality of point values, and then calculates a deviation value between the plane where the palm center is located and the plane where the camera lens surface is located.
Step S302: and controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape according to the deviation information. Specifically, the camera is adjusted according to the received deviation information, so that the mirror surface of the camera is parallel to the palm surface of the hand shape.
Therefore, the plane where the palm of the hand shape is located can be accurately positioned through establishment of the space coordinate system, so that deviation information between the palm surface and the mirror surface of the camera can be accurately obtained, then the mirror surface of the camera can be quickly adjusted to be parallel to the palm surface of the hand shape through the deviation information, and the hand vein recording efficiency is further improved.
In a specific implementation, referring to fig. 4, the step S104 may include a step S401.
The preset condition is that the distance between the camera and the hand shape is within the preset range. Step S104 includes step S401: and controlling the camera to adjust that the distance between the camera and the hand shape is within the preset range. Specifically, after the palm center of the hand shape is parallel to the lens of the camera, the vein of the hand is collected inaccurately because the camera is far away from the hand, and if the vein of the hand is too close to the palm center of the hand, the vein of the hand cannot be collected, so that whether the distance between the camera and the hand shape is suitable or not needs to be judged.
Therefore, the distance between the camera and the hand shape can be in a proper range only by adjusting the position of the camera, the hand shape does not need to be adjusted by a user, and the hand pulse acquisition efficiency is improved.
In a specific implementation, referring to fig. 5, the step S401 may include steps S501 to 502.
Step S501: receiving the current distance between the camera and the hand shape sent by a distance sensor; specifically, the distance sensor can collect distance information between the camera and the hand shape and send the distance information.
Step S502: according to current distance control the camera adjustment extremely the camera with distance between the hand shape is located predetermine the within range, it is concrete, after hand shape centre of the palm is in the parallel state with the camera lens, because the camera is far away from the hand can cause the inaccuracy of hand vein collection, if too near, then can lead to the possibility that can not gather the vein of whole hands, consequently, need judge whether distance between camera and the hand shape is suitable.
Therefore, the distance between the current position of the camera and the hand shape is calculated, whether the distance is in a proper range or not is judged, and if not, a corresponding instruction is generated and sent to the adjusting unit, so that the hand pulse recording efficiency is increased to a certain extent.
In a specific implementation, referring to fig. 6, the step S103 may include steps S601 to 602.
Step S601: when the hand shape exists, whether the hand shape is complete or not is detected, specifically, the machine model can recognize the features of a part of the hand shape, for example, the camera captures an image including only a part of the finger end, but the machine model can prejudge the orientation of the finger end, that is, the camera is controlled to move towards the direction of the finger end, so that the features of the whole hand can be captured, but the invention is not limited thereto.
Step S602: when the hand shape is complete, whether the first image data meet the preset condition is judged, specifically, when the collected first image data are analyzed, the integrity of the hand shape can be identified, if the integrity of the hand shape is complete, the next judgment is carried out, namely, whether the hand shape data in the first image deflect relative to the camera lens or whether the hand shape is not proper in distance from the camera is judged.
Therefore, the judgment on the completeness of the hand shape is added, so that the information of the incomplete hand shape is prevented from being acquired, and the effect of incomplete hand pulse information is avoided.
In a specific implementation, referring to fig. 7, the step S105 may include steps S106 to 107.
Step S106: and continuously controlling the camera to adjust the position so that the camera shoots in a third posture to obtain third image data, specifically, after the camera collects the data of the hand shape in one posture, the camera can continuously collect the hand vein data at different angles so as to ensure the integrity of the collection of the hand vein data.
Step S107: and receiving third image data sent by the camera and putting the hand vein information of the user, specifically, processing the received third image data, extracting information related to the hand vein of the user, and storing the hand vein data information of the user in a database.
Therefore, the camera can shoot the hand shape in multiple directions to ensure the completeness of hand pulse input.
Referring to fig. 8, an embodiment of the present application further provides a hand pulse recording device, and a specific implementation manner of the hand pulse recording device is consistent with the implementation manner and the achieved technical effect described in the embodiment of the foregoing method, and details are not repeated.
The device comprises: a receiving module 401, configured to receive first image data sent by a camera, where the first image data is obtained by shooting with a first pose by the camera; the second image data is used for receiving the second image data sent by the camera and is used as hand pulse information of the user; a detecting module 402, configured to detect whether a hand shape exists according to the first image data; a determining module 403, configured to determine whether the first image data meets a preset condition when the hand shape exists, where the preset condition is a condition that the position and/or the posture of the hand shape should meet; and the control module 404 is configured to control the camera to adjust the position according to the first image data when the first image data does not meet the preset condition, so that the camera shoots in a second position posture to obtain second image data.
In a specific implementation, the preset condition may include at least one of: the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape; the distance between the camera and the hand shape is within the preset range.
In a specific implementation, the preset condition may be that the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape; the control module 404 may be further configured to control the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape.
Referring to fig. 9, in a specific implementation, the control module 404 may include: a comparison unit 4041, configured to establish a spatial coordinate system of the hand shape according to the first image data, select multiple point values corresponding to the palm center of the hand shape in the spatial coordinate system, generate a plane where the palm center of the hand shape is located according to the multiple point values, and compare the plane data with the collected mirror surface data of the camera to generate deviation information between the palm center surface of the hand shape and the mirror surface of the camera; and the first control unit 4042 is configured to control the camera to adjust that the mirror surface of the camera is parallel to the palm surface of the hand shape according to the deviation information. .
In a specific implementation, the preset condition may be that a distance between the camera and the hand shape is within the preset range; the control module 404 may be further configured to control the camera to adjust that the distance between the camera and the hand shape is within the preset range.
Referring to fig. 10, in a specific implementation, the control module 404 may include: a distance receiving unit 4043, configured to receive the current distance between the camera and the hand shape sent by the distance sensor; a second control unit 4044, configured to control the camera to adjust that the distance between the camera and the hand shape is within the preset range according to the current distance.
Referring to fig. 11, in a specific implementation, the determining module 403 may include: a completeness detection unit 4031, configured to detect whether the hand shape is complete when the hand shape exists; a pose determination unit 4032, configured to determine whether the first image data meets the preset condition when the hand shape is complete.
Referring to fig. 12 and 13, in a specific implementation, the apparatus may further include a continuation adjustment module 405, where the continuation adjustment module 405 includes: a third control unit 4051, configured to continue to control the camera to adjust the position, so that the camera shoots in a third posture, and third image data is obtained; and a hand pulse receiving unit 4052, configured to receive the third image data sent by the camera and put the hand pulse information of the user in the third image data.
Referring to fig. 14 and 15, the present application embodiment also provides a hand pulse recording device 200, the hand pulse recording device 200 includes at least one memory 210, at least one processor 220, and a bus 230 connecting different platform systems.
The memory 210 may include readable media in the form of volatile memory, such as Random Access Memory (RAM)211 and/or cache memory 212, and may further include Read Only Memory (ROM) 213.
The memory 210 further stores a computer program, and the computer program can be executed by the processor 220, so that the processor 220 executes the steps of any one of the methods in the embodiments of the present application, and the specific implementation manner of the method is consistent with the implementation manner and the achieved technical effect described in the embodiments of the method, and some contents are not described again. Memory 210 may also include a program/utility 214 having a set (at least one) of program modules 215, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Accordingly, processor 220 may execute the computer programs described above, as well as may execute programs/utilities 214.
Bus 230 may be a local bus representing one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or any other type of bus structure.
The handvein entry device 200 may also communicate with one or more external devices 240, such as a keyboard, pointing device, bluetooth device, etc., and may also communicate with one or more devices capable of interacting with the handvein entry device 200, and/or any device (e.g., router, modem, etc.) that enables the handvein entry device 200 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 250. Also, the handvein entry device 200 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 260. The network adapter 260 may communicate with the other modules of the handpulse recording device 200 via the bus 230. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the hand pulse entry device 200, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.
As shown in fig. 14, in a specific implementation, the hand pulse recording device 200 further includes: a camera 502; a base 501; a first rotating portion 503 provided on the base 501, the first rotating portion 503 being rotatable in a first direction; a second rotating portion 504 provided on the first rotating portion 503, the second rotating portion 504 being rotatable in a second direction; a moving part 505, disposed between the second rotating part 504 and the camera 502, for driving the camera 502 to move; wherein the camera 502 is configured to capture a first image. Specifically, the first image can be accurately captured by the camera 502 arranged on the moving portion 505 through the cooperation of the first rotating portion 503, the second rotating portion 504 and the moving portion 505, wherein the first rotating portion 503 drives the camera 502 to rotate in the horizontal direction, the second rotating portion 504 drives the camera 502 to move in the vertical direction, and the moving portion 505 drives the camera 502 to translate but does not specifically limit.
In a specific implementation, the hand pulse recording device 200 further comprises: and a control unit (the control unit includes a memory 210 and a processor 220) connected to the first rotating unit 503, the second rotating unit 504 and the moving unit 505, respectively, for sending a preset command to the first rotating unit 503, the second rotating unit 504 and the moving unit 505, respectively, so as to enable the camera 502 to capture the first image. Specifically, the control unit is electrically connected to a rotating unit, a second rotating unit 504 and a moving unit 505, respectively, and is configured to send instructions, for example, an angle instruction for rotating in the horizontal direction is sent to the first rotating unit 503, an angle instruction for rotating in the vertical direction is sent to the second rotating unit 504, and a distance instruction for translating is sent to the moving unit 505, so that the camera 502 can accurately capture the first image.
In a specific implementation, the first rotating portion 503 includes a first driving motor and a first transmission shaft, and the first driving motor is configured to drive the first rotating shaft to rotate. Specifically, the first driving motor can drive the first transmission shaft to rotate along the horizontal direction.
In a specific implementation, the first direction is a horizontal direction.
In a specific implementation, the second rotating portion 504 includes a second driving motor and a second rotating shaft, and the second driving motor is configured to drive the second rotating shaft to rotate. Specifically, the second driving motor can drive the second transmission shaft to rotate along the horizontal direction.
In a specific implementation, the second direction is a vertical direction.
In a specific implementation, the moving part 505 includes a sliding track part, which includes at least two guide rails and a slider, the guide rails are fixedly connected with the second rotating part 504, and the camera 502 is fixed on the slider. Specifically, the camera 502 is fixed on the slider, the slider is arranged on the guide rail, and the slider can drive the camera 502 to slide on the guide rail, so that the distance of the first image collected by the camera 502 is changed.
In a specific implementation, the moving portion 505 includes a telescopic portion, the telescopic portion includes a telescopic rod and a micro motor, one end of the telescopic rod is fixedly connected to the second rotating portion 504, and the other end of the telescopic rod is used for fixing the camera 502. Specifically, the camera 502 can be fixed on a telescopic rod, and the telescopic rod is arranged on the second rotating portion 504 through a micro motor, so that the telescopic rod drives the camera 502 to change the distance of the camera 502 for collecting the first image.
The embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium is used to store a computer program, and when the computer program is executed, the steps of any one of the methods in the embodiments of the present application are implemented, and a specific implementation manner of the steps is consistent with the implementation manner and the achieved technical effect described in the embodiments of the methods, and some details are not repeated. Fig. 16 shows a program product 300 for implementing the method provided by the embodiment, which may employ a portable compact disc read only memory (CD-ROM) and include program codes, and may be run on a terminal device, such as a personal computer. However, the program product 300 of the present application is not so limited, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. Program product 300 may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing. Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
The foregoing description and drawings are only for purposes of illustrating the preferred embodiments of the present application and are not intended to limit the present application, which is, therefore, to the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

Claims (26)

1. A hand pulse recording method, characterized by comprising:
receiving first image data sent by a camera, wherein the first image data is obtained by shooting with a first posture by the camera;
detecting whether a hand shape exists according to the first image data;
when the hand shape exists, judging whether the first image data meets a preset condition, wherein the preset condition is a condition which is met by the position and/or the posture of the hand shape;
when the first image data does not meet the preset condition, controlling the camera to adjust the position according to the first image data so that the camera shoots in a second position posture to obtain second image data;
and receiving second image data sent by the camera as the hand pulse information of the user.
2. A hand pulse recording method according to claim 1, wherein the preset condition includes at least one of:
the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the distance between the camera and the hand shape is within the preset range.
3. The hand pulse recording method according to claim 2, wherein the preset condition is that a mirror surface of the camera is parallel or approximately parallel to a palm center surface of the hand shape;
the controlling the camera adjusting position includes:
and controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape.
4. The hand pulse recording method according to claim 3, wherein the controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape includes:
establishing a space coordinate system of the hand shape according to the first image data, selecting a plurality of point values corresponding to the palm center of the hand shape in the space coordinate system, generating a plane where the palm center of the hand shape is located according to the plurality of point values, and comparing the plane data with the collected mirror surface data of the camera to generate deviation information of the palm center surface of the hand shape and the mirror surface of the camera;
and controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape according to the deviation information.
5. A hand pulse recording method according to claim 2, wherein the preset condition is that a distance between the camera and the hand shape is within the preset range;
the controlling the camera adjusting position includes:
and controlling the camera to adjust that the distance between the camera and the hand shape is within the preset range.
6. The hand pulse recording method according to claim 5, wherein the controlling of the camera to adjust the distance between the camera and the hand shape to be within the preset range includes:
receiving the current distance between the camera and the hand shape sent by a distance sensor;
and controlling the camera to adjust the distance between the camera and the hand shape to be within the preset range according to the current distance.
7. The hand pulse recording method according to claim 1, wherein the determining whether the first image data satisfies a preset condition when the hand shape exists includes:
when the hand shape exists, detecting whether the hand shape is complete;
and when the hand shape is complete, judging whether the first image data meets the preset condition.
8. A hand pulse entry method as claimed in claim 1, further comprising:
continuously controlling the camera to adjust the position so that the camera shoots in a third posture to obtain third image data;
and receiving third image data sent by the camera and putting the hand pulse information of the user.
9. A hand pulse recording device, characterized in that the device comprises:
the receiving module is used for receiving first image data sent by a camera, wherein the first image data is obtained by shooting the camera in a first position; the second image data is used for receiving the second image data sent by the camera and is used as hand pulse information of the user;
the detection module is used for detecting whether a hand shape exists according to the first image data;
the judging module is used for judging whether the first image data meets a preset condition when the hand shape exists, wherein the preset condition is a condition which is met by the position and/or the posture of the hand shape;
and the control module is used for controlling the camera to adjust the position according to the first image data when the first image data does not meet the preset condition, so that the camera shoots in a second position posture to obtain second image data.
10. A hand pulse entry device as claimed in claim 9, wherein the preset conditions include at least one of:
the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the distance between the camera and the hand shape is within the preset range.
11. The hand pulse recording device according to claim 10, wherein the preset condition is that the mirror surface of the camera is parallel or approximately parallel to the palm surface of the hand shape;
the control module is also used for controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape.
12. The manual pulse entry device of claim 11, wherein the control module comprises:
the comparison unit is used for establishing a space coordinate system of the hand shape according to the first image data, selecting a plurality of point values corresponding to the palm center of the hand shape in the space coordinate system, generating a plane where the palm center of the hand shape is located according to the plurality of point values, and comparing the plane data with the collected mirror surface data of the camera to generate deviation information of the palm center surface of the hand shape and the mirror surface of the camera;
and the first control unit is used for controlling the camera to adjust the mirror surface of the camera to be parallel to the palm surface of the hand shape according to the deviation information.
13. The hand pulse recording device according to claim 10, wherein the preset condition is that a distance between the camera and the hand shape is within the preset range;
the control module is also used for controlling the camera to adjust the distance between the camera and the hand shape to be within the preset range.
14. The manual pulse entry device of claim 13, wherein the control module comprises:
the distance receiving unit is used for receiving the current distance between the camera and the hand shape sent by the distance sensor;
and the second control unit is used for controlling the camera to adjust the distance between the camera and the hand shape to be within the preset range according to the current distance.
15. A hand pulse entry device as claimed in claim 9, wherein the decision module comprises:
the integrity detection unit is used for detecting whether the hand shape is complete or not when the hand shape exists;
and the pose judgment unit is used for judging whether the first image data meets the preset condition or not when the hand shape is complete.
16. The manual pulse entry device of claim 9, further comprising a continuous adjustment module, the continuous adjustment module comprising:
the third control unit is used for continuously controlling the camera to adjust the position so as to enable the camera to shoot in a third posture to obtain third image data;
and the hand pulse receiving unit is used for receiving the third image data sent by the camera and putting the hand pulse information of the user into the third image data.
17. A hand pulse entry device, characterized in that it comprises a memory storing a computer program and a processor implementing the steps of the hand pulse entry method according to any one of claims 1-8 when said computer program is executed by said processor.
18. The hand pulse entry device of claim 17, further comprising:
a camera;
a base;
a first rotating part which is arranged on the base and can rotate around a first direction;
the second rotating part is arranged on the first rotating part and can rotate around a second direction;
the moving part is arranged between the second rotating part and the camera and is used for driving the camera to move;
wherein the camera is used for capturing a first image.
19. The hand pulse entry device of claim 18, further comprising:
and the control part is respectively connected with the first rotating part, the second rotating part and the moving part, and respectively sends preset instructions to the first rotating part, the second rotating part and the moving part so that the camera captures the first image.
20. A hand pulse entry device according to claim 18, wherein the first rotary portion comprises a first drive motor for driving the first rotary shaft for rotation and a first drive shaft.
21. A hand pulse entry device as claimed in claim 20 wherein the first direction is a horizontal direction.
22. A hand pulse entry device as claimed in claim 18 wherein the second rotary part comprises a second drive motor and a second rotary shaft, the second drive motor being for driving the second rotary shaft into rotation.
23. A hand pulse entry device as claimed in claim 22 wherein the second direction is a vertical direction.
24. A hand vein entry device according to claim 18 wherein said moving portion comprises a sliding track portion comprising at least two rails and a slider, said rails being fixedly connected to said second rotating portion, said slider having said camera head fixed thereto.
25. The hand pulse recording device according to claim 18, wherein the moving part comprises a telescopic part, the telescopic part comprises a telescopic rod and a micro motor, one end of the telescopic rod is fixedly connected with the second rotating part, and the other end of the telescopic rod is used for fixing the camera.
26. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the hand pulse recording method according to any one of claims 1 to 8.
CN202011547736.2A 2020-12-24 2020-12-24 Hand pulse input method, device, equipment and computer readable storage medium Pending CN112784681A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011547736.2A CN112784681A (en) 2020-12-24 2020-12-24 Hand pulse input method, device, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011547736.2A CN112784681A (en) 2020-12-24 2020-12-24 Hand pulse input method, device, equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN112784681A true CN112784681A (en) 2021-05-11

Family

ID=75752089

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011547736.2A Pending CN112784681A (en) 2020-12-24 2020-12-24 Hand pulse input method, device, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN112784681A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113221891A (en) * 2021-05-12 2021-08-06 佛山育脉科技有限公司 Method and device for adjusting recognition angle of palm vein image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015032270A1 (en) * 2013-09-04 2015-03-12 北京天诚盛业科技有限公司 Iris collection device
CN104766073A (en) * 2015-04-28 2015-07-08 天津理工大学 Self-adaptive hand back vein image collecting system
CN107341469A (en) * 2017-06-30 2017-11-10 广东欧珀移动通信有限公司 Control method, electronic installation and computer-readable recording medium
CN110604579A (en) * 2019-09-11 2019-12-24 腾讯科技(深圳)有限公司 Data acquisition method, device, terminal and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015032270A1 (en) * 2013-09-04 2015-03-12 北京天诚盛业科技有限公司 Iris collection device
CN104766073A (en) * 2015-04-28 2015-07-08 天津理工大学 Self-adaptive hand back vein image collecting system
CN107341469A (en) * 2017-06-30 2017-11-10 广东欧珀移动通信有限公司 Control method, electronic installation and computer-readable recording medium
CN110604579A (en) * 2019-09-11 2019-12-24 腾讯科技(深圳)有限公司 Data acquisition method, device, terminal and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113221891A (en) * 2021-05-12 2021-08-06 佛山育脉科技有限公司 Method and device for adjusting recognition angle of palm vein image

Similar Documents

Publication Publication Date Title
US11914792B2 (en) Systems and methods of tracking moving hands and recognizing gestural interactions
US10983597B2 (en) Three dimensional (3D) modeling of a complex control object
US8428306B2 (en) Information processor and information processing method for performing process adapted to user motion
US8509484B2 (en) Information processing device and information processing method
KR101738569B1 (en) Method and system for gesture recognition
US8373654B2 (en) Image based motion gesture recognition method and system thereof
US8525876B2 (en) Real-time embedded vision-based human hand detection
US9076226B2 (en) Apparatus and method for calculating energy consumption based on three-dimensional motion tracking
CN102103409A (en) Man-machine interaction method and device based on motion trail identification
EP2854097A1 (en) Bio-information processing device, bio-information processing method, and program
CN112784681A (en) Hand pulse input method, device, equipment and computer readable storage medium
Wang et al. Dynamic gesture recognition using 3D trajectory
CN109993794A (en) A kind of robot method for relocating, device, control equipment and storage medium
CN116664620A (en) Picture dynamic capturing method and related device based on tracking system
CN215453039U (en) Hand pulse input equipment
JP2015085434A (en) Robot, image processing method and robot system
KR102227494B1 (en) Apparatus and method for processing an user input using movement of an object
CN106815264B (en) Information processing method and system
CN115809679A (en) Physical fitness test method, electronic device, storage medium, and computer program product
CN111078336B (en) Display method, device, equipment and storage medium
CN113510707A (en) Robot control method and device, electronic equipment and storage medium
CN215424552U (en) Image acquisition device
CN109732606A (en) Long-range control method, device, system and the storage medium of mechanical arm
CN109814712A (en) A kind of gesture recognition system based on virtual interacting device
WO2020195272A1 (en) Region detection device, region detection method, and computer-readable recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination