CN115153457A - Method and equipment for determining target displacement information of pulse measuring device - Google Patents
Method and equipment for determining target displacement information of pulse measuring device Download PDFInfo
- Publication number
- CN115153457A CN115153457A CN202210878780.4A CN202210878780A CN115153457A CN 115153457 A CN115153457 A CN 115153457A CN 202210878780 A CN202210878780 A CN 202210878780A CN 115153457 A CN115153457 A CN 115153457A
- Authority
- CN
- China
- Prior art keywords
- pulse
- information
- image
- unit
- wrist
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4887—Locating particular structures in or on the body
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4887—Locating particular structures in or on the body
- A61B5/489—Blood vessels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Veterinary Medicine (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Public Health (AREA)
- Vascular Medicine (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
The application aims at providing a method and equipment for determining target displacement information of a pulse measuring device, wherein the method comprises the following steps: shooting first and second image information of the wrist of the user when the first and second laser emitting units are in an open and closed state; determining first and second image position information of the first and second reference points in the first image information, and determining third image position information of the third reference point in the second image information; determining a mapping relation between an image distance and an actual distance according to the first image position information, the second image position information and the position relation between the first laser emission unit and the second laser emission unit; and determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first or second image position information, the third image position information and the mapping relation between the image distance and the actual distance, so that the pulse measuring unit can conveniently align the pulse point of the wrist of the user and acquire an accurate pulse signal for subsequent diagnosis.
Description
Technical Field
The present application relates to the field of pulse detection, and more particularly, to a technique for determining target displacement information of a pulse measurement device.
Background
The pulse is an artery pulse that can be palpated on the body surface, and has important clinical significance for distinguishing the cause of diseases, deducing the change of diseases, identifying the true and false of diseases, judging the prognosis of diseases and the like. Such arterial pulsation is usually weak, and the position needs to be found accurately to acquire the pulse.
Disclosure of Invention
An object of the present application is to provide a method and apparatus for determining target displacement information of a pulse measurement device.
According to one aspect of the application, a method of adjusting a pulse measuring device is provided, wherein the pulse measuring device comprises a cavity for accommodating a wrist of a user, a first laser emitting unit, a second laser emitting unit, a camera unit and a pulse measuring unit, the method comprising:
shooting first image information and second image information of a wrist of a user through the camera unit when the first laser emitting unit and the second laser emitting unit are in an opening state and a closing state respectively, wherein the first image information comprises a first reference point and a second reference point, the first reference point and the second reference point are images of light emitting points of the first laser emitting unit and the second laser emitting unit in the first image information respectively, the second image information comprises a third reference point, and the third reference point is an image of a pulse point of the wrist of the user in the second image information;
determining first image position information and second image position information of the first reference point and the second reference point in the first image information respectively, and determining third image position information of the third reference point in the second image information;
determining a mapping relation between an image distance and an actual distance according to the first image position information, the second image position information and the position relation between the first laser emission unit and the second laser emission unit;
and determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information and the mapping relation between the image distance and the actual distance.
According to one aspect of the application, a computer device for determining target displacement information of a pulse measuring apparatus is provided, comprising a memory, a processor and a computer program stored on the memory, characterized in that the processor executes the computer program to implement the steps of any of the methods as described above.
According to an aspect of the application, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that the computer program, when executed by a processor, implements the steps of any of the methods described above.
According to an aspect of the application, a computer program product is provided, comprising a computer program, characterized in that the computer program, when executed by a processor, implements the steps of any of the methods as described above.
According to an aspect of the present application, there is provided a pulse measurement device, wherein the pulse measurement device includes a cavity for accommodating a wrist of a user, a first laser emitting unit, a second laser emitting unit, a camera unit, and a pulse measurement unit, the pulse measurement device further includes:
a module, configured to capture first image information and second image information of a wrist of a user through the camera unit when the first laser emitting unit and the second laser emitting unit are in an on state and an off state, respectively, where the first image information includes a first reference point and a second reference point, the first reference point and the second reference point are images of a light emitting point of the first laser emitting unit and the second laser emitting unit in the first image information, respectively, the second image information includes a third reference point, and the third reference point is an image of a pulse point of the wrist of the user in the second image information;
a second module, configured to determine first image location information and second image location information of the first reference point and the second reference point in the first image information, respectively, and determine third image location information of the third reference point in the second image information;
a third module, configured to determine a mapping relationship between an image distance and an actual distance according to the first image location information, the second image location information, and a location relationship between the first laser emitting unit and the second laser emitting unit;
and the fourth module is used for determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information and the mapping relation between the image distance and the actual distance.
Compared with the prior art, the method and the device have the advantages that the first image information and the second image information of the wrist of the user are shot through the camera unit when the first laser emission unit and the second laser emission unit are in the on and off states, wherein the first image information comprises a first reference point and a second reference point, the first reference point and the second reference point are respectively images of the light emission points of the first laser emission unit and the second laser emission unit in the first image information, the second image information comprises a third reference point, and the third reference point is an image of the pulse point of the wrist of the user in the second image information; determining first image position information and second image position information of the first reference point and the second reference point in the first image information respectively, and determining third image position information of the third reference point in the second image information; determining a mapping relation between an image distance and an actual distance according to the first image position information, the second image position information and the position relation between the first laser emission unit and the second laser emission unit; and determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information and the mapping relation between the image distance and the actual distance, so that the pulse measuring unit in the pulse measuring device can conveniently align the pulse point of the wrist of the user and acquire accurate pulse signals to perform subsequent diagnosis.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 illustrates a flow chart of a method of determining target displacement information for a pulse measurement device according to one embodiment of the present application;
FIG. 2 illustrates a first image information diagram according to an embodiment of the present application;
FIG. 3 illustrates a second graphical information diagram according to one embodiment of the present application;
FIG. 4 illustrates a diagram of a pulse measurement device according to one embodiment of the present application;
FIG. 5 illustrates an exemplary system that can be used to implement the various embodiments described in this application.
The same or similar reference numbers in the drawings identify the same or similar elements.
Detailed Description
The present application is described in further detail below with reference to the attached figures.
In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party each include one or more processors (e.g., central Processing Units (CPUs)), input/output interfaces, network interfaces, and memory.
The Memory may include volatile Memory in a computer readable medium, random Access Memory (RAM), and/or nonvolatile Memory such as Read Only Memory (ROM) or Flash Memory. Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase-Change Memory (PCM), programmable Random Access Memory (PRAM), static Random-Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash Memory or other Memory technology, compact Disc Read Only Memory (CD-ROM), digital Versatile Disc (DVD) or other optical storage, magnetic tape storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
The device referred to in this application includes, but is not limited to, a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user equipment includes, but is not limited to, any mobile electronic product, such as a smart phone, a tablet computer, etc., capable of performing human-computer interaction with a user (e.g., human-computer interaction through a touch panel), and the mobile electronic product may employ any operating system, such as an Android operating system, an iOS operating system, etc. The network Device includes an electronic Device capable of automatically performing numerical calculation and information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded Device, and the like. The network device includes but is not limited to a computer, a network host, a single network server, multiple network server sets, or a cloud of multiple servers; here, the Cloud is composed of a large number of computers or web servers based on Cloud Computing (Cloud Computing), which is a kind of distributed Computing, one virtual supercomputer consisting of a collection of loosely coupled computers. Including, but not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless Ad Hoc network (Ad Hoc network), etc. Preferably, the device may also be a program running on the user device, the network device, or a device formed by integrating the user device and the network device, the touch terminal, or the network device and the touch terminal through a network.
Of course, those skilled in the art will appreciate that the foregoing is by way of example only, and that other existing or future devices, which may be suitable for use in the present application, are also encompassed within the scope of the present application and are hereby incorporated by reference.
In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
Fig. 1 shows a flowchart of a method of determining target displacement information of a pulse measurement device according to an embodiment of the present application, the method comprising: step S11, step S12, step S13, and step S14. In step S11, the pulse measurement apparatus captures first image information and second image information of a wrist of a user through the camera unit when the first laser emitting unit and the second laser emitting unit are in an on state and an off state, respectively, where the first image information includes a first reference point and a second reference point, the first reference point and the second reference point are images of a light emitting point of the first laser emitting unit and the second laser emitting unit in the first image information, respectively, the second image information includes a third reference point, and the third reference point is an image of a pulse point of the wrist of the user in the second image information; in step S12, the pulse measurement device determines first image position information and second image position information of the first reference point and the second reference point in the first image information, respectively, and determines third image position information of the third reference point in the second image information; in step S13, the pulse measurement device determines a mapping relationship between an image distance and an actual distance according to the first image position information, the second image position information, and a position relationship between the first laser emission unit and the second laser emission unit; in step S14, the pulse measurement device determines target displacement information of the pulse measurement unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information, and the mapping relationship between the image distance and the actual distance.
In step S11, the pulse measurement device captures first image information and second image information of the wrist of the user through the camera unit when the first laser emitting unit and the second laser emitting unit are in an on state and an off state, respectively, where the first image information includes a first reference point and a second reference point, the first reference point and the second reference point are images of the light emitting points of the first laser emitting unit and the second laser emitting unit in the first image information, respectively, the second image information includes a third reference point, and the third reference point is an image of the pulse point of the wrist of the user in the second image information.
In some embodiments, the camera unit may be fixed in the pulse measurement device, and may be capable of capturing a position of the cavity for accommodating the wrist of the user, for example, a position above the cavity. For example, the camera unit is fixedly connected with the first laser emitting unit or the second laser emitting unit, when the first laser emitting unit or the second laser emitting unit moves, the camera unit is also driven to move, and a shooting area of the camera unit changes accordingly. When the light emitting point of the first laser emitting unit or the second laser emitting unit can fall on the cavity area of the pulse measuring device, the image information containing the wrist of the user can be shot by the camera shooting unit. In some embodiments, the first laser emitting unit and the second laser emitting unit may be configured to emit laser or the like directional light. Referring to the first image information diagram shown in fig. 2, the pulse measurement device may capture the first image information through the camera unit when the first laser emitting unit and the second laser emitting unit are both in the on state. The first image information includes a first reference point and a second reference point, i.e., "a", "B"2 light points photographed on the wrist of the user in fig. 2. In some embodiments, the pulse measurement apparatus may capture second image information through the camera unit when both the first laser emitting unit and the second laser emitting unit are in the off state, refer to a schematic diagram of the second image information shown in fig. 3, where the position shown in "good" is an imaging position of the user wrist pulse point in the second image information. The pulse measurement device may identify the first reference point and a second reference point included in the first image information using a light point identification algorithm; and identifying the third reference point in the second image information through a pulse position identification model.
In some embodiments, the positions of the cavity, the first laser emitting unit, the second laser emitting unit, the camera unit and the pulse measuring unit in the pulse measuring device are kept unchanged during the shooting process of the first image information and the second image information. The first image information and the second image information correspond to the same image size, the same shooting parameters of the shooting unit and the like. Here, the order of capturing the first image information and the second image information is not limited. The second image information can be shot firstly, and the first laser emission unit and the second laser emission unit are started after the shooting is finished, so that the first image information is shot. Or shooting the first image information first, closing the first laser emission unit and the second laser emission unit after shooting is finished, and shooting the second image information.
In some embodiments, if the initial positions of the first laser emitting unit and the second laser emitting unit in the pulse measurement device are set at positions where the emitted light of the first laser emitting unit and the emitted light of the second laser emitting unit can be in a cavity region, the pulse measurement device can directly control the first laser emitting unit and the second laser emitting unit to be turned on or off to obtain the first image information and the second image information required by the scheme after the wrist of the user is placed in the cavity.
In some embodiments, the method further includes, before the step S11, a step S15 (not shown) in which the pulse measurement device drives the first laser emitting unit and the second laser emitting unit to move, so that the light spots emitted by the first laser emitting unit and the second laser emitting unit are both irradiated on the wrist of the user. For example, if the initial positions of the first laser emitting unit and the second laser emitting unit in the pulse measurement device are set at positions where the emitted light cannot be in a cavity region, before the pulse measurement device performs shooting through the camera unit, the driving information about the first laser emitting unit and the second laser emitting unit may be determined according to the position relationship between the initial positions of the first laser emitting unit and the second laser emitting unit in the pulse measurement device and the cavity, so that the light spots emitted by the first laser emitting unit and the second laser emitting unit after moving may be irradiated on the wrist of the user.
In step S12, the pulse measurement device determines first image position information and second image position information of the first reference point and the second reference point in the first image information, respectively, and determines third image position information of the third reference point in the second image information. In some embodiments, the pulse measurement device constructs the pixel coordinate systems of the first image information and the second image information, respectively, in the same coordinate system establishing manner. For example, the first image position information (Xa, ya), the second image position information (Xb, yb) and the third image position information (Xm, ym) may be determined by establishing a pixel coordinate system of the first image information and the second image information respectively with the upper image boundary as the X-axis and the left image boundary as the Y-axis, and calculating the pixel coordinates of the first reference point, the second reference point and the third reference point in the image based on the pixel coordinate system.
In some embodiments, the method further comprises step S17 (not shown), the pulse measurement device identifying the first reference point and the second reference point in the first image information; identifying the third reference point in the second image information. For example, the pulse measurement device identifies each reference point from the first image information and the second image information before determining the image position information corresponding to each reference point. In some embodiments, the pulse measurement device may identify the first reference point and the second reference point in the first image information using a light point identification algorithm. For example, the pulse measuring device converts the first image information from an RGB image into an HSV image, extracts an S component image and a V component image from the converted HSV image, determines 2 light spots in the first image information according to the S component image and the V component image, and determines a first reference point corresponding to the first laser emitting unit and a second reference point corresponding to the second laser emitting unit by combining the distribution of the 2 light spots in the first image information and the positional relationship between the first laser emitting unit and the second laser emitting unit. In some embodiments, the pulse measurement apparatus may determine the third reference point in the second image information according to a pulse position recognition model, wherein the pulse position recognition model is obtained by training a plurality of sample pictures containing the pulse point of the wrist of the person, and a specific position of the pulse point of the wrist of the person is marked in each sample picture.
In step S13, the pulse measurement device determines a mapping relationship between an image distance and an actual distance according to the first image position information, the second image position information, and a position relationship between the first laser emission unit and the second laser emission unit. In some embodiments, if the first laser emitting unit and the second laser emitting unit are fixedly connected, the relative positions of the two laser emitting units are kept unchanged; or the initial positions of the first laser emission unit and the second laser emission unit in the pulse measurement device are set at positions where the emitted light of the first laser emission unit and the second laser emission unit can be in the cavity area, that is, the position relationship between the first laser emission unit and the second laser emission unit is only related to the initial position relationship between the first laser emission unit and the second laser emission unit in the pulse measurement device, and the mapping relationship between the image distance and the actual distance can be determined by directly using the initial position relationship between the first laser emission unit and the second laser emission unit as the position relationship. For example, if a three-dimensional coordinate system is constructed by using a fixed point in the pulse measurement device as a coordinate origin, a right direction parallel to a horizontal plane as an x-axis forward direction, a downward direction parallel to the horizontal plane as a y-axis forward direction, and a downward direction perpendicular to the horizontal plane as a z-axis forward direction, the pulse measurement device can determine a mapping relationship between an image distance and an actual distance based on an initial position relationship (Δ x, Δ y) between the first laser emitting unit and the second laser emitting unit, the first image position information (Xa, ya) and the second image position information (Xb, yb) in the three-dimensional coordinate system, wherein:
the displacement mapping relation between the displacement in the X-axis direction of the image and the displacement in the actual X-axis direction is as follows: rx = | Xb-Xa |/Δ x;
the displacement mapping relation between the displacement in the Y-axis direction of the image and the displacement in the actual Y-axis direction is as follows: ry = | Yb-Ya |/Δ y.
In some embodiments, the method further comprises: step S16 (not shown), the pulse measurement device determines a position relationship between the first laser emitting unit and the second laser emitting unit according to first displacement information and second displacement information generated by the movement of the first laser emitting unit and the second laser emitting unit. In some embodiments, if the initial positions of the first laser emitting unit and the second laser emitting unit in the pulse measurement device are set at positions where the emitted light cannot be in the cavity region, the first laser emitting unit and the second laser emitting unit move before shooting. And the first laser emission unit and the second laser emission unit are not fixedly connected and can respectively move randomly. The pulse measuring device can determine the position relation (delta x ', delta y') between the first laser emitting unit and the second laser emitting unit after moving according to the first displacement information and the second displacement information generated by the movement of the first laser emitting unit and the second laser emitting unit and the initial position relation (delta x, delta y) between the first laser emitting unit and the second laser emitting unit based on the three-dimensional coordinate system. The pulse measurement device can determine the mapping relationship Rx and Ry between the image distance and the actual distance based on the position relationship (Δ x ', Δ y'), in a manner the same as or similar to that described in the foregoing step S13, and therefore, the description is omitted, and the description is incorporated herein by reference.
In step S14, the pulse measuring device determines target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information, and the mapping relationship between the image distance and the actual distance. In some embodiments, the pulse measurement device may determine third displacement information of the pulse point of the first laser emission unit or the second laser emission unit and the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information, and the mapping relationship between the image distance and the actual distance, and determine target displacement information of the pulse point of the pulse measurement unit and the wrist of the user in the horizontal direction according to the third displacement information and the position relationship between the first laser emission unit or the second laser emission unit and the pulse measurement unit. For example, the pulse measuring apparatus may determine third displacement information of the second laser emitting unit and the pulse point of the wrist of the user in the horizontal direction according to the second image position information (Xb, yb), the third image position information (Xm, ym), and a mapping relationship between the image distance and the actual distance. If the pulse measurement unit is fixedly connected with the second laser emission unit or the second laser emission unit does not move, and the relative positions of the pulse measurement unit and the second laser emission unit do not change, the pulse measurement device can directly determine the target displacement information according to the stored initial position relationship between the second laser emission unit and the pulse measurement unit and the third displacement information. If the relative position between the pulse measurement unit and the second laser emission unit changes, for example, the second laser emission unit moves and is not fixedly connected with the pulse measurement unit, the pulse measurement unit may determine the position relationship between the second laser emission unit and the pulse measurement unit based on the initial position relationship between the second laser emission unit and the pulse measurement unit and the second displacement information of the second laser emission unit, and further determine the target displacement information.
In some embodiments, the step S14 includes: the pulse measuring device determines the position relation between the first laser emitting unit or the second laser emitting unit and the pulse measuring unit according to first displacement information or second displacement information generated by the movement of the first laser emitting unit or the second laser emitting unit; and determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information, the position relation between the first laser emitting unit or the second laser emitting unit and the pulse measuring unit and the mapping relation between the image distance and the actual distance. For example, if the pulse measurement device and the first laser emission unit or the second laser emission unit and the pulse measurement unit are not fixedly connected, when the first laser emission unit or the second laser emission unit moves, the position relationship between the pulse measurement unit and the first laser emission unit or the second laser emission unit also changes. The pulse measuring unit can determine the position relation between the pulse measuring unit and the first laser emitting unit or the second laser emitting unit based on the first displacement information or the second displacement information and the initial position relation between the pulse measuring unit and the first laser emitting unit or the second laser emitting unit. The pulse measuring unit can choose to calculate the position relation between the pulse measuring unit and one of the laser emitting units. And when the target displacement is calculated subsequently, calculating according to the image position information corresponding to the laser emission unit. For example, a second laser emitting unit is selected for calculation, and the pulse measurement device determines a position relationship (Tx, ty) between the second laser emitting unit and the pulse measurement unit according to the second displacement information and an initial position relationship between the pulse measurement unit and the second laser emitting unit in the three-dimensional coordinate system, wherein Tx, ty includes the position direction relationship between the second laser emitting unit and the pulse measurement unit, and for example, if the Tx value is negative, the second laser emitting unit is on the left side of the pulse measurement unit in the x-axis direction; if the Ty value is negative, the height of the second laser emitting unit is lower than that of the pulse measuring unit in the y-axis direction. According to the second image position information (Xb, yb), the third image position information (Xm, ym), and the inter-pulse measurement unit position relationship (Tx, ty) of the second laser emitting unit and the pulse measurement unit, the pulse measurement device may determine corresponding target displacement information: displacement information Lx = (Xm-Xb)/Rx + Tx in the x-axis direction, and displacement information Ly = (Ym-Yb)/Ry + Ty in the y-axis direction of the measurement unit and the pulse point of the user's wrist.
In some embodiments, the method further includes a step S18 (not shown), in which the pulse measurement unit and/or the cavity is driven by the pulse measurement device according to the target displacement information, so that the pulse measurement unit is aligned with the wrist pulse point of the user. In some embodiments, the pulse measurement device may drive the pulse measurement unit or the cavity or the pulse measurement unit and the cavity to generate displacement in the x-axis and/or y-axis and/or z-axis direction based on the corresponding driving design of the pulse measurement unit and the cavity, so that the pulse measurement unit and the cavity generate relative displacement in the horizontal and vertical directions. For example, the pulse measurement device may drive the pulse measurement unit to move in the x, y, and z-axis directions only, or the pulse measurement device may drive the pulse measurement unit to move in the x and y-axis directions, drive the cavity to move in the z-axis direction, and the like. The pulse measuring device can drive the measuring unit and/or the cavity according to the target displacement information, so that the pulse measuring unit is aligned to the wrist pulse point of the user, and the wrist pulse signal of the user is acquired.
In some embodiments, the step S18 includes: the pulse measuring device drives the pulse measuring unit and/or the cavity according to the target displacement information and by combining with the vertical distance information of the pulse measuring unit and the pulse point of the wrist of the user, so that the pulse measuring unit is aligned to the pulse point of the wrist of the user. In some embodiments, the vertical distance information may be determined based on preset distance information of the pulse measurement unit from the cavity. Or the imaging unit uses a depth camera and has the same initial height as the pulse measurement unit, the vertical distance information may be determined based on depth information of the first image information or the second image information captured by the imaging unit. In some embodiments, the pulse measurement device can drive the pulse measurement unit and/or the cavity to move on a horizontal plane according to the target displacement information, so that the pulse measurement unit is aligned with the pulse point of the wrist of the user in a vertical direction. The driving the pulse measurement unit and/or the cavity to move on the horizontal plane includes, but is not limited to, only driving the pulse measurement unit or the cavity to move on the horizontal plane, driving the pulse measurement unit to move on the horizontal plane in one direction (for example, the x-axis direction) and driving the cavity to move on the horizontal plane in another direction (for example, the y-axis direction). The pulse measuring device drives the pulse measuring unit and/or the cavity to move in the vertical direction according to the vertical distance information, so that the measuring unit is aligned with the wrist pulse point of the user. The order of the movement in the horizontal direction and the movement in the vertical direction is not limited here. The movement can be performed according to the target displacement information and then according to the vertical distance information. Or moving according to the vertical distance information and then moving according to the target displacement information. Or the pulse measurement unit may be driven to move in the horizontal direction according to the target displacement information, and the cavity may be driven to move in the vertical direction according to the vertical distance information.
In some embodiments, the step S18 includes: the pulse measuring device determines target coordinate information for aligning the pulse measuring unit to the pulse point of the wrist of the user in a three-dimensional space according to the target displacement information and the vertical distance information between the pulse measuring unit and the pulse point of the wrist of the user; and driving the pulse measuring unit and/or the cavity according to the target coordinate information so as to enable the pulse measuring unit to be aligned with the wrist pulse point of the user. In some embodiments, the target coordinate information is coordinate information of the wrist pulse point of the user in the three-dimensional coordinate system. The pulse measuring device can determine the target coordinate information according to the target displacement information and the vertical distance information delta z between the pulse measuring unit and the wrist pulse point of the user. The pulse measuring device can determine the displacement information required to be executed by the pulse measuring unit and/or the cavity according to the target coordinate information, directly drive the pulse measuring unit and/or the cavity, and enable the pulse measuring unit and/or the cavity to move from the current position of the pulse measuring unit and/or the cavity through a certain horizontal plane and/or a certain vertical direction, so that the pulse measuring unit is aligned with the pulse point of the wrist of the user; or directly driving the pulse measuring unit or the cavity to make the pulse measuring unit or the cavity linearly move at a certain angle from the current position of the pulse measuring unit or the cavity, so that the pulse measuring unit is aligned with the pulse point of the wrist of the user, and the angle can be determined according to the target coordinate information.
In some embodiments, the method further includes step S19 (not shown), in which the pulse measurement device obtains a pressure signal of the pulse point on the wrist of the user through the pulse measurement unit, and drives the pulse measurement unit and/or the cavity to move in a vertical direction according to a magnitude relationship between magnitude information of the pressure signal and pulse pressure signal threshold information, so that the pulse measurement unit is aligned with the pulse point on the wrist of the user. In some embodiments, after the pulse measurement device drives the pulse measurement unit and/or the cavity to move according to the target displacement information and/or the vertical distance information, the pulse measurement device may further adjust the relative position of the measurement unit and the wrist pulse point of the user according to the acquired pressure signal of the pulse point, so that the pulse measurement device is more accurately aligned with the wrist pulse point of the user, and an optimal pulse signal is conveniently acquired. The pressure signal can be obtained by a pulse pressure sensor in the pulse measuring unit. For example, if the amplitude information of the pressure signal is smaller than the minimum pulse pressure signal threshold information, the pulse measurement device drives the pulse measurement unit to move downwards in the vertical direction or drives the cavity to move upwards in the vertical direction according to the preset vertical direction displacement information; if the amplitude information of the pressure signal is larger than the maximum pulse pressure signal threshold value information, the pulse measuring device drives the pulse measuring unit to move upwards in the vertical direction or the cavity to move downwards in the vertical direction according to the preset vertical direction displacement information. The vertical displacement information can be a preset fixed value, and can also be determined according to the relationship between the amplitude information of the pressure signal and the pulse pressure signal threshold value information. For example, if the amplitude information of the pressure signal is smaller than the minimum pulse pressure signal threshold information, the larger the difference between the amplitude information of the pressure signal and the minimum pulse pressure signal threshold information is, the larger the vertical displacement information is; if the amplitude information of the pressure signal is greater than the threshold information of the maximum pulse pressure signal, the larger the difference between the amplitude information of the pressure signal and the threshold information of the maximum pulse pressure signal is, the larger the vertical displacement information is. The pulse measuring device can repeat the steps until the acquired pressure signal of the wrist pulse point of the user is in the interval of [ minimum pulse pressure signal threshold information, maximum pulse pressure signal threshold information ].
Fig. 4 shows a structure diagram of a pulse measurement device according to an embodiment of the present application, wherein the pulse measurement device includes a cavity for accommodating a wrist of a user, a first laser emitting unit, a second laser emitting unit, a camera unit, and a pulse measurement unit, and the pulse measurement device further includes a module 11, a module 12, a module 13, and a module 14. A module 11 respectively shoots first image information and second image information of a wrist of a user through the camera unit when the first laser emitting unit and the second laser emitting unit are in an on state and a off state, wherein the first image information comprises a first reference point and a second reference point, the first reference point and the second reference point are respectively images of light emitting points of the first laser emitting unit and the second laser emitting unit in the first image information, the second image information comprises a third reference point, and the third reference point is an image of a pulse point of the wrist of the user in the second image information; a second module 12 determines first image position information and second image position information of the first reference point and the second reference point in the first image information, respectively, and determines third image position information of the third reference point in the second image information; a third module 13 determines a mapping relationship between an image distance and an actual distance according to the first image position information, the second image position information and the position relationship between the first laser emission unit and the second laser emission unit; a fourth module 14 determines the target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information and the mapping relationship between the image distance and the actual distance. Here, the specific embodiments corresponding to the one-to-one module 11, the two-to-two module 12, the one-to-three module 13, and the one-to-four module 14 shown in fig. 4 are the same as or similar to the specific embodiments of the step S11, the step S12, the step S13, and the step S14, respectively, and therefore are not repeated herein, and are included herein by reference.
In some embodiments, the pulse measurement device further comprises a five module 15 (not shown). The first-fifth module 15 drives the first laser emitting unit and the second laser emitting unit to move, so that light spots emitted by the first laser emitting unit and the second laser emitting unit are irradiated on the wrist of the user. Here, the specific implementation manner of the fifth module 15 is the same as or similar to that of the step S15, and therefore, the detailed description is omitted, and the detailed implementation manner is incorporated herein by reference.
In some embodiments, the pulse measurement device further includes a six-module 16 (not shown). The sixth module 16 determines the position relationship between the first laser emitting unit and the second laser emitting unit according to the first displacement information and the second displacement information generated by the movement of the first laser emitting unit and the second laser emitting unit. Here, the specific implementation manner of the one-six module 16 is the same as or similar to that of the step S16, and thus is not described herein again and is included herein by reference.
In some embodiments, the pulse measurement device further comprises a seven module 17 (not shown). The seventh module 17 identifies the first reference point and the second reference point in the first image information; identifying the third reference point in the second image information. Here, the specific implementation manner of the seventh module 17 is the same as or similar to that of the step S17, and therefore, the detailed description is omitted, and the detailed implementation manner is incorporated herein by reference.
In some embodiments, the pulse measurement device further includes an eight module 18 (not shown). The eight modules 18 drive the pulse measurement unit and/or the cavity according to the target displacement information, so that the pulse measurement unit is aligned with the wrist pulse point of the user. Here, the specific implementation manner of the eight modules 18 is the same as or similar to that of the step S18, and therefore, the detailed description is omitted, and the detailed implementation manner is included herein by reference.
In some embodiments, the pulse measurement device further comprises a nine module 19 (not shown). The nine modules 19 acquire the pressure signal of the user wrist pulse point through the pulse measuring unit, and drive the pulse measuring unit and/or the cavity to move in the vertical direction according to the magnitude relation between the amplitude information of the pressure signal and the pulse pressure signal threshold information, so that the pulse measuring unit is aligned with the user wrist pulse point. Here, the specific implementation manner of the nine module 19 is the same as or similar to that of the step S19, and therefore, the detailed description is omitted, and the detailed implementation manner is incorporated herein by reference.
FIG. 5 illustrates an exemplary system that can be used to implement the various embodiments described herein;
in some embodiments, as shown in FIG. 5, the system 300 can be implemented as any of the devices in the various embodiments described. In some embodiments, system 300 may include one or more computer-readable media (e.g., system memory or NVM/storage 320) having instructions and one or more processors (e.g., processor(s) 305) coupled with the one or more computer-readable media and configured to execute the instructions to implement modules to perform the actions described herein.
For one embodiment, system control module 310 may include any suitable interface controllers to provide any suitable interface to at least one of processor(s) 305 and/or any suitable device or component in communication with system control module 310.
The system control module 310 may include a memory controller module 330 to provide an interface to the system memory 315. Memory controller module 330 may be a hardware module, a software module, and/or a firmware module.
For one embodiment, system control module 310 may include one or more input/output (I/O) controllers to provide an interface to NVM/storage 320 and communication interface(s) 325.
For example, NVM/storage 320 may be used to store data and/or instructions. NVM/storage 320 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more Hard Disk Drives (HDDs), one or more Compact Disc (CD) drives, and/or one or more Digital Versatile Disc (DVD) drives).
NVM/storage 320 may include storage resources that are physically part of the device on which system 300 is installed or may be accessed by the device and not necessarily part of the device. For example, NVM/storage 320 may be accessible over a network via communication interface(s) 325.
Communication interface(s) 325 may provide an interface for system 300 to communicate over one or more networks and/or with any other suitable device. System 300 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols.
For one embodiment, at least one of the processor(s) 305 may be packaged together with logic for one or more controller(s) (e.g., memory controller module 330) of the system control module 310. For one embodiment, at least one of the processor(s) 305 may be packaged together with logic for one or more controller(s) of the system control module 310 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic for one or more controller(s) of the system control module 310. For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic for one or more controller(s) of the system control module 310 to form a system on a chip (SoC).
In various embodiments, system 300 may be, but is not limited to being: a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, system 300 may have more or fewer components and/or different architectures. For example, in some embodiments, system 300 includes one or more cameras, a keyboard, a Liquid Crystal Display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an Application Specific Integrated Circuit (ASIC), and speakers.
In addition to the methods and apparatus described in the embodiments above, the present application also provides a computer readable storage medium storing computer code that, when executed, performs the method as described in any of the previous items.
The present application also provides a computer program product, which when executed by a computer device, performs the method of any of the preceding claims.
The present application further provides a computer device, comprising:
one or more processors;
a memory for storing one or more computer programs;
the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any preceding claim.
It should be noted that the present application may be implemented in software and/or a combination of software and hardware, for example, implemented using Application Specific Integrated Circuits (ASICs), general purpose computers or any other similar hardware devices. In one embodiment, the software programs of the present application may be executed by a processor to implement the steps or functions described above. Likewise, the software programs (including associated data structures) of the present application may be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Additionally, some of the steps or functions of the present application may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
In addition, some of the present application may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or techniques in accordance with the present application through the operation of the computer. Those skilled in the art will appreciate that the forms of computer program instructions that reside on a computer-readable medium include, but are not limited to, source files, executable files, installation package files, and the like, and that the manner in which the computer program instructions are executed by a computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Computer-readable media herein can be any available computer-readable storage media or communication media that can be accessed by a computer.
Communication media includes media by which communication signals, including, for example, computer readable instructions, data structures, program modules, or other data, are transmitted from one system to another. Communication media may include conductive transmission media such as cables and wires (e.g., fiber optics, coaxial, etc.) and wireless (non-conductive transmission) media capable of propagating energy waves such as acoustic, electromagnetic, RF, microwave, and infrared. Computer readable instructions, data structures, program modules, or other data may be embodied in a modulated data signal, for example, in a wireless medium such as a carrier wave or similar mechanism such as is embodied as part of spread spectrum techniques. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. The modulation may be analog, digital or hybrid modulation techniques.
By way of example, and not limitation, computer-readable storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory such as random access memory (RAM, DRAM, SRAM); and non-volatile memory such as flash memory, various read-only memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic/ferroelectric memories (MRAM, feRAM); and magnetic and optical storage devices (hard disk, tape, CD, DVD); or other now known media or later developed that can store computer-readable information/data for use by a computer system.
An embodiment according to the present application comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or a solution according to the aforementioned embodiments of the present application.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not to denote any particular order.
Claims (12)
1. A method of determining target displacement information of a pulse measurement device, wherein the pulse measurement device comprises a cavity for accommodating a wrist of a user, a first laser emitting unit, a second laser emitting unit, a camera unit, and a pulse measurement unit, the method comprising:
shooting first image information and second image information of a wrist of a user through the camera unit when the first laser emitting unit and the second laser emitting unit are in an opening state and a closing state respectively, wherein the first image information comprises a first reference point and a second reference point, the first reference point and the second reference point are images of light emitting points of the first laser emitting unit and the second laser emitting unit in the first image information respectively, the second image information comprises a third reference point, and the third reference point is an image of a pulse point of the wrist of the user in the second image information;
determining first image position information and second image position information of the first reference point and the second reference point in the first image information respectively, and determining third image position information of the third reference point in the second image information;
determining a mapping relation between an image distance and an actual distance according to the first image position information, the second image position information and the position relation between the first laser emission unit and the second laser emission unit;
and determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information and the mapping relation between the image distance and the actual distance.
2. The method of claim 1, wherein the method captures first and second image information of a wrist of a user by the camera unit when the first and second laser emitting units are in on and off states, respectively, wherein the first image information includes a first reference point and a second reference point, the first and second reference points are images of a light emitting point of the first and second laser emitting units in the first image information, respectively, the second image information includes a third reference point, and the third reference point is before the imaging of a pulse point of the wrist of the user in the second image information, further comprising:
and driving the first laser emission unit and the second laser emission unit to move, so that light spots emitted by the first laser emission unit and the second laser emission unit are irradiated on the wrist of the user.
3. The method of claim 2, wherein the method further comprises:
and determining the position relation between the first laser emitting unit and the second laser emitting unit according to first displacement information and second displacement information generated by the movement of the first laser emitting unit and the second laser emitting unit.
4. The method according to claim 2 or 3, wherein the determining of the target displacement information of the pulse measurement unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information and the mapping relationship between the image distance and the actual distance comprises:
determining the position relation between the first laser emission unit or the second laser emission unit and the pulse measurement unit according to first displacement information or second displacement information generated by the movement of the first laser emission unit or the second laser emission unit;
and determining target displacement information of the pulse measuring unit and the pulse point of the wrist of the user in the horizontal direction according to the first image position information or the second image position information, the third image position information, the position relation between the first laser emitting unit or the second laser emitting unit and the pulse measuring unit and the mapping relation between the image distance and the actual distance.
5. The method of claim 1, wherein the method further comprises:
identifying the first reference point and the second reference point in the first image information;
identifying the third reference point in the second image information.
6. The method of claim 1, wherein the method further comprises:
and driving the pulse measuring unit and/or the cavity according to the target displacement information so as to enable the pulse measuring unit to be aligned with the wrist pulse point of the user.
7. The method of claim 6, wherein said driving the pulse measurement unit and/or the cavity to align the pulse measurement unit to the user's wrist pulse point according to the target displacement information comprises:
and driving the pulse measuring unit and/or the cavity according to the target displacement information and by combining the vertical distance information of the pulse measuring unit and the pulse point of the wrist of the user, so that the pulse measuring unit is aligned to the pulse point of the wrist of the user.
8. The method according to claim 6 or 7, wherein said driving the pulse measurement unit and/or the cavity to align the pulse measurement unit to the user wrist pulse point according to the target displacement information comprises:
determining target coordinate information for aligning the pulse measuring unit to the pulse point of the wrist of the user in a three-dimensional space according to the target displacement information and the vertical distance information between the pulse measuring unit and the pulse point of the wrist of the user;
and driving the pulse measuring unit and/or the cavity according to the target coordinate information so as to enable the pulse measuring unit to be aligned with the wrist pulse point of the user.
9. The method of any of claims 6 to 8, wherein the method further comprises:
the pressure signal of the wrist pulse point of the user is obtained through the pulse measuring unit, and the pulse measuring unit and/or the cavity body are driven to move in the vertical direction according to the magnitude relation between the amplitude information of the pressure signal and the pulse pressure signal threshold value information, so that the pulse measuring unit is aligned to the wrist pulse point of the user.
10. A computer device for determining target displacement information of a pulse measuring apparatus, comprising a memory, a processor and a computer program stored on the memory, characterized in that the processor executes the computer program to carry out the steps of the method according to any one of claims 1 to 9.
11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 9.
12. A computer program product comprising a computer program, characterized in that the computer program realizes the steps of the method of any one of claims 1 to 9 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210878780.4A CN115153457A (en) | 2022-07-25 | 2022-07-25 | Method and equipment for determining target displacement information of pulse measuring device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210878780.4A CN115153457A (en) | 2022-07-25 | 2022-07-25 | Method and equipment for determining target displacement information of pulse measuring device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115153457A true CN115153457A (en) | 2022-10-11 |
Family
ID=83497498
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210878780.4A Pending CN115153457A (en) | 2022-07-25 | 2022-07-25 | Method and equipment for determining target displacement information of pulse measuring device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115153457A (en) |
-
2022
- 2022-07-25 CN CN202210878780.4A patent/CN115153457A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107909612B (en) | Method and system for visual instant positioning and mapping based on 3D point cloud | |
| EP3466070B1 (en) | Method and device for obtaining image, and recording medium thereof | |
| CN112971740B (en) | Method and equipment for diagnosing pulse through pulse diagnosing equipment | |
| US20190011542A1 (en) | Method and apparatus for measuring angular resolution of multi-beam lidar | |
| US20130129224A1 (en) | Combined depth filtering and super resolution | |
| CN109032348B (en) | Intelligent manufacturing method and equipment based on augmented reality | |
| CN111311684B (en) | Method and equipment for initializing SLAM | |
| WO2023035829A1 (en) | Method for determining and presenting target mark information and apparatus | |
| CN107784671B (en) | Method and system for visual instant positioning and drawing | |
| CN111161347B (en) | Method and equipment for initializing SLAM | |
| CN109615664B (en) | Calibration method and device for optical perspective augmented reality display | |
| US11593960B2 (en) | Determining the relative position between a point cloud generating camera and another camera | |
| CN110264523B (en) | Method and equipment for determining position information of target image in test image | |
| JP2024509690A (en) | Method and apparatus for constructing three-dimensional maps | |
| CN109656364B (en) | Method and device for presenting augmented reality content on user equipment | |
| CN112057057B (en) | Method and apparatus for adjusting pulse measurement device and measuring pulse signal | |
| CN110572635A (en) | Method, equipment and system for tracking and positioning handheld control equipment | |
| US20210241467A1 (en) | Electronic apparatus and controlling method thereof | |
| CN115153457A (en) | Method and equipment for determining target displacement information of pulse measuring device | |
| CN112690766B (en) | Method and equipment for measuring pulse information of user by pulse feeling equipment | |
| CN110837295A (en) | Handheld control equipment and tracking and positioning method, equipment and system thereof | |
| CN110930312A (en) | Method and device for generating fisheye camera image | |
| US9053371B2 (en) | Method, system and computer program product for identifying a location of an object within a video sequence | |
| CN110892449A (en) | Image processing method and device and mobile device | |
| CN108776338A (en) | Signal source space method for sensing, device and active sensor-based system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |