WO2021254209A1 - 智能护理镜、智能护理设备、图像显示方法及系统 - Google Patents
智能护理镜、智能护理设备、图像显示方法及系统 Download PDFInfo
- Publication number
- WO2021254209A1 WO2021254209A1 PCT/CN2021/098789 CN2021098789W WO2021254209A1 WO 2021254209 A1 WO2021254209 A1 WO 2021254209A1 CN 2021098789 W CN2021098789 W CN 2021098789W WO 2021254209 A1 WO2021254209 A1 WO 2021254209A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- smart
- nursing
- care
- mirror
- Prior art date
Links
- 230000000474 nursing effect Effects 0.000 title claims abstract description 116
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000004891 communication Methods 0.000 claims description 53
- 238000012545 processing Methods 0.000 claims description 16
- 230000005855 radiation Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 8
- 230000006870 function Effects 0.000 description 13
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 239000000758 substrate Substances 0.000 description 5
- 239000011521 glass Substances 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000001680 brushing effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 208000006558 Dental Calculus Diseases 0.000 description 1
- 208000002064 Dental Plaque Diseases 0.000 description 1
- 241000628997 Flos Species 0.000 description 1
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000006210 lotion Substances 0.000 description 1
- 239000000178 monomer Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- HBMJWWWQQXIZIP-UHFFFAOYSA-N silicon carbide Chemical compound [Si+]#[C-] HBMJWWWQQXIZIP-UHFFFAOYSA-N 0.000 description 1
- 229910010271 silicon carbide Inorganic materials 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47G—HOUSEHOLD OR TABLE EQUIPMENT
- A47G1/00—Mirrors; Picture frames or the like, e.g. provided with heating, lighting or ventilating means
- A47G1/02—Mirrors used as equipment
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/0076—Body hygiene; Dressing; Knot tying
- G09B19/0084—Dental hygiene
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Definitions
- the present disclosure relates to the field of image display technology, and in particular to smart care mirrors, smart care equipment, image display methods and systems.
- Persisting in personal care contributes to people's health.
- the actual effect of care on the user's health is closely related to the user's way of care. Irregular care methods will threaten the user's health.
- the embodiments of the present disclosure provide a smart care mirror, smart care equipment, image display method and system.
- a smart nursing mirror which includes a camera component, a processor, and a mirror body display component;
- the camera component is configured to collect a target image in front of the smart care mirror, and the target image includes at least: a user image and a smart care device image;
- the processor is configured to obtain a care guidance video based on the user image and the smart care device image;
- the scope display assembly is configured to display the nursing instruction video.
- the mirror display assembly includes a transparent base layer, a transflective layer, and a display layer that are stacked, wherein the transflective layer and the display layer are located on both sides of the transparent base layer;
- the transflective layer includes a transflective area and a reflective area, and the light-emitting surface of the display layer is arranged corresponding to the transflective area;
- the reflective area is used to reflect incident light toward the light exit surface
- the transflective area is used to partially transmit and partially reflect the incident light toward the light exit surface, and transmit the light exiting from the light exit surface.
- a substrate layer is further provided between the transflective layer and the display layer.
- it also includes:
- the first communication component is configured to obtain a user's care record from the smart toothbrush in response to the smart care device being a smart toothbrush;
- the mirror body display assembly is further configured to display the care record of the user
- the nursing record includes: at least one of the current nursing duration, the number of consecutive nursing days, and the nursing score.
- the first communication component is a first near field communication component
- the first near field communication component is configured to perform a communication connection in response to a communication connection request of the second near field communication component of the smart toothbrush;
- the processor is further configured to control the camera assembly to perform image collection in response to the communication connection between the first near field communication component and the second near field communication component of the smart toothbrush.
- it also includes:
- the audio input component is configured to collect the user's voice information
- the processor is further configured to control the camera component to perform image collection when the voice information meets the voice wake-up standard.
- it also includes:
- the audio output component is configured to output audio data of the nursing guidance video.
- it further includes: an infrared sensor configured to collect heat radiation information of the current environment; and
- the processor is further configured to control the camera component to perform image collection in response to the thermal radiation information of the human body contained in the thermal radiation information of the current environment.
- a smart care device including:
- Toothbrush body
- the second communication component is configured to send the care record of the user to the first communication component of the smart care mirror.
- At least one identification mark is provided on the surface of the toothbrush body.
- an image display method which is applied to the above-mentioned smart nursing mirror, and the method includes:
- the target image in front of the smart care mirror, where the target image at least includes: a user image and a smart care device image;
- the nursing instruction video is displayed.
- the nursing guidance video includes: a virtual image of a person including a virtual image of a tooth, and a virtual image of a smart care device.
- the obtaining the nursing guidance video includes:
- the virtual image of the person and the virtual image of the smart care device are synthesized according to the second relative position to obtain the care guidance video.
- the virtual tooth image includes a highlighting mark
- the combination of the virtual image of the person and the virtual image of the smart care device according to the second relative position to obtain the care guidance video includes:
- the virtual image of the person including the virtual image of the culled tooth and the virtual image of the smart care device are synthesized to obtain the care guidance video.
- the method further includes:
- a nursing score is obtained, and the nursing score is displayed.
- an image display system includes the above-mentioned smart care mirror and smart care equipment, the smart care equipment including:
- Toothbrush body
- the second communication component is configured to send the care record of the user to the first communication component of the smart care mirror.
- At least one identification mark is provided on the surface of the toothbrush body.
- a computing processing device which includes:
- a memory in which computer-readable codes are stored
- One or more processors when the computer-readable code is executed by the one or more processors, the computing processing device executes the above-mentioned image display method.
- a computer program product including computer-readable code, which when the computer-readable code runs on a computing processing device, causes the computing processing device to execute the above-mentioned image display method.
- a non-transitory computer-readable storage medium in which computer instructions are stored, and when the computer instructions are executed by a processor, the foregoing image display method is implemented.
- FIG. 1 is a schematic structural diagram of a smart nursing mirror provided by an embodiment of the disclosure
- FIG. 2 is a schematic structural diagram of a mirror display assembly provided by an embodiment of the disclosure.
- FIG. 3 is a schematic structural diagram of another lens display assembly provided by an embodiment of the disclosure.
- FIG. 4 is a schematic structural diagram of another smart nursing mirror provided by an embodiment of the disclosure.
- FIG. 5 is a schematic structural diagram of a smart care device provided by an embodiment of the disclosure.
- FIG. 6 is a flowchart of steps of an image display method provided by an embodiment of the disclosure.
- FIG. 7 is a flowchart of steps of a method for acquiring a video according to an embodiment of the present disclosure
- FIG. 8 is a flowchart of steps of another video acquisition method provided by an embodiment of the present disclosure.
- Figure 9 is a flowchart of steps of a nursing evaluation method provided by related technologies.
- FIG. 10 schematically shows a block diagram of a computing processing device for executing the method according to the present disclosure.
- Fig. 11 schematically shows a storage unit for holding or carrying program codes for implementing the method according to the present disclosure.
- words such as “first” and “second” are used to distinguish the same items or similar items that have basically the same function and effect. This is only to clearly describe the technical solutions of the embodiments of the present disclosure, and cannot be understood. To indicate or imply relative importance or implicitly indicate the number of technical features indicated.
- the orientation or positional relationship indicated by the terms “inner”, “outer”, etc. are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, rather than indicating or It is implied that the device or element referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure.
- multiple times means two or more times, unless otherwise specifically defined.
- a smart nursing mirror 10 provided by an embodiment of the present disclosure, including: a camera component 101, a processor 102, and a mirror body display component 103;
- the camera component 101 is configured to collect a target image in front of the smart care mirror 10, and the target image includes at least a user image and a smart care device image.
- the camera component 101 can be a functional component with image acquisition function, can be integrated on the scope display component 103, or can be independently arranged outside the scope display component 103, as long as it can be used for the smart care mirror Image collection from the front is sufficient, and there is no specific limitation here.
- the target image is an image containing a user image and an image of a smart care device, and is specifically obtained by image capture by the camera component 101 when the user is in front of the smart care mirror 10.
- the user image refers to the image of the display area where the user is located in the target image
- the smart care device image refers to the image of the display area where the smart care device is located in the target image.
- the user can stand in front of the smart care mirror 10 during care, thereby triggering the smart care mirror 10 to collect images of the process of the user using the smart care equipment to perform care to obtain the target image.
- the smart care equipment may be toothbrushes, dental floss, facial masks, skin care lotions, etc. used for care, which can be specifically determined according to actual needs, and there is no limitation here.
- the processor 102 is configured to obtain a care guidance video based on the user image and the smart care device image.
- the type of the processor 102 (Central Processing Unit, CPU) is also not limited. It may be a single-chip microcomputer, an advanced reduced instruction set computing machine (Advanced RISC Machines, ARM), or a field programmable gate array (Field Programmable Gate Array). Programmable Gate Array, FPGA), etc., which can be determined according to actual design requirements.
- CPU Central Processing Unit
- FPGA Field Programmable Gate Array
- the nursing guidance video is a video that contains screen content that instructs the user to use the smart care device to take care of.
- the screen content of the nursing guidance video can be specifically determined according to the smart care device information such as the type and location of the smart care device in the smart care device image, and user information such as the user's body movement information, the user's gender, and the user's age in the user image. It can be understood that for different smart care equipment, the screen content of the nursing guidance video that needs to guide the user is different, and the user information such as the user's body movements, user gender, etc. is different, the screen content of the required nursing guidance video is also different.
- the way of obtaining the nursing guidance video based on the user image and the smart care device image can be determined according to actual needs, and is not limited here.
- the scope display assembly 103 is configured to display the nursing instruction video.
- the mirror display assembly 103 not only includes a mirror surface with a light reflection function, but also includes a display layer with an image display function.
- the appearance of the mirror display component 103 may be a mirror similar to a conventional square, circle, ellipse, etc., but the mirror body is integrated with a display component, so that the nursing guidance video can be displayed through the mirror.
- the image display area in the mirror display assembly 103 may be the entire mirror area of the mirror display assembly 103 or a partial mirror area.
- the mirror display component 103 does not display the nursing guidance video, the user can use it as a mirror.
- the image display area in the mirror display component 103 is a partial area of the mirror surface, it can also be used when displaying the nursing guidance video. Use the non-image display area of the mirror as a mirror.
- the smart nursing mirror provided by the present disclosure can collect images during the nursing process of the user when the user is performing personal care in front of the smart nursing mirror, and display the nursing guidance video according to the image of the user and the image of the smart nursing device. Instruct users to use smart care equipment for nursing care, so that users can easily obtain nursing guidance during the nursing process.
- the mirror display assembly 103 includes a transparent base layer 1031, a transflective layer 1032, and a display layer 1033 that are stacked, wherein the transflective layer 1032 and the display layer 1033 are located on the transparent substrate.
- the transflective layer 1032 includes a transflective area 10321 and a reflective area 10322, the light-emitting surface of the display layer 1033 is arranged corresponding to the transflective area 10321; the reflective area 10322 is used to face the The incident light on the light exit surface is reflected; the transflective area 10321 is used to partially transmit and partially reflect the incident light toward the light exit surface, and transmit the light emitted from the light exit surface.
- the transparent base layer 1031 may be made of light-transmitting materials such as transparent glass.
- the reflective area 10322 of the transflective layer 1032 can be made of opaque material such as silver powder, which can reflect all the light incident on the front of the smart care mirror 10.
- the transflective area 10321 of the transflective layer 1032 may have a transflective film made of a material with a certain light-transmitting ability, which can reflect part of the incident light and other parts of the light can pass through the transflective area 10321 of the transflective layer 1032, specifically reflecting and transmissive
- the light ratio can be determined according to actual needs and is not limited here.
- the display layer 1033 is a display screen bonded and connected to the transflective area 10321 of the transflective layer 1032.
- the type of the display layer is not limited, and it can be a liquid crystal display (LCD) screen, an organic light emitting diode (Organic Light- Emitting Diode (OLED) screen, Micro Light-Emitting Diode (Micro LED) screen and other semiconductor process display screens, can also be projection screens, LED screens, etc., and can be flat or curved, as long as it can be used The image is displayed.
- the display layer 1033 and the transparent base layer 1031 are bonded and connected to two opposite surfaces of the transflective layer 1032, respectively.
- the transparent base layer 1031 and the reflective area 10322 of the transflective layer 1032 are bonded and connected, and the reflective area 10322 of the transparent base layer 1031 is bonded and connected to the reflective area 10322 of the transflective layer 1032, due to the reflective area of the transflective layer 1032.
- 10322 can completely reflect light, so the first mirror area where the reflective layer is located can be used as a mirror. Since the transflective layer 1032 has a semi-transmissive effect, when the display layer 1033 is not performing image display, the transflective layer 1032 and the second mirror area of the transparent base layer 1031 can be used as mirrors.
- the transparent The optical layer can present the image displayed by the display layer 1033 through the transparent base layer 1031.
- a smart care mirror is provided with a transflective layer containing a reflective area and a transflective area, and a display layer is provided after the transflective layer.
- a transflective layer containing a reflective area and a transflective area
- a display layer is provided after the transflective layer.
- the transparent base layer 1031 is a glass layer; a substrate layer 1034 is also provided between the transflective layer 1032 and the display layer 1033.
- the substrate layer 1034 is a light-transmitting material with the characteristics of thermal conductivity, electrical conductivity, etc., such as: monomer crystals, silicon carbide, etc., which are not limited here.
- a substrate layer is provided between the light-transmitting layer and the display layer, thereby effectively improving the picture display effect of the display layer.
- the smart care mirror 10 further includes:
- the first communication component 104 is configured to obtain the user's care record from the smart toothbrush when the smart care device is a smart toothbrush.
- the first communication component 104 may have a functional component with a wireless data transmission function, and the wireless data transmission function may be implemented using, for example, Bluetooth, wireless network, mobile network, Near Field Communication (NFC), etc. , There is no limitation here.
- the first communication component 104 can communicate with the second communication component in the smart toothbrush, so that the care record of the user can be obtained.
- the nursing record includes: at least one of the current nursing duration, the number of consecutive nursing days, and the nursing score.
- the current care duration refers to the duration of the user's current care
- the number of consecutive care days refers to the number of consecutive days that the user performs care each day
- the care score refers to the evaluation score of the user's care, which can be based on the user's care
- the parameters of nursing body movement information, duration, frequency and other parameters are determined, and there is no limitation here.
- the scope display component 103 is also configured to display the care record of the user.
- the mirror body display assembly 103 may also display the care records obtained from the smart toothbrush, so that the user can learn about the care status of the user through the smart care mirror in real time.
- the first communication component 104 is a first near field communication component
- the first near field communication component is configured to communicate with the second near field communication component of the smart toothbrush.
- the first near field communication component and the second near field communication component refer to NFC, so that when the distance between the smart toothbrush and the smart care mirror is less than, for example, 1 meter or 50 cm, the smart toothbrush and the smart care mirror
- the first near field communication component and the second approach communication component can be used for communication connection.
- the processor 102 is further configured to control the camera component to perform image collection when the first near field communication component is communicatively connected with the second near field communication component of the smart toothbrush.
- the first near field communication component of the smart care mirror 10 when the user holds the smart toothbrush close to the smart care mirror 10, the first near field communication component of the smart care mirror 10 will automatically establish a communication connection with the second near field communication component of the smart toothbrush.
- the processor 102 will automatically power on the smart care mirror 10 and control the camera assembly 101 to collect images in front of the smart care mirror.
- the NFC is set in the smart care mirror, so that when the user holds the smart toothbrush close to the smart care mirror, the smart care mirror is automatically awakened for image collection, so that the user can conveniently obtain the care guidance video.
- the smart care mirror 10 further includes:
- the audio input component 105 is configured to collect voice information of the user.
- the audio input component 105 is a functional component such as a microphone having functions such as audio collection and recording, and can collect voice information of the user.
- the processor 102 is further configured to control the camera component to perform image collection when the voice information meets the voice wake-up standard.
- the voice wake-up criterion may be a judgment mechanism including criteria such as target voice content and duration, and it may be determined whether the smart care mirror 10 needs to be awakened according to the content contained in the user's voice information.
- the processor 102 can recognize the user's voice information through a preset voice recognition model, and determine whether to wake up the smart care mirror based on the content, duration and other parameters of the voice information according to the voice wake-up criteria, for example, the user's voice information is collected When the content is "magic mirror", "I want to brush my teeth", etc., wake up the smart nursing mirror.
- the embodiments of the present disclosure wake up the smart nursing mirror through the user's voice information, so that the user can conveniently obtain the nursing guidance video through the smart nursing mirror.
- the smart care mirror 10 further includes:
- the audio output component 106 is configured to output audio data of the nursing guidance video.
- the audio output component 106 may be a functional component with audio playback and audio transmission functions, and it may directly play the audio data of the nursing guidance video through the audio output component 106, or it may be a function of the nursing guidance video.
- the audio data is sent to other audio playback devices, such as the user's earphones, speakers, etc., for playback.
- the specifics can be determined according to actual needs and are not limited here.
- the smart care mirror 10 further includes an infrared sensor 107 configured to collect heat radiation information of the current environment.
- the infrared sensor 107 may be a sensor with infrared new line sensing function.
- an infrared probe may also be set in the infrared sensor 107 to obtain the heat of the current environment in front of the smart care mirror. Radiation information can be determined according to actual needs, and is not limited here.
- the processor 102 is further configured to control the camera assembly to perform image collection when the heat radiation information of the current environment includes human body heat radiation information.
- the human body thermal radiation analysis is performed on the thermal radiation information of the current environment collected by the infrared sensor 107 to determine whether the current environment has a human body heat source, that is, whether the thermal radiation information of the current environment contains human thermal radiation Information to determine whether the user is close to the smart care mirror 10.
- the processor 102 will wake up the smart nursing mirror.
- the infrared sensor automatically wakes up the smart care mirror when detecting that the user is close to the smart care mirror to provide the user with a care guidance video, so that the user can more conveniently obtain the care guidance video through the smart care mirror.
- a smart care device 20 provided by an embodiment of the present disclosure, which includes a toothbrush body 201 and a second communication component 202.
- the toothbrush body 201 includes structural components of a conventional toothbrush such as bristles and a brush rod.
- the material of the toothbrush body 201 can be wood, rubber, etc., which is not limited here.
- the second communication component 202 is configured to send the user's care record to the first communication component of the smart care mirror.
- the second communication component 202 may be a functional component with a wireless data transmission function.
- the wireless data transmission function may be, for example, Bluetooth, wireless network, mobile network, Near Field Communication (NFC), etc. Realization, there is no limitation here.
- the smart care device in the embodiment of the present disclosure sends the user's care record to the smart care mirror through the second communication component, so that the user can learn about the care status of the user in real time through the smart care mirror.
- At least one identification mark 2011 is provided on the surface of the toothbrush body 201.
- the identification mark may be a mark of a specific color and shape, such as a circular red dot, a black square, etc., and the smart care mirror of the user recognizes the smart care device, so that the data of the smart care mirror can be processed.
- Step 301 Collect a target image in front of the smart care mirror, where the target image at least includes: a user image and a smart care device image.
- Step 302 Obtain a nursing guidance video based on the user image and the smart care device image.
- Step 303 Display the nursing guidance video.
- Steps 301 to 302 and the embodiments can refer to the detailed description of the smart nursing mirror in the embodiment, and to avoid repetition, the details are not repeated here.
- the image display method provided by the present disclosure can collect images during the nursing process of the user when the user is taking care in front of the smart nursing mirror, and display the nursing guidance video according to the user image and the smart nursing device image, so as to check
- the user uses the intelligent care device to provide nursing guidance, so that the user can conveniently obtain nursing guidance during the nursing process.
- the nursing guidance video includes: a virtual image of a person including a virtual image of a tooth, and a virtual image of a smart care device.
- the virtual tooth image is an image that simulates the user's teeth in the virtual image of a person, and can be highlighted by means of highlighting, zooming, and the like.
- the step 302 includes:
- Sub-step 3021 Obtain a first relative position of the smart care device image and the user image in the target image.
- the first relative position of the smart care device image and the user image is the relative position of the smart care device image and the user image in the target image, which may specifically be the relative distance and the image coordinates.
- a second relative position of the virtual image of the person and the virtual image of the smart care device is obtained according to the first relative position and the preset care guidance rule.
- the preset care guide rules are rules formulated in advance based on standardized care methods, for example, when the smart care device is a toothbrush, rules regarding the order and duration of tooth brushing position and so on.
- the virtual image of the character and the virtual image of the smart care device refer to 3D images, animated images, etc. that simulate the user and the smart care device respectively, and are not limited here.
- the second relative position refers to the relative position between the virtual image of the smart care device and the virtual image of the user in the required nursing guidance video.
- sub-step 3023 the virtual image of the person and the virtual image of the smart care device are synthesized according to the second relative position to obtain a care guidance video.
- the virtual image of the person and the virtual image of the smart care device can be synthesized according to the second relative position to obtain the nursing guidance video.
- the embodiments of the present disclosure display an adaptive nursing guidance video to the user according to the relative position between the user’s smart care equipment and the user during the nursing process, so that the displayed nursing guidance video can be more in line with the actual needs of the user and improve Effectiveness of nursing instruction.
- the virtual tooth image includes a highlighting mark.
- the sub-step 3023 includes:
- sub-step 30231 according to the second relative position, the overlapping area between the virtual image of the tooth and the virtual image of the smart care device for a preset period of time is taken as the target area.
- the highlighted logo refers to a logo image that simulates dental plaque, tartar, stains, etc., and is used to remind the user which parts of the site need to be cared for.
- the nursing guidance video changes in real time based on the position of the user’s image and the image of the smart care device.
- the nursing guidance video will guide the user to take care of each area of the tooth in turn, and if the content of the nursing guidance video has instructed the user to After taking care of a certain area of the teeth, it is necessary to inform the user that the area has been taken care of.
- the overlapping area between the virtual image of the tooth and the virtual image of the smart care device in the nursing guidance video can be determined as the target area of the care that has been performed for a preset period of time.
- the preset period of time can be, for example, 2s, 3s, etc., which can be specifically based on The actual requirements are determined, and there is no limitation here.
- sub-step 30232 the highlighted mark of the target area on the virtual tooth image is removed to obtain the virtual tooth image after the removal.
- the highlighted sign in the target area determined on the virtual tooth image is removed, so as to obtain the virtual tooth image that can prompt the user to take care of the area.
- sub-step 30233 according to the second relative position, the virtual image of the person including the virtual image of the culled tooth and the virtual image of the smart care device are synthesized to obtain the care guidance video.
- the virtual image of the user with the highlighted sign removed and the virtual image of the smart care device are synthesized to obtain a nursing guidance video that can remind the user of the area on the teeth that has been treated, which improves the interest of the nursing guidance .
- the method further includes:
- Step 304 Collect the user's care image.
- the user's care image The image of the user's care process is specifically collected after the care guidance video is displayed.
- Step 305 Acquire the first position of the smart care device image in the user's care image and the second position of the smart care device virtual image in the care guidance video.
- the first position is used to indicate the position of the smart care device in the process of actual care by the user
- the second position is used to indicate the position of the smart care device in the displayed nursing guidance video.
- Step 306 The first position and the second position are compared to obtain the coincidence degree and coincidence time of the smart care device image and the smart care device virtual image.
- the degree of coincidence between the first position and the second position, and the total length of time during which the degree of coincidence is greater than the coincidence degree threshold is determined, that is, the coincidence time.
- Step 307 Obtain a nursing score according to the coincidence degree and the coincidence time, and display the nursing score.
- the user's performance of nursing with reference to the nursing guidance video can be scored according to the degree of overlap and the overlap time.
- the scoring mechanism may be that the higher the degree of overlap, the higher the score, the longer the overlap time, the higher the score, and vice versa. Low, of course, other scoring mechanisms can also be set, which can be determined according to actual needs, and there is no limitation here.
- the user’s care is scored by comparing the actual operation of the smart care device with the guidance operation of the care guidance video during the care process, so that the user can easily understand the situation of their own care and improve The fun of nursing guidance.
- the embodiments of the present disclosure provide an image display system, including the smart care mirror and smart care equipment provided in the above embodiments.
- the device embodiments described above are merely illustrative, where the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement without creative work.
- the various component embodiments of the present disclosure may be implemented by hardware, or by software modules running on one or more processors, or by a combination of them.
- a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the computing processing device according to the embodiments of the present disclosure.
- DSP digital signal processor
- the present disclosure can also be implemented as a device or device program (for example, a computer program and a computer program product) for executing part or all of the methods described herein.
- Such a program for realizing the present disclosure may be stored on a computer-readable medium, or may have the form of one or more signals.
- Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
- FIG. 10 shows a computing processing device that can implement the method according to the present disclosure.
- the computing processing device traditionally includes a processor 1010 and a computer program product in the form of a memory 1020 or a computer readable medium.
- the memory 1020 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
- the memory 1020 has a storage space 1030 for executing program codes 1031 of any method steps in the above methods.
- the storage space 1030 for program codes may include various program codes 1031 respectively used to implement various steps in the above method. These program codes can be read from or written into one or more computer program products.
- These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards, or floppy disks.
- Such a computer program product is usually a portable or fixed storage unit as described with reference to FIG. 11.
- the storage unit may have storage segments, storage spaces, and the like arranged similarly to the memory 1020 in the computing processing device of FIG. 10.
- the program code can be compressed in an appropriate form, for example.
- the storage unit includes computer-readable codes 1031', that is, codes that can be read by, for example, a processor such as 1010. These codes, when run by a computing processing device, cause the computing processing device to execute the method described above. The various steps.
- any reference signs placed between parentheses should not be constructed as a limitation to the claims.
- the word “comprising” does not exclude the presence of elements or steps not listed in the claims.
- the word “a” or “an” preceding an element does not exclude the presence of multiple such elements.
- the present disclosure can be realized by means of hardware including several different elements and by means of a suitably programmed computer. In the unit claims that list several devices, several of these devices may be embodied in the same hardware item.
- the use of the words first, second, and third, etc. do not indicate any order. These words can be interpreted as names.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Public Health (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Biomedical Technology (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Pathology (AREA)
- Data Mining & Analysis (AREA)
- Physical Education & Sports Medicine (AREA)
- Biophysics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Entrepreneurship & Innovation (AREA)
- User Interface Of Digital Computer (AREA)
- Mirrors, Picture Frames, Photograph Stands, And Related Fastening Devices (AREA)
Abstract
Description
Claims (20)
- 一种智能护理镜,包括摄像组件、处理器和镜体显示组件;所述摄像组件被配置为采集所述智能护理镜前方的目标图像,所述目标图像至少包括:用户图像和智能护理设备图像;所述处理器被配置为根据所述用户图像和所述智能护理设备图像,获取护理指导视频;并且所述镜体显示组件被配置为显示所述护理指导视频。
- 根据权利要求1所述的智能护理镜,其中,所述镜体显示组件包括层叠设置的透明基底层、透射反射层及显示层,其中,所述透射反射层及所述显示层位于所述透明基底层的两侧;所述透射反射层包括透反区及反射区,所述显示层的出光面与所述透反区对应设置;所述反射区用于对朝向所述出光面的入射光进行反射;并且所述透反区用于对朝向所述出光面的入射光部分透射、部分反射,并对从出光面出射的光进行透射。
- 根据权利要求2所述的智能护理镜,其中,所述透射反射层及所述显示层之间还设置有衬底层。
- 根据权利要求1所述的智能护理镜,其中,还包括:第一通信组件,被配置为响应于所述智能护理设备为智能牙刷,从所述智能牙刷获取用户的护理记录;所述镜体显示组件,还被配置为显示所述用户的护理记录;其中,所述护理记录包括:当前护理时长、连续护理天数、护理评分中的至少一项。
- 根据权利要求4所述智能护理镜,其中,所述第一通信组件为第一近场通信组件;所述第一近场通信组件被配置为响应于所述智能牙刷的第二近场通信组件通信连接的请求进行通信连接;并且所述处理器还被配置为响应于所述第一近场通信组件与所述智能牙刷的第二近场通信组件通信连接,控制所述摄像组件进行图像采集。
- 根据权利要求1所述的智能护理镜,还包括:音频输入组件,被配置为采集用户的语音信息;所述处理器还被配置为在所述语音信息符合语音唤醒标准的情况下,控制所述摄像组件进行图像采集。
- 根据权利要求1所述的智能护理镜,其中,还包括:音频输出组件,被配置为输出所述护理指导视频的音频数据。
- 根据权利要求1所述的智能护理镜,其中,还包括:红外传感器,被配置为采集当前环境的热辐射信息;所述处理器还被配置为响应于所述当前环境的热辐射信息中包含人体热辐射信息,控制所述摄像组件进行图像采集。
- 一种智能护理设备,包括:牙刷主体;以及第二通信组件,被配置为向智能护理镜的第一通信组件发送用户的护理记录。
- 根据权利要求9所述的方法,其中,所述牙刷主体表面设置有至少一个识别标志。
- 一种图像显示方法,应用于权利要求1至8任一项所述的智能护理镜,其中,所述方法包括:采集所述智能护理镜前方的所述目标图像,所述目标图像至少包括:用户图像和智能护理设备图像;根据所述用户图像和所述智能护理设备图像,获取所述护理指导视频;以及显示所述护理指导视频。
- 根据权利要求11所述的方法,其中,所述护理指导视频包括:包含牙齿虚拟图像的人物虚拟图像,和智能护理设备虚拟图像。
- 根据权利要求12所述的方法,所述获取所述护理指导视频,包括:获取所述目标图像中所述智能护理设备图像和所述用户图像的第一相对位置;根据所述第一相对位置和预设护理指导规则,获取所述人物虚拟图像和所述智能护理设备虚拟图像的第二相对位置;以及根据所述第二相对位置将所述人物虚拟图像和所述智能护理设备虚拟图 像进行合成,得到所述护理指导视频。
- 根据权利要去13所述的方法,其中,所述牙齿虚拟图像上包含突出显示标志,所述根据所述第二相对位置将所述人物虚拟图像和所述智能护理设备虚拟图像进行合成,得到所述护理指导视频,包括:根据所述第二相对位置,将所述牙齿虚拟图像和所述智能护理设备虚拟图像之间持续预设时长的重合区域作为目标区域;剔除所述牙齿虚拟图像上所述目标区域的突出显示标志,得到剔除后的牙齿虚拟图像;以及根据所述第二相对位置将包含所述剔除后的牙齿虚拟图像的人物虚拟图像和所述智能护理设备虚拟图像进行合成,得到所述护理指导视频。
- 根据权利要求12所述的方法,其中,在所述显示所述护理指导视频之后,还包括:采集用户的护理图像;获取所述用户的护理图像中所述智能护理设备图像的第一位置,以及所述护理指导视频中所述智能护理设备虚拟图像的第二位置;将所述第一位置和第二位置进行比对,得到所述智能护理设备图像和所述智能护理设备虚拟图像的重合度和重合时间;以及根据所述重合度和所述重合时间,得到护理评分,并显示所述护理评分。
- 一种图像显示系统,其中,所述系统包括权利要求1至8所述的智能护理镜,以及智能护理设备,所述智能护理设备包括:牙刷主体;以及第二通信组件,被配置为向所述智能护理镜的第一通信组件发送用户的护理记录。
- 根据权利要求16所述的图像显示系统,其中,所述牙刷主体表面设置有至少一个识别标志。
- 一种计算处理设备,其中,包括:存储器,其中存储有计算机可读代码;以及一个或多个处理器,当所述计算机可读代码被所述一个或多个处理器执行时,所述计算处理设备执行如权利要求11-15中任一项所述的图像显示方法。
- 一种计算机程序产品,包括计算机可读代码,当所述计算机可读代码在计算处理设备上运行时,导致所述计算处理设备执行根据权利要求11-15中任一项所述的图像显示方法。
- 一种非瞬态计算机可读存储介质,其中存储了计算机指令,所述计算机指令被处理器执行时实现如权利要求11-15中任一项所述的图像显示方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/775,457 US20220386793A1 (en) | 2020-06-17 | 2021-06-08 | Intelligent nursing mirror, intelligent nursing device, and image display method and system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010553875.XA CN111726580B (zh) | 2020-06-17 | 2020-06-17 | 智能护理镜、智能护理设备、图像显示方法及系统 |
CN202010553875.X | 2020-06-17 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021254209A1 true WO2021254209A1 (zh) | 2021-12-23 |
Family
ID=72567163
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/098789 WO2021254209A1 (zh) | 2020-06-17 | 2021-06-08 | 智能护理镜、智能护理设备、图像显示方法及系统 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20220386793A1 (zh) |
CN (1) | CN111726580B (zh) |
WO (1) | WO2021254209A1 (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111726580B (zh) * | 2020-06-17 | 2022-04-15 | 京东方科技集团股份有限公司 | 智能护理镜、智能护理设备、图像显示方法及系统 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015021895A1 (zh) * | 2013-08-11 | 2015-02-19 | Wang Yongjing | 口腔护理系统及方法 |
US20160295038A1 (en) * | 2004-01-30 | 2016-10-06 | Ip Holdings, Inc. | Image and Augmented Reality Based Networks Using Mobile Devices and Intelligent Electronic Glasses |
CN108037823A (zh) * | 2017-11-30 | 2018-05-15 | 深圳云天励飞技术有限公司 | 信息推荐方法、智能镜子及计算机可读存储介质 |
CN108776663A (zh) * | 2018-04-17 | 2018-11-09 | 深圳市赛亿科技开发有限公司 | 智能镜子及其控制方法、计算机可读存储介质 |
CN110087106A (zh) * | 2019-04-18 | 2019-08-02 | 杰哈思文化创意(杭州)有限公司 | 刷牙视频的播放方法、装置、存储介质和终端 |
CN110109553A (zh) * | 2019-05-24 | 2019-08-09 | 京东方科技集团股份有限公司 | 一种智能镜子和显示方法 |
CN110322024A (zh) * | 2019-06-21 | 2019-10-11 | 上海翊视皓瞳信息科技有限公司 | 一种基于穿戴设备的工作指导系统及方法 |
CN111726580A (zh) * | 2020-06-17 | 2020-09-29 | 京东方科技集团股份有限公司 | 智能护理镜、智能护理设备、图像显示方法及系统 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102018363A (zh) * | 2009-09-21 | 2011-04-20 | 熊正雄 | 一种刷牙方式语音教学指导牙刷 |
KR101494301B1 (ko) * | 2014-07-22 | 2015-02-24 | (주)지란지교소프트 | 스마트 미러 장치 |
CN104199542A (zh) * | 2014-08-20 | 2014-12-10 | 百度在线网络技术(北京)有限公司 | 一种智能镜实现方法、装置和智能镜 |
KR20160123644A (ko) * | 2015-04-16 | 2016-10-26 | (주) 사름 | 스마트 미러 장치 및 사용자 맞춤형 영상 제공 방법 |
CN107637957A (zh) * | 2017-09-14 | 2018-01-30 | 彭程伟 | 基于终端智能镜的交互式智能牙刷及其系统 |
CN107832719B (zh) * | 2017-11-15 | 2020-09-04 | 西藏班公湖藏药材开发有限责任公司 | 刷牙分析方法、装置及刷牙系统 |
CN108525261A (zh) * | 2018-05-22 | 2018-09-14 | 深圳市赛亿科技开发有限公司 | 一种智能镜子健身指导方法及系统 |
CN108741612A (zh) * | 2018-08-07 | 2018-11-06 | 南京林业大学 | 一种劝导式儿童刷牙系统和装置 |
-
2020
- 2020-06-17 CN CN202010553875.XA patent/CN111726580B/zh active Active
-
2021
- 2021-06-08 US US17/775,457 patent/US20220386793A1/en active Pending
- 2021-06-08 WO PCT/CN2021/098789 patent/WO2021254209A1/zh active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160295038A1 (en) * | 2004-01-30 | 2016-10-06 | Ip Holdings, Inc. | Image and Augmented Reality Based Networks Using Mobile Devices and Intelligent Electronic Glasses |
WO2015021895A1 (zh) * | 2013-08-11 | 2015-02-19 | Wang Yongjing | 口腔护理系统及方法 |
CN108037823A (zh) * | 2017-11-30 | 2018-05-15 | 深圳云天励飞技术有限公司 | 信息推荐方法、智能镜子及计算机可读存储介质 |
CN108776663A (zh) * | 2018-04-17 | 2018-11-09 | 深圳市赛亿科技开发有限公司 | 智能镜子及其控制方法、计算机可读存储介质 |
CN110087106A (zh) * | 2019-04-18 | 2019-08-02 | 杰哈思文化创意(杭州)有限公司 | 刷牙视频的播放方法、装置、存储介质和终端 |
CN110109553A (zh) * | 2019-05-24 | 2019-08-09 | 京东方科技集团股份有限公司 | 一种智能镜子和显示方法 |
CN110322024A (zh) * | 2019-06-21 | 2019-10-11 | 上海翊视皓瞳信息科技有限公司 | 一种基于穿戴设备的工作指导系统及方法 |
CN111726580A (zh) * | 2020-06-17 | 2020-09-29 | 京东方科技集团股份有限公司 | 智能护理镜、智能护理设备、图像显示方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
CN111726580B (zh) | 2022-04-15 |
CN111726580A (zh) | 2020-09-29 |
US20220386793A1 (en) | 2022-12-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN208689385U (zh) | 电子手表、电子设备和可穿戴电子设备 | |
US11819108B2 (en) | Smart mirror system and methods of use thereof | |
CN105891136B (zh) | 多点测量配件、多点测量装置与多点测量系统 | |
CN109154860A (zh) | 情感/认知状态触发记录 | |
CN110192248A (zh) | 语音输入处理方法和用于支持该方法的电子设备 | |
TWI581178B (zh) | 混合實境顯示器中使用者控制的真實物件的消失 | |
CN109814719B (zh) | 一种基于穿戴眼镜的显示信息的方法与设备 | |
CN110024370A (zh) | 电子装置以及在电子装置中显示用于虹膜辨识的图像的方法 | |
CN104919396B (zh) | 在头戴式显示器中利用身体握手 | |
CN108604116A (zh) | 能够进行眼睛追踪的可穿戴设备 | |
CN109154858A (zh) | 智能电子设备及其操作方法 | |
CN109890266B (zh) | 用于通过捕捉眼睛获得信息的方法和设备 | |
WO2021254209A1 (zh) | 智能护理镜、智能护理设备、图像显示方法及系统 | |
CN108462818A (zh) | 电子设备及用于在该电子设备中显示360度图像的方法 | |
US11782271B2 (en) | Augmented reality device and methods of use | |
CN108761513A (zh) | 定位方法、电子设备和存储介质 | |
CN108089700A (zh) | 用于显示图像的电子设备及其控制方法 | |
CN202276404U (zh) | 固定便携两用医用远红外摄像头 | |
US10952662B2 (en) | Analysis of cognitive status through object interaction | |
KR20190062722A (ko) | 치과 발치 훈련 시스템 | |
TWI463428B (zh) | 自動移動健康照護裝置 | |
RU2767716C1 (ru) | Система обучения для гигиенического оборудования | |
US11589761B2 (en) | Electronic devices having optical sensors with curved laminated films | |
CN205306977U (zh) | 便携式非接触创口面积测量装置 | |
WO2015109907A1 (zh) | 检测头戴式智能设备持续附着在人体上的装置和方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21824789 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21824789 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03-07-2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21824789 Country of ref document: EP Kind code of ref document: A1 |