CN112315463B - Infant hearing test method and device and electronic equipment - Google Patents
Infant hearing test method and device and electronic equipment Download PDFInfo
- Publication number
- CN112315463B CN112315463B CN202011207637.XA CN202011207637A CN112315463B CN 112315463 B CN112315463 B CN 112315463B CN 202011207637 A CN202011207637 A CN 202011207637A CN 112315463 B CN112315463 B CN 112315463B
- Authority
- CN
- China
- Prior art keywords
- infant
- feature information
- facial expression
- facial
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/12—Audiometering
- A61B5/121—Audiometering evaluating hearing capacity
- A61B5/125—Audiometering evaluating hearing capacity objective methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Molecular Biology (AREA)
- Evolutionary Computation (AREA)
- Otolaryngology (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- General Engineering & Computer Science (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Image Analysis (AREA)
Abstract
An infant hearing test method, device and electronic equipment, the method comprising the steps of: acquiring a first facial image of an infant; extracting first facial expression feature information of the infant according to the first facial image; sending a test sound to the infant; acquiring a second face image of the infant; extracting second facial expression feature information of the infant according to the second facial image; analyzing the first facial expression feature information and the second facial expression feature information; and outputting a hearing test report according to the analysis result. According to the infant hearing test method and device and the electronic equipment, the infant facial expressions are identified based on the computing equipment, especially the infant facial expressions are identified based on the preset image processing and identifying model, the requirements of judging the infant facial expressions on relevant experience of doctors can be obviously reduced, the infant facial expression judgment accuracy is improved, and the hearing test accuracy is improved.
Description
Technical Field
The invention belongs to the technical field of hearing tests, and particularly relates to a method and a device for testing the hearing of an infant and an electronic device.
Background
When the human body is subjected to health examination, the hearing test is a necessary detection item, and whether the human body is in normal hearing can be detected. When detecting, a doctor can use the testing equipment to send a section of voice, and requires the person to be tested to repeat the voice, and judges the hearing condition of the person according to the repeat accuracy.
At present, when behavior audiometry is performed on preschool children, different response modes are generally selected according to the ages of the children. In the hearing test of children, sound reproduction is generally adopted in clinic, and if the children can be matched with the hearing test more accurately, the children may use a hand-lifting mode to represent that the sounds are heard.
At present, the audiometry of the child behavior is mainly completed by 2 workers, one teacher is responsible for audiometry, and the other teacher is responsible for teaching the child to guide the child. However, some children have weak patience in the testing process, sometimes do not have confidence and are small in size, and are afraid of mistakes. At this time, some experienced doctors can observe the facial expression changes of the children to judge whether the children hear the sound, but the situation needs very much experience of the doctors and is not practical.
Disclosure of Invention
In order to solve the above problems, the present invention provides a hearing test method for infants, the method comprising the steps of:
acquiring a first face image of an infant;
extracting first facial expression feature information of the infant according to the first facial image;
sending a test sound to the infant;
acquiring a second face image of the infant;
extracting second facial expression feature information of the infant according to the second facial image;
analyzing the first facial expression feature information and the second facial expression feature information;
and outputting a hearing test report according to the analysis result.
Preferably, the acquiring of the first facial image of the infant comprises the steps of:
presetting an image pickup device and an image processing device;
orienting the camera towards an infant;
connecting the image processing apparatus with the image pickup apparatus;
shooting a first original face image of an infant by using the camera;
sending the first original face image to the image processing device;
processing the first original face image using the image processing device and obtaining the first face image.
Preferably, the extracting the first facial expression feature information of the infant according to the first facial image comprises the following steps:
acquiring an image processing identification model;
acquiring the first face image;
inputting the first facial image into the image processing recognition model;
and acquiring the first facial expression characteristic information output by the image processing and identifying model.
Preferably, the sending of the test sound to the infant comprises the steps of:
presetting a sound sending device and a sound storage device;
directing the sound transmitting device toward an infant;
connecting the sound storage device with the sound transmission device;
transmitting a preset sound to the sound transmitting apparatus using the sound storage apparatus;
and sending a preset sound to the infant by using the sound sending equipment.
Preferably, the acquiring of the second face image of the infant comprises the steps of:
acquiring an image pickup device and an image processing device;
orienting the camera towards an infant;
connecting the image processing apparatus with the image pickup apparatus;
shooting a second original face image of the infant by using the camera;
sending the second original facial image to the image processing device;
processing the second original face image using the image processing device and obtaining the second face image.
Preferably, the extracting second facial expression feature information of the infant according to the second facial image comprises the following steps:
acquiring an image processing identification model;
acquiring the second face image;
inputting the second facial image into the image processing recognition model;
and acquiring the second facial expression characteristic information output by the image processing and identifying model.
Preferably, the analyzing the first facial expression feature information and the second facial expression feature information includes the steps of:
acquiring the first facial expression feature information and the second facial expression feature information;
judging whether the first facial expression feature information and the second facial expression feature information corresponding to the same position are changed or not;
if yes, acquiring facial expression feature changes;
if not, returning to the step of judging whether the first facial expression characteristic information and the second facial expression characteristic information corresponding to the same position are changed or not.
Preferably, the outputting of the hearing test report according to the analysis result includes the steps of:
acquiring the total number of all facial expression features;
acquiring the total number of the changed facial expression features;
calculating the ratio of the total number of the changed facial expression features to the total number of the facial expression features;
judging whether the ratio exceeds a preset value or not;
if yes, judging that the infant hears the sound;
if not, the infant is judged not to hear the sound.
The invention also provides a hearing test device for infants, and the method comprises the following steps:
the first acquisition module is used for acquiring a first facial image of an infant;
the first extraction module is used for extracting first facial expression feature information of the infant according to the first facial image;
the sound sending module is used for sending test sounds to the infant;
the second acquisition module is used for acquiring a second facial image of the infant;
the second extraction module is used for extracting second facial expression feature information of the infant according to the second facial image;
the analysis module is used for analyzing the first facial expression characteristic information and the second facial expression characteristic information;
and the output module is used for outputting the hearing test report according to the analysis result.
The present invention also provides an electronic device, including:
at least one processor; and (c) a second step of,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the infant hearing test method of any of claims 1-8.
The infant hearing test method, the infant hearing test device and the electronic equipment have the following beneficial effects:
(1) The method comprises the steps that facial images of infants are obtained through camera equipment, and facial expression feature information is extracted, so that the accuracy of judging the facial expressions of the infants is greatly improved;
(2) The infant facial expression recognition method based on the image processing recognition model has the advantages that the infant facial expression is recognized based on the computing equipment, particularly the infant facial expression is recognized based on the preset image processing recognition model, requirements of judging the infant facial expression on relevant experience of doctors can be remarkably reduced, the infant facial expression judgment accuracy is improved, and the accuracy of hearing tests is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of a hearing test method for infants according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a hearing test device for infants according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an electronic device provided by an embodiment of the invention;
fig. 4 is a schematic diagram of a storage medium according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings in conjunction with the following detailed description. It is to be understood that these descriptions are only illustrative and are not intended to limit the scope of the present invention. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present invention.
In an embodiment of the present application, as shown in fig. 1, the present invention provides a method for testing hearing of an infant, the method comprising the steps of:
s1: acquiring a first face image of an infant;
s2: extracting first facial expression feature information of the infant according to the first facial image;
s3: sending a test sound to the infant;
s4: acquiring a second face image of the infant;
s5: extracting second facial expression feature information of the infant according to the second facial image;
s6: analyzing the first facial expression feature information and the second facial expression feature information;
s7: and outputting a hearing test report according to the analysis result.
When the hearing test of the infants is carried out, firstly, first facial images of the infants are obtained, then, first facial expression feature information of the infants is extracted according to the first facial images, and then, test sounds are sent to the infants; then acquiring a second facial image of the infant, and extracting second facial expression feature information of the infant according to the second facial image; and then analyzing the first facial expression characteristic information and the second facial expression characteristic information, and outputting a hearing test report according to an analysis result.
In an embodiment of the present application, the acquiring the first facial image of the infant in step S1 includes:
presetting a camera device and an image processing device;
orienting the camera towards an infant;
connecting the image processing apparatus with the image pickup apparatus;
shooting a first original face image of an infant by using the camera device;
sending the first original face image to the image processing device;
processing the first original face image using the image processing device and obtaining the first face image.
In the embodiment of the application, when a first facial image of an infant is acquired, an image pickup device and an image processing device are preset firstly, the image pickup device faces the infant, and the image processing device is connected with the image pickup device; then, a first original face image of the infant is shot by the image shooting device, the first original face image is sent to the image processing device, and then the first original face image is processed by the image processing device to obtain the first face image.
In the embodiment of the present application, the extracting of the first facial expression feature information of the infant from the first facial image in step S2 includes:
acquiring an image processing identification model;
acquiring the first face image;
inputting the first facial image into the image processing recognition model;
and acquiring the first facial expression characteristic information output by the image processing and identifying model.
In an embodiment of the present application, the image processing recognition model includes: linear regression classification models, neural network models, support Vector Machine (SVM) models, hidden markov models, and the like; the first facial expression feature information includes: eye feature information, eyebrow feature information, mouth feature information, and the like.
In the embodiment of the present application, the sending of the test sound to the infant in step S3 includes the steps of:
presetting a sound sending device and a sound storage device;
directing the sound transmitting device toward an infant;
connecting the sound storage device with the sound transmission device;
transmitting a preset sound to the sound transmitting apparatus using the sound storage apparatus;
and sending a preset sound to the infant by using the sound sending equipment.
In the embodiment of the application, when the test sound is sent to the infant, a sound sending device and a sound storage device are preset firstly, the sound sending device faces the infant, and the sound storage device is connected with the sound sending device; and then transmitting a preset sound to the sound transmitting device by using the sound storage device, and transmitting the preset sound to the infant by using the sound transmitting device.
In the embodiment of the present application, the acquiring of the second face image of the infant in step S4 includes the steps of:
acquiring an image pickup device and an image processing device;
orienting the camera towards an infant;
connecting the image processing apparatus with the image pickup apparatus;
shooting a second original face image of the infant by using the camera;
sending the second original facial image to the image processing device;
processing the second original face image using the image processing device and obtaining the second face image.
In the embodiment of the application, when acquiring the second face image of the infant, firstly acquiring the image pickup device and the image processing device, and facing the image pickup device to the infant, and simultaneously connecting the image processing device and the image pickup device; then shooting a second original face image of the infant by using the camera equipment, sending the second original face image to the image processing equipment, and processing the second original face image by using the image processing equipment to obtain the second face image.
In an embodiment of the present application, the extracting, in step S5, second facial expression feature information of the infant from the second facial image includes:
acquiring an image processing identification model;
acquiring the second face image;
inputting the second facial image into the image processing recognition model;
and acquiring the second facial expression characteristic information output by the image processing and identifying model.
In an embodiment of the present application, the image processing recognition model includes: linear regression classification models, neural network models, support Vector Machine (SVM) models, hidden markov models, and the like; the second facial expression feature information includes: eye feature information, eyebrow feature information, mouth feature information, and the like.
In this embodiment of the present application, the analyzing the first facial expression feature information and the second facial expression feature information in step S6 includes:
acquiring the first facial expression feature information and the second facial expression feature information;
judging whether the first facial expression feature information and the second facial expression feature information corresponding to the same position are changed or not;
if yes, acquiring facial expression feature changes;
and if not, returning to the step of judging whether the first facial expression characteristic information and the second facial expression characteristic information corresponding to the same position are changed or not.
In the embodiment of the present application, when analyzing the first facial expression feature information and the second facial expression feature information, first acquiring the first facial expression feature information and the second facial expression feature information, and determining whether the first facial expression feature information and the second facial expression feature information corresponding to the same position change; when the judgment result is yes, acquiring facial expression feature changes; and if not, returning to the step of judging whether the first facial expression characteristic information and the second facial expression characteristic information corresponding to the same position are changed.
In an embodiment of the present application, the outputting a hearing test report according to the analysis result in step S7 includes the steps of:
acquiring the total number of all facial expression features;
acquiring the total number of the changed facial expression features;
calculating the ratio of the total number of the changed facial expression features to the total number of the facial expression features;
judging whether the ratio exceeds a preset value or not;
if so, judging that the infant hears the sound;
if not, judging that the infant does not hear the sound.
In the embodiment of the application, when a hearing test report is output according to an analysis result, the total number of all facial expression features is acquired at first, and the total number of all changed facial expression features is acquired; then calculating the ratio of the total number of the changed facial expression features to the total number of the facial expression features, and judging whether the ratio exceeds a preset value; when the judgment result is yes, judging that the infant hears the sound; and when the judgment result is no, judging that the infant does not hear the sound.
In an embodiment of the present application, as shown in fig. 2, the present invention further provides an infant hearing test apparatus, the method including the steps of:
a first acquisition module 10, configured to acquire a first facial image of an infant;
the first extraction module 20 is configured to extract first facial expression feature information of the infant according to the first facial image;
the sound sending module 30 is used for sending a test sound to the infant;
a second obtaining module 40, configured to obtain a second face image of the infant;
a second extracting module 50, configured to extract second facial expression feature information of the infant according to the second facial image;
an analysis module 60, configured to analyze the first facial expression feature information and the second facial expression feature information;
and an output module 70 for outputting a hearing test report according to the analysis result.
The infant hearing test device provided by the application can execute the infant hearing test method.
Referring now to fig. 3, a schematic diagram of an electronic device 100 suitable for implementing an embodiment of the disclosure is shown, the electronic device 100 being capable of implementing any of the infant hearing test methods described above. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 3, the electronic device 100 may include a processing means (e.g., a central processing unit, a graphic processor, etc.) 101 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 102 or a program loaded from a storage means 108 into a Random Access Memory (RAM) 103. In the RAM 103, various programs and data necessary for the operation of the electronic apparatus 100 are also stored. The processing device 101, the ROM 102, and the RAM 103 are connected to each other via a bus 104. An input/output (I/O) interface 105 is also connected to bus 104.
Generally, the following systems may be connected to the I/O interface 105: input devices 106 including, for example, a touch screen, touch pad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; an output device 107 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 108 including, for example, magnetic tape, hard disk, etc.; and a communication device 1010. The communication means 1010 may allow the electronic device 100 to communicate with other devices wirelessly or by wire to exchange data. While the figures illustrate an electronic device 100 having various means, it is understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, the processes described above with reference to the flow diagrams may be implemented as computer software programs, according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 1010, or installed from the storage means 108, or installed from the ROM 102. The computer program, when executed by the processing device 101, performs the above-described functions defined in the methods of the embodiments of the present disclosure.
Referring now to fig. 4, shown is a schematic diagram of a computer-readable storage medium suitable for use in implementing embodiments of the present disclosure, the computer-readable storage medium storing a computer program that, when executed by a processor, is capable of implementing the infant hearing test method as described in any of the above.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor device, system, or apparatus, or a combination of any of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution apparatus, system, or device. In contrast, in the present disclosure, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution apparatus, system, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring at least two internet protocol addresses; sending a node evaluation request comprising the at least two internet protocol addresses to node evaluation equipment, wherein the node evaluation equipment selects the internet protocol addresses from the at least two internet protocol addresses and returns the internet protocol addresses; receiving an internet protocol address returned by the node evaluation equipment; wherein the obtained internet protocol address indicates an edge node in the content distribution network.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving a node evaluation request comprising at least two internet protocol addresses; selecting an internet protocol address from the at least two internet protocol addresses; returning the selected internet protocol address; wherein the received internet protocol address indicates an edge node in the content distribution network.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first obtaining unit may also be described as a "unit obtaining at least two internet protocol addresses".
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof.
The infant hearing test method, the infant hearing test device and the electronic equipment have the following beneficial effects:
(1) The method comprises the steps that facial images of infants are obtained through camera equipment, and facial expression feature information is extracted, so that the accuracy of judging the facial expressions of the infants is greatly improved;
(2) The infant facial expression recognition method based on the image processing recognition model has the advantages that the infant facial expression is recognized based on the computing equipment, particularly the infant facial expression is recognized based on the preset image processing recognition model, requirements of judging the infant facial expression on relevant experience of doctors can be remarkably reduced, the infant facial expression judgment accuracy is improved, and the accuracy of hearing tests is improved.
Finally, it should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "first" and "second" in this application are to be understood as terms.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (9)
1. A hearing test method for an infant, the method comprising the steps of:
acquiring a first facial image of an infant;
extracting first facial expression feature information of the infant according to the first facial image; the first facial expression feature information includes: eye feature information, eyebrow feature information, and mouth feature information;
sending a test sound to the infant;
acquiring a second face image of the infant;
extracting second facial expression feature information of the infant according to the second facial image; the second facial expression feature information includes: eye feature information, eyebrow feature information, and mouth feature information;
analyzing the first facial expression feature information and the second facial expression feature information;
outputting a hearing test report according to the analysis result;
the outputting of the hearing test report according to the analysis result includes the steps of:
acquiring the total number of all facial expression features;
acquiring the total number of the changed facial expression features;
calculating the ratio of the total number of the changed facial expression features to the total number of the facial expression features;
judging whether the ratio exceeds a preset value or not;
if so, judging that the infant hears the sound;
if not, judging that the infant does not hear the sound.
2. The hearing test method for an infant of claim 1, wherein the step of obtaining the first facial image of the infant comprises:
presetting a camera device and an image processing device;
orienting the camera towards an infant;
connecting the image processing apparatus with the image pickup apparatus;
shooting a first original face image of an infant by using the camera device;
sending the first original facial image to the image processing device;
processing the first original face image using the image processing device and obtaining the first face image.
3. The hearing test method for infants according to claim 1, wherein the extracting of the first facial expression feature information of infants according to the first facial image comprises:
acquiring an image processing identification model;
acquiring the first facial image;
inputting the first facial image into the image processing recognition model;
and acquiring the first facial expression characteristic information output by the image processing and identifying model.
4. The hearing test method for infants according to claim 1, wherein the sending a test sound to an infant comprises the steps of:
presetting sound sending equipment and sound storage equipment;
directing the sound emitting device toward an infant;
connecting the sound storage device with the sound transmission device;
transmitting a preset sound to the sound transmitting apparatus using the sound storage apparatus;
and sending a preset sound to the infant by using the sound sending equipment.
5. The hearing test method for an infant of claim 1, wherein the step of obtaining a second facial image of the infant comprises the steps of:
acquiring an image pickup device and an image processing device;
orienting the camera towards an infant;
connecting the image processing apparatus with the image pickup apparatus;
shooting a second original face image of the infant by using the camera device;
sending the second original facial image to the image processing device;
processing the second original face image using the image processing device and obtaining the second face image.
6. The hearing test method for infants according to claim 1, wherein the extracting second facial expression feature information of infants according to the second facial image comprises the steps of:
acquiring an image processing identification model;
acquiring the second face image;
inputting the second facial image into the image processing recognition model;
and acquiring the second facial expression characteristic information output by the image processing and identifying model.
7. The infant hearing test method of claim 1, wherein the analyzing the first facial expressive feature information and the second facial expressive feature information comprises:
acquiring the first facial expression feature information and the second facial expression feature information;
judging whether the first facial expression feature information and the second facial expression feature information corresponding to the same position are changed or not;
if yes, acquiring facial expression feature changes;
if not, returning to the step of judging whether the first facial expression characteristic information and the second facial expression characteristic information corresponding to the same position are changed or not.
8. An infant hearing test device, comprising:
the first acquisition module is used for acquiring a first facial image of an infant;
the first extraction module is used for extracting first facial expression feature information of the infant according to the first facial image; the first facial expression feature information includes: eye feature information, eyebrow feature information, and mouth feature information;
the sound sending module is used for sending test sounds to the infant;
the second acquisition module is used for acquiring a second face image of the infant;
the second extraction module is used for extracting second facial expression feature information of the infant according to the second facial image; the second facial expression feature information includes: eye feature information, eyebrow feature information, and mouth feature information;
the analysis module is used for analyzing the first facial expression feature information and the second facial expression feature information;
the output module is used for outputting a hearing test report according to the analysis result;
the outputting the hearing test report according to the analysis result comprises:
acquiring the total number of all facial expression features;
acquiring the total number of the changed facial expression features;
calculating the ratio of the total number of the changed facial expression features to the total number of the facial expression features;
judging whether the ratio exceeds a preset value or not;
if yes, judging that the infant hears the sound;
if not, the infant is judged not to hear the sound.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and (c) a second step of,
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the infant hearing test method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011207637.XA CN112315463B (en) | 2020-11-03 | 2020-11-03 | Infant hearing test method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011207637.XA CN112315463B (en) | 2020-11-03 | 2020-11-03 | Infant hearing test method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112315463A CN112315463A (en) | 2021-02-05 |
| CN112315463B true CN112315463B (en) | 2023-01-10 |
Family
ID=74324676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011207637.XA Active CN112315463B (en) | 2020-11-03 | 2020-11-03 | Infant hearing test method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112315463B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113425292A (en) * | 2021-06-25 | 2021-09-24 | 四川大学华西医院 | Infant hearing screening method and device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108460324A (en) * | 2018-01-04 | 2018-08-28 | 上海孩子通信息科技有限公司 | A method of child's mood for identification |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9288593B2 (en) * | 2010-07-19 | 2016-03-15 | Sonova Ag | Visually-based fitting of hearing devices |
| KR101967364B1 (en) * | 2016-11-30 | 2019-04-09 | 사회복지법인 삼성생명공익재단 | Hearing test system and hearing test method |
| TWM550619U (en) * | 2016-12-02 | 2017-10-21 | Unlimiter Mfa Co Ltd | Electronic device for acquiring hearing data based on facial image recognition result |
-
2020
- 2020-11-03 CN CN202011207637.XA patent/CN112315463B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108460324A (en) * | 2018-01-04 | 2018-08-28 | 上海孩子通信息科技有限公司 | A method of child's mood for identification |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112315463A (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110473525B (en) | Method and device for acquiring voice training sample | |
| CN109919244B (en) | Method and apparatus for generating a scene recognition model | |
| WO2020029608A1 (en) | Method and apparatus for detecting burr of electrode sheet | |
| CN109376419B (en) | Data model generation method and device, electronic equipment and readable medium | |
| CN110659542B (en) | Monitoring method and device | |
| CN109214501B (en) | Method and apparatus for identifying information | |
| CN110070076B (en) | Method and device for selecting training samples | |
| CN108387757B (en) | Method and apparatus for detecting moving state of movable device | |
| CN111897976A (en) | Virtual image synthesis method and device, electronic equipment and storage medium | |
| CN111402220B (en) | Method and device for acquiring information | |
| CN112315463B (en) | Infant hearing test method and device and electronic equipment | |
| CN110673717A (en) | Method and apparatus for controlling output device | |
| CN111325160B (en) | Method and device for generating information | |
| CN111586295B (en) | Image generation method and device and electronic equipment | |
| CN112382266A (en) | Voice synthesis method and device, electronic equipment and storage medium | |
| CN112309389A (en) | Information interaction method and device | |
| CN111832354A (en) | Target object age identification method and device and electronic equipment | |
| EP4276827A1 (en) | Speech similarity determination method, device and program product | |
| CN112185186B (en) | Pronunciation correction method and device, electronic equipment and storage medium | |
| CN111787264B (en) | Question asking method and device for remote teaching, question asking terminal and readable medium | |
| CN110334763B (en) | Model data file generation method, model data file generation device, model data file identification device, model data file generation apparatus, model data file identification apparatus, and model data file identification medium | |
| CN110084298B (en) | Method and device for detecting image similarity | |
| CN111310858A (en) | Method and apparatus for generating information | |
| CN114038047A (en) | Face verification method, device and storage medium | |
| CN113220128B (en) | Self-adaptive intelligent interaction method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |