WO2022068650A1

WO2022068650A1 - Auscultation position indication method and device

Info

Publication number: WO2022068650A1
Application number: PCT/CN2021/119629
Authority: WO
Inventors: 吴宙真; 李宏宝; 邱凌志; 黄曦
Original assignee: 华为技术有限公司
Priority date: 2020-09-29
Filing date: 2021-09-22
Publication date: 2022-04-07
Also published as: CN114359953A

Abstract

An auscultation position indication method and a device, relating to the field of electronic devices. The method comprises: an electronic device acquires and displays a user image, the user image comprising an image of the body part to be tested of a user (S401); the electronic device identifies an auscultation site of said body part according to the user image (S402); the electronic device displays a first mark on the user image, the position of the first mark on the user image corresponding to the position of the auscultation site on said body part, and being used for instructing the user to place an auscultation device on the auscultation site (S403). According to the solution, the electronic device can be used for different users, adapt to differences in auscultation sites of different users, and reduce the position error of the indicated auscultation sites.

Description

Method and device for indicating auscultation position

This application claims the priority of the Chinese patent application with the application number 202011053491.8 and the application title "Method and Apparatus for Indicating Auscultation Position", which was submitted to the State Intellectual Property Office on September 29, 2020, the entire contents of which are incorporated into this application by reference middle.

technical field

The embodiments of the present application relate to the field of electronic devices, and in particular, to a method and device for indicating an auscultation position.

Background technique

A stethoscope is one of the examination devices commonly used by physicians. Using a stethoscope, various tests such as heart sounds, lung sounds, and bowel sounds can be performed. Among them, the heart sound refers to the heart sound signal composed of the systolic and diastolic movement of the heart, the opening and closing of the valve, and the murmur signal under abnormal conditions. Through heart sound auscultation, the opening and closing state of the heart valve can be initially judged, so as to make the initial diagnosis of heart diseases such as valvular heart disease. General auscultation locations for heart sound auscultation may include: aortic valve auscultation area, pulmonary valve auscultation area, second aortic valve auscultation area, tricuspid valve auscultation area, and mitral valve auscultation area, etc.

Because the artificial stethoscope needs to be used by people with professional medical knowledge, otherwise it is impossible to make a more accurate judgment on the heard heart sounds. Therefore, among home users, smart stethoscopes are widely used. Smart stethoscopes are usually provided with auscultation sensors, such as heart sound sensors, for auscultation detection. When in use, the user can place the smart stethoscope at the corresponding auscultation position, so that the smart stethoscope can perform auscultation detection on the corresponding position. The smart stethoscope can send the detected auscultation data to terminals such as mobile phones through Bluetooth or wired transmission. A terminal such as a mobile phone can make a preliminary judgment on heart sounds and the like according to the received auscultation data. At present, when a user uses a smart stethoscope, he needs to determine his corresponding auscultation position according to a pre-provided auscultation position indication map or video.

For example, as shown in FIG. 1 , an auscultation position indication diagram 100 is displayed on a terminal such as a mobile phone. The auscultation position indication diagram 100 may include a schematic diagram of the upper body of the human body, and the corresponding positions on the schematic diagram of the upper body of the human body are respectively marked with the aortic valve auscultation area 101, the pulmonary valve auscultation area 102, the second aortic valve auscultation area 103, and the tricuspid valve auscultation area 104. And auscultation positions such as the mitral valve auscultation area 105 . The user can find the corresponding auscultation position according to each auscultation position in the above schematic diagram.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a method and device for indicating an auscultation position. The electronic device may collect and display the user image, and identify the user image to correspondingly indicate the auscultation site for the user's body part to be measured on the user image. The electronic device can adapt to the differences of the auscultation points of different users for different users, and reduce the position error of the indicated auscultation points.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

In a first aspect, an embodiment of the present application provides a method for indicating an auscultation position, and the method can be applied to an electronic device. The method includes: when the user needs to perform auscultation examination on the body part to be measured, an image of the user can be collected and displayed through an electronic device. Wherein, the user image may include an image of the user's body part to be measured. The electronic device may identify the auscultation site on the body part to be measured according to the user image, and display a mark corresponding to the auscultation site, such as the first mark, on the user image. The position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured, and is used to instruct the user to place an auscultation device at the auscultation site.

With the above technical solution, when the user performs auscultation examination on the body part to be measured, the auscultation device needs to be placed at the auscultation site. The user can collect and display the user image including the body part to be measured through the electronic device, and the electronic device can correspondingly indicate the auscultation site for the body part to be measured of the user. Therefore, when different users perform auscultation examinations, the electronic device can adapt to the differences in the auscultation points of different users for different users, thereby reducing the position error of the indicated auscultation points.

In a possible implementation manner, when the user places the auscultation device on the body part to be measured, the user image further includes: the image of the auscultation device; the position of the auscultation device image on the user image can be determined according to the position of the auscultation device on the user's image. Movement of the body part in response to the movement of the auscultation device. In this way, the user can judge whether the auscultation device is accurately placed at the auscultation site according to whether the image of the auscultation device in the user image coincides with the first mark. Thus, the accuracy of the user placing the auscultation device on the auscultation site is improved.

In another possible implementation manner, the electronic device is connected in communication with the auscultation device; the first mark includes a first mark to be auscultated, and the first mark to be auscultated is a first auscultation site that is not auscultated from the identified auscultation sites the corresponding mark to be auscultated; after the electronic device displays the first mark on the user image, the method further includes: the electronic device outputs first prompt information, where the first prompt information is used to instruct the user to send the first mark corresponding to the first mark to be auscultated The auscultation site moves the auscultation device; after the user moves the auscultation device according to the first prompt information, the electronic device stores and receives the auscultation data from the auscultation device when it is determined that the image of the auscultation device coincides with the first mark to be auscultated. In this way, the user can conveniently place the auscultation device on the corresponding auscultation site according to the guidance of the electronic device. Thus, the learning cost of the user is reduced, the operation is more intuitive, and the user experience is improved.

In another possible implementation manner, the first mark further includes to-be-auscultation marks corresponding to other un-auscultated auscultation points among the identified auscultation points, and the first to-be-auscultated mark is a distance from the auscultation equipment among the to-be-auscultated marks image recently. In this way, the user can be preferentially guided to the auscultation site closest to the auscultation device, thereby saving the user's time for moving the auscultation device and improving the user experience.

In another possible implementation manner, the first prompt information includes: an arrow pointing to the first mark to be auscultated from the image of the auscultation device. In this way, the user can move the auscultation device to the auscultation site more conveniently according to the path or direction indicated by the arrow. In this way, the guidance for users is more intuitive, the user experience is better, and the learning cost is lower.

In another possible implementation manner, the method further includes: the electronic device displays a second mark corresponding to each mark to be auscultated, and the second mark is used to indicate the auscultation sequence of each auscultation site. In this way, the user can know the auscultation sequence of the auscultation sites more clearly according to the second mark, so as to know the position of the next auscultation site. Auscultation at the auscultation site.

In another possible implementation manner, the first prompt information includes: a voice for instructing the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated. In this way, the user can move the auscultation device to the auscultation site according to the voice, which facilitates the user with poor eyesight to obtain the first prompt information and improves the user experience.

In another possible implementation manner, when the electronic device determines that the image of the auscultation device coincides with the first mark to be auscultated, and after storing and receiving the auscultation data from the auscultation device, the method further includes: the electronic device re-identifies the first auscultation data according to the auscultation data. an auscultation site; the electronic device updates and displays the first auscultation mark according to the re-identified first auscultation site, and re-outputs the first prompt information. In this way, by updating the first auscultation site, the accuracy of the electronic device in guiding the user to the corresponding auscultation site can be improved, thereby improving the accuracy of the final auscultation result.

In another possible implementation manner, the electronic device identifies the auscultation site of the body part to be measured according to the user image, including: the electronic device obtains the clavicle length on the body part to be measured according to the user image; The user image and the auscultation position characteristics determine the auscultation site. By obtaining the clavicle length of the user's body part to be measured, the proportional relationship between the to-be-measured body part and each distribution size in the characteristics of the auscultation position can be calculated. In this way, the identified auscultation position can be more matched with the user and reduce auscultation. Identification error of the locus.

In another possible implementation manner, when the electronic device displays the image of the auscultation device on the user image; the electronic device obtains the clavicle length on the body part to be measured according to the user image, including: when the user is on the body part to be measured When moving the auscultation device, the electronic device obtains the displacement data from the auscultation device. The displacement data is the data collected by the auscultation device during the process of moving the auscultation device from one end of the clavicle to the other end; the electronic device determines the user's clavicle length according to the displacement data. In this way, the auscultation device can be used to measure the length of the clavicle, thereby improving the accuracy of the obtained clavicle length.

In another possible implementation manner, the displacement data is collected by the auscultation device through a motion sensor. The auscultation device can conveniently and quickly collect displacement data through the motion sensor to send it to the electronic device. In this way, the structure of the auscultation device is relatively simple and easy to set up.

In another possible implementation manner, before the electronic device acquires the clavicle length on the body part to be measured according to the user image, the method further includes: the electronic device outputs second prompt information, where the second prompt information is used to instruct the user to Move the auscultation device from one end of the clavicle to the other end of the body part to be tested. In this way, the user can conveniently complete the measurement of the clavicle length according to the second prompt information. This reduces user learning costs and improves user experience.

In another possible implementation manner, the display screen of the electronic device includes a first area and a second area; collecting and displaying the user image by the electronic device includes: collecting and displaying the user image by the electronic device in the first area; the method further includes : The electronic device displays the auscultation data from the auscultation device in the second area. In this way, in addition to displaying a user image and guiding the user, the electronic device can also display auscultation data in the second area, such as a heart sound waveform diagram, an electrocardiogram, etc., so that the user can obtain more auscultation-related parameter data.

In a second aspect, an embodiment of the present application provides an apparatus for indicating an auscultation position, and the apparatus can be applied to an electronic device to implement the method in the first aspect above. The functions of the apparatus may be implemented by hardware, or by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above functions, for example, a display module, an identification module, a prompt module, a processing module, and the like.

Among them, the display module is used to collect and display the user image, and the user image includes the image of the user's body part to be measured; the identification module is used to identify the auscultation site of the body part to be measured according to the user image; the display module is also used to A first mark is displayed on the user image, and the position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured, and is used to instruct the user to place an auscultation device at the auscultation site.

In a possible implementation manner, when the user places the auscultation device on the body part to be measured, the user image further includes: an image of the auscultation device; the position of the auscultation device on the user image varies with the user Movement of the auscultation device on the body part to be measured.

In another possible implementation manner, the electronic device is connected in communication with the auscultation device; the first mark includes a first mark to be auscultated, and the first mark to be auscultated is a first auscultation site that is not auscultated from the identified auscultation sites the corresponding mark to be auscultated; the prompt module is used to output the first prompt information, and the first prompt information is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated; the processing module is used to determine the auscultation When the image of the device coincides with the first mark to be auscultated, the auscultation data received from the auscultation device is stored.

In another possible implementation manner, the first mark further includes to-be-auscultation marks corresponding to other un-auscultated auscultation points among the identified auscultation points, and the first to-be-auscultated mark is a distance from the auscultation equipment among the to-be-auscultated marks image recently.

In another possible implementation manner, the first prompt information includes: an arrow pointing to the first mark to be auscultated from the image of the auscultation device.

In another possible implementation manner, the display module is further configured to display a second mark corresponding to each mark to be auscultated, and the second mark is used to indicate the auscultation sequence of each auscultation site.

In another possible implementation manner, the first prompt information includes: a voice for instructing the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated.

In another possible implementation manner, the identification module is further configured to re-identify the first auscultation site according to the auscultation data; the display module is further configured to update and display the first auscultation mark according to the re-identified first auscultation site ; The prompt module is also used to re-output the first prompt information.

In another possible implementation manner, the identification module is specifically configured to obtain the clavicle length on the body part to be measured according to the user image; and determine the auscultation site according to the clavicle length, the user image and the auscultation position characteristics.

In another possible implementation manner, the identification module is specifically configured to acquire displacement data from the auscultation device when the user moves the auscultation device on the body part to be measured, where the displacement data is the movement of the auscultation device from one end of the clavicle to the other. The data collected by the auscultation equipment during the process of one end; the length of the user's collarbone is determined according to the displacement data.

In another possible implementation manner, the displacement data is collected by the auscultation device through a motion sensor.

In another possible implementation manner, the prompt module is further configured to output second prompt information, where the second prompt information is used to instruct the user to move the auscultation device from one end of the clavicle to the other end of the body part to be measured.

In another possible implementation manner, the display screen of the electronic device includes a first area and a second area; a display module is specifically configured to collect and display a user image in the first area; and display the image from the auscultation device in the second area Auscultation data.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, and a memory for storing instructions executable by the processor. When the processor is configured to execute the above instructions, the electronic device implements the method for indicating an auscultation position according to any one of the first aspect or possible implementation manners of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium on which computer program instructions are stored. When executed by the electronic device, the computer program instructions cause the electronic device to implement the method for indicating an auscultation position according to the first aspect or any one of possible implementations of the first aspect.

In a fifth aspect, embodiments of the present application provide a computer program product, comprising computer-readable codes, when the computer-readable codes are executed in an electronic device, the electronic device enables the electronic device to implement the first aspect or the possibility of the first aspect The method for indicating an auscultation position according to any one of the implementation manners.

It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages may be realized in any single embodiment. On the contrary, it can be understood that the description of features or beneficial effects means that a specific technical feature, technical solution or beneficial effect is included in at least one embodiment. Therefore, descriptions of technical features, technical solutions or beneficial effects in this specification do not necessarily refer to the same embodiments. Furthermore, the technical features, technical solutions and beneficial effects described in this embodiment can also be combined in any appropriate manner. Those skilled in the art will understand that an embodiment can be implemented without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and benefits may also be identified in specific embodiments that do not embody all embodiments.

Description of drawings

1 is a schematic diagram of an interface when a method for indicating auscultation position provided by the prior art is applied;

FIG. 2 is an application scenario diagram of a method for indicating an auscultation position provided by an embodiment of the present application;

3 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

4 is a schematic flowchart of a method for indicating an auscultation position according to an embodiment of the present application;

5 is a schematic interface diagram when a method for indicating an auscultation position provided by an embodiment of the present application is applied;

FIG. 6 is a schematic diagram of auscultation point distribution features provided by an embodiment of the present application;

7 is a schematic interface diagram when another method for indicating auscultation position provided by an embodiment of the present application is applied;

FIG. 8 is a schematic interface diagram when another method for indicating an auscultation position provided by an embodiment of the present application is applied;

9 is a schematic interface diagram when another method for indicating auscultation position provided by an embodiment of the present application is applied;

10 is a schematic interface diagram when another method for indicating an auscultation position provided by an embodiment of the present application is applied;

11 is a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application;

12 is a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application;

13 is a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application;

14 is a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application;

15 is a schematic interface diagram when another method for indicating an auscultation position provided by an embodiment of the present application is applied;

FIG. 16 is a schematic structural diagram of an apparatus for indicating an auscultation position according to an embodiment of the present application.

Detailed ways

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are set forth in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It is to be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described feature, integer, step, operation, element and/or component, but does not exclude one or more other The presence or addition of features, integers, steps, operations, elements, components and/or sets thereof.

It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.

In addition, in the description of the specification of the present application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and should not be construed as indicating or implying relative importance.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise.

Usually, a person with professional medical knowledge (such as a doctor, etc.) needs to use an artificial stethoscope to examine the person to be tested (or the user to be auscultated) to check heart sounds, lung sounds, or bowel sounds during auscultation examination. Since the auscultation examination needs to analyze the heard heart sounds, lung sounds, or bowel sounds, etc., ordinary home users generally cannot use an artificial stethoscope to perform auscultation examinations on themselves or others. The intelligent auscultation device can perform auscultation detection on the body part (such as the chest) of the person to be measured through the auscultation sensor. And intelligent auscultation equipment can send the detected auscultation data (such as heart sound signal, lung sound signal, bowel sound signal, etc.) to electronic equipment with data processing function (such as mobile phone, smart TV, computer, etc.) The results of auscultation can be obtained from the analysis of the auscultation data. For example, when the person to be tested needs to perform a heart sound check, the intelligent auscultation device can be placed at the corresponding auscultation site on the upper chest of the tested person, so that the intelligent auscultation device can perform auscultation detection on the corresponding auscultation site of the user to be tested. .

Therefore, when using the intelligent auscultation device, it is necessary to indicate the corresponding auscultation site to the user, so that the user can place the intelligent auscultation device on the corresponding auscultation site. At present, there are mainly two ways to indicate the auscultation site to the user:

Referring to FIG. 1, an auscultation position indication map 100 including each auscultation site (or auscultation area) can be displayed on the electronic device, so that the user can find the corresponding auscultation site on the body part to be measured according to the indication map. .

Alternatively, an auscultation gown is provided, and an indication pattern corresponding to the auscultation site can be printed on the auscultation gown. When the user wears the auscultation gown, the corresponding position of the indication pattern on the auscultation gown on the user's body part to be measured is the indicated auscultation site.

It can be seen that the above two ways of indicating the auscultation site to the user are both instructing the user through a pre-set indication map or indication pattern. For different users, the indication graphs or indication patterns are uniformly set, and cannot adapt to the differences in the auscultation points of different users to carry out personalized indications for the users.

Based on this, an embodiment of the present application provides a method for indicating an auscultation position, including: when a user needs to perform auscultation on a body part to be measured, an electronic device can collect and display an image of the user. Wherein, the user image may include an image of the user's body part to be measured. The electronic device may identify the auscultation site on the body part to be measured according to the user image, and display a mark corresponding to the auscultation site, such as the first mark, on the user image. In this way, the auscultation sites for the user's body part to be measured can be correspondingly indicated on the user image, thereby adapting to differences in auscultation sites of different users and reducing the position error of the indicated auscultation sites.

FIG. 2 shows an application scenario of a method for indicating an auscultation position provided by the present application. Referring to FIG. 2 , the scenario includes a user 201 and an electronic device 202 . The electronic device 202 has a camera, and the user 201 can use the camera of the electronic device 202 to capture a user image of the user 201 . As shown in FIG. 2 , the electronic device 202 is shown by taking a mobile phone as an example.

The method for indicating the auscultation position provided by the embodiments of the present application can be applied to the electronic device in FIG. 2 . For example, the electronic device may be a mobile phone, a tablet computer, a wearable device with a camera, a television set, a laptop computer, a desktop computer, an augmented reality (AR)/virtual reality (VR) device, and the like. The embodiments of the present application do not specifically limit the specific form of the electronic device. It should be noted that the above electronic devices can also be used in combination, for example, a user image is collected by a camera of a smart screen, and the user image is sent to a mobile phone to be displayed on the screen of the mobile phone. Alternatively, the user image is collected through the camera of the mobile phone, and the user image is sent to the VR device to display the VR image including the user image, and the like.

Taking a mobile phone as an example, the structure of an electronic device will be described. Please refer to FIG. 3 , which is a schematic structural diagram of an electronic device according to an embodiment of the present application.

As shown in FIG. 3 , the electronic device may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charge management module 340, a power management module 341, a battery 342, Antenna 1, Antenna 2, Mobile Communication Module 350, Wireless Communication Module 360, Audio Module 370, Speaker 370A, Receiver 370B, Microphone 370C, Headphone Interface 370D, Sensor Module 380, Key 390, Motor 391, Indicator 392, Camera 393, A display screen 394, and a subscriber identification module (SIM) card interface 395, etc. The sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, and an environment Light sensor 380L, bone conduction sensor 380M, etc.

It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or some components may be combined, or some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 310 may include one or more processing units, for example, the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

A controller can be the nerve center and command center of an electronic device. The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 310 for storing instructions and data. In some embodiments, the memory in processor 310 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 310 . If the processor 310 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 310 is reduced, thereby increasing the efficiency of the system.

In some embodiments, processor 310 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.

The charging management module 340 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 340 may receive charging input from the wired charger through the USB interface 330 . In some wireless charging embodiments, the charging management module 340 may receive wireless charging input through a wireless charging coil of the electronic device. While the charging management module 340 is charging the battery 342 , it can also supply power to the electronic device through the power management module 341 .

The power management module 341 is used to connect the battery 342 , the charging management module 340 and the processor 310 . The power management module 341 receives input from the battery 342 and/or the charging management module 340, and supplies power to the processor 310, the internal memory 321, the external memory, the display screen 394, the camera 393, and the wireless communication module 360. The power management module 341 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters. In some other embodiments, the power management module 341 may also be provided in the processor 310 . In other embodiments, the power management module 341 and the charging management module 340 may also be provided in the same device.

The wireless communication function of the electronic device can be implemented by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 350 can provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the electronic device. The mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like. The mobile communication module 350 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into electromagnetic waves for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 350 may be provided in the processor 310 . In some embodiments, at least some of the functional modules of the mobile communication module 350 may be provided in the same device as at least some of the modules of the processor 310.

The wireless communication module 360 can provide applications on electronic devices including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 360 may be one or more devices integrating at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310 . The wireless communication module 360 can also receive the signal to be sent from the processor 310 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the electronic device is coupled with the mobile communication module 350, and the antenna 2 is coupled with the wireless communication module 360, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device realizes the display function through the GPU, the display screen 394, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 394 is used to display images, videos, and the like. Display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the electronic device may include 1 or N display screens 394, where N is a positive integer greater than 1.

The electronic device can realize the shooting function through the ISP, the camera 393, the video codec, the GPU, the display screen 394, and the application processor.

The ISP is used to process the data fed back by the camera 393 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 393 .

Camera 393 is used to capture still images or video. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the electronic device may include 1 or N cameras 393, where N is a positive integer greater than 1.

A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device selects the frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

Video codecs are used to compress or decompress digital video. An electronic device may support one or more video codecs. In this way, the electronic device can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Through the NPU, applications such as intelligent cognition of electronic devices can be realized, such as image recognition, face recognition, speech recognition, text understanding, etc.

Internal memory 321 may be used to store computer executable program code, which includes instructions. The processor 310 executes various functional applications and data processing of the electronic device by executing the instructions stored in the internal memory 321 . The internal memory 321 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device. In addition, the internal memory 321 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

The electronic device can implement audio functions through an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, and an application processor. Such as music playback, recording, etc.

The audio module 370 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 370 may also be used to encode and decode audio signals. In some embodiments, the audio module 370 may be provided in the processor 310 , or some functional modules of the audio module 370 may be provided in the processor 310 .

Speaker 370A, also referred to as "horn", is used to convert audio electrical signals into sound signals. The electronic device can listen to music through speaker 370A, or listen to hands-free calls.

The receiver 370B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device answers a call or a voice message, the voice can be answered by placing the receiver 370B close to the human ear.

The microphone 370C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message or needing to trigger the electronic device to perform certain events through the voice assistant, the user can make a sound by approaching the microphone 370C through the human mouth, and input the sound signal into the microphone 370C. The electronic device may be provided with at least one microphone 370C. In other embodiments, the electronic device may be provided with two microphones 370C, in addition to collecting sound signals, a noise reduction function may also be implemented. In other embodiments, the electronic device may further be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The pressure sensor 380A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 380A may be provided on the display screen 394 . There are many types of pressure sensors 380A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to pressure sensor 380A, the capacitance between the electrodes changes. The electronic device determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 394, the electronic device detects the intensity of the touch operation according to the pressure sensor 380A. The electronic device can also calculate the touched position according to the detection signal of the pressure sensor 380A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

The gyro sensor 380B can be used to determine the motion attitude of the electronic device. In some embodiments, the angular velocity of the electronic device about three axes (ie, x, y, and z axes) may be determined by gyro sensor 380B. The gyro sensor 380B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 380B detects the shaking angle of the electronic device, calculates the distance to be compensated by the lens module according to the angle, and allows the lens to counteract the shaking of the electronic device through reverse motion to achieve anti-shake. The gyro sensor 380B can also be used for navigation and somatosensory game scenarios.

Touch sensor 380K, also known as "touch panel". The touch sensor 380K may be disposed on the display screen 394, and the touch sensor 380K and the display screen 394 form a touch screen, also called a "touch screen". The touch sensor 380K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 380K may also be disposed on the surface of the electronic device, which is different from the location where the display screen 394 is located.

The keys 390 include a power-on key, a volume key, and the like. Keys 390 may be mechanical keys. It can also be a touch key. The electronic device may receive key input and generate key signal input related to user settings and function control of the electronic device.

Motor 391 can generate vibrating cues. The motor 391 can be used for incoming call vibration alerts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. The motor 391 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 394 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The SIM card interface 395 is used to connect a SIM card. The SIM card can be inserted into the SIM card interface 395 or pulled out from the SIM card interface 395 to achieve contact and separation with the electronic device. The electronic device can support 1 or N SIM card interfaces 395 , where N is a positive integer greater than 1. The SIM card interface 395 can support Nano SIM card, Micro SIM card, SIM card and so on. The same SIM card interface 395 can insert multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 395 can also be compatible with different types of SIM cards. The SIM card interface 395 is also compatible with external memory cards. The electronic device interacts with the network through the SIM card to realize functions such as call and data communication. In some embodiments, the electronic device employs an eSIM, ie: an embedded SIM card. The eSIM card can be embedded in the electronic device and cannot be separated from the electronic device.

The methods in the following embodiments can all be implemented in an electronic device having the above-mentioned hardware structure.

FIG. 4 is a schematic flowchart of a method for indicating an auscultation position according to an embodiment of the present application. As shown in FIG. 4 , the method for indicating an auscultation position may include the following S401-S405.

S401, the electronic device collects and displays a user image.

Wherein, the user image may include an image of the user's body part to be measured.

The body part of the user to be measured may generally be a part that needs auscultation, such as the user's chest or upper body. When the user needs to perform an auscultation examination, the user can specifically determine the body part to be measured according to different auscultation examinations. For example, if the user needs to check the heart sound or bowel sound, the front of the upper body can be used as the body part to be measured for the electronic device to collect and display. Or if the user needs to perform a lung sound test, the front and back of the upper body can be used as the body parts to be tested for the electronic equipment to collect and display.

For example, as shown in FIG. 5 , the front of the user's upper body is used as the body part to be measured, and the electronic device collects and displays an image 501 of the user's upper body.

In some embodiments, the electronic device may collect user images through its built-in camera or an external camera. The user image collected and displayed by the electronic device can be a dynamic image (or video image), so that when the subsequent electronic device recognizes the auscultation site according to the user image, it can be adjusted in real time according to the change of the user image, so that the auscultation point recognized by the electronic device can be adjusted in real time. location is more accurate.

S402, the electronic device identifies the auscultation site of the body part to be measured according to the user image.

Wherein, the electronic device can identify the auscultation site of the body part to be measured in the user image by means of image recognition.

For example, the electronic device can identify the feature points of the image of the body part to be tested in the user image, such as when the image of the body part to be tested is the upper body image corresponding to the front of the user's upper body, the feature point can be the symmetrical center point of the two collarbones, Shoulders and lower ribs, etc. Then, the electronic device determines the auscultation points of the body part to be measured in combination with the distribution characteristics of the auscultation points corresponding to the body part to be measured.

The distribution feature of the auscultation points may be the positional relationship between each auscultation point and the above-identified feature points. For example, the distribution feature of the auscultation points may be the distance between each auscultation point and the corresponding feature point, the distance between the auscultation points, and the like.

Take the body part to be measured as the user's upper body, the auscultation site as the heart sound auscultation site, and the feature point identified by the electronic device as the symmetrical center of the two collarbones as an example. The electronic device can first identify the symmetrical centers of the two collarbones of the upper body of the user according to the upper body image. Then, as shown in FIG. 6 , the electronic device can be based on the vertical distance A between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602 and the symmetrical centers of the two clavicle 603 respectively, as well as the aortic valve auscultation area 601 and the pulmonary valve auscultation area. The distance B between 602 determines two heart sound auscultation sites in the user's upper body in the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602 . Similarly, the electronic device can determine the distance between other heart sound auscultation sites, such as the second aortic valve auscultation area 604, the tricuspid valve auscultation area 605, and the mitral valve auscultation area 606, and the approximate positions on the ribs 607, respectively. Other heart sound auscultation sites. Among them, the vertical distance A between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602 and the symmetrical centers of the two clavicle 603 respectively, the distance B between the aortic valve auscultation area 601 and the pulmonary valve auscultation area 602, and the aortic valve auscultation area B The distances between other heart sound auscultation sites, such as the second auscultation area 604 , the tricuspid valve auscultation area 605 , and the mitral valve auscultation area 606 , can be obtained according to medical prior knowledge.

Usually, the electronic device can also obtain the clavicle length on the body part to be measured according to the user image, so as to calculate and determine the above-mentioned distances for the user according to the proportional relationship between the clavicle length and the clavicle length defined in medical prior knowledge (or distance), thereby improving the matching degree between the determined auscultation site and the user's body part to be measured, and increasing the accuracy of identifying the auscultation site.

S403, the electronic device displays the first mark on the user image.

Wherein, the position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured. The user can be instructed to place the auscultation device at the auscultation site by the first mark.

In some embodiments, the first mark displayed by the electronic device may correspond to the auscultation points identified in S402, and all the auscultation points to be identified are displayed on the user image. For example, the image of the body part to be measured is the upper body image of the user, and the auscultation sites identified by the electronic device are five heart sound auscultation sites, as shown in FIG. 5 , the electronic device can display five first Mark 502.

For example, the first mark may be a mark pattern displayed at a corresponding position on the user's image, eg, a dot, a circle (as shown in FIG. 5 ), and the like. In this embodiment, as the user sequentially performs auscultation checks on the auscultation sites corresponding to the displayed first mark, there will be auscultation sites that have not been auscultated and auscultation sites that have been auscultated in each auscultation site. Therefore, in this embodiment of the present application, the first mark displayed by the electronic device includes a mark corresponding to an auscultation site that is not under auscultation, such as a mark to be auscultated. Correspondingly, the first marker may also include a marker corresponding to the auscultated auscultation site, such as may be referred to as an auscultation marker.

The electronic device can also be distinguished from the to-be-auscultated mark and display the auscultated mark. In order to facilitate the user to judge whether the corresponding auscultation site has undergone auscultation examination. For example, the auscultation mark is displayed in black or gray, and the auscultation mark is displayed in red or other colors, and the color difference is used to distinguish the auscultation mark and the auscultation mark. In other embodiments, after the auscultation site is subjected to auscultation examination, the electronic device may no longer display the mark corresponding to the auscultation site (or the auscultation mark).

In some other embodiments, the first indicia displayed by the electronic device may include only one indicia. For example, the first mark corresponds to an auscultation site without auscultation (or the first mark is a mark to be auscultated). That is, the electronic device can display the identified auscultation sites in sequence until all auscultation sites complete the auscultation.

Generally, when the user places the auscultation device on the body part to be measured, the user image may further include: an image of the auscultation device. The position of the image of the auscultation device on the user's image may move with the user's movement of the auscultation device on the body part to be measured. That is, the image of the auscultation device is a dynamic image (or a video image).

The user can select a certain mark to be auscultated, such as the first mark to be auscultated, by moving the auscultation device to make the image of the auscultation device coincide with the first mark to be auscultated, so as to place the auscultation device at the auscultation site without auscultation. In this way, it is easier for the user to place the auscultation device according to the first mark displayed by the electronic device and the image of the auscultation device, thereby improving the accuracy of the user placing the auscultation device on the auscultation site.

After the electronic device displays the first mark on the user image, the electronic device may further guide the auscultation sites corresponding to the marks to be auscultated according to preset rules, so that the user can move the auscultation device to the corresponding auscultation site according to the guidance of the electronic device. Auscultation site. Wherein, the preset rule may be to preferentially select the auscultation site closest to the auscultation device for guidance, or to guide the auscultation sites without auscultation according to a certain order of auscultation. Wherein, if the first mark displayed by the electronic device includes only one mark, the first mark can be displayed according to the above-mentioned preset rule, that is, the electronic device only displays the first mark corresponding to the auscultation mark that will guide the user to auscultate.

Therefore, when the electronic device guides the auscultation site corresponding to a certain mark to be auscultated, such as the first auscultation site corresponding to the first mark to be auscultated. This embodiment may also include the following S404-S405.

S404, the electronic device outputs the first prompt information.

The first prompt information can instruct the user to move the auscultation device to the auscultation site corresponding to the first mark to be auscultated.

In some embodiments, the first prompt information may be text displayed by the electronic device, or an indicator displayed on the user's image, or voice broadcast by the electronic device, or the like.

For example, as shown in FIG. 7 , the electronic device may display an arrow 703 on the image of the user pointing to the first mark 702 to be auscultated from the image 701 of the auscultation device. The arrow 703 can be updated in real time as the user moves the auscultation device. The arrow is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated, which is more intuitive, can reduce user learning costs and improve user experience.

For another example, the electronic device may broadcast a voice that instructs the user to move the auscultation device to the auscultation site corresponding to the first mark to be auscultated.

In some embodiments, the electronic device may further display a second mark corresponding to the mark to be auscultated, and the auscultation sequence of each auscultation site is indicated by the second mark. For example, as shown in FIG. 8 , the second mark 801 is a digital identification corresponding to the auscultation order of each auscultation site. Each second mark 801 is correspondingly displayed on the corresponding first mark 802, respectively.

When the electronic device displays the second mark, the electronic device is used to instruct the user to move the voice of the auscultation device, and the first mark to be auscultated can be expressed in combination with the second mark. For example, the second mark corresponding to the first mark to be auscultated is number 1. As shown in FIG. 9 , the voice broadcast by the electronic device may be “Please move the auscultation device to the auscultation site 1”, etc., which is not limited here.

In some embodiments, when the electronic device is a device with a large display screen, such as a tablet computer, a notebook computer, a smart TV (such as a smart screen, etc.), a desktop computer with a large-screen display, etc., the electronic device can also display In the form of auxiliary information, text is used to guide the user to move the auscultation device. The content of the text may be the same as the content of the above-mentioned voice.

For example, the display screen of the electronic device may include a first area and a second area, the electronic device may display the user image in the first area, and display the above-mentioned auxiliary information in the second area.

Taking the electronic device as a smart screen as an example, as shown in FIG. 10 , the display screen of the smart screen is divided into a first area 1001 and a second area 1002 , a user image 1003 is displayed in the first area 1001 , and auxiliary information is displayed in the second area 1002 1004. The second mark 1006 corresponding to the first mark to be auscultated 1005 is the number 1, and the auxiliary information 1004 includes the text "Please move the auscultation device to the auscultation site 1".

In some embodiments, the above-mentioned auxiliary information may further include auscultation data detected by the auscultation device. For example, the auscultation device can be communicatively connected with the electronic device in a wired or wireless manner. The auscultation data detected by the auscultation device can be sent to the electronic device. For example, the auscultation device may include auscultation sensors, such as a heart sound sensor, a lung sound sensor, a bowel sound sensor, and the like. The auscultation device can detect the heart sound, lung sound or bowel sound at the auscultation site through the auscultation sensor to generate data such as heart sound, lung sound or bowel sound. In some possible embodiments, the auscultation device may further include a heart rate sensor to detect the user's heart rate to generate electrocardiographic data. Among them, the heart rate sensor may use an electrode type heart rate sensor, an optical heart rate sensor, and the like. When the user needs to perform heart rate/ECG detection while performing auscultation detection on the body part to be measured (such as the upper body) through the auscultation device, the user can wear no clothes on the upper body, so that the heart rate sensor of the auscultation device can directly contact the body skin, thereby Has higher detection accuracy. For example, the auxiliary information may be the above-mentioned auscultation data and/or electrocardiogram data displayed by the electronic device in the form of a waveform diagram.

Optionally, the wireless communication protocol adopted when establishing the connection between the auscultation device and the electronic device in a wireless manner may be a wireless fidelity (Wi-Fi) protocol, a bluetooth (bluetooth) protocol, a ZigBee protocol, a near-field communication (near) field communication, NFC) protocol, various cellular network protocols, etc., which are not specifically limited here.

Continuing to take the electronic device as the smart screen as an example, as shown in Figure 10, the smart screen can also display the heart sound waveform diagram of the heart sound detected by the auscultation device and the ECG waveform detected by the auscultation device in the second area.

It should be noted that the above-mentioned auscultation data, ECG data, etc. may all be data sent by auscultation equipment in real time, or may be data detected at the auscultation site after the auscultation equipment is placed at the auscultation site, which is not specifically limited here.

S405. After the user moves the auscultation device according to the first prompt information, the electronic device stores and receives the auscultation data from the auscultation device when it is determined that the image of the auscultation device coincides with the first mark to be auscultated.

When the image of the auscultation device coincides with the first mark to be auscultated, it means that the auscultation device is placed on the auscultation site corresponding to the first mark to be auscultated. At this time, the electronic device stores and receives the auscultation data from the auscultation device, and can subsequently analyze the corresponding auscultation site according to the auscultation data, so as to make a preliminary diagnosis of the auscultation site.

FIG. 11 shows a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application. As shown in FIG. 11 , the method of indicating the auscultation position may include the following S1101-S1108.

S1101. The electronic device collects and displays a user image.

S1102, the electronic device acquires the clavicle length on the body part to be measured according to the user image.

In some embodiments, the electronic device can identify the clavicle on the body part to be measured by means of image recognition, so as to obtain the clavicle length.

In other embodiments, when the user moves the auscultation device on the body part to be measured, the electronic device can also obtain the clavicle length by acquiring displacement data from the auscultation device. The displacement data is the displacement data generated by the auscultation device moving from one end of the clavicle to the other end. For example, the user may move the auscultation device from one end of the clavicle to the other. The auscultation device can send the detected displacement data to the electronic device, so that the electronic device can obtain the clavicle length according to the displacement data. Among them, the auscultation equipment can be acquired through motion sensor acquisition, such as a six-axis motion sensor. In some possible implementations, before S1102, the electronic device may also output second prompt information to instruct the user to move the auscultation device from one end of the clavicle to the other end of the body part to be measured. Wherein, the second prompt information may be an indication mark or the like correspondingly displayed on the clavicle in the user image. For example, the electronic device displays an arrow on the clavicle on the image of the user, and the arrow extends along the extending direction of the clavicle.

S1103, the electronic device determines the auscultation site according to the clavicle length, the user image and the auscultation position characteristics.

For the implementation of this step, reference may be made to the example of S402, which will not be repeated here.

S1104, the electronic device determines whether there is a position that needs auscultation, and if so, executes S1105, and the electronic device displays a first mark on the user image. If not, the electronic device ends indicating the auscultation position.

S1106. The electronic device outputs first prompt information.

S1107. After the user moves the auscultation device according to the first prompt information, the electronic device determines whether the auscultation device has reached the auscultation site, and if so, executes S1108 to store and receive the auscultation data from the auscultation device. If not, execute S1106.

In some embodiments, the electronic device can determine whether the auscultation device has reached the auscultation site by means of image recognition. For example, when it is determined that the image of the auscultation device coincides with the first mark to be auscultated, the electronic device may determine that the auscultation device has reached the auscultation site.

In other embodiments, the electronic device may further determine whether the auscultation site has been reached by acquiring the auscultation data sent by the auscultation device. For example, the auscultation data includes intensity information of the auscultation signal. When the electronic device determines that the intensity of the auscultation signal is greater than the detection threshold, it can determine that the auscultation device has reached the auscultation site.

Alternatively, the electronic device can also obtain the displacement data detected by the auscultation device to determine whether the distance moved by the auscultation device is equal to the distance between the initial position of the auscultation device and the auscultation site or the difference is smaller than the preset value, and if so, it can be determined. The auscultation device reaches the auscultation site.

Generally, after the electronic device stores and receives the auscultation data from the auscultation device, it can also return to S1104 until all auscultation sites complete the auscultation.

Wherein, S1101 , S1105 , and S1106 are the same as the embodiments of S401 , S403 , and S404 respectively, and will not be repeated here.

FIG. 12 shows a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application. As shown in FIG. 12 , the method for indicating an auscultation position may include the following S1201-S12010.

S1201, the electronic device collects and displays a user image.

S1202, the electronic device acquires the clavicle length on the body part to be measured according to the user image.

S1203 , the electronic device determines the auscultation site according to the length of the clavicle, the image of the user, and the characteristics of the auscultation position.

S1204, the electronic device determines whether there is a position that needs auscultation, and if so, executes S1205, and the electronic device displays the first mark on the user image. If not, the electronic device ends indicating the auscultation position.

S1206, the electronic device outputs the first prompt information.

S1207, the electronic device acquires the data detected by the auscultation device.

S1208, the electronic device displays auxiliary information according to the data detected by the auscultation device.

Wherein, the data detected by the auscultation device may include displacement data, auscultation data, etc., and the corresponding auxiliary information may include the text that guides the user to move the auscultation device as described in the description of S404, an electrocardiogram, and a heart sound waveform. For a specific implementation manner, reference may be made to the example related to the auxiliary information in S404, which will not be repeated here.

S1209. After the user moves the auscultation device according to the first prompt information, the electronic device determines whether the auscultation device has reached the auscultation site, and if so, executes S12010 to store and receive the auscultation data from the auscultation device. If not, execute S1206.

It should be noted that, S1201 to S1206 , S1209 and S12010 are respectively the same as the embodiments of S1101 to S1108 , which are not repeated here.

FIG. 13 shows a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application. As shown in FIG. 13 , the method of indicating the auscultation position may include the following S1301-S13011.

S1301, the electronic device collects and displays a user image.

S1302, the electronic device acquires the clavicle length on the body part to be measured according to the user image.

S1303, the electronic device determines the auscultation site according to the length of the clavicle, the user image, and the characteristics of the auscultation position.

S1304, the electronic device determines whether there is a position that needs auscultation, and if so, executes S1305, and the electronic device displays the first mark on the user image. If not, the electronic device ends indicating the auscultation position.

S1306, the electronic device outputs the first prompt information.

S1307, the electronic device acquires the data detected by the auscultation device.

S1308, the electronic device displays auxiliary information according to the data detected by the auscultation device.

S1309. After the user moves the auscultation device according to the first prompt information, the electronic device determines whether the auscultation device has reached the auscultation site, and if so, executes S13010 to store and receive the auscultation data from the auscultation device. If not, execute S13011, and the electronic device determines whether the first prompt information needs to be updated. If so, update the first prompt information and execute S1306; otherwise, execute S1306.

Wherein, the first mark to be auscultated guided by the first prompt information may be the mark to be auscultated corresponding to the non-auscultated auscultation site closest to the auscultation device. The electronic device can determine whether the first prompt information needs to be updated according to whether the auscultation site closest to the auscultation device is changed without auscultation. For example, when the auscultation site closest to the auscultation device is changed to another auscultation site, the electronic device can update the first prompt information accordingly to redirect the user to guide the auscultation device to the changed auscultation site.

It should be noted that, S1301 to S13010 are respectively the same as the embodiments of S1201 to S12010, and details are not described here.

FIG. 14 shows a schematic flowchart of another method for indicating an auscultation position provided by an embodiment of the present application. As shown in FIG. 14 , the method of indicating the auscultation position may include the following S1401-S1408.

S1401, the electronic device collects and displays a user image.

S1402, the electronic device acquires the clavicle length on the body part to be measured according to the user image.

S1403 , the electronic device determines each auscultation site according to the length of the clavicle, the user image and the characteristics of the auscultation position.

Wherein, each auscultation site may be an area range where each auscultation site is located. That is, each auscultation site is located within the range of the corresponding auscultation site.

S1404, the electronic device displays the first mark on the user image.

S1405. The electronic device outputs first prompt information.

S1406, the electronic device acquires the data detected by the auscultation device.

S1407, the electronic device determines whether the optimal position of the auscultation site is reached according to the data detected by the auscultation device. If yes, execute S1408, store the auscultation data received from the auscultation device. If not, update the auscultation site and execute S1404.

Wherein, the electronic device can use the data detected by the auscultation device, such as the auscultation signal strength, to determine whether the auscultation signal strength is greater than the preset threshold after the auscultation device reaches the auscultation site, otherwise it can be determined that the auscultation site is not the optimal position. At this time, the electronic device may re-determine the auscultation site according to the strength of the auscultation signal, that is, update the auscultation site.

For example, updating the auscultation site may be to re-determine the region range of the corresponding auscultation site, such as narrowing the region range of the corresponding auscultation site.

For example, as shown in (a) of FIG. 15 , the first mark displayed by the electronic device includes only one mark, which corresponds to one of the auscultation marks that are not auscultated in the identified auscultation sites, which may be referred to as the first pending auscultation mark. Auscultation mark 1501. The user moves the auscultation device to the auscultation site corresponding to the first auscultation mark 1501 according to the first prompt information, that is, the image 1502 of the auscultation device is coincident with the first auscultation mark 1501 . At this time, the electronic device can re-determine a better position of the auscultation site according to the acquired auscultation data sent by the auscultation device, such as narrowing the area of the auscultation site. And as shown in (b) of FIG. 15 , the first mark 1501 to be auscultated (or the first mark) is displayed again. In this way, the user can finally move the auscultation device to a more accurate auscultation site, thereby improving the accuracy of the subsequent auscultation results.

In some embodiments, the first mark displayed by the electronic device may be a mark corresponding to a non-auscultated auscultation mark in the identified auscultation sites. Then, after S1408, the electronic device can also execute S1409 to determine whether all auscultation sites have completed auscultation, if so, end indicating the auscultation position, otherwise, replace the auscultation site and return to S1404. That is, the first mark corresponding to the replaced auscultation site is redisplayed to guide the replaced auscultation site.

Wherein, S1401 to S1406 and S1408 are respectively the same as the embodiments of S1301 to S1303 and S1305 to S1307, and will not be repeated here.

With the method in the foregoing embodiment, when the user needs to check the body part to be measured. The user can collect and display the user image including the body part to be measured through the electronic device. The electronic device can identify the auscultation points corresponding to the body part to be measured according to the user image, and mark and display these auscultation points on the user image. In this way, the auscultation site marked and displayed by the electronic device corresponds to the body part to be measured of the user, so that for different users, the method can adapt to the difference of the auscultation sites of different users and reduce the position error of the indicated auscultation site . In addition, the user image collected and displayed by the electronic device may also include the image of the auscultation device. The electronic device can guide the user by outputting prompt information, so that the user can move the auscultation device to the corresponding auscultation site according to the prompt information. The user can intuitively perceive whether the auscultation device has reached the auscultation site by whether the image of the auscultation device in the user image coincides with the mark corresponding to the auscultation site. Therefore, the user can more accurately place the auscultation device on the auscultation site, improve the accuracy of the auscultation examination, and improve the user experience.

Corresponding to the methods in the foregoing embodiments, the embodiments of the present application further provide a device for indicating auscultation position. The apparatus can be applied to electronic equipment for implementing the methods in the foregoing embodiments. The functions of the apparatus may be implemented by hardware, or by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the above functions. For example, FIG. 16 shows a schematic structural diagram of an apparatus for indicating auscultation position. As shown in FIG. 16 , the apparatus includes: a display module 1601 , an identification module 1602 , a prompt module 1603 , and a processing module 1604 .

Among them, the display module 1601 is used to collect and display the user image, and the user image includes the image of the user's body part to be measured; the identification module 1602 is used to identify the auscultation site of the to-be-measured body part according to the user image; the display module 1601, also It is used to display the first mark on the user image, and the position of the first mark on the user image corresponds to the position of the auscultation site on the body part to be measured, and is used to instruct the user to place the auscultation device at the auscultation site.

In another possible implementation manner, the electronic device is connected in communication with the auscultation device; the first mark includes a first mark to be auscultated, and the first mark to be auscultated is a first auscultation site that is not auscultated from the identified auscultation sites The corresponding mark to be auscultated; the prompt module 1603 is used to output the first prompt information, and the first prompt information is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated; the processing module 1604 is used to When it is determined that the image of the auscultation device coincides with the first mark to be auscultated, the auscultation data received from the auscultation device is stored.

In another possible implementation manner, the display module 1601 is further configured to display a second mark corresponding to each mark to be auscultated, and the second mark is used to indicate the auscultation sequence of each auscultation site.

In another possible implementation manner, the identification module 1602 is further configured to re-identify the first auscultation site according to the auscultation data; the display module 1601 is further configured to update and display the first auscultation site according to the re-identified first auscultation site Auscultation mark; the prompt module 1603 is further configured to output the first prompt information again.

In another possible implementation manner, the identification module 1602 is specifically configured to obtain the clavicle length on the body part to be measured according to the user image; and determine the auscultation site according to the clavicle length, the user image and the auscultation position characteristics.

In another possible implementation manner, the identification module 1602 is specifically configured to acquire displacement data from the auscultation device when the user moves the auscultation device on the body part to be measured, where the displacement data is the movement of the auscultation device from one end of the clavicle to the The data collected by the auscultation device during the process at the other end; the length of the user's collarbone is determined according to the displacement data.

In another possible implementation manner, the prompt module 1603 is further configured to output second prompt information, where the second prompt information is used to instruct the user to move the auscultation device from one end of the clavicle to the other end of the body part to be measured.

In another possible implementation manner, the display screen of the electronic device includes a first area and a second area; the display module 1601 is specifically configured to collect and display user images in the first area; and display images from the auscultation device in the second area auscultation data.

It should be understood that the division of units or modules (hereinafter referred to as units) in the above apparatus is only a division of logical functions, and may be fully or partially integrated into a physical entity in actual implementation, or may be physically separated. And all the units in the device can be realized in the form of software calling through the processing element; also can all be realized in the form of hardware; some units can also be realized in the form of software calling through the processing element, and some units can be realized in the form of hardware.

For example, each unit can be a separately established processing element, or can be integrated in a certain chip of the device to be implemented, and can also be stored in the memory in the form of a program, which can be called by a certain processing element of the device and execute the unit's processing. Features. In addition, all or part of these units can be integrated together, and can also be implemented independently. The processing element described here may also be called a processor, which may be an integrated circuit with signal processing capability. In the implementation process, each step of the above method or each of the above units may be implemented by an integrated logic circuit of hardware in the processor element or implemented in the form of software being invoked by the processing element.

In one example, the units in the above apparatus may be one or more integrated circuits configured to implement the above method, such as: one or more ASICs, or, one or more DSPs, or, one or more FPGAs, or a combination of at least two of these integrated circuit forms.

For another example, when a unit in an apparatus can be implemented in the form of a processing element scheduler, the processing element can be a general-purpose processor, such as a CPU or other processor that can invoke a program. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).

In one implementation, the unit of the above apparatus for implementing each corresponding step in the above method may be implemented in the form of a processing element scheduler. For example, the apparatus may include a processing element and a storage element, and the processing element invokes a program stored in the storage element to execute the method described in the above method embodiments. The storage element may be a storage element on the same chip as the processing element, ie, an on-chip storage element.

In another implementation, the program for performing the above method may be in a storage element on a different chip from the processing element, ie, an off-chip storage element. At this time, the processing element calls or loads the program from the off-chip storage element to the on-chip storage element, so as to call and execute the methods described in the above method embodiments.

For example, an embodiment of the present application may further provide an apparatus, such as an electronic device, which may include a processor, a memory for storing instructions executable by the processor. When the processor is configured to execute the above-mentioned instructions, the electronic device implements the method for indicating an auscultation position as described in the foregoing embodiments. The memory may be located within the electronic device or external to the electronic device. And the processor includes one or more.

In yet another implementation, the unit of the apparatus for implementing each step in the above method may be configured as one or more processing elements, and these processing elements may be provided on the corresponding electronic equipment described above, and the processing elements here may be integrated circuits , for example: one or more ASICs, or, one or more DSPs, or, one or more FPGAs, or a combination of these types of integrated circuits. These integrated circuits can be integrated together to form chips.

For example, an embodiment of the present application further provides a chip, which can be applied to the above-mentioned electronic device. The chip includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the processor receives and executes computer instructions from the memory of the electronic device through the interface circuit, so as to realize the above method embodiments. Methods.

Embodiments of the present application further provide a computer program product, including computer instructions for running an electronic device, such as the above-mentioned electronic device.

From the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated as required. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be Incorporation may either be integrated into another device, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or may be distributed to multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application essentially or contribute to the prior art, or all or part of the technical solutions may be embodied in the form of software products, such as programs. The software product is stored in a program product, such as a computer-readable storage medium, and includes several instructions to cause a device (which may be a single-chip microcomputer, a chip, etc.) or a processor (processor) to execute all of the methods described in the various embodiments of the present application. or part of the steps. The aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.

For example, the embodiments of the present application may further provide a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by the electronic device, the electronic device is made to implement the method of indicating the auscultation position as described in the foregoing method embodiments.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this, and any changes or substitutions within the technical scope disclosed in the present application should be covered within the protection scope of the present application. . Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

A method for indicating an auscultation position, comprising:

The electronic device collects and displays a user image, and the user image includes an image of the user's body part to be measured;

The electronic device identifies the auscultation site of the body part to be measured according to the user image;

The electronic device displays a first mark on the user image, and the position of the first mark on the user image corresponds to the position of the auscultation point on the body part to be measured, and is used to indicate The user places an auscultation device at the auscultation site.
The method according to claim 1, wherein when the user places the auscultation device on the body part to be measured, the user image further comprises: an image of the auscultation device; The position of the image on the user image moves with the user's movement of the auscultation device on the body part to be measured.
The method of claim 2, wherein the electronic device is communicatively connected to the auscultation device; the first mark comprises a first mark to be auscultated, and the first mark to be auscultated is the same as the identified auscultation mark corresponding to the first auscultation site that is not auscultated among the auscultation sites;

After the electronic device displays the first indicia on the user image, the method further includes:

The electronic device outputs first prompt information, where the first prompt information is used to instruct the user to move the auscultation device to the first auscultation site corresponding to the first mark to be auscultated;

After the user moves the auscultation device according to the first prompt information, the electronic device stores and receives the auscultation data from the auscultation device when it is determined that the image of the auscultation device coincides with the first mark to be auscultated.
The method according to claim 3, wherein the first mark further comprises a to-be-auscultation mark corresponding to other un-auscultated auscultation points among the identified auscultation points, and the first to-be-auscultated mark Among the marks to be auscultated, the image of the auscultation device is the closest.
The method according to claim 3 or 4, wherein the first prompt information comprises: an arrow pointing to the first mark to be auscultated from the image of the auscultation device.
The method of claim 4, wherein the method further comprises:

The electronic device displays a second mark corresponding to each of the marks to be auscultated, and the second mark is used to indicate the auscultation sequence of each of the auscultation sites.
The method according to any one of claims 3 to 6, wherein the first prompt information comprises: instructing the user to move the first auscultation point corresponding to the first mark to be auscultated Voice of auscultation equipment.
The method according to any one of claims 3 to 7, wherein, when the electronic device determines that the image of the auscultation device coincides with the first mark to be auscultated, the electronic device stores the auscultation received from the auscultation device. After the data, the method further includes:

The electronic device re-identifies the first auscultation site according to the auscultation data;

The electronic device updates and displays the first auscultation mark according to the re-identified first auscultation site, and re-outputs the first prompt information.
The method according to any one of claims 1 to 8, wherein the electronic device identifies the auscultation site of the body part to be measured according to the user image, comprising:

The electronic device acquires the clavicle length on the body part to be measured according to the user image;

The electronic device determines the auscultation site according to the clavicle length, the user image and the auscultation position characteristics.
The method of claim 9, wherein when the electronic device displays the image of the auscultation device on the user image; the electronic device acquires the body part to be measured according to the user image The upper collarbone length, including:

When the user moves the auscultation device on the body part to be measured, the electronic device obtains displacement data from the auscultation device, and the displacement data is the process of the auscultation device moving from one end of the clavicle to the other end data collected by auscultation equipment;

The electronic device determines the clavicle length of the user according to the displacement data.
The method of claim 10, wherein the displacement data is collected by the auscultation device through a motion sensor.
The method according to claim 10 or 11, wherein before the electronic device acquires the clavicle length on the body part to be measured according to the user image, the method further comprises:

The electronic device outputs second prompt information, and the second prompt information is used to instruct the user to move the auscultation device from one end of the clavicle on the body part to be measured to the other end.
The method according to any one of claims 1-12, wherein the display screen of the electronic device comprises a first area and a second area;

The electronic device collecting and displaying the user image includes: the electronic device collecting and displaying the user image in the first area;

The method further includes: the electronic device displaying auscultation data from the auscultation device in the second area.
An electronic device, comprising: a processor, a memory for storing executable instructions of the processor;

The processor, when configured to execute the instructions, causes the electronic device to implement the method of any one of claims 1 to 13.
A computer-readable storage medium on which computer program instructions are stored; characterized in that,

The computer program instructions, when executed by an electronic device, cause the electronic device to implement the method of any one of claims 1 to 13.