CN115691793A - Method and device for processing tongue picture data and related equipment - Google Patents
Method and device for processing tongue picture data and related equipment Download PDFInfo
- Publication number
- CN115691793A CN115691793A CN202211692647.6A CN202211692647A CN115691793A CN 115691793 A CN115691793 A CN 115691793A CN 202211692647 A CN202211692647 A CN 202211692647A CN 115691793 A CN115691793 A CN 115691793A
- Authority
- CN
- China
- Prior art keywords
- tongue
- tongue picture
- picture
- image
- diagnosis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012545 processing Methods 0.000 title claims abstract description 31
- 238000003745 diagnosis Methods 0.000 claims abstract description 60
- 238000001514 detection method Methods 0.000 claims abstract description 35
- 230000003750 conditioning effect Effects 0.000 claims abstract description 25
- 238000003860 storage Methods 0.000 claims abstract description 14
- 238000005520 cutting process Methods 0.000 claims abstract description 8
- 238000013507 mapping Methods 0.000 claims abstract description 6
- 238000007781 pre-processing Methods 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 8
- 239000011248 coating agent Substances 0.000 claims description 7
- 238000000576 coating method Methods 0.000 claims description 7
- 238000010606 normalization Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 4
- 230000003993 interaction Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000003672 processing method Methods 0.000 description 6
- 239000003814 drug Substances 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012935 Averaging Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 208000017667 Chronic Disease Diseases 0.000 description 1
- 238000001467 acupuncture Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000037213 diet Effects 0.000 description 1
- 235000005911 diet Nutrition 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 210000001835 viscera Anatomy 0.000 description 1
Images
Abstract
The invention discloses a method and a device for processing tongue picture data, computer equipment and a storage medium, wherein the method comprises the following steps: acquiring tongue picture data of a tongue diagnosis user; inputting the tongue picture data into a tongue picture detection network, determining the position of a tongue in a tongue picture image, and cutting the tongue picture image based on the position of the tongue to obtain a cut image containing the tongue; inputting the cut image into a tongue picture classification network to obtain a tongue picture classification result, wherein the result comprises tongue diagnosis characteristics of a user; and matching and inquiring the tongue picture classification result based on a tongue picture database, and outputting the constitution state and the conditioning strategy which are associated with the tongue picture classification result, wherein the tongue picture database comprises an association table, and the association table records the mapping relation of the tongue picture characteristics, the constitution state and the conditioning strategy. The invention can improve the flexibility of tongue diagnosis and the accuracy of tongue diagnosis results.
Description
Technical Field
The invention relates to the field of natural language processing and computer vision, in particular to a method and a device for processing tongue picture data, computer equipment and a storage medium.
Background
The application of traditional Chinese medicine in China has been in the history for thousands of years, the etiology is explored and the disease location is sought through means of 'inspection, smell, inquiry, cutting', and the like, and the tongue diagnosis is regarded as an important component of 'inspection' diagnosis, and is increasingly paid more attention in the medical field. According to the traditional Chinese medicine, the meridians and collaterals on the tongue are connected with the five internal organs of the human body, and the representation of the meridians and collaterals can visually reflect the functional changes of the human body. The deficiency, excess, cold and heat, exterior and interior yin and yang of the human body can be judged by observing the tongue picture characteristics, so that the physique and the health condition can be judged, and the people in healthy and sub-healthy states can be prevented from suffering from chronic diseases and serious diseases.
The traditional tongue diagnosis and inquiry technology is that a patient naturally extends out of the tongue under the natural light condition, and then a doctor provides related suggestions for the patient after related judgment by observing the tongue nature, the tongue coating and the tongue body form, the color of the tongue coating, the thickness of the tongue coating, whether the tongue coating falls off and the like. However, this method is not flexible enough, depends heavily on the professional knowledge of the doctor and the tongue picture characteristics observed by naked eyes, and the tongue picture characteristics cannot be analyzed objectively and quantitatively due to the inconsistent level of each doctor, resulting in certain subjectivity.
Therefore, how to improve the flexibility of tongue diagnosis and accurately analyze the tongue picture characteristics so as to ensure the accuracy of tongue diagnosis results is a problem to be solved at present.
Disclosure of Invention
The embodiment of the invention provides a tongue picture data processing method, a tongue picture data processing device, computer equipment and a storage medium, which can improve the flexibility of tongue diagnosis inquiry and the accuracy of tongue diagnosis results.
In order to solve the above technical problem, an embodiment of the present application provides a method for processing tongue image data, including the following steps: acquiring tongue picture data of a tongue diagnosis user, wherein the tongue picture data comprises a tongue picture image of the user; inputting the tongue image data into a tongue image detection network, determining the tongue position in the tongue image, and cutting the tongue image based on the tongue position to obtain a cut image containing the tongue; inputting the cut image into a tongue picture classification network to obtain a tongue picture classification result, wherein the classification result comprises tongue diagnosis characteristics of the user; and performing matching query on the tongue picture classification result based on a tongue diagnosis database, and outputting the constitution state and the conditioning strategy associated with the tongue picture classification result, wherein the tongue diagnosis database comprises an association table, and the association table records the mapping relation of the tongue diagnosis characteristics, the constitution state and the conditioning strategy.
In one possible implementation, the tongue image data is preprocessed before being input to the tongue image detection network, and the preprocessing includes at least one of image scaling, normalization, and averaging.
In another possible implementation manner, sample tongue picture data is obtained, wherein the sample tongue picture data comprises a sample tongue picture; and carrying out position marking and tongue picture characteristic marking on the sample image, wherein the position marking comprises a tongue picture position in the sample tongue picture image, and the tongue picture characteristic marking comprises a tongue color, a tongue coating quality and a tongue shape.
In another possible implementation, the tongue picture detection network is trained by using a labeled sample tongue picture image; and the tongue picture detection network determines the tongue picture position in the sample tongue picture image and outputs a cutting image containing the tongue picture position.
In another possible implementation manner, the cut image containing the tongue picture position is input into the tongue picture classification network for training; and the tongue picture classification network carries out operation analysis on the cut image and outputs tongue picture characteristics corresponding to the cut image.
In another possible implementation manner, the physical status and the conditioning strategy associated with the tongue manifestation classification result are output to a terminal device for display through a user interaction module, wherein the terminal device comprises an electronic device associated with the tongue diagnosis user.
In order to solve the above technical problem, an embodiment of the present application further provides a tongue image data processing apparatus, including: the data acquisition module is used for acquiring tongue picture data of a tongue diagnosis user, and the tongue picture data comprises a tongue picture image of the user; the detection module is used for determining the tongue position in the tongue picture image and cutting the tongue picture image based on the tongue position to obtain a cut image containing the tongue; the classification module is used for classifying the tongue picture to obtain a tongue picture classification result, and the classification result comprises the tongue diagnosis characteristics of the user; and the matching query module is used for performing matching query on the tongue picture classification result based on a tongue diagnosis database and outputting the physical condition and the conditioning strategy associated with the tongue picture classification result, wherein the tongue diagnosis database comprises an association table, and the association table records the mapping relation among the tongue diagnosis characteristics, the physical condition and the conditioning strategy.
In order to solve the above technical problem, an embodiment of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the above method when executing the computer program.
In order to solve the above technical problem, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements the steps of the above method.
The tongue picture data processing method, the device, the computer equipment and the storage medium provided by the embodiment of the invention can be used for determining whether the tongue picture exists in the image and the position of the tongue picture by acquiring the tongue picture image of the tongue diagnosis user, further analyzing by using the tongue picture classification network to obtain the tongue diagnosis special diagnosis corresponding to the tongue picture, searching in the tongue diagnosis database according to the tongue diagnosis special diagnosis, finding out the physical state and the conditioning strategy matched with the tongue diagnosis special diagnosis, and finally outputting and feeding back to the tongue diagnosis user. By the method, the flexibility of tongue diagnosis inquiry can be improved, the user can be helped to get rid of the limitation of the inherent inquiry scene, the experience of the user is improved, meanwhile, the tongue picture image is processed by utilizing the tongue picture detection network and the tongue picture classification network, manual participation is not needed, and the accuracy of the tongue diagnosis result is further improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is an exemplary system architecture diagram in which the present application may be applied.
FIG. 2 is a flow chart of one embodiment of a tongue representation data processing method of the present application.
Fig. 3 is a schematic diagram of tongue image position detection in the present application.
FIG. 4 is a flow diagram of one embodiment of a network training process of the present application.
FIG. 5 is a schematic block diagram of an embodiment of a tongue image data processing apparatus according to the present application.
FIG. 6 is a schematic block diagram of one embodiment of a computer device according to the present application.
Detailed Description
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs; the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application; the terms "including" and "having," and any variations thereof, in the description and claims of this application and the description of the above figures are intended to cover non-exclusive inclusions. The terms "first," "second," and the like in the description and claims of this application or in the above-described drawings are used for distinguishing between different objects and not for describing a particular order.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, as shown in fig. 1, a system architecture 100 may include a terminal device 110, a network 120, and a server 130. Network 120 is the medium used to provide communication links between terminal device 110 and server 130. Network 120 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
A user may use terminal device 110 to interact with server 130 over network 120 to receive or send messages and the like.
The terminal device 110 may be various electronic devices having a display screen and supporting web browsing and photographing functions, including but not limited to a smart phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts Group Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion Picture Experts Group Audio Layer 4), a laptop portable computer, a desktop computer, and the like.
The tongue image data processing method provided by the embodiment of the present application is executed by a server, and accordingly, the tongue image data processing apparatus is disposed in the server.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. According to implementation needs, there may be any number of terminal devices, networks, and servers, and the terminal device 110 in this embodiment may specifically correspond to an application system in actual production.
Referring to fig. 2, fig. 2 shows a method for processing tongue image data according to an embodiment of the present invention, which is described by taking the method applied to the server in fig. 1 as an example, and is described in detail as follows.
S201, tongue picture data of the tongue diagnosis user are obtained.
Specifically, the tongue diagnosis user can take a picture containing his tongue image through a terminal device (such as a mobile phone) and send the picture to a server through a network, or send a pre-stored picture containing the tongue image to the server, and the server further processes the picture.
Optionally, after receiving the tongue picture data of the tongue diagnosis user, the server performs preprocessing on the tongue picture data, for example, performs scaling processing on the tongue picture image, scales the image to the same scale, or performs normalization and averaging processing on the tongue picture image, thereby ensuring that all data have uniformity in the subsequent processing process and improving the data processing efficiency.
S202, inputting the tongue picture data into a tongue picture detection network, and determining the tongue position in the tongue picture image.
Specifically, the preprocessed tongue picture data is output to a tongue picture detection network for detection, so that whether a tongue exists in the tongue picture image can be judged, under the condition that the tongue exists in the tongue picture image, the tongue picture detection network marks the tongue position in the tongue picture image by utilizing a frame according to the tongue position, and finally, the tongue picture image is cut according to the frame, and a cut image containing the tongue is obtained. As shown in fig. 3, after the tongue image passes through the tongue image detection network, the tongue in the image will be marked with a rectangular frame.
It should be noted that the tongue picture detection network is a detection model constructed based on a convolutional neural network, and before the tongue picture detection is performed by using the tongue picture detection model, it needs to be trained to make it have tongue picture detection capability, and the training process of the tongue picture detection network will be described in detail later.
And S203, inputting the cut image into a tongue picture classification network to obtain a tongue picture classification result.
Specifically, after preliminary processing by the tongue picture detection network, a cut image containing a tongue is obtained, then the tongue picture classification network further operates and analyzes the cut image, and outputs a plurality of characteristic results corresponding to the tongue picture contained in the cut image, such as tongue color, coating quality, tongue shape and the like.
It should be noted that the tongue picture classification network is similar to the tongue picture detection network, and is also a classification model constructed based on a convolutional neural network, and before the tongue picture classification is performed by using the tongue picture classification network, it is also necessary to train the tongue picture classification network to have tongue picture classification capability, and the training process of the tongue picture classification network will be described in detail later.
And S204, matching and inquiring the tongue picture classification result based on the tongue diagnosis database, and outputting the physical state and the conditioning strategy associated with the tongue picture classification result.
Specifically, after the tongue diagnosis characteristics of the tongue picture are obtained through analysis by the tongue picture classification network, the tongue diagnosis database is traversed, the database is established in advance, different tongue diagnosis characteristics and corresponding physical states and conditioning strategies are stored in the database, therefore, in the traversing process, the physical characteristics and the conditioning strategies matched with the tongue diagnosis characteristics can be found through the obtained tongue diagnosis characteristics, and the conditioning strategies can comprise diet conditioning, medicine intervention, emotion conditioning, health acupuncture points, exercise suggestions and the like.
Optionally, after the server finds the corresponding physical state and conditioning strategy, the server sends the physical state and conditioning strategy to the terminal device associated with the user for displaying, so that the tongue diagnosis user can visually obtain the tongue diagnosis result, the user can be helped not to be limited by regions and time, the tongue diagnosis inquiry can be performed anytime and anywhere, the tongue diagnosis result and the relevant conditioning strategy can be accurately obtained, and the user experience is improved.
The following describes the training process of the tongue picture detection network and the tongue picture classification network, please refer to fig. 4.
S401, obtaining sample tongue picture data.
Specifically, based on the existing image acquisition terminal, tongue picture data is acquired under a real natural open environment, or a tongue picture is acquired from a tongue picture database.
It should be noted that, in the process of acquiring the tongue picture data of the sample, tongue picture images with different tongue picture characteristics need to be acquired, so as to expand the application range of the model.
And S402, marking the tongue picture image of the sample.
Specifically, after the tongue manifestation images of the samples are obtained, the tongue manifestation images of each sample are labeled by the traditional Chinese medicine experts, and the positions of the tongue manifestations and the corresponding tongue manifestation characteristics are mainly labeled, so that the labeling accuracy can be further improved, and the accuracy of the tongue diagnosis result is improved.
And S403, inputting the marked sample tongue picture into a tongue picture detection network for training.
Specifically, after a sample tongue picture image is input, the tongue picture detection network detects whether a tongue picture exists in the sample tongue picture image, frames the tongue picture in the sample tongue picture image by using a frame, then compares the frame with a frame marked by an expert, and continuously iterates until the error between the frame marked by the expert and the frame marked by the expert is smaller than a threshold value, at the moment, the tongue picture detection network is trained, and the tongue picture detection network has the tongue picture detection capability.
S404, inputting the tongue picture image output by the tongue picture detection network into a tongue picture classification network for training.
Specifically, after detecting the tongue picture, the tongue picture detection network performs clipping processing on the frame selected tongue picture, the clipping range is the internal image of the square frame, and then the clipped tongue picture image is input to the tongue picture classification network.
Further, the tongue picture classification network carries out operation analysis on the cut tongue picture to obtain a tongue picture classification result, then the tongue picture classification result is compared with tongue picture characteristics marked by experts to calculate a corresponding loss function, and then the iteration is carried out continuously until the loss function is converged, namely the tongue picture characteristics output by the tongue picture classification network are basically consistent with the tongue picture characteristics marked by the experts, so that the training of the tongue picture classification network is completed, and at the moment, the tongue picture classification network has the tongue picture classification capability.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 5 is a schematic block diagram of a tongue picture data processing device corresponding to the tongue picture data processing method in one-to-one manner according to the above embodiment. As shown in fig. 5, the tongue picture data processing apparatus includes a data obtaining module 510, a detecting module 520, a classifying module 530, and a matching query module 540. Each functional block is described in detail below.
And a data acquiring module 510, configured to acquire tongue image data of the tongue diagnosis user, where the tongue image data includes a tongue image of the user.
And the detection module 520 is configured to determine a tongue position in the tongue image, and crop the tongue image based on the tongue position to obtain a cropped image including a tongue.
The classifying module 530 is configured to classify the tongue picture to obtain a tongue picture classification result, where the classification result includes tongue diagnosis characteristics of the user.
And a matching query module 540, configured to perform matching query on the tongue manifestation classification result based on a tongue diagnosis database, and output the constitutional status and the conditioning strategy associated with the tongue manifestation classification result, where the tongue diagnosis database includes an association table, and the association table records a mapping relationship between tongue diagnosis characteristics, the constitutional status, and the conditioning strategy.
In some optional implementations of the present embodiment, the tongue image data processing apparatus 500 further includes a preprocessing module 550, and the preprocessing module 550 is configured to perform preprocessing on the tongue image data, where the preprocessing includes at least one of image scaling, normalization, and averaging.
For the specific limitation of the tongue image data processing device, reference may be made to the above limitation of the tongue image data processing method, which is not described herein again. The various modules in the tongue representation data processing apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent of a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In order to solve the technical problem, the embodiment of the application further provides computer equipment. Referring to fig. 6 in detail, fig. 6 is a block diagram of a basic structure of a computer device according to the embodiment.
The computer device 600 includes a memory 610, a processor 620, and a network interface 630 communicatively coupled to each other via a system bus. It is noted that only a computer device 600 having components connected to memory 610, processor 620, and network interface 630 is shown, but it is understood that not all of the illustrated components are required to be implemented, and that more or fewer components can be implemented instead. As will be understood by those skilled in the art, the computer device is a device capable of automatically performing numerical calculation and/or information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded device, and the like.
The computer device can be a desktop computer, a notebook, a palm computer, a cloud server and other computing devices. The computer equipment can carry out man-machine interaction with a user in a keyboard mode, a mouse mode, a remote controller mode, a touch panel mode or a voice control equipment mode.
The memory 610 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or D interface display memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the storage 610 may be an internal storage unit of the computer device 600, such as a hard disk or a memory of the computer device 600. In other embodiments, the memory 610 may also be an external storage device of the computer device 600, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), etc. provided on the computer device 600. Of course, the memory 610 may also include both internal and external storage devices for the computer device 600. In this embodiment, the memory 610 is generally used for storing an operating system installed in the computer device 600 and various application software, such as program codes for controlling electronic files. In addition, the memory 610 may also be used to temporarily store various types of data that have been output or are to be output.
The processor 620 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 620 generally serves to control the overall operation of the computer device 600. In this embodiment, the processor 620 is configured to execute the program code stored in the memory 610 or process data, for example, execute the program code for controlling an electronic file.
The network interface 630 may include a wireless network interface or a wired network interface, and the network interface 630 is generally used for establishing a communication connection between the computer device 600 and other electronic devices.
The present application further provides another embodiment, which is to provide a computer-readable storage medium, wherein the computer-readable storage medium stores an interface display program, and the interface display program can be executed by at least one processor, so as to enable the at least one processor to execute the steps of the image library construction method.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (such as a ROM/RAM, a magnetic disk, and an optical disk), and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
It is to be understood that the above-described embodiments are merely illustrative of some, but not restrictive, of the broad invention, and that the appended drawings illustrate preferred embodiments of the invention and do not limit the scope of the invention. This application is capable of embodiments in many different forms and the embodiments are provided so that this disclosure will be thorough and complete. Although the present application has been described in detail with reference to the foregoing embodiments, it will be apparent to one skilled in the art that the present application may be practiced without modification or with equivalents of some of the features described in the foregoing embodiments. All equivalent structures made by using the contents of the specification and the drawings of the present application are directly or indirectly applied to other related technical fields and are within the protection scope of the present application.
Claims (10)
1. A method of processing tongue image data, the method comprising:
acquiring tongue picture data of a tongue diagnosis user, wherein the tongue picture data comprises a tongue picture image of the user;
inputting the tongue picture data into a tongue picture detection network, determining a tongue position in the tongue picture image, and cutting the tongue picture image based on the tongue position to obtain a cut image containing a tongue;
inputting the cut image into a tongue picture classification network to obtain a tongue picture classification result, wherein the classification result comprises tongue diagnosis characteristics of the user;
and matching and inquiring the tongue picture classification result based on a tongue picture database, and outputting the constitution state and the conditioning strategy which are associated with the tongue picture classification result, wherein the tongue picture database comprises an association table, and the association table records the mapping relation of the tongue picture characteristics, the constitution state and the conditioning strategy.
2. The method of claim 1, wherein prior to inputting the tongue data into a tongue detection network, the method further comprises:
preprocessing the tongue image data, wherein the preprocessing comprises at least one of image scaling processing, normalization processing and mean value reduction processing.
3. The method of claim 1 or 2, wherein prior to acquiring tongue picture data of a tongue examination user, the method further comprises:
acquiring sample tongue picture data, wherein the sample tongue picture data comprises a sample tongue picture image;
and carrying out position marking and tongue picture characteristic marking on the sample image, wherein the position marking comprises the tongue picture position in the sample tongue picture image, and the tongue picture characteristic marking comprises the tongue color, the tongue coating quality and the tongue shape.
4. The method of claim 3, wherein the method further comprises:
training the tongue picture detection network by using the marked sample tongue picture image;
and the tongue picture detection network determines the tongue picture position in the sample tongue picture image and outputs a cutting image containing the tongue picture position.
5. The method of claim 4, wherein the method further comprises:
inputting the cut image containing the tongue picture position into the tongue picture classification network for training;
and the tongue picture classification network carries out operation analysis on the cut image and outputs tongue picture characteristics corresponding to the cut image.
6. The method of claim 1, wherein outputting the physical status and conditioning strategy associated with the tongue picture classification result comprises:
and outputting the physical state and the conditioning strategy associated with the tongue picture classification result to terminal equipment for displaying through a user interaction module, wherein the terminal equipment comprises electronic equipment associated with the tongue diagnosis user.
7. A tongue image data processing apparatus, characterized in that the apparatus comprises:
the data acquisition module is used for acquiring tongue picture data of a tongue diagnosis user, and the tongue picture data comprises a tongue picture image of the user;
the detection module is used for determining the tongue position in the tongue picture image and cutting the tongue picture image based on the tongue position to obtain a cut image containing the tongue;
the classification module is used for classifying the tongue picture to obtain a tongue picture classification result, and the classification result comprises the tongue diagnosis characteristics of the user;
and the matching query module is used for performing matching query on the tongue picture classification result based on a tongue diagnosis database and outputting the constitution state and the conditioning strategy associated with the tongue picture classification result, wherein the tongue diagnosis database comprises an association table, and the association table records the mapping relation among the tongue diagnosis characteristics, the constitution state and the conditioning strategy.
8. The apparatus of claim 7, wherein the apparatus further comprises a pre-processing module,
the preprocessing module is used for preprocessing the tongue picture data, and the preprocessing comprises at least one of image scaling processing, normalization processing and mean value reduction processing.
9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211692647.6A CN115691793A (en) | 2022-12-28 | 2022-12-28 | Method and device for processing tongue picture data and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211692647.6A CN115691793A (en) | 2022-12-28 | 2022-12-28 | Method and device for processing tongue picture data and related equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115691793A true CN115691793A (en) | 2023-02-03 |
Family
ID=85055208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211692647.6A Pending CN115691793A (en) | 2022-12-28 | 2022-12-28 | Method and device for processing tongue picture data and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115691793A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115830292A (en) * | 2023-02-07 | 2023-03-21 | 智慧眼科技股份有限公司 | Tongue image processing method and system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113724228A (en) * | 2021-08-31 | 2021-11-30 | 平安科技（深圳）有限公司 | Tongue color and coating color identification method and device, computer equipment and storage medium |
-
2022
- 2022-12-28 CN CN202211692647.6A patent/CN115691793A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113724228A (en) * | 2021-08-31 | 2021-11-30 | 平安科技（深圳）有限公司 | Tongue color and coating color identification method and device, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 吴亚杰, 北京：中国中医药出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115830292A (en) * | 2023-02-07 | 2023-03-21 | 智慧眼科技股份有限公司 | Tongue image processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107194158A (en) | A kind of disease aided diagnosis method based on image recognition | |
| CN109545394B (en) | Interrogation method and device | |
| CN109817312A (en) | A kind of medical bootstrap technique and computer equipment | |
| CN113724228A (en) | Tongue color and coating color identification method and device, computer equipment and storage medium | |
| CN108427941B (en) | Method for generating face detection model, face detection method and device | |
| CN110827236B (en) | Brain tissue layering method, device and computer equipment based on neural network | |
| CN113724848A (en) | Medical resource recommendation method, device, server and medium based on artificial intelligence | |
| CN110610125A (en) | Ox face identification method, device, equipment and storage medium based on neural network | |
| CN113763348A (en) | Image quality determination method and device, electronic equipment and storage medium | |
| CN115691793A (en) | Method and device for processing tongue picture data and related equipment | |
| CN110059721A (en) | Floor plan area recognizing method, device, equipment and computer readable storage medium | |
| CN111339290A (en) | Text classification method and system | |
| CN111281355B (en) | Method and equipment for determining pulse acquisition position | |
| CN116130088A (en) | Multi-mode face diagnosis method, device and related equipment | |
| CN112800758A (en) | Method, system, equipment and medium for distinguishing similar meaning words in text | |
| CN111949356A (en) | Popup window processing method and device and electronic equipment | |
| CN115525192A (en) | User-oriented quotation charging method and device, computer equipment and storage medium | |
| CN110703965A (en) | Intelligent traditional Chinese medicine health state identification software and electronic equipment | |
| CN111192252B (en) | Image segmentation result optimization method and device, intelligent terminal and storage medium | |
| CN114913361A (en) | Classification method and system applied to anti-human globulin test result images | |
| CN110705447A (en) | Hand image detection method and device and electronic equipment | |
| CN111967739A (en) | Concentration degree-based online teaching method and system | |
| CN110889836A (en) | Image data analysis method and device, terminal equipment and storage medium | |
| CN112529888B (en) | Face image evaluation method, device, equipment and medium based on deep learning | |
| CN116913526B (en) | Normalization feature set up-sampling method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230203 |
|
| RJ01 | Rejection of invention patent application after publication |