CN109949900B

CN109949900B - Three-dimensional pulse wave display method and device, computer equipment and storage medium

Info

Publication number: CN109949900B
Application number: CN201910166739.2A
Authority: CN
Inventors: 彭勃
Original assignee: Zhimei Kangmin Zhuhai Health Technology Co Ltd
Current assignee: Zhimei Kangmin (Zhuhai) Health Technology Co., Ltd
Priority date: 2019-03-06
Filing date: 2019-03-06
Publication date: 2021-07-06
Anticipated expiration: 2039-03-06
Also published as: CN109949900A

Abstract

The invention relates to a method and a device for displaying three-dimensional pulse waves, computer equipment and a storage medium, and belongs to the technical field of signal processing. The method comprises the following steps: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; and if the first characteristic information is matched with the identification evaluation information, outputting the pulse wave animation file in a display screen according to an augmented reality technology so as to display the three-dimensional pulse wave. By the technical scheme, the problem that man-machine interaction is not intelligent enough in the display of the traditional three-dimensional pulse wave image is solved. When the identification object meets a certain condition, AR display of the three-dimensional pulse wave can be realized, and the intelligence of human-computer interaction is effectively improved.

Description

Three-dimensional pulse wave display method and device, computer equipment and storage medium

Technical Field

The present invention relates to the field of signal processing technologies, and in particular, to a method and an apparatus for displaying three-dimensional pulse waves, a computer device, and a storage medium.

Background

In traditional Chinese medicine diagnosis, the pulse condition obtained by palpation can be used for analyzing the overall health condition of a patient. With the continuous popularization and promotion of pulse diagnosis instruments, the demand of users for pulse condition visualization is increasing. The three-dimensional pulse wave image is an image in a three-dimensional dynamic form, and can convert the finger-down feeling during manual pulse taking into visual experience. In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: the three-dimensional pulse wave image is preset with an observation path by a designer, and a user can only check the three-dimensional pulse wave through the set observation path, so that the human-computer interaction is not intelligent enough.

Disclosure of Invention

Based on this, the embodiment of the invention provides a three-dimensional pulse wave display method and device, a computer device and a storage medium, which can display the three-dimensional pulse wave according to an augmented reality technology, and effectively improve the intelligence of human-computer interaction.

The content of the embodiment of the invention is as follows:

a method for displaying three-dimensional pulse waves comprises the following steps: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; and if the first characteristic information is matched with the identification evaluation information, outputting the pulse wave animation file in a display screen according to an augmented reality technology so as to display the three-dimensional pulse wave.

In one embodiment, the identification evaluation information includes second characteristic information of the sticker model; if the first characteristic information is matched with the identification evaluation information, before the step of outputting the pulse wave animation file in a display screen according to the augmented reality technology, the method further comprises the following steps: determining the matching degree of the first characteristic information and the second characteristic information; and when the matching degree meets a preset condition, judging that the first characteristic information is matched with the identification evaluation information.

In one embodiment, before determining the matching degree between the first feature information and the second feature information, the method further includes: obtaining a model image of a sticker model, and carrying out binarization processing on the model image; and determining the characteristic points of the model image subjected to binarization processing, and determining the second characteristic information according to the characteristic points of the model image.

In one embodiment, the identification object comprises a target sticker; the target paster is pasted on the skin surface of the wrist of the human body; the step of outputting the pulse wave animation file in a display screen according to the augmented reality technology comprises the following steps: determining the position of the target paster, and determining the position of a set pulse on the wrist of the human body according to the position of the target paster; the set pulse comprises at least one of: cun, guan and chi vessels; determining a display position on a display area of a display screen according to the position of the set pulse; and outputting the pulse wave animation file on the display position.

In one embodiment, after the step of outputting the pulse wave animation file in the display screen according to the augmented reality technology to display the three-dimensional pulse wave, the method further includes: setting an anchor point according to the display position; and the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.

In one embodiment, the step of obtaining a pulse wave animation file corresponding to a three-dimensional pulse wave of a pulse includes: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; generating space curved surface information with a set format according to the space distribution information to obtain the three-dimensional pulse wave; and arranging the three-dimensional pulse waves according to a time sequence, and obtaining the pulse wave animation file according to the arranged three-dimensional pulse waves.

In one embodiment, the step of arranging the three-dimensional pulses in a time sequence includes: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence.

Accordingly, an embodiment of the present invention provides a display device for three-dimensional pulse waves, including: the animation file acquisition module is used for acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; the characteristic information acquisition module is used for acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; and the pulse wave display module is used for outputting the pulse wave animation file in a display screen according to the augmented reality technology to display the three-dimensional pulse wave if the first characteristic information is matched with the identification evaluation information.

According to the three-dimensional pulse wave display method and device, the first characteristic information is determined according to the image of the identification object, and when the first characteristic information is matched with the identification evaluation information, the three-dimensional pulse wave is displayed according to the augmented reality technology. When the identification object meets a certain condition, AR display of the three-dimensional pulse wave can be realized, and the intelligence of human-computer interaction is effectively improved.

A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; and if the first characteristic information is matched with the identification evaluation information, outputting the pulse wave animation file in a display screen according to an augmented reality technology so as to display the three-dimensional pulse wave. The computer equipment can realize AR display of the three-dimensional pulse wave when the identification object meets certain conditions, and effectively improves the intelligence of human-computer interaction.

A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; and if the first characteristic information is matched with the identification evaluation information, outputting the pulse wave animation file in a display screen according to an augmented reality technology so as to display the three-dimensional pulse wave. The computer-readable storage medium can realize AR display of the three-dimensional pulse wave when the identification object meets a certain condition, and effectively improves the intelligence of human-computer interaction.

Drawings

FIG. 1 is a diagram of an exemplary embodiment of a three-dimensional pulse wave display method;

FIG. 2 is a flow chart illustrating a method for displaying three-dimensional pulses according to an embodiment;

FIG. 3 is a schematic diagram of a structure for displaying three-dimensional pulse waves on a display screen according to an embodiment;

FIG. 4 is a schematic view of an embodiment of attaching a target sticker to a human wrist;

FIG. 5 is a schematic diagram of a sensor array in one embodiment;

FIG. 6 is a schematic diagram illustrating a structure of a spatial curved surface corresponding to spatial curved surface information in one embodiment;

fig. 7 is a block diagram of a display device for three-dimensional pulses in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 1. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor is configured to provide computational and control capabilities. The memory comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface is used for communicating with an external terminal through network connection, such as: and the pulse wave animation file is connected with a certain server and used for receiving the pulse wave animation file sent from the server. The computer program is executed by a processor to implement a method for displaying a three-dimensional pulse wave. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like. Those skilled in the art will appreciate that the architecture shown in fig. 1 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

The embodiment of the invention provides a method and a device for displaying three-dimensional pulse waves, computer equipment and a storage medium. The following are detailed below.

In one embodiment, as shown in fig. 2, a method for displaying a three-dimensional pulse wave is provided. The method is described by taking the example of being applied to a computer device.

The computer device refers to a terminal for displaying three-dimensional pulse waves, and may refer to a terminal with a display screen, for example: televisions, personal computers, notebook computers, smart phones, tablet computers, head-mounted display devices, and the like. When the computer device is a smart phone, the system of the smart phone can be Android, IOS, Windows and the like, and AR implementation tools such as ARKit, ARCore and the like can be integrated on the smart phone. When the computer device is a head-mounted display device, it may be a Hololens, Magic Leap lightnear, or the like. The computer equipment can be provided with a camera which can be a camera with a depth sensing function, the camera with the depth sensing function can grab three-dimensional feature points of a space area, and then judges whether an identification object is caught or not, and then determines the pulse position. If the computer device is not provided with a camera with a depth sensing function but a plane camera, a sticker can be pasted on a radial artery and other positions, and the pulse position can be determined through the recognition of the sticker.

The method for displaying a three-dimensional pulse wave provided by the embodiment comprises the following steps:

s201, obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse.

The pulse may refer to various types of pulses on a human body, for example: cun pulse, guan pulse, chi pulse (cun pulse, guan pulse and chi pulse together may be referred to as cun guan chi), etc. Three-dimensional pulse waves refer to a stereoscopic representation of pulse condition information, which may also be referred to as pulse condition models in some embodiments. The pulse wave animation file refers to an animation file representing information such as the shape, size, amplitude, playing rate and the like of the three-dimensional pulse wave, wherein the pulse wave animation refers to animation corresponding to the three-dimensional pulse wave.

S202, acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used to indicate the location of the pulse.

The identification object refers to an object for which feature analysis is performed, and the object may be various contents having identification functions, such as: the device comprises stickers, articles with specific shapes and the outline of the wrist of a human body (the position of a certain pulse can be analyzed according to the external outline of the wrist of the human body). The image identifying the object may be indicative of an image identifying the object itself; or an image of an object containing the identified object, for example: an image is provided which identifies the subject's human wrist.

In addition, the image of the identification object can be captured by a camera in real time, or can be read from a pre-stored image. The implementation process of determining the first feature information according to the image may be: the image pixels are analyzed, characteristics of the image such as frequency, contrast and brightness are determined, and the characteristics are used as first characteristic information.

And S203, if the first characteristic information is matched with the identification evaluation information, outputting a pulse wave animation file in a display screen according to the augmented reality technology so as to display the three-dimensional pulse wave.

The identification evaluation information refers to information capable of evaluating the first characteristic information, and can refer to characteristic information with reference value; may be information corresponding to an object used to evaluate the characteristic of the identified object. The first feature information represents the feature of the identification object, the feature is compared with the identification evaluation information, and if the feature of the identification object is consistent with the identification evaluation information or the similarity of the feature of the identification object and the identification evaluation information meets a certain condition, the first feature information can be considered to be matched with the identification evaluation information. The identification evaluation information may be stored in an internal memory of the computer device in advance, or may be acquired from other devices in a certain manner.

Augmented Reality (AR) is a new technology for integrating real world information and virtual world information in a superimposed manner. By means of the electronic information science technology and corresponding equipment, the AR technology simulates and superposes objective information (such as visual information, touch sense or other information and the like) which is limited by a time space range and is difficult to experience in the original real world, and then applies the objective information to the real world, so that human sense can generate the illusion that the object information exists in the real world, and the beyond-reality sense experience can be achieved. At present, the augmented reality technology is often realized through AR glasses and mobile phones supporting AR functions.

Taking a smart phone as an example, a three-dimensional pulse wave displayed on the smart phone by the augmented reality technology can be as shown in fig. 3 (the three-dimensional pulse wave represents a skin surface that is raised during pulse beat). Fig. 3 shows the corresponding three-dimensional pulse wave near the position of the wrist cun-guan scale of the target human body, and the displayed three-dimensional pulse wave is very visual. In addition, because the displayed three-dimensional pulse wave is a pulse condition curved surface which changes in real time, the difference of different pulse conditions in form can be well embodied in the displayed three-dimensional pulse wave, such as: the three-dimensional pulse wave of the flat pulse is similar to a cone-shaped curved surface, while the string pulse is obviously elongated in the blood flow direction and is in a 'string' shape, and the three-dimensional pulse waves of the two pulse conditions are obviously distinguished and clear at a glance.

Before displaying the three-dimensional pulse wave, the pulse wave animation file can be processed by a specific tool (such as Unity 3D) so that the pulse wave animation file can be better displayed on an AR (augmented reality) computer device.

In the embodiment, the identification object is analyzed, AR display of the three-dimensional pulse wave can be realized when the identification object meets certain conditions, and the intelligence of man-machine interaction is effectively improved.

In one embodiment, the three-dimensional pulse wave comprises a single pulse period of the three-dimensional pulse wave; wherein a single pulse cycle comprises a plurality of time instants. The plurality of time instants may be determined in dependence on a sampling frequency of the sensor array. The pulse signal can be regarded as a periodic signal as a whole. Therefore, on the premise of ensuring the playing effect, in order to save the calculation amount and improve the efficiency of computer equipment, a single pulse period can be intercepted from the original pulse wave signal to carry out animation production, and the periodic jumping of the three-dimensional pulse wave is realized in a circulating mode. Further, the step of outputting the pulse wave animation file at the display position of the display screen according to the augmented reality technology comprises the following steps: according to the augmented reality technology, a pulse wave animation file is output on a display position for multiple times so as to periodically display a three-dimensional pulse wave of a single pulse period. Of course, in order to improve the accuracy of the displayed three-dimensional pulse wave, a pulse wave animation file of a plurality of pulse wave periods can be obtained, and a continuous pulse wave animation file can be obtained and displayed in real time.

In one embodiment, analyzing the image of the identified object may be implemented by SIFT, Vuforia (a software development kit for mobile device augmented reality applications developed by highpass), or the like.

The basic idea of the algorithm in the AR application related to image recognition is to establish a spatial coordinate system through a device camera, perform image registration through feature points, fiducial marks and optical flows, and perform image processing using corner points, blobs, edges or thresholds. Most of recognition algorithms based on feature point detection are improved based on the SIFT algorithm.

The SIFT algorithm (full scale invariant feature transform algorithm) is published in 1999 by David Lowe and perfectly summarized in 2004, is used for searching and describing local features of images, is a classic image recognition algorithm taking extreme points of a scale space as feature points, and is widely applied to the fields of gesture recognition, robot map perception navigation, image tracking and the like. The SIFT algorithm can be divided into four phases: 1. detecting an extreme value of the scale space by using a Gaussian differential function, and identifying potential feature points on the image position; 2. on each candidate position, positioning the characteristic points through a fitting model of the characteristics to determine the position and the scale; 3. the third stage is based on the local gradient direction of the image and distributes the direction for the characteristic points; 4. the feature points are described. In the embodiment of the invention, the corresponding first characteristic information can be determined according to the description of the characteristic points.

Further, the SIFT algorithm uses gaussian blur (i.e., the aforementioned gaussian differential function) to obtain the scale space in the feature point search stage. As an image filter universal for multiple algorithms, Gaussian blur uses a Gaussian function to calculate an image blur template, so that the purpose of blurring an image to acquire edges and characteristics is achieved. In the N-dimensional space, the gaussian normal distribution equation is as follows:

further, assuming that the size of the image of the identification object is m × n (describing the distribution of the pixel points), the second-order gaussian normal distribution equation corresponding to the element (x, y) is:

in an actual image processing program, the size of the gaussian template matrix is usually obtained by (6 σ +1) × (6 σ +1) calculation, so that the influence of the relevant pixels can be ensured. And (4) convolving the numerical value obtained by the second-order Gaussian formula with the original image to obtain the Gaussian blur image of the original image. From this gaussian-blurred image, the characteristic points in the image of the identification object can be determined.

Further, the scale calculation of the feature points is performed by adopting a scale space method. The scale space is an important theory proposed by Iijima in 1962 that is widely applicable to the field of computer vision. The method introduces the traditional single-scale image information processing technology into an image information processing dynamic model with continuously changing scales, establishes a scale space representation sequence under multiple scales, and extracts a main contour as a feature vector from the scale space representation sequence, thereby realizing the feature extraction of image edges, corner points and the like.

The scale space L (x, y, σ) of the image L is defined as the convolution of the image second order gaussian function G (x, y, σ) with the original image I (x, y), i.e.:

L(x,y,σ)＝G(x,y,σ)*I(x,y)

the smaller the value of σ, the lighter the representation image is smoothed, and the smaller the corresponding scale. Thus, the large scale corresponds to the global profile features of the image, and the small scale corresponds to the detail features of the image.

On the other hand, Vuforia is a practical augmented reality software, has extremely strong compatibility, and provides an application toolkit for a plurality of mainstream development platforms including unity. The method utilizes the computer vision technology to recognize and capture the plane image and the three-dimensional object in real time, and provides an interface and a plug-in for a user, thereby facilitating the application development with the augmented reality function. The high-pass Vufaria has 9 assemblies in total, and can realize rich functions. Tracking targets in image formats such as JPG (joint photographic experts group) and the like can be identified and captured through a lens, targets which accord with comparison data in the real world can be identified, and even a specific three-dimensional model can be identified through a given two-dimensional external contour image; the ObjectTarget component functions to identify the three-dimensional model scanned by the scanner android application provided by Vuforia from the feature point cloud and the feature plane. In the above components, Vuforia uses a self-defining changeable image recognition algorithm to detect and describe the spatial model and the planar image local features, and has good application performance in the aspects of object recognition, image stitching, 3D model building and the like.

In order to reduce the operation difficulty and the data complexity of color identification, the self-contained Vuforia algorithm firstly carries out preprocessing such as binarization, noise reduction and the like on an image. Then, the algorithm searches gray feature points in a space coordinate system or a plane image to form a feature point cloud, and extracts information such as position coordinates and quaternary vectors (a parameter describing space rotation) of each point for identification processing. The characteristic points based on the local appearance of the image belong to local characteristics, are not influenced by the color, the size and the rotation translation of the image, have certain fault-tolerant capability on affine transformation, visual angle change, local target shielding and color of the image, are easy to collect, have high detection rate and light system load, and are suitable for precise matching in small and medium-sized characteristic databases. Based on the above characteristics, the Vufoira algorithm can quickly identify and match the identification object.

In the embodiment, the image of the identification object is analyzed by a set method, the characteristic points in the image can be accurately extracted, the position of the pulse is accurately determined, and finally, the accurate display of the three-dimensional pulse wave is realized.

In one embodiment, the identification evaluation information includes second characteristic information of the sticker model; before S203, the method further includes: determining the matching degree of the first characteristic information and the second characteristic information; and when the matching degree meets a preset condition, judging that the first characteristic information is matched with the identification evaluation information.

Before determining the matching degree of the first characteristic information and the second characteristic information, the method further comprises the following steps: obtaining a model image of the sticker model, and carrying out binarization processing on the model image; and determining the characteristic points of the model image subjected to binarization processing, and determining second characteristic information according to the characteristic points of the model image.

Specifically, the implementation process of determining the second feature information may be: uploading the image of the manufactured identification object in the JPG format (of course, the image can be in other formats) to computer equipment; and the computer equipment automatically carries out preprocessing such as binaryzation on the image, then identifies the feature points and carries out identification accuracy evaluation so as to obtain second feature information, and the second feature information is stored in the database. After completion, the database is packed and imported into a Unity (Unity combines with ARCore/Vuforia to provide technical support for enhanced display of a computer device) project, and activation of the database is completed. Each image in the database is an Imagetarget object, the target object can be dynamically loaded through a function method and a file name, and the second characteristic information can be directly read from the database when information comparison is needed.

In addition, the condition that the matching degree needs to meet can be that the matching degree is greater than a certain preset threshold value; this threshold value may be determined on an actual basis.

Determining the degree of matching of the first characteristic information and the second characteristic information may be accomplished along with a moving process of the computer device. Specifically, taking a mobile phone as an example, a user holds the mobile phone, and directs a camera of the mobile phone to an identification object, the camera of the mobile phone obtains an image of the identification object, determines first feature information of the identification object according to the image, continuously calculates a matching degree of the first feature information and second feature information, determines that the first feature information is matched with the second feature information when the matching degree is greater than a preset threshold, and outputs prompt information (the prompt information can be output on a display screen of the mobile phone).

The embodiment determines second characteristic information according to the sticker model; and comparing the predetermined second characteristic information with the first characteristic information acquired by the computer equipment, and displaying the corresponding three-dimensional pulse wave when the matching degree of the two meets a preset condition. The display of the three-dimensional pulse wave is realized through the interaction process with the user, and the intelligence of the three-dimensional pulse wave display interaction is effectively improved.

In one embodiment, the identification object comprises a target sticker; the target paster is pasted on the skin surface of the wrist of the human body; s203 includes: determining the position of the target sticker, and determining the position of the set pulse on the wrist of the human body according to the position of the target sticker; setting the pulse includes at least one of: cun, guan and chi vessels; determining a display position on a display area of a display screen according to the position of the set pulse; and outputting the pulse wave animation file on the display position.

The target paster can be pasters with various shapes and colors, and patterns, characters and the like can be arranged on the target paster. The embodiment of the invention does not limit the form of the target sticker and the content form on the target sticker, and can play a role in marking. Further, the target sticker can be pasted on the position of the small dimension of the wrist of the human body (the wrist of the human body pasted with the target sticker can be as shown in fig. 4, wherein 401 represents the target sticker), the image pasted with the target sticker is shot by the camera of the mobile phone, and the position of the small dimension is determined according to the image.

The implementation process of determining the position of the target sticker may be: and determining the position of the cun-guan ruler on the wrist of the human body according to the position of the target sticker on the wrist of the human body, and further obtaining the spatial position of the cun-guan ruler. The display position is determined from this spatial position.

Further, the display position in the display screen is determined according to the position of the set pulse, and the display position may be determined at a position near the set pulse, for example, a position near the customs scale as the display position. Further, since the three-dimensional pulse wave is often a curved area, and the displayed three-dimensional pulse wave may include a plurality of pulse waves corresponding to the pulse wave, the location space required for displaying the three-dimensional pulse wave may be a "stereoscopic space area", and thus the display location may be a space area. Of course, the display position may be a point, so that the three-dimensional pulse wave is displayed with the point as the center; the display position may be one plane, and the three-dimensional pulse wave may be displayed above or below the plane region.

Furthermore, when the three-dimensional pulse wave is a pulse wave corresponding to a plurality of pulse waves, the display positions of the pulse waves can be respectively determined.

The display position is determined according to the position of the set pulse on the wrist of the target human body, so that the three-dimensional pulse wave displayed on the computer equipment is 'long' on the wrist of the target human body, and the intuitiveness of the three-dimensional pulse wave display can be improved. In addition, the pulse wave animation file may refer to an animation file corresponding to the target human wrist, and in this case, an effect of displaying the three-dimensional pulse wave of the target human wrist on the target human wrist can be achieved.

In one embodiment, after S203, the method further comprises the steps of: setting an anchor point according to the display position; the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.

The anchor point may be set according to the display position, an area corresponding to the display position may be set as the anchor point area, or an area near or related to the display position may be determined as the anchor point area. Further, the anchor point region can be determined according to the spatial position of the target sticker, and then the anchor point is set, so that the anchor point region keeps a position-invariant state in the display screen, for example: anchor points are arranged in the area where the customs size is located (the position where the target sticker is pasted).

When the three-dimensional pulse wave is a pulse wave corresponding to a plurality of pulse waves, an anchor point may be set for each pulse wave, so that each pulse wave is maintained at a fixed position in the display environment (virtual environment in which the displayed content is located). Namely, a plane anchor point is established and bound for each pulse condition model (three-dimensional pulse wave), when the equipment per se generates displacement transformation relative to the coordinates, the coordinates of the pulse condition model can be correspondingly calculated and changed, so that the three-dimensional pulse condition model in the lens image can keep the virtual fixation of the plane and cannot move along with the lens.

The embodiment can realize the motion tracking of the computer equipment, namely when the computer equipment has position change, the displayed three-dimensional pulse wave is ensured to be kept unchanged relative to the display position in the screen, namely, the method can be understood as follows: no matter how the display screen rotates, the position of the three-dimensional pulse wave in the display environment is fixed, and the process of screen rotation can be understood as observing the three-dimensional pulse wave from different angles, so that the intelligent interaction of the three-dimensional pulse wave display can be effectively improved.

In one embodiment, step S201 includes: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; generating space curved surface information with a set format according to the space distribution information to obtain a three-dimensional pulse wave; and arranging the three-dimensional pulse waves according to a time sequence, and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.

The pulse condition sensing information may refer to pulse condition information measured by the pulse condition sensing device. Since the pulse is usually a region corresponding to the surface of the human body, the pulse condition sensing device needs to acquire the sensing information of the region. Based on this, the spatial distribution information of the pulse condition, i.e. the information of the pulse condition at a specific spatial position (e.g. the pressure data at a certain position) can be determined according to the pulse condition sensing information of a region.

The pulse condition sensing device can be various sensors, and the sensors can be arranged on the pulse diagnosis instrument. The plurality of sensors are arranged together to form a sensor array, so that pulse condition sensing information can be acquired through the sensor array. The sensor array can be as shown in fig. 5, and a plurality of sensors are arranged in a criss-cross manner to form the sensor array, so that the sensor array can acquire pulse condition information of each position in the area where the pulse is located. The sensor may be a pressure sensor or the like. Specifically, the pulse condition sensing device may be a capacitive pressure sensor (the corresponding pulse condition sensing information is pressure value information). While the sensor array may have some flexibility.

Further, the step of obtaining the spatial distribution information of the pulse condition comprises: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; integrating the pulse condition sensing information according to the arrangement relationship to obtain the spatial distribution information of the pulse condition. The area where the pulse is located refers to a small area on the skin surface where the pulse can be sensed (the boundary of the area can be determined according to whether the sensor can sense the pulse condition information).

Since the spatial distribution information is the pulse condition information in a certain space, the process of pulse up-and-down beating can form a curved surface in a small range, as shown in fig. 6. Integrating the obtained spatial distribution information to obtain corresponding spatial curved surface information; this integration process may be a certain operation or format conversion of the spatial distribution information. In addition, the set format may be FBX, DAE, STL, OBJ, or the like, and the specific format selected may be determined as the case may be.

Furthermore, the spatial curved surface information at a certain moment may correspond to a curved surface, and the spatial curved surface information at multiple moments may correspond to a continuously-jumping curved surface. The information corresponding to the continuously pulsating surface is a three-dimensional pulse wave.

In one embodiment, before the step of obtaining the three-dimensional pulse wave according to the spatial curved surface information with the set format, the method further includes: and generating the spatial curved surface information in the STL format according to the spatial distribution information. Further, determining the spatial distribution information and performing format conversion on the spatial distribution information may be implemented by a matlab tool. The embodiment determines the spatial curved surface information in the STL format, and the STL format can be well used in tools such as matlab and the like, so that the efficiency of displaying the three-dimensional pulse wave is improved. Of course, the process of determining the spatial distribution information and performing format conversion on the spatial distribution information may also be implemented by software such as Rhinoceros, solidworks, maya, and the like. At this time, spatial surface information in other formats may be generated.

The display method of the three-dimensional pulse wave can convert abstract pulse condition information into a pulse wave animation file, and display the three-dimensional pulse wave through an augmented reality technology, wherein the displayed three-dimensional pulse wave is very visual; and according to the characteristics of the augmented reality technology, a user can display the three-dimensional pulse wave as required, and meanwhile, the interaction with the three-dimensional pulse wave display can be realized, so that intelligent human-computer interaction is realized.

In one embodiment, the step of arranging the three-dimensional pulses in a time sequence comprises: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence. Wherein, the step of arranging the three-dimensional pulse wave according to the time sequence comprises: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence. Further, color rendering of the three-dimensional pulse wave can be realized through a certain algorithm; it can also be implemented by specific tools, such as: matlab, maya, etc. The process of color rendering through maya may be: performing color rendering on the three-dimensional pulse wave frame by frame (for example, the color is red when the amplitude of the waveform is higher, and the color is blue when the amplitude is lower, namely, the colors of the waveform from high to low are in transition in the order of red, orange, yellow, green and blue); color rendering can also be achieved by combining matlab and maya: generating space curved surface information of the three-dimensional pulse wave by utilizing the matlab; the colormap corresponding to each frame of the space surface information is added with the corresponding pulse wave animation information block (a plurality of pulse wave animation information blocks form a pulse wave animation file) in maya.

Further, maya arranges the rendered three-dimensional pulses according to a time sequence, so as to obtain a pulse animation file, and at this time, the pulse animation file in fbx format can be played everywhere (the pulse animation file in fbx format can be conveniently played on a tool such as a mobile phone, and of course, can be in other formats).

The step of obtaining the pulse wave animation file according to the arranged three-dimensional pulse wave comprises the following steps: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate. The display size determines the proportional relation between the three-dimensional pulse wave and the anchor point during AR playing, so a reasonable initial value needs to be set; the initial value of the playing speed is the real playing speed of the three-dimensional pulse wave.

According to the three-dimensional pulse wave display method provided by the embodiment, before the pulse wave animation file is generated, the color rendering, the time arrangement, the parameter adjustment and other processing are performed on the space curved surface information, so that the displayed three-dimensional pulse wave can be more visual, and the intelligence of the interactive display of the three-dimensional pulse wave is improved.

In one embodiment, the step of outputting the pulse wave animation file in the display screen according to the augmented reality technology further comprises the following steps: and if the first characteristic information is not matched with the identification evaluation information, stopping outputting the pulse wave animation file.

The case that the first feature information does not match the identification evaluation information may refer to: when the image of the identification object shot by the computer equipment is incomplete or has an angle deviation. Further, if the camera of the computer device generates a positional shift, resulting in the target sticker not being within the shooting range of the camera, the first feature information may be considered as not matching the identification evaluation information.

The three-dimensional pulse wave display method provided in this embodiment can calculate the matching degree between the first feature information of the identification object and the identification evaluation information in real time, display the three-dimensional pulse wave near the identification object when the matching degree between the first feature information and the identification evaluation information is high, and stop displaying the three-dimensional pulse wave when the matching degree between the first feature information and the identification evaluation information is not high.

Further, the specific implementation process may be: the user computer equipment scans the surrounding environment, when the similarity between the target sticker and the sticker model is high, the three-dimensional pulse wave is displayed, if the user continues to align the camera of the computer equipment with the identification object at the moment, the three-dimensional pulse wave is continuously displayed, and when the user moves away the camera of the computer equipment from the identification object and the matching degree of the camera of the computer equipment and the identification object is low, the three-dimensional pulse wave is not displayed. The three-dimensional pulse wave display method can effectively improve intelligent human-computer interaction in the three-dimensional pulse wave display process.

Specifically, the control of the three-dimensional pulse condition model in the AR scene can be realized in the DefaultTracbleEventHandler script file. By perfecting two key functions of OnTrackingPoint (finding the function of the identified object) and OnTrackingLost (the function of losing the identified object), the corresponding action of the three-dimensional pulse condition model is realized after the picture is successfully identified or disappears from the view finding range of the camera. For multi-image recognition, a Trackeblename (identification object recognition function) function is called to judge and distinguish the current recognition image, so that the function that different identification objects correspond to different pulse condition models is realized; furthermore, different target stickers are pasted at different pulse positions on the wrist of the human body (for example, the target stickers can be pasted at three positions of cun guan chi respectively), and after the target stickers are identified by the computer equipment, corresponding three-dimensional pulse waves are respectively displayed near the pulse positions.

In one embodiment, the step of obtaining a pulse wave animation file corresponding to a three-dimensional pulse wave includes: and downloading the pulse wave animation file from the ftp server. The ftp server is used for storing the pulse wave animation file and providing network support for the display of the computer device. After downloading the pulse wave animation file from the ftp server, the computer device can store the pulse wave animation file in the memory, and then read the pulse wave animation file in the memory when the three-dimensional pulse wave display is needed. Of course, the computer device can also acquire and play the pulse wave animation file from the ftp server in real time online.

The ftp server may or may not be a server that generates a pulse wave animation file. When the ftp server is not the server that generated the pulse wave animation file, the ftp server can receive the pulse wave animation file sent from the server that generated the pulse wave animation file.

According to the three-dimensional pulse wave display method provided by the embodiment, the computer equipment acquires the pulse wave animation file and displays the corresponding three-dimensional pulse wave according to the augmented reality technology, so that the computer equipment can display the three-dimensional pulse wave in real time, and the convenience of displaying the three-dimensional pulse wave is improved.

In some embodiments, the ftp server may be replaced with a web server, an nntp server, an smtp server, and the like. The device that generates the pulse wave animation file may be a terminal device, for example, a smartphone, instead of the server.

In one embodiment, a user may log in a pre-defined APP on a computer device, the APP having pre-configured thereon an associated implementation of the enhanced display technology. Based on this, after the user logs in the APP, the AR display of the three-dimensional pulse wave can be performed by acquiring the corresponding pulse wave animation file. In order to facilitate users to observe and learn the AR pulse condition model better, basic operation functions such as rotation, scaling, speed change and the like can be added in the APP; the method comprises the steps that a model transformation function is provided for meeting the requirement that a user views different pulse condition model samples (the model samples can refer to pulse condition models of different positions or different display modes pre-stored by the user, and of course, an APP (application) can also obtain pulse condition animation files corresponding to the pulse condition models from an ftp (file transfer protocol) server and the like in real time); after a correct user name and a correct password are input in an initial login interface of an APP, if a plurality of groups of models exist under the user name, the user can skip to enter a model selection interface; in order to meet the requirements of a large amount of data of future users and protect personal privacy, multi-user account switching is supported; finally, considering the factor of single-hand operation of the APP, a UI interface which is convenient for single-hand operation and can switch left and right hand modes is designed, and good interaction experience is provided for a user. Meanwhile, the heart rate file corresponding to the model can be read, the actual heart rate speed and the playing speed of the current pulse condition model can be obtained through calculation, and the actual heart rate speed and the playing speed are displayed on a screen through Text (as shown in fig. 3). The display method of the three-dimensional pulse wave provided by the embodiment is provided with various functions which can be controlled by a user, the three-dimensional pulse wave can be displayed according to the requirements of the user, and very good interactive experience is provided.

In order to better understand the above method, an application example of the method for displaying three-dimensional pulses according to the present invention is described in detail below by taking a mobile phone as an example.

1. And importing a model image of the sticker model on the mobile phone, processing the model image to obtain second characteristic information, and storing the second characteristic information into a database.

2. And downloading a pulse wave animation file corresponding to the three-dimensional pulse wave from the ftp server, and storing the pulse wave animation file in a memory.

3. And pasting a target paster on the inch-scale position of the wrist. The method comprises the steps of shooting an image of a target sticker through a camera of a mobile phone, and determining first characteristic information of the target sticker according to the image.

4. And determining the matching degree of the first characteristic information and the second characteristic information in the database, and judging that the first characteristic information is matched with the second characteristic information when the matching degree is higher than a preset threshold value.

5. And determining the position of the inch-off ruler on the wrist according to the position of the target sticker on the wrist of the human body, and determining the display position of the three-dimensional pulse wave near the position of the inch-off ruler.

6. And outputting the pulse wave animation file stored in the memory at the display position to display the three-dimensional pulse wave.

7. An anchor point is bound to each pulse condition model at the position of the cun-guan scale, and when the mobile phone per se generates displacement transformation relative to the coordinates, the coordinates of the pulse condition model can be correspondingly calculated and changed.

The display method of the three-dimensional pulse wave provided by the embodiment can realize the following functions:

1) as long as the target sticker is pasted on the wrist of the user, the pulse condition model can be immediately identified and successfully projected through the lens of the mobile phone. Because the target sticker is often distinctive in characteristic, the accuracy of target sticker identification can be effectively guaranteed, the identification of the three-dimensional pulse wave is more stable, and the implementation is relatively simple.

2) The three-dimensional display satisfies the spatial characteristics of the three-dimensional pulse wave, is convenient for researchers and speakers to freely switch the viewing angle for observing the three-dimensional pulse wave, and flexibly selects the observation angle in a dynamic state so as to quickly find each characteristic region of the pulse wave image.

3) The traditional Chinese medicine researchers can observe and experience the complete pulse condition and sense the finger feeling freely on the wrists at any time and any place.

4) The distance between the pulse diagnosis instrument and the user is shortened in an AR mode, and the spread and the popularity of the pulse condition and the pulse diagnosis of the traditional Chinese medicine are improved.

In a word, the three-dimensional pulse wave is put at the original pulse taking point position of the user, so that the characteristics of the three-dimensional pulse wave image are more visually displayed, and a method with higher information content and more convenient observation is provided for multi-angle observation, pulse condition analysis, pulse condition recording and finger sense translation.

It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present invention is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present invention.

Based on the same idea as the display method of the three-dimensional pulse wave in the above embodiment, the present invention also provides a display device of the three-dimensional pulse wave, which can be used to execute the above display method of the three-dimensional pulse wave. For convenience of illustration, only the parts related to the embodiments of the present invention are shown in the schematic structural diagram of the three-dimensional pulse wave display device, and those skilled in the art will understand that the illustrated structure does not constitute a limitation to the device, and may include more or less components than those illustrated, or combine some components, or arrange different components.

As shown in fig. 7, the three-dimensional pulse wave display device includes an animation file obtaining module 701, a characteristic information obtaining module 702, and a pulse wave display module 703, which are described in detail as follows: the animation file obtaining module 701 is configured to obtain a pulse wave animation file corresponding to a three-dimensional pulse wave of a pulse. A feature information obtaining module 702, configured to obtain an image of an identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used to indicate the location of the pulse. And a pulse wave display module 703, configured to output a pulse wave animation file in the display screen according to the augmented reality technology if the first characteristic information matches the identification evaluation information, so as to display a three-dimensional pulse wave. The display device of the three-dimensional pulse wave provided by the embodiment can realize AR display of the three-dimensional pulse wave when the identification object meets a certain condition, and effectively improves the intelligence of human-computer interaction.

In one embodiment, the identification evaluation information includes second characteristic information of the sticker model; the display device of three-dimensional pulse wave still includes: the matching degree determining module is used for determining the matching degree of the first characteristic information and the second characteristic information; and the matching judgment module is used for judging that the first characteristic information is matched with the identification evaluation information when the matching degree meets the preset condition.

In one embodiment, the apparatus for displaying three-dimensional pulse waves further comprises: the image processing module is used for acquiring a model image of the sticker model and carrying out binarization processing on the model image; and the characteristic information determining module is used for determining the characteristic points of the model image subjected to the binarization processing and determining second characteristic information according to the characteristic points of the model image.

In one embodiment, the identification object comprises a target sticker; the target paster is pasted on the skin surface of the wrist of the human body; the pulse wave display module 703 includes: the pulse position determining submodule is used for determining the position of the target sticker and determining the position of the set pulse on the wrist of the human body according to the position of the target sticker; setting the pulse includes at least one of: cun, guan and chi vessels; the display position determining submodule is used for determining a display position on a display area of the display screen according to the position of the set pulse; and the animation file output submodule is used for outputting the pulse wave animation file on the display position.

In one embodiment, the apparatus for displaying three-dimensional pulse waves further comprises: the anchor point setting module is used for setting an anchor point according to the display position; the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.

In one embodiment, the animation file obtaining module 701 includes: the distribution information acquisition submodule is used for acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; the three-dimensional pulse wave determining submodule is used for generating space curved surface information in a set format according to the space distribution information to obtain a three-dimensional pulse wave; and the sequencing submodule is used for arranging the three-dimensional pulse waves according to a time sequence and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.

In one embodiment, the ordering sub-module includes: the color rendering unit is used for performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and the sequencing unit is used for sequencing the rendered three-dimensional pulse waves according to a time sequence.

In one embodiment, the sorting submodule is further configured to adjust setting parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate.

In one embodiment, the distribution information obtaining sub-module includes: the sensing information receiving unit is used for receiving pulse condition sensing information of the area where the pulse is sent by the sensor array; the arrangement relation acquisition unit is used for acquiring the arrangement relation of the sensor array; and the integration unit is used for integrating the pulse condition sensing information according to the arrangement relation to obtain the spatial distribution information.

In one embodiment, the apparatus for displaying three-dimensional pulse waves further comprises: and the output stopping module is used for stopping outputting the pulse wave animation file if the first characteristic information is not matched with the identification evaluation information.

In one embodiment, the animation file obtaining module 701 is further configured to download the pulse wave animation file from the ftp server.

It should be noted that, the display device of the three-dimensional pulse wave of the present invention corresponds to the display method of the three-dimensional pulse wave of the present invention one to one, and the technical features and the advantageous effects described in the embodiments of the display method of the three-dimensional pulse wave are all applicable to the embodiments of the display device of the three-dimensional pulse wave.

In addition, in the embodiment of the three-dimensional pulse wave display device illustrated above, the logic division of each program module is only an example, and in practical applications, the above function distribution may be performed by different program modules according to needs, for example, due to the configuration requirements of corresponding hardware or the convenience of implementation of software, that is, the internal structure of the three-dimensional pulse wave display device is divided into different program modules to perform all or part of the above described functions.

In one embodiment, a computer device is provided, which may be a cell phone, a head mounted display device, or the like. The computer device comprises a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; identifying a subject for indicating a location of a pulse; and if the first characteristic information is matched with the identification evaluation information, outputting a pulse wave animation file in a display screen according to the augmented reality technology so as to display the three-dimensional pulse wave.

In one embodiment, the identification evaluation information includes second characteristic information of the sticker model; if the first characteristic information is matched with the identification evaluation information, the processor executes the computer program and further realizes the following steps: determining the matching degree of the first characteristic information and the second characteristic information; and when the matching degree meets a preset condition, judging that the first characteristic information is matched with the identification evaluation information.

In one embodiment, the processor, when executing the computer program, further performs the steps of: obtaining a model image of the sticker model, and carrying out binarization processing on the model image; and determining the characteristic points of the model image subjected to binarization processing, and determining second characteristic information according to the characteristic points of the model image.

In one embodiment, the identification object comprises a target sticker; the target paster is pasted on the skin surface of the wrist of the human body; the processor, when executing the computer program, further performs the steps of: determining the position of the target sticker, and determining the position of the set pulse on the wrist of the human body according to the position of the target sticker; setting the pulse includes at least one of: cun, guan and chi vessels; determining a display position on a display area of a display screen according to the position of the set pulse; and outputting the pulse wave animation file on the display position.

In one embodiment, the processor, when executing the computer program, further performs the steps of: setting an anchor point according to the display position; the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.

In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; generating space curved surface information with a set format according to the space distribution information to obtain a three-dimensional pulse wave; and arranging the three-dimensional pulse waves according to a time sequence, and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.

In one embodiment, the processor, when executing the computer program, further performs the steps of: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence.

In one embodiment, the processor, when executing the computer program, further performs the steps of: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate.

In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; and integrating the pulse condition sensing information according to the arrangement relation to obtain spatial distribution information.

In one embodiment, the processor, when executing the computer program, further performs the steps of: and if the first characteristic information is not matched with the identification evaluation information, stopping outputting the pulse wave animation file.

In one embodiment, the processor, when executing the computer program, further performs the steps of: and downloading the pulse wave animation file from the ftp server.

In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse; acquiring an image of the identification object; acquiring first characteristic information of the identification object according to the image; identifying a subject for indicating a location of a pulse; and if the first characteristic information is matched with the identification evaluation information, outputting a pulse wave animation file in a display screen according to the augmented reality technology so as to display the three-dimensional pulse wave.

In one embodiment, the identification evaluation information includes second characteristic information of the sticker model; if the first characteristic information matches the identification rating information, the computer program when executed by the processor further performs the steps of: determining the matching degree of the first characteristic information and the second characteristic information; and when the matching degree meets a preset condition, judging that the first characteristic information is matched with the identification evaluation information.

In one embodiment, the computer program when executed by the processor further performs the steps of: obtaining a model image of the sticker model, and carrying out binarization processing on the model image; and determining the characteristic points of the model image subjected to binarization processing, and determining second characteristic information according to the characteristic points of the model image.

In one embodiment, the identification object comprises a target sticker; the target paster is pasted on the skin surface of the wrist of the human body; the computer program when executed by the processor further realizes the steps of: determining the position of the target sticker, and determining the position of the set pulse on the wrist of the human body according to the position of the target sticker; setting the pulse includes at least one of: cun, guan and chi vessels; determining a display position on a display area of a display screen according to the position of the set pulse; and outputting the pulse wave animation file on the display position.

In one embodiment, the computer program when executed by the processor further performs the steps of: setting an anchor point according to the display position; the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.

In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; generating space curved surface information with a set format according to the space distribution information to obtain a three-dimensional pulse wave; and arranging the three-dimensional pulse waves according to a time sequence, and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.

In one embodiment, the computer program when executed by the processor further performs the steps of: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence.

In one embodiment, the computer program when executed by the processor further performs the steps of: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate.

In one embodiment, the computer program when executed by the processor further performs the steps of: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; and integrating the pulse condition sensing information according to the arrangement relation to obtain spatial distribution information.

In one embodiment, the computer program when executed by the processor further performs the steps of: and if the first characteristic information is not matched with the identification evaluation information, stopping outputting the pulse wave animation file.

In one embodiment, the computer program when executed by the processor further performs the steps of: and downloading the pulse wave animation file from the ftp server.

It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which is stored in a computer readable storage medium and sold or used as a stand-alone product. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

The terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or (module) elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-described examples merely represent several embodiments of the present invention and should not be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A method for displaying three-dimensional pulse waves is characterized by comprising the following steps:

obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse;

capturing three-dimensional characteristic points in a space area through a camera with a depth sensing function to obtain an image of a marked object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; the identification object is the outline of the wrist of the human body;

if the first characteristic information is matched with the identification evaluation information, outputting the pulse wave animation file in a display screen according to an augmented reality technology so as to display the three-dimensional pulse wave;

the outputting the pulse wave animation file in a display screen according to an augmented reality technology to display the three-dimensional pulse wave includes: determining the position near the pulse as the display position of a display screen, and outputting the pulse wave animation file in the display position of the display screen according to the augmented reality technology so as to display the three-dimensional pulse wave; establishing and binding a plane anchor point for the three-dimensional pulse wave, and when the relative coordinate of the equipment per se is subjected to displacement transformation, carrying out corresponding calculation change on the coordinate of the three-dimensional pulse wave so that the three-dimensional pulse wave in a lens image keeps the virtual fixation of a plane;

after the step of outputting the pulse wave animation file in the display screen according to the augmented reality technology, the method further comprises the following steps of: if the first characteristic information is not matched with the identification evaluation information, stopping outputting the pulse wave animation file;

the method further comprises the following steps:

calculating the image of the identification object through a second-order Gaussian normal distribution equation, convolving the calculated numerical value with the original image of the identification object to obtain a Gaussian blur image of the original image, determining characteristic points in the image of the identification object according to the Gaussian blur image, and determining the position of the pulse according to the characteristic points.

2. The method for displaying a three-dimensional pulse wave according to claim 1, wherein the identification evaluation information includes second feature information of a sticker model;

if the first characteristic information is matched with the identification evaluation information, before the step of outputting the pulse wave animation file in a display screen according to the augmented reality technology, the method further comprises the following steps:

determining the matching degree of the first characteristic information and the second characteristic information;

and when the matching degree meets a preset condition, judging that the first characteristic information is matched with the identification evaluation information.

3. The method for displaying a three-dimensional pulse wave according to claim 2, wherein before determining the degree of matching between the first characteristic information and the second characteristic information, the method further comprises:

obtaining a model image of a sticker model, and carrying out binarization processing on the model image;

and determining the characteristic points of the model image subjected to binarization processing, and determining the second characteristic information according to the characteristic points of the model image.

4. The method of displaying a three-dimensional pulse wave according to claim 1, wherein the identification object includes a target sticker; the target paster is pasted on the skin surface of the wrist of the human body;

the step of outputting the pulse wave animation file in a display screen according to the augmented reality technology comprises the following steps:

determining the position of the target paster, and determining the position of a set pulse on the wrist of the human body according to the position of the target paster; the set pulse comprises at least one of: cun, guan and chi vessels;

determining a display position on a display area of a display screen according to the position of the set pulse;

and outputting the pulse wave animation file on the display position.

5. The method for displaying a three-dimensional pulse wave according to claim 4, wherein after the step of outputting the pulse wave animation file on a display screen according to an augmented reality technology to display the three-dimensional pulse wave, the method further comprises:

setting an anchor point according to the display position; and the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.

6. The method for displaying a three-dimensional pulse wave according to claim 1, wherein the step of obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse wave comprises:

acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse;

generating space curved surface information with a set format according to the space distribution information to obtain the three-dimensional pulse wave;

and arranging the three-dimensional pulse waves according to a time sequence, and obtaining the pulse wave animation file according to the arranged three-dimensional pulse waves.

7. The method for displaying a three-dimensional pulse wave according to claim 6, wherein said step of arranging said three-dimensional pulse wave in a time sequence comprises:

performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave;

and arranging the rendered three-dimensional pulse waves according to a time sequence.

8. The method for displaying a three-dimensional pulse wave according to claim 6, wherein the step of obtaining the pulse wave animation file according to the arranged three-dimensional pulse wave comprises:

adjusting the set parameters of the arranged three-dimensional pulse waves to obtain the pulse wave animation file; the setting parameters comprise display size and playing speed.

9. The method of displaying a three-dimensional pulse wave according to claim 6, wherein the step of obtaining the spatial distribution information of the pulse wave comprises:

receiving pulse condition sensing information of an area where a pulse is sent by a sensor array;

acquiring the arrangement relation of the sensor array;

and integrating the pulse condition sensing information according to the arrangement relation to obtain the spatial distribution information.

10. The method for displaying a three-dimensional pulse wave according to any one of claims 1 to 9, wherein the step of obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse wave comprises:

and downloading the pulse wave animation file from an ftp server.

11. A three-dimensional pulse wave display device, comprising:

the animation file acquisition module is used for acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave of the pulse;

the characteristic information acquisition module is used for capturing three-dimensional characteristic points in a space area through a camera with a depth sensing function so as to acquire an image of the identification object; acquiring first characteristic information of the identification object according to the image; the identification object is used for indicating the position of the pulse; the identification object is the outline of the wrist of the human body;

the pulse wave display module is used for outputting the pulse wave animation file in a display screen according to the augmented reality technology to display the three-dimensional pulse wave if the first characteristic information is matched with the identification evaluation information;

the pulse wave display module is also used for determining the position near the pulse wave as the display position of the display screen, and outputting the pulse wave animation file in the display position of the display screen according to the augmented reality technology so as to display the three-dimensional pulse wave; establishing and binding a plane anchor point for the three-dimensional pulse wave, and when the relative coordinate of the equipment per se is subjected to displacement transformation, carrying out corresponding calculation change on the coordinate of the three-dimensional pulse wave so that the three-dimensional pulse wave in a lens image keeps the virtual fixation of a plane;

further comprising: the stop output module is used for stopping outputting the pulse wave animation file if the first characteristic information is not matched with the identification evaluation information;

the device further comprises a module for executing the following steps:

12. The apparatus for displaying a three-dimensional pulse wave according to claim 11, wherein the identification evaluation information includes second characteristic information of a sticker model;

the display device of the three-dimensional pulse wave further comprises:

the matching degree determining module is used for determining the matching degree of the first characteristic information and the second characteristic information;

and the matching judgment module is used for judging that the first characteristic information is matched with the identification evaluation information when the matching degree meets a preset condition.

13. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 10 are implemented by the processor when executing the computer program.

14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 10.