CN109949928B - Three-dimensional pulse wave display method and device, computer equipment and storage medium - Google Patents

Three-dimensional pulse wave display method and device, computer equipment and storage medium Download PDF

Info

Publication number
CN109949928B
CN109949928B CN201910166627.7A CN201910166627A CN109949928B CN 109949928 B CN109949928 B CN 109949928B CN 201910166627 A CN201910166627 A CN 201910166627A CN 109949928 B CN109949928 B CN 109949928B
Authority
CN
China
Prior art keywords
pulse
pulse wave
model
display
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910166627.7A
Other languages
Chinese (zh)
Other versions
CN109949928A (en
Inventor
彭勃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhimei Kangmin (Zhuhai) Health Technology Co., Ltd
Original Assignee
Zhimei Kangmin Zhuhai Health Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhimei Kangmin Zhuhai Health Technology Co Ltd filed Critical Zhimei Kangmin Zhuhai Health Technology Co Ltd
Priority to CN201910166627.7A priority Critical patent/CN109949928B/en
Publication of CN109949928A publication Critical patent/CN109949928A/en
Application granted granted Critical
Publication of CN109949928B publication Critical patent/CN109949928B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to a method and a device for displaying three-dimensional pulse waves, computer equipment and a storage medium, and belongs to the technical field of signal processing. The method comprises the following steps: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by spatial distribution information; acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology. By the technical scheme, the problem that man-machine interaction is not intelligent enough in the display of the traditional three-dimensional pulse wave image is solved. The abstract pulse condition information can be converted into a pulse wave animation file, AR display of three-dimensional pulse waves is achieved, and the intelligence of human-computer interaction is effectively improved.

Description

Three-dimensional pulse wave display method and device, computer equipment and storage medium
Technical Field
The present invention relates to the field of signal processing technologies, and in particular, to a method and an apparatus for displaying three-dimensional pulse waves, a computer device, and a storage medium.
Background
In traditional Chinese medicine diagnosis, the pulse condition obtained by palpation can be used for analyzing the overall health condition of a patient. With the continuous popularization and promotion of pulse diagnosis instruments, the demand of users for pulse condition visualization is increasing. The three-dimensional pulse wave image is an image in a three-dimensional dynamic form, and can convert the finger-down feeling during manual pulse taking into visual experience. In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: the three-dimensional pulse wave image is preset with an observation path by a designer, and a user can only check the three-dimensional pulse wave through the set observation path, so that the human-computer interaction is not intelligent enough.
Disclosure of Invention
Based on this, the embodiment of the invention provides a three-dimensional pulse wave display method and device, a computer device and a storage medium, which can display the three-dimensional pulse wave according to an augmented reality technology, and effectively improve the intelligence of human-computer interaction.
The content of the embodiment of the invention is as follows:
a method for displaying three-dimensional pulse waves comprises the following steps: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by the spatial distribution information; obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; and the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology.
In an embodiment, the step of obtaining the pulse wave animation file corresponding to the three-dimensional pulse wave includes: and arranging the three-dimensional pulse waves according to a time sequence, and obtaining the pulse wave animation file according to the arranged three-dimensional pulse waves.
In one embodiment, the step of arranging the three-dimensional pulses in a time sequence includes: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to the time sequence.
In an embodiment, the step of obtaining the pulse wave animation file according to the arranged three-dimensional pulse wave includes: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain the pulse wave animation file; the setting parameters comprise display size and playing speed.
In one embodiment, before the step of obtaining the three-dimensional pulse wave according to the spatial curved surface information with the set format, the method further includes: and generating the spatial curved surface information in the STL format according to the spatial distribution information.
In one embodiment, the step of obtaining the spatial distribution information of the pulse condition comprises: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; and integrating the pulse condition sensing information according to the arrangement relation to obtain the spatial distribution information of the pulse condition.
In one embodiment, the step of sending the pulse wave animation file to a display terminal includes: sending the pulse wave animation file to an ftp server; sending file in-place information to a display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, and outputting the pulse wave animation file according to the augmented reality technology.
In an embodiment, an embodiment of the present invention provides a method for displaying a three-dimensional pulse wave, including the following steps: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave; the pulse wave animation file is obtained according to the space curved surface information of the pulse; determining the space position of the pulse, and determining a display position on a display area of a display screen according to the space position; and outputting the pulse wave animation file on the display position according to an augmented reality technology so as to display the three-dimensional pulse wave.
In an embodiment, the step of obtaining a pulse wave animation file corresponding to a three-dimensional pulse wave includes: receiving file in-place information; and downloading the pulse wave animation file from the ftp server according to the file in-place information, and outputting the pulse wave animation file according to the augmented reality technology.
In one embodiment, the three-dimensional pulse wave comprises a single pulse period of the three-dimensional pulse wave; wherein the single pulse cycle includes a plurality of time instants.
In one embodiment, the step of outputting the pulse wave animation file on the display position according to the augmented reality technology comprises: according to the augmented reality technology, the pulse wave animation file is output on the display position for multiple times so as to periodically display the three-dimensional pulse wave of the single pulse period.
Accordingly, an embodiment of the present invention provides a display device for three-dimensional pulse waves, including: the distribution information acquisition module is used for acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the area where the pulse is located; the pulse wave determining module is used for obtaining a three-dimensional pulse wave according to the space curved surface information with the set format; the spatial curved surface information is generated by the spatial distribution information; the first pulse wave display module is used for acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave and sending the pulse wave animation file to a display terminal; and the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology.
The embodiment of the present invention further provides a display device of three-dimensional pulse waves, including: the file acquisition module is used for acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave; the pulse wave animation file is obtained according to the space curved surface information of the pulse; the position determining module is used for determining the space position of the pulse and determining a display position on a display area of a display screen according to the space position; and the second pulse wave display module is used for outputting the pulse wave animation file on the display position according to the augmented reality technology so as to display the three-dimensional pulse wave.
According to the three-dimensional pulse wave display method and device, the spatial distribution information of the pulse wave is determined according to the pulse wave sensing information of the pulse, the three-dimensional pulse wave is obtained according to the spatial distribution information of the pulse wave, the pulse wave animation file corresponding to the three-dimensional pulse wave is obtained, and then the pulse wave animation file is output by the display terminal according to the augmented reality technology, so that the three-dimensional pulse wave is displayed. The abstract pulse condition information can be converted into a pulse wave animation file, AR display of three-dimensional pulse waves is achieved, and the intelligence of human-computer interaction is effectively improved.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by the spatial distribution information; obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; and the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology. The computer equipment can convert abstract pulse condition information into pulse wave animation files, realize AR display of three-dimensional pulse waves and effectively improve the intelligence of human-computer interaction.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by the spatial distribution information; obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; and the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology. The computer-readable storage medium can convert abstract pulse condition information into pulse wave animation files, realize AR display of three-dimensional pulse waves and effectively improve the intelligence of human-computer interaction.
Drawings
FIG. 1 is a diagram of an exemplary embodiment of a three-dimensional pulse wave display method;
FIG. 2 is a flow chart illustrating a method for displaying three-dimensional pulses according to an embodiment;
FIG. 3 is a schematic diagram of a sensor array in one embodiment;
FIG. 4 is a schematic diagram illustrating a surface structure corresponding to spatial surface information in one embodiment;
FIG. 5 is a diagram illustrating a structure of displaying three-dimensional pulse waves on a display screen according to an embodiment;
FIG. 6 is a schematic diagram of a structure for displaying three-dimensional pulse waves on a display screen in another embodiment;
FIG. 7 is a schematic diagram illustrating a structure of displaying three-dimensional pulse waves on a display screen according to still another embodiment;
FIG. 8 is a flow chart illustrating a method for displaying three-dimensional pulses in another embodiment;
FIG. 9 is a diagram illustrating an example of an interface for logging in an APP via a mobile phone;
FIG. 10 is a block diagram of an exemplary three-dimensional pulse wave display device;
FIG. 11 is a block diagram of a three-dimensional pulse wave display device according to another embodiment;
FIG. 12 shows an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The three-dimensional pulse wave display method provided by the application can be applied to the application environment shown in fig. 1. The application environment includes a server 101 and a display terminal 102, and the server 101 communicates with the display terminal 102 via a network. The server 101 generates a pulse wave animation file according to the spatial distribution information of the pulse condition and sends the pulse wave animation file to the display terminal 102; the display terminal 102 displays the corresponding three-dimensional pulse wave according to the augmented reality technology. The server 101 may be implemented by an independent server or a server cluster composed of a plurality of servers; of course, the server 101 may be replaced by a terminal having a data processing function, such as a smartphone. The display terminal 101 may be, but is not limited to, various televisions with display screens, personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices (e.g., head-mounted display devices, etc.).
The embodiment of the invention provides a method and a device for displaying three-dimensional pulse waves, computer equipment and a storage medium. The following are detailed below.
In one embodiment, as shown in fig. 2, a method for displaying a three-dimensional pulse wave is provided. Taking the application of the method to the server 101 in fig. 1 as an example for explanation, the method includes the following steps:
s201, acquiring space distribution information of pulse conditions; the spatial distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse.
The pulse may refer to various types of pulses on a human body, for example: cun pulse, guan pulse, chi pulse (cun pulse, guan pulse and chi pulse together may be referred to as cun guan chi), etc. The pulse condition sensing information may refer to pulse condition information measured by the pulse condition sensing device. Since the pulse is usually a region corresponding to the surface of the human body, the pulse condition sensing device needs to acquire the sensing information of the region. Based on this, the spatial distribution information of the pulse condition, i.e. the information of the pulse condition at a specific spatial position (e.g. the pressure data at a certain position) can be determined according to the pulse condition sensing information of a region.
The pulse condition sensing device can be various sensors, and the sensors can be arranged on the pulse diagnosis instrument. The plurality of sensors are arranged together to form a sensor array, so that pulse condition sensing information can be acquired through the sensor array. The sensor array can be as shown in fig. 3, and a plurality of sensors are arranged in a criss-cross manner to form the sensor array, so that the sensor array can acquire pulse condition information of each position in the area where the pulse is located. The sensor may be a pressure sensor or the like. Specifically, the pulse condition sensing device may be a capacitive pressure sensor (the corresponding pulse condition sensing information is pressure value information). While the sensor array may have some flexibility.
Further, the step of obtaining the spatial distribution information of the pulse condition comprises: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; integrating the pulse condition sensing information according to the arrangement relationship to obtain the spatial distribution information of the pulse condition. The area where the pulse is located refers to a small area on the skin surface where the pulse can be sensed (the boundary of the area can be determined according to whether the sensor can sense the pulse condition information).
S202, obtaining a three-dimensional pulse wave according to the space curved surface information in the set format; the spatial surface information is generated from the spatial distribution information.
Since the spatial distribution information is the pulse condition information in a certain space, the process of pulse up-and-down beating can form a curved surface in a small range, as shown in fig. 4. The obtained spatial distribution information is integrated to a certain extent, so that corresponding spatial curved surface information can be obtained; this integration process may be a certain operation or format conversion of the spatial distribution information. In addition, the set format may be FBX, DAE, STL, OBJ, or the like, and the specific format selected may be determined as the case may be.
Furthermore, the spatial curved surface information at a certain moment may correspond to a curved surface, and the spatial curved surface information at multiple moments may correspond to a continuously-jumping curved surface. The information corresponding to the continuously pulsating surface is a three-dimensional pulse wave (in some embodiments, the three-dimensional pulse wave may also be referred to as a pulse condition model).
S203, obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology.
The pulse wave animation file refers to an animation file representing information such as the shape, size, amplitude, playing rate and the like of the three-dimensional pulse wave, wherein the pulse wave animation refers to animation corresponding to the three-dimensional pulse wave.
Augmented Reality (AR) is a new technology for integrating real world information and virtual world information in a superimposed manner. By means of the electronic information science technology and corresponding equipment, the AR technology simulates and superposes objective information (such as visual information, touch sense or other information and the like) which is limited by a time space range and is difficult to experience in the original real world, and then applies the objective information to the real world, so that human sense can generate the illusion that the object information exists in the real world, and the beyond-reality sense experience can be achieved.
The display terminal refers to a terminal for displaying three-dimensional pulse waves, and may refer to a simple display screen, or a terminal with a display screen, for example: televisions, personal computers, notebook computers, smart phones, tablet computers, head-mounted display devices, and the like. When the display terminal is a smart phone, the system of the smart phone can be Android, IOS, Windows and the like, and tools such as ARKit, ARCore and the like can be configured on the smart phone. When the display terminal is a head-mounted display device, the display terminal may be a device such as a Hololens device, a Magic Leap lightnear device, or the like. Specifically, for example, in the case of a head-mounted display device, after receiving a pulse wave animation file sent by the server 101, the Hololens displays a three-dimensional pulse wave on a display screen by outputting the pulse wave animation file.
Can be provided with the camera on the demonstration terminal, this camera can be the camera that has the degree of depth sensing function, and this kind of camera that has the degree of depth sensing function can carry out snatching of three-dimensional characteristic point to human parts such as wrist, and then directly acquire the spatial position of pulse. If the display terminal is not provided with a camera with a depth sensing function but a plane camera, a sticker can be pasted on the radial artery and other positions, and the space position of the pulse is determined through the recognition of the sticker.
Taking a smart phone as an example, a three-dimensional pulse wave displayed on the smart phone by the augmented reality technology can be shown as fig. 5/6/7. The graph 5/6/7 shows the corresponding three-dimensional pulse wave near the cun-guan position of the wrist (the three-dimensional pulse wave in the graph represents the raised skin surface during pulse beating), and the displayed three-dimensional pulse wave is very intuitive. In addition, because the displayed three-dimensional pulse wave is a pulse condition curved surface which changes in real time, the difference of different pulse conditions in form can be well embodied in the displayed three-dimensional pulse wave, such as: the three-dimensional pulse wave of the flat pulse is similar to a cone-shaped curved surface, while the string pulse is obviously elongated in the blood flow direction and is in a 'string' shape, and the three-dimensional pulse waves of the two pulse conditions are obviously distinguished and clear at a glance.
Meanwhile, the display terminal can display the three-dimensional pulse wave in an interactive mode with the user, for example, when the camera of the display terminal identifies the wrist of the human body, the three-dimensional pulse wave is displayed near the wrist of the human body. The playing speed, the playing angle and the like of the displayed three-dimensional pulse wave can be controlled, and the interactivity of the three-dimensional pulse wave display is effectively improved.
Before the three-dimensional pulse wave is displayed through the display terminal, the pulse wave animation file can be processed through a specific tool (such as Unity 3D) so that the pulse wave animation file can be better displayed on the display terminal in an AR manner.
The display method of the three-dimensional pulse wave can convert abstract pulse condition information into a pulse wave animation file, and display the three-dimensional pulse wave through an augmented reality technology, wherein the displayed three-dimensional pulse wave is very visual; and according to the characteristics of the augmented reality technology, a user can display the three-dimensional pulse wave as required, and meanwhile, the interaction with the three-dimensional pulse wave display can be realized, so that intelligent human-computer interaction is realized.
In one embodiment, before the step of obtaining the three-dimensional pulse wave according to the spatial curved surface information with the set format, the method further includes: and generating the spatial curved surface information in the STL format according to the spatial distribution information. Further, determining the spatial distribution information and performing format conversion on the spatial distribution information may be implemented by a matlab tool. The embodiment determines the spatial curved surface information in the STL format, and the STL format can be well used in tools such as matlab and the like, so that the efficiency of displaying the three-dimensional pulse wave is improved.
Of course, the process of determining the spatial distribution information and performing format conversion on the spatial distribution information may be implemented by software such as Rhinoceros, solidworks, maya, and the like. At this time, spatial surface information in other formats may be generated.
In one embodiment, the step of obtaining a pulse wave animation file corresponding to a three-dimensional pulse wave includes: and arranging the three-dimensional pulse waves according to a time sequence, and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.
Wherein, the step of arranging the three-dimensional pulse wave according to the time sequence comprises: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence. Further, color rendering of the three-dimensional pulse wave can be realized through a certain algorithm; it can also be implemented by specific tools, such as: matlab, maya, etc. The process of color rendering through maya may be: performing color rendering on the three-dimensional pulse wave frame by frame (for example, the color is red when the amplitude of the waveform is higher, and the color is blue when the amplitude is lower, namely, the colors of the waveform from high to low are in transition in the order of red, orange, yellow, green and blue); color rendering can also be achieved by combining matlab and maya: generating space curved surface information of the three-dimensional pulse wave by utilizing the matlab; the colormap corresponding to each frame of the space surface information is added with the corresponding pulse wave animation information block (a plurality of pulse wave animation information blocks form a pulse wave animation file) in maya.
Further, maya arranges the rendered three-dimensional pulses according to a time sequence, so as to obtain a pulse animation file, and at this time, the pulse animation file in fbx format can be played everywhere (the pulse animation file in fbx format can be conveniently played on a tool such as a mobile phone, and of course, can be in other formats).
The step of obtaining the pulse wave animation file according to the arranged three-dimensional pulse wave comprises the following steps: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate. The display size determines the proportional relation between the three-dimensional pulse wave and the anchor point during AR playing, so a reasonable initial value needs to be set; the initial value of the playing speed is the real playing speed of the three-dimensional pulse wave.
According to the three-dimensional pulse wave display method provided by the embodiment, before the pulse wave animation file is generated, the color rendering, the time arrangement, the parameter adjustment and other processing are performed on the space curved surface information, so that the displayed three-dimensional pulse wave can be more visual, and the intelligence of the interactive display of the three-dimensional pulse wave is improved.
In one embodiment, the step of sending the pulse wave animation file to the display terminal includes: sending the pulse wave animation file to an ftp server; sending file in-place information to a display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, and the pulse wave animation file is output according to the augmented reality technology. The file in-place information is used for indicating whether the pulse wave animation file is sent to the ftp server or not.
The ftp server is used for storing the pulse wave animation file and providing network support for display of the display terminal. After downloading the pulse wave animation file from the ftp server, the display terminal can store the pulse wave animation file in the memory, and then read the pulse wave animation file in the memory when the three-dimensional pulse wave display is needed. Of course, the server 101 may directly transmit the pulse wave motion picture file to the display terminal without relaying through the ftp server. The server 101 may transmit the pulse wave animation file to the ftp server in real time to display the three-dimensional pulse wave in real time.
According to the three-dimensional pulse wave display method provided by the embodiment, the display terminal acquires the pulse wave animation file and displays the corresponding three-dimensional pulse wave according to the augmented reality technology, so that the display terminal can display the three-dimensional pulse wave in real time, and the convenience of displaying the three-dimensional pulse wave is improved.
In some embodiments, the ftp server may be replaced with a web server, an nntp server, an smtp server, and the like. In addition, taking the ftp server as an example, the server 101 may not transmit the pulse wave animation file to the ftp server; instead, upon receiving a file acquisition instruction transmitted from the display terminal, the ftp server accesses the server 101, and the server 101 returns the pulse wave animation file to the ftp server or directly transmits the pulse wave animation file to the display terminal.
In addition, the purpose of the server 101 outputting the file-in-place information is to prompt the user that the pulse wave animation file has been sent to the ftp server. Therefore, the server 101 may transmit the file in-place information to another terminal that the user can touch, instead of transmitting the file in-place information to the display terminal, and when the user acquires the information that the pulse wave animation file has been transmitted to the ftp server, the display operation of the three-dimensional pulse wave may be performed through the display terminal.
In an embodiment, as shown in fig. 8, an embodiment of the present invention provides a method for displaying a three-dimensional pulse wave, which is described by taking the method as an example for being applied to the display terminal 102 in fig. 1, and includes the following steps:
s801, obtaining a pulse animation file corresponding to the three-dimensional pulse; the pulse animation file is obtained according to the space curved surface information of the pulse.
S802, determining the space position of the pulse, and determining the display position on the display area of the display screen according to the space position.
The display area of the display screen may refer to a display frame of the display screen. As shown in fig. 5/6/7, the display position may be a certain position on the display area. Taking the example of displaying the three-dimensional pulse wave on the wrist of the human body as an example, the customs position of the wrist of the human body in the display area can be determined, and a certain position (for example, a certain distance above) near the customs position is determined as the display position.
When the display terminal is provided with the camera with the depth sensing function, the space position of the pulse can be determined directly through the display terminal, and then the display position is determined. When the display terminal is not configured with a camera having a depth sensing function, the spatial position of the pulse can be determined based on the image detection technique of the high-pass Vuforia.
Further, taking the display terminal as a mobile phone as an example, the implementation process of determining the display position may be: the method comprises the steps of shooting an image of a wrist of a human body through a camera on a mobile phone, determining the spatial position of the wrist dimension according to the shot image based on the image detection technology of high-pass Vuforia, and determining the display position of a three-dimensional pulse wave when the three-dimensional pulse wave is displayed on a screen of the mobile phone according to the spatial position.
And S803, outputting the pulse wave animation file on the display position according to the augmented reality technology to display the three-dimensional pulse wave.
In the method for displaying a three-dimensional pulse wave provided in this embodiment, the display terminal determines the display position on the display screen after acquiring the pulse wave animation file, and then displays the corresponding three-dimensional pulse wave according to the augmented reality technology.
In one embodiment, S801 includes: receiving file in-place information; and downloading the pulse wave animation file from the ftp server according to the file in-place information, and outputting the pulse wave animation file according to the augmented reality technology.
According to the three-dimensional pulse wave display method provided by the embodiment, the display terminal acquires the pulse wave animation file and displays the corresponding three-dimensional pulse wave according to the augmented reality technology, so that the display terminal can display the three-dimensional pulse wave in real time, and the convenience of displaying the three-dimensional pulse wave is improved.
In one embodiment, the three-dimensional pulse wave comprises a single pulse period of the three-dimensional pulse wave; wherein a single pulse cycle comprises a plurality of time instants. The plurality of time instants may be determined in dependence on a sampling frequency of the sensor array.
The pulse signal can be regarded as a periodic signal as a whole. Research shows that under the condition of stable measurement conditions, the ratio of nonlinear components in the measured pulse wave signal is not more than 5%, so that on the premise of ensuring the playing effect, in order to save the calculation amount and improve the efficiency of the display terminal, a single pulse period can be intercepted from the pulse wave original signal to carry out animation production, and the periodic pulsation of the three-dimensional pulse wave is realized in a circulating manner. Further, the step of outputting the pulse wave animation file on the display position according to the augmented reality technology comprises: according to the augmented reality technology, a pulse wave animation file is output on a display position for multiple times so as to periodically display a three-dimensional pulse wave of a single pulse period.
Of course, in order to improve the accuracy of the displayed three-dimensional pulse wave, a plurality of cycles of pulse wave animation files may be acquired, or a continuous pulse wave animation file may be acquired and displayed in real time.
In one embodiment, an anchor point may be set on the display terminal according to the display position; the anchor point is used for controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area when the position of the display screen is changed.
The region corresponding to the display position may be set as an anchor region, or a region near or related to the display position may be set as an anchor region. Further, an anchor point area can be determined according to the spatial position of the pulse, and then an anchor point is set, so that the anchor point area keeps a position-invariant state in the display screen, for example: and setting an anchor point in the area where the inch-scale is located.
When the three-dimensional pulse wave is a pulse wave corresponding to a plurality of pulse waves, an anchor point may be set for each pulse wave, so that each pulse wave is maintained at a fixed position in the display environment (virtual environment in which the displayed content is located).
The embodiment can realize the motion tracking of the display terminal, that is, when the position of the display terminal changes, the displayed three-dimensional pulse wave is ensured to be kept unchanged relative to the display position in the screen, that is, the method can be understood as follows: no matter how the display screen rotates, the position of the three-dimensional pulse wave in the display environment is fixed, and the process of screen rotation can be understood as observing the three-dimensional pulse wave from different angles, so that the intelligent interaction of the three-dimensional pulse wave display can be effectively improved.
In one embodiment, a user may log in a preset APP on a display terminal, where the APP is pre-configured with a related implementation program for enhancing the display technology. Based on this, after the user logs in the APP, the AR display of the three-dimensional pulse wave can be performed by acquiring the corresponding pulse wave animation file. In order to facilitate users to observe and learn the AR pulse condition model better, basic operation functions such as rotation, scaling, speed change and the like can be added in the APP; the method comprises the steps that a model transformation function is provided for meeting the requirement that a user views different pulse condition model examples in a current account (the model examples can refer to pulse condition models of different positions or different display modes pre-stored by the user, and of course, an APP (application) can also obtain pulse wave animation files from an ftp (file transfer protocol) server and the like in real time); as shown in fig. 9 (a), the initial login interface of APP is provided, after a correct user name and password are input, if multiple sets of models exist under the user name, the user can jump to the model selection interface shown in fig. 9 (b); in order to meet the requirements of a large amount of data of future users and protect personal privacy, multi-user account switching is supported; finally, considering the factor of operating the APP with one hand, a UI interface is designed (as shown in (c) of fig. 9) that facilitates one-handed operation and can switch between left and right-handed modes, providing a good interactive experience for the user.
These functions are described in detail below, taking as an example a three-dimensional pulse wave that shows the inch-off scale on the wrist:
one, basic operation function
1. And (4) zooming. Zooming, which refers to changing the size of the currently played model, can be accomplished using a Slider in the Unity UGUI component package. The Slider assembly Slider is first initialized and listening is set. When the user carries out interactive operation and the value of the sliding strip is changed, monitoring can be triggered to obtain the current target pulse condition model, and the size of the model is adjusted by using a method provided by transform. As shown in fig. 5, the size of the model can be changed by moving the lateral slide bar (fig. 5 (a) is the original size, (fig. 5 (b) is the reduced size, and fig. 5 (c) is the enlarged size), and as can be seen from fig. 5, the relative position between the pulse wave and the pulse wave remains unchanged after the model size is changed.
2. And (4) rotating. The rotation is to change the angle of the currently played pulse condition model, so that the three pulse condition models rotate around the middle point. In order to enable the user to determine the degree of rotation of the current model more intuitively, a circular slider assembly radialslide which can rotate 360 ° can be used to achieve this function. Components may also be bound to events of the model. Monitoring is set for the angle value of the assembly radialslide, when the angle changes, the current target pulse condition model and the rotation central point thereof are obtained, and a Rotate method is called to enable the models at two positions of 'cun' and 'chi' to Rotate around the model at the 'off' position. Fig. 6 (a) shows the original three-dimensional pulse wave, (b) shows the three-dimensional pulse wave after small angle rotation in fig. 6, and (c) shows the three-dimensional pulse wave after large angle rotation in fig. 6. In addition, clicking the square button in the middle of the circular sliding bar can restore the pulse condition model to the initial state.
3. The playing speed. The function of model playing speed is also realized by a component Slider in UGUI, and the method is similar to that in zooming. When the value of the sliding bar is changed and monitoring is triggered, a pulse animation file identifier bound in a target model in an FBX format is obtained, a speed method is called to modify the playing speed, the vertical sliding bar in the figure 7 can be rotated, the (a) in the figure 7 is the original three-dimensional pulse playing speed, the (b) in the figure 7 is the fastest playing speed, and the (c) in the figure 7 is the slowest playing speed. Meanwhile, a heart rate file corresponding to the model can be read, the actual heart rate speed and the playing speed of the current pulse condition model are obtained through calculation, and the actual heart rate speed and the playing speed are displayed on the upper corner of the screen through Text.
4. And (6) resetting the model. This function can be accomplished through a Button component. First, every time a group of models is selected and drawn at the correct position of the wrist, parameters such as the spatial coordinates, the rotation quaternary vector, the size, the playing speed and the like of the current model are recorded (as shown in fig. 7 (a)), and when a user clicks a button, the button is triggered to click and monitor, and all drawn model parameters are restored to initialization.
The key code for the custom circular slider assembly implementation is as follows. Where angle is the angle of rotation of the slider.
Figure BDA0001986544120000151
The key code for rate, angle and size adjustment of the target model is as follows, where anim1 is the animation of the pulse condition model binding.
Figure BDA0001986544120000152
The key code for reading and drawing the pulse condition model file from the local is as follows:
Figure BDA0001986544120000153
second, model selection
Each user may have multiple different sets of pulse condition models, and when the user logs in, they need to select the pulse condition that they want to watch in the main interface. This functionality is implemented primarily using the DropDown component DropDown provided in the Unity UGUI.
1. And (5) realizing the function of the elastic frame. First is user data acquisition and bullet box initialization. When the user jumps to the main interface from the login interface, the user name and the model number which are transmitted can be obtained through PlayerPrefs, and therefore the pulse condition model array Usermodel corresponding to the current user is obtained. And traversing the model array Usermodel, and adding the name of each model group in the array into one item in the DropDown component, so as to complete the content filling of the option bullet box. The second step is a pop-up click event. Monitoring is set for the popup window, when a click selection event occurs, the content of the currently selected option can be obtained, and here, in order to facilitate automatic correspondence from the option to the model group, a special model file naming rule can be established, and one-to-one mapping of the pulse condition model, the affiliated user, the affiliated group and the position (inch rule) of the model is realized. When one group is selected, the pulse condition models of three different positions of the group can be obtained.
2. And (4) switching models. Before the model switching is realized, the corresponding model is drawn at the wrist image identifier. Because the models to which the users belong are all stored in the FTP background, the model files are downloaded to a certain specific path of the memory of the mobile phone of the users after login is successful, and therefore the files need to be read firstly: by using a LoadFromFile method and combining with memory relative path application. After a user selects a model, the currently displayed pulse condition model is replaced and drawn into the selected pulse condition model, a function named ChooseModel can be realized in a project, the first step is to store the unique identifier of the original model and destroy the original model, the second step is to load the required model file from the local mobile phone and draw and display the model file by using an instantate method, the parameters such as the size and the coordinates of the new model are set, and the last step is to assign the identifier of the original model to the new model and return the new model to an object, so that the switching from the old model to the new model can be realized.
Third, user's habits
The UI interface convenient for one-hand operation is designed, the layout is simple and attractive, the operations of rotation, zooming and the like can be completed by only one finger, and all interaction components are placed in a range which can be easily reached by one hand. Considering the handedness of different users, a Button can be used to complete the left-right switching and interface adaptive functions of the component. In the Start method, an integer counting mark is used to determine whether the left-hand or right-hand interface is currently used (the left-hand interface is shown in fig. 5, and the right-hand interface is shown in fig. 6 and 7), and then the length and width of the current device screen are obtained, and the relative position and proportion of the components are set according to the size. The user can switch the UI interface left and right through a square button at the lower right of the interface. And clicking a setting button at the upper left corner of the screen, and skipping to a setting interface to select a custom layout or log out a user.
The display method of the three-dimensional pulse wave provided by the embodiment is provided with various functions which can be controlled by a user, the three-dimensional pulse wave can be displayed according to the requirements of the user, and very good interactive experience is provided.
In order to better understand the above method, an application example of the three-dimensional pulse wave display method of the present invention is described in detail below, taking the three-dimensional pulse wave display on the wrist of a human body through a mobile phone as an example.
1. And pressure value information of the cun-guan-chi area on the wrist of the human body is obtained through a pressure sensor array on the pulse diagnosis instrument. And the server determines the spatial distribution information of the pulse condition through a matlab tool according to the pressure value information and the arrangement information of the sensor array.
2. And the server determines the space curved surface information at the corresponding moment through a matlab tool and stores the space curved surface information into an STL format one by one.
3. The server arranges the spatial curved surface information in the STL format according to the time sequence through the maya tool to form a 3D animation file, performs operations such as color rendering and parameter adjustment on the animation file, and finally derives a pulse wave animation file in the fbx format.
4. The server performs batch processing on the pulse wave animation files by using Unity, puts the pulse wave animation files into an ftp server together, and sends file in-place information to the mobile phone.
5. After receiving the file in-place information and receiving a pulse animation playing instruction sent by a user through the APP, the mobile phone shoots an image of the wrist of the human body through the camera (at the moment, the wrist of the human body needs to enter the monitoring range of the camera), and the spatial position of the inch on the wrist of the human body is determined through the image; and determining the display position of the three-dimensional pulse wave on the display screen according to the space position.
6. And the mobile phone downloads the corresponding pulse wave animation file from the ftp server, and outputs the pulse wave animation file on the display position according to the augmented reality technology to realize the display of the three-dimensional pulse wave.
The traditional pulse diagnosis instrument product mainly uses a single-point sensor to simulate fingertips for measurement, the obtained data is simple one-dimensional blood pressure time waves, and the inherent deficiency of data dimension causes a large amount of pulse wave details to be lost, so the one-dimensional blood pressure time waves with the information loss are difficult to be translated into pulse conditions. Embodiments of the present invention integrate the sensor array for measurement. The pulse wave obtained by the multi-point sensor is a three-dimensional image and can be directly used for comparing the finger-down feeling when the pulse is manually taken, so that the successful translation of the pulse wave to a three-dimensional data model is realized. The three-dimensional pulse wave image is played back and analyzed through the increasingly popular AR platform of the mobile phone, so that the bouncing three-dimensional pulse wave is directly 'long' on the wrist. The method is convenient for relevant researchers to flexibly switch and observe the visual angle of the three-dimensional pulse wave so as to quickly find each characteristic region of the pulse wave image, and also enables traditional Chinese medicine researchers to freely observe and experience the complete pulse condition and feel the finger feeling on the wrist at any time and any place, thereby converting the state that the traditional pulse diagnosis study can be only realized through language description.
In addition, the three-dimensional pulse wave can be better spread and shared through the mobile phone. The distance between the pulse diagnosis instrument and a user is shortened in an AR vivid mode, and the spread and the popularity of the traditional Chinese medicine pulse condition and the pulse diagnosis are improved. In summary, the three-dimensional pulse wave is projected on a real plane or the original pulse taking point position of the user, so that the characteristics of the three-dimensional pulse wave are more intuitively released, and a method with higher information content and more convenient observation is provided for multi-angle observation, pulse condition analysis, pulse condition recording and finger sense translation.
It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present invention is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present invention.
Based on the same idea as the display method of the three-dimensional pulse wave in the above embodiment, the present invention also provides a display device of the three-dimensional pulse wave, which can be used to execute the above display method of the three-dimensional pulse wave. For convenience of illustration, only the parts related to the embodiments of the present invention are shown in the schematic structural diagram of the three-dimensional pulse wave display device, and those skilled in the art will understand that the illustrated structure does not constitute a limitation to the device, and may include more or less components than those illustrated, or combine some components, or arrange different components.
As shown in fig. 10, the three-dimensional pulse wave display device includes a distribution information obtaining module 1001, an animation file obtaining module 1002, and a pulse wave display module 1003, which are described in detail as follows: a distribution information obtaining module 1001 configured to obtain spatial distribution information of pulse conditions; the spatial distribution information is determined according to the pulse condition sensing information of the area where the pulse is located. An animation file obtaining module 1002, configured to obtain a pulse wave animation file corresponding to a three-dimensional pulse wave at multiple times; wherein the three-dimensional pulse wave is obtained according to the spatial distribution information. The pulse wave display module 1003 is used for acquiring a display position in the display area; and outputting the pulse wave animation file at the display position of the display area to display the three-dimensional pulse wave. According to the embodiment, abstract pulse condition information can be converted into the pulse wave animation file, AR display of three-dimensional pulse waves is achieved, and the intelligence of human-computer interaction is effectively improved.
In an embodiment, the first pulse wave display module 1003 is further configured to arrange the three-dimensional pulse waves according to a time sequence, and obtain a pulse wave animation file according to the arranged three-dimensional pulse waves.
In one embodiment, the first pulse wave display module 1003 includes: the color rendering submodule is used for performing color rendering on the three-dimensional pulse wave according to the height of the waveform of the three-dimensional pulse wave; and the sequencing submodule is used for sequencing the rendered three-dimensional pulse waves according to a time sequence.
In one embodiment, the first pulse wave display module 1003 is further configured to adjust setting parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate.
In one embodiment, the apparatus for displaying three-dimensional pulse waves further comprises: and the curved surface information acquisition module is used for generating the spatial curved surface information in the STL format according to the spatial distribution information.
In one embodiment, the distribution information obtaining module 1001 includes: the sensing information receiving submodule is used for receiving pulse condition sensing information of an area where the pulse is sent by the sensor array; the arrangement relation acquisition submodule is used for acquiring the arrangement relation of the sensor array; and the distribution information acquisition submodule is used for integrating the pulse condition sensing information according to the arrangement relation to obtain the spatial distribution information of the pulse condition.
In one embodiment, the first pulse wave display module 1003 includes: the file sending submodule is used for sending the pulse wave animation file to the ftp server; the pulse wave display submodule is used for sending file in-place information to the display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, and the pulse wave animation file is output according to the augmented reality technology.
In one embodiment, as shown in fig. 11, an embodiment of the present invention provides a display device for three-dimensional pulse waves, including: the file acquisition module 1101 is used for acquiring a pulse wave animation file corresponding to a three-dimensional pulse wave; and the pulse animation file is obtained according to the space curved surface information of the pulse. A position determining module 1102, configured to determine a spatial position of the pulse, and determine a display position on a display area of a display screen according to the spatial position. And a second pulse wave display module 1103, configured to output the pulse wave animation file at the display position according to an augmented reality technology, so as to display the three-dimensional pulse wave. According to the embodiment, abstract pulse condition information can be converted into the pulse wave animation file, AR display of three-dimensional pulse waves is achieved, and the intelligence of human-computer interaction is effectively improved.
In one embodiment, the file obtaining module 1101 includes: the information receiving submodule is used for receiving the in-place information of the file; and the file downloading submodule is used for downloading the pulse wave animation file from the ftp server according to the file in-place information and outputting the pulse wave animation file according to the augmented reality technology.
In one embodiment, the three-dimensional pulse wave comprises a single pulse period of the three-dimensional pulse wave; wherein a single pulse cycle comprises a plurality of time instants.
In one embodiment, the second pulse wave display module 1103 is further configured to output the pulse wave animation file on the display location multiple times according to the augmented reality technology, so as to periodically display the three-dimensional pulse wave of a single pulse period.
It should be noted that, the display device of the three-dimensional pulse wave of the present invention corresponds to the display method of the three-dimensional pulse wave of the present invention one to one, and the technical features and the advantageous effects described in the embodiments of the display method of the three-dimensional pulse wave are all applicable to the embodiments of the display device of the three-dimensional pulse wave.
In addition, in the embodiment of the three-dimensional pulse wave display device illustrated above, the logic division of each program module is only an example, and in practical applications, the above function distribution may be performed by different program modules according to needs, for example, due to the configuration requirements of corresponding hardware or the convenience of implementation of software, that is, the internal structure of the three-dimensional pulse wave display device is divided into different program modules to perform all or part of the above described functions.
The three-dimensional pulse wave display method provided by the application can be applied to computer equipment shown in fig. 12. The computer device may be a server or a terminal device (e.g., a mobile phone or a head-mounted device), and its internal structure diagram may be as shown in fig. 12. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor is configured to provide computing and control capabilities; the memory comprises a nonvolatile storage medium and an internal memory, wherein the nonvolatile storage medium stores an operating system, a computer program (the computer program realizes a three-dimensional pulse wave display method when being executed by the processor) and a database, and the internal memory provides an environment for the operating system in the nonvolatile storage medium and the running of the computer program; the database is used for storing data required in the execution process of the display method of the three-dimensional pulse wave; the network interface is used for communicating with an external terminal through network connection, for example, communicating with a display terminal, and sending a pulse wave animation file to the display terminal to display a corresponding three-dimensional pulse wave. Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, which may be a cell phone, a head mounted display device, or the like. The computer device comprises a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by spatial distribution information; acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology.
In one embodiment, the processor, when executing the computer program, further performs the steps of: and arranging the three-dimensional pulse waves according to a time sequence, and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.
In one embodiment, the processor, when executing the computer program, further performs the steps of: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence.
In one embodiment, the processor, when executing the computer program, further performs the steps of: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate.
In one embodiment, the processor, when executing the computer program, further performs the steps of: and generating the spatial curved surface information in the STL format according to the spatial distribution information.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; integrating the pulse condition sensing information according to the arrangement relationship to obtain the spatial distribution information of the pulse condition.
In one embodiment, the processor, when executing the computer program, further performs the steps of: sending the pulse wave animation file to an ftp server; sending file in-place information to a display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, and the pulse wave animation file is output according to the augmented reality technology.
In one embodiment, the processor, when executing the computer program, further performs the steps of: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave; the pulse animation file is obtained according to the space curved surface information of the pulse; determining the space position of the pulse, and determining the display position on the display area of the display screen according to the space position; and outputting the pulse wave animation file on the display position according to the augmented reality technology so as to display the three-dimensional pulse wave.
In one embodiment, the processor, when executing the computer program, further performs the steps of: receiving file in-place information; and downloading the pulse wave animation file from the ftp server according to the file in-place information, and outputting the pulse wave animation file according to the augmented reality technology.
In one embodiment, the three-dimensional pulse wave comprises a single pulse period of the three-dimensional pulse wave; wherein a single pulse cycle comprises a plurality of time instants.
In one embodiment, the processor, when executing the computer program, further performs the steps of: according to the augmented reality technology, a pulse wave animation file is output on a display position for multiple times so as to periodically display a three-dimensional pulse wave of a single pulse period.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse; obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by spatial distribution information; acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology.
In one embodiment, the computer program when executed by the processor further performs the steps of: and arranging the three-dimensional pulse waves according to a time sequence, and obtaining a pulse wave animation file according to the arranged three-dimensional pulse waves.
In one embodiment, the computer program when executed by the processor further performs the steps of: performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave; and arranging the rendered three-dimensional pulse waves according to a time sequence.
In one embodiment, the computer program when executed by the processor further performs the steps of: adjusting the set parameters of the arranged three-dimensional pulse waves to obtain a pulse wave animation file; the setting parameters include a display size and a play rate.
In one embodiment, the computer program when executed by the processor further performs the steps of: and generating the spatial curved surface information in the STL format according to the spatial distribution information.
In one embodiment, the computer program when executed by the processor further performs the steps of: receiving pulse condition sensing information of an area where a pulse is sent by a sensor array; acquiring the arrangement relation of the sensor array; integrating the pulse condition sensing information according to the arrangement relationship to obtain the spatial distribution information of the pulse condition.
In one embodiment, the computer program when executed by the processor further performs the steps of: sending the pulse wave animation file to an ftp server; sending file in-place information to a display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, and the pulse wave animation file is output according to the augmented reality technology.
In one embodiment, the computer program when executed by the processor further performs the steps of: obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave; the pulse animation file is obtained according to the space curved surface information of the pulse; determining the space position of the pulse, and determining the display position on the display area of the display screen according to the space position; and outputting the pulse wave animation file on the display position according to the augmented reality technology so as to display the three-dimensional pulse wave.
In one embodiment, the computer program when executed by the processor further performs the steps of: receiving file in-place information; and downloading the pulse wave animation file from the ftp server according to the file in-place information, and outputting the pulse wave animation file according to the augmented reality technology.
In one embodiment, the three-dimensional pulse wave comprises a single pulse period of the three-dimensional pulse wave; wherein a single pulse cycle comprises a plurality of time instants.
In one embodiment, the computer program when executed by the processor further performs the steps of: according to the augmented reality technology, a pulse wave animation file is output on a display position for multiple times so as to periodically display a three-dimensional pulse wave of a single pulse period.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which is stored in a computer readable storage medium and sold or used as a stand-alone product. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
The terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or (module) elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-described examples merely represent several embodiments of the present invention and should not be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (13)

1. A method for displaying three-dimensional pulse waves is characterized by comprising the following steps:
acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the pulse;
obtaining a three-dimensional pulse wave according to the space curved surface information with a set format; the spatial curved surface information is generated by the spatial distribution information;
obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave, and sending the pulse wave animation file to a display terminal; the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology;
when the display terminal is provided with a camera with a depth sensing function, grabbing three-dimensional feature points on the wrist of a human body through the camera to obtain a space position of a pulse, and determining a display position on a display area of a display screen of the terminal equipment according to the space position of the pulse; setting anchor points for pulse waves corresponding to the inch-off scales respectively in the area where the inch-off scales are located on the display terminal according to the display position;
the step of sending the pulse wave animation file to a display terminal comprises the following steps: sending the pulse wave animation file to an ftp server; the ftp server is used for storing the pulse wave animation file and providing network support for display of the display terminal; sending file in-place information to a display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, when the human wrist is identified by a camera of the display terminal, the three-dimensional pulse wave is displayed near the human wrist according to the augmented reality technology, and when the position of the display screen changes, the relative position of the three-dimensional pulse wave and the display position is controlled to be kept unchanged in the display area according to the anchor point;
the three-dimensional pulse wave is a pulse condition model, when a user carries out interactive operation and the value of a sliding strip changes in the process of displaying an object model by a display terminal, monitoring is triggered to obtain a current target pulse condition model, and the size of the current target pulse condition model is adjusted by using a method provided by transform; when the angle is changed, acquiring a current target pulse condition model and a rotation central point, and calling a Rotate method to enable the models at the cun position and the chi position to Rotate around the model at the 'close' position; when the numerical value of the sliding bar is changed and monitoring is triggered, acquiring a pulse animation file identifier bound in a current target pulse condition model in an FBX format, and calling a speed method to modify the playing speed;
the method further comprises the following steps:
when jumping to the main interface from the login interface, acquiring a transferred user name and a model number through PlayerPrefs, thereby obtaining a pulse condition model array Usermodel corresponding to the current user, traversing the model array Usermodel, and adding each model group name in the array into one item in a DropDown component; establishing one-to-one mapping of the pulse condition model, the belonged user, the belonged group and the inch-customs size position of the model; monitoring is set for the popup window, and when a selection event of clicking one group occurs, a pulse condition model of the inch-scale position under the currently selected group is obtained based on the mapping relation;
before model switching, loading a target pulse condition model file into an AssetBundle class by using a LoadFromFile method and combining with memory relative path application. After a user selects a pulse model, the currently displayed pulse model is replaced and drawn into the selected pulse model, the unique identifier of the original model is stored, the original model is destroyed, a required model file is loaded locally from the mobile phone and is drawn and displayed by using an instantate method, the size and coordinate parameters of the new model are set, the identifier of the original model is assigned to the new model, and switching from the old model to the new model is realized.
2. The method for displaying a three-dimensional pulse wave according to claim 1, wherein the step of obtaining the pulse wave animation file corresponding to the three-dimensional pulse wave comprises:
and arranging the three-dimensional pulse waves according to a time sequence, and obtaining the pulse wave animation file according to the arranged three-dimensional pulse waves.
3. The method for displaying a three-dimensional pulse wave according to claim 2, wherein the step of arranging the three-dimensional pulse wave in a time sequence comprises:
performing color rendering on the three-dimensional pulse wave according to the height of the three-dimensional pulse wave;
and arranging the rendered three-dimensional pulse waves according to the time sequence.
4. The method for displaying a three-dimensional pulse wave according to claim 2, wherein the step of obtaining the pulse wave animation file according to the arranged three-dimensional pulse wave comprises:
adjusting the set parameters of the arranged three-dimensional pulse waves to obtain the pulse wave animation file; the setting parameters comprise display size and playing speed.
5. The method for displaying a three-dimensional pulse wave according to claim 2, wherein before the step of obtaining the three-dimensional pulse wave based on the spatial curved surface information in the set format, the method further comprises:
and generating the spatial curved surface information in the STL format according to the spatial distribution information.
6. The method of displaying a three-dimensional pulse wave according to claim 1, wherein the step of obtaining the spatial distribution information of the pulse wave comprises:
receiving pulse condition sensing information of an area where a pulse is sent by a sensor array;
acquiring the arrangement relation of the sensor array;
and integrating the pulse condition sensing information according to the arrangement relation to obtain the spatial distribution information of the pulse condition.
7. A method for displaying three-dimensional pulse waves is characterized by comprising the following steps:
obtaining a pulse wave animation file corresponding to the three-dimensional pulse wave; the pulse wave animation file is obtained according to the space curved surface information of the pulse;
determining the space position of the pulse, and determining a display position on a display area of a display screen according to the space position;
outputting the pulse wave animation file on the display position according to an augmented reality technology to display the three-dimensional pulse wave;
determining the space position of the pulse, and determining the display position on the display area of the display screen according to the space position, wherein the method comprises the following steps: when a camera with a depth sensing function is configured, grabbing three-dimensional feature points on the wrist of a human body through the camera to obtain the space position of the pulse, and determining a display position on a display area of a display screen according to the space position of the pulse; setting anchor points for pulse waves corresponding to the inch-off scales respectively according to the display positions in the areas where the inch-off scales are located;
the step of obtaining the pulse wave animation file corresponding to the three-dimensional pulse wave comprises the following steps: receiving file in-place information; downloading the pulse wave animation file from the ftp server according to the file in-place information; the ftp server is used for storing the pulse wave animation file and providing network support for display of the display terminal;
outputting the pulse wave animation file on the display position according to an augmented reality technology to display the three-dimensional pulse wave, comprising: when the camera identifies the wrist of the human body, the three-dimensional pulse wave is displayed near the wrist of the human body according to the augmented reality technology, and when the position of the display screen changes, the relative position of the three-dimensional pulse wave and the display position is controlled to be kept unchanged in the display area according to the anchor point;
the three-dimensional pulse wave is a pulse condition model, and in the process of displaying the object model, when a user carries out interactive operation and the value of a sliding strip is changed, monitoring is triggered to obtain a current target pulse condition model, and the size of the current target pulse condition model is adjusted by using a method provided by transform; when the angle is changed, acquiring a current target pulse condition model and a rotation central point, and calling a Rotate method to enable the models at the cun position and the chi position to Rotate around the model at the 'close' position; when the numerical value of the sliding bar is changed and monitoring is triggered, acquiring a pulse animation file identifier bound in a current target pulse condition model in an FBX format, and calling a speed method to modify the playing speed;
the method further comprises the following steps:
when jumping to the main interface from the login interface, acquiring a transferred user name and a model number through PlayerPrefs, thereby obtaining a pulse condition model array Usermodel corresponding to the current user, traversing the model array Usermodel, and adding each model group name in the array into one item in a DropDown component; establishing one-to-one mapping of the pulse condition model, the belonged user, the belonged group and the inch-customs size position of the model; monitoring is set for the popup window, and when a selection event of clicking one group occurs, a pulse condition model of the inch-scale position under the currently selected group is obtained based on the mapping relation;
before model switching, loading a target pulse condition model file into an AssetBundle class by using a LoadFromFile method and combining with memory relative path application. After a user selects a pulse model, the currently displayed pulse model is replaced and drawn into the selected pulse model, the unique identifier of the original model is stored, the original model is destroyed, a required model file is loaded locally from the mobile phone and is drawn and displayed by using an instantate method, the size and coordinate parameters of the new model are set, the identifier of the original model is assigned to the new model, and switching from the old model to the new model is realized.
8. The method of claim 7, wherein the three-dimensional pulse wave comprises a single pulse cycle three-dimensional pulse wave; wherein the single pulse cycle includes a plurality of time instants.
9. The method for displaying a three-dimensional pulse wave according to claim 8, wherein the step of outputting the pulse wave animation file at the display position according to the augmented reality technique comprises:
according to the augmented reality technology, the pulse wave animation file is output on the display position for multiple times so as to periodically display the three-dimensional pulse wave of the single pulse period.
10. A three-dimensional pulse wave display device, comprising:
the distribution information acquisition module is used for acquiring the spatial distribution information of the pulse condition; the space distribution information of the pulse condition is determined according to the pulse condition sensing information of the area where the pulse is located;
the pulse wave determining module is used for obtaining a three-dimensional pulse wave according to the space curved surface information with the set format; the spatial curved surface information is generated by the spatial distribution information;
the first pulse wave display module is used for acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave and sending the pulse wave animation file to a display terminal; the pulse wave animation file is used for triggering the display terminal to display the three-dimensional pulse wave according to the augmented reality technology;
the method also comprises a module for executing the following steps: when the display terminal is provided with a camera with a depth sensing function, grabbing three-dimensional feature points on the wrist of a human body through the camera to obtain a space position of a pulse, and determining a display position on a display area of a display screen of the terminal equipment according to the space position of the pulse; setting anchor points for pulse waves corresponding to the inch-off scales respectively in the area where the inch-off scales are located on the display terminal according to the display position;
the first pulse wave display module is also used for sending the pulse wave animation file to the ftp server; the ftp server is used for storing the pulse wave animation file and providing network support for display of the display terminal; sending file in-place information to a display terminal; the file in-place information is used for triggering the display terminal to download the pulse wave animation file from the ftp server, when the human wrist is identified by a camera of the display terminal, the three-dimensional pulse wave is displayed near the human wrist according to the augmented reality technology, and when the position of the display screen changes, the relative position of the three-dimensional pulse wave and the display position is controlled to be kept unchanged in the display area according to the anchor point;
the three-dimensional pulse wave is a pulse condition model, when a user carries out interactive operation and the value of a sliding strip changes in the process of displaying an object model by a display terminal, monitoring is triggered to obtain a current target pulse condition model, and the size of the current target pulse condition model is adjusted by using a method provided by transform; when the angle is changed, acquiring a current target pulse condition model and a rotation central point, and calling a Rotate method to enable the models at the cun position and the chi position to Rotate around the model at the 'close' position; when the numerical value of the sliding bar is changed and monitoring is triggered, acquiring a pulse animation file identifier bound in a current target pulse condition model in an FBX format, and calling a speed method to modify the playing speed;
the apparatus also includes means for performing the steps of:
when jumping to the main interface from the login interface, acquiring a transferred user name and a model number through PlayerPrefs, thereby obtaining a pulse condition model array Usermodel corresponding to the current user, traversing the model array Usermodel, and adding each model group name in the array into one item in a DropDown component; establishing one-to-one mapping of the pulse condition model, the belonged user, the belonged group and the inch-customs size position of the model; monitoring is set for the popup window, and when a selection event of clicking one group occurs, a pulse condition model of the inch-scale position under the currently selected group is obtained based on the mapping relation;
before model switching, loading a target pulse condition model file into an AssetBundle class by using a LoadFromFile method and combining with memory relative path application. After a user selects a pulse model, the currently displayed pulse model is replaced and drawn into the selected pulse model, the unique identifier of the original model is stored, the original model is destroyed, a required model file is loaded locally from the mobile phone and is drawn and displayed by using an instantate method, the size and coordinate parameters of the new model are set, the identifier of the original model is assigned to the new model, and switching from the old model to the new model is realized.
11. A three-dimensional pulse wave display device, comprising:
the file acquisition module is used for acquiring a pulse wave animation file corresponding to the three-dimensional pulse wave; the pulse wave animation file is obtained according to the space curved surface information of the pulse;
the position determining module is used for determining the space position of the pulse and determining a display position on a display area of a display screen according to the space position;
the second pulse wave display module is used for outputting the pulse wave animation file on the display position according to the augmented reality technology so as to display the three-dimensional pulse wave;
the position determining module is also used for capturing three-dimensional characteristic points of the wrist of the human body through the camera when the camera with the depth sensing function is configured, so as to obtain the space position of the pulse, and determining the display position on the display area of the display screen according to the space position of the pulse; setting anchor points for pulse waves corresponding to the inch-off scales respectively according to the display positions in the areas where the inch-off scales are located;
the file acquisition module is also used for receiving file in-place information; downloading the pulse wave animation file from the ftp server according to the file in-place information; the ftp server is used for storing the pulse wave animation file and providing network support for display of the display terminal;
the second pulse wave display module is also used for displaying the three-dimensional pulse wave near the wrist of the human body according to the augmented reality technology when the wrist of the human body is identified by the camera, and controlling the relative position of the three-dimensional pulse wave and the display position to be kept unchanged in the display area according to the anchor point when the position of the display screen is changed;
the three-dimensional pulse wave is a pulse condition model, and in the process of displaying the object model, when a user carries out interactive operation and the value of a sliding strip is changed, monitoring is triggered to obtain a current target pulse condition model, and the size of the current target pulse condition model is adjusted by using a method provided by transform; when the angle is changed, acquiring a current target pulse condition model and a rotation central point, and calling a Rotate method to enable the models at the cun position and the chi position to Rotate around the model at the 'close' position; when the numerical value of the sliding bar is changed and monitoring is triggered, acquiring a pulse animation file identifier bound in a current target pulse condition model in an FBX format, and calling a speed method to modify the playing speed;
the apparatus also includes means for performing the steps of:
when jumping to the main interface from the login interface, acquiring a transferred user name and a model number through PlayerPrefs, thereby obtaining a pulse condition model array Usermodel corresponding to the current user, traversing the model array Usermodel, and adding each model group name in the array into one item in a DropDown component; establishing one-to-one mapping of the pulse condition model, the belonged user, the belonged group and the inch-customs size position of the model; monitoring is set for the popup window, and when a selection event of clicking one group occurs, a pulse condition model of the inch-scale position under the currently selected group is obtained based on the mapping relation;
before model switching, loading a target pulse condition model file into an AssetBundle class by using a LoadFromFile method and combining with memory relative path application. After a user selects a pulse model, the currently displayed pulse model is replaced and drawn into the selected pulse model, the unique identifier of the original model is stored, the original model is destroyed, a required model file is loaded locally from the mobile phone and is drawn and displayed by using an instantate method, the size and coordinate parameters of the new model are set, the identifier of the original model is assigned to the new model, and switching from the old model to the new model is realized.
12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 9 are implemented by the processor when executing the computer program.
13. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 9.
CN201910166627.7A 2019-03-06 2019-03-06 Three-dimensional pulse wave display method and device, computer equipment and storage medium Active CN109949928B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910166627.7A CN109949928B (en) 2019-03-06 2019-03-06 Three-dimensional pulse wave display method and device, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910166627.7A CN109949928B (en) 2019-03-06 2019-03-06 Three-dimensional pulse wave display method and device, computer equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109949928A CN109949928A (en) 2019-06-28
CN109949928B true CN109949928B (en) 2021-09-07

Family

ID=67009144

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910166627.7A Active CN109949928B (en) 2019-03-06 2019-03-06 Three-dimensional pulse wave display method and device, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109949928B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080000019A (en) * 2006-06-26 2008-01-02 엘지마이크론 주식회사 Device and method for detecting pulse wave
CN105653876A (en) * 2016-01-22 2016-06-08 中国科学院微电子研究所 Pulse wave image collecting and storing method based on three-dimensional imaging
CN207337934U (en) * 2017-10-30 2018-05-08 成都极致空觉科技有限公司 The AR object wearing devices of detection physical condition in real time
CN108551519A (en) * 2018-03-05 2018-09-18 腾讯科技(深圳)有限公司 A kind of information processing method, device, storage medium and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080000019A (en) * 2006-06-26 2008-01-02 엘지마이크론 주식회사 Device and method for detecting pulse wave
CN105653876A (en) * 2016-01-22 2016-06-08 中国科学院微电子研究所 Pulse wave image collecting and storing method based on three-dimensional imaging
CN207337934U (en) * 2017-10-30 2018-05-08 成都极致空觉科技有限公司 The AR object wearing devices of detection physical condition in real time
CN108551519A (en) * 2018-03-05 2018-09-18 腾讯科技(深圳)有限公司 A kind of information processing method, device, storage medium and system

Also Published As

Publication number Publication date
CN109949928A (en) 2019-06-28

Similar Documents

Publication Publication Date Title
CN102915112B (en) For the system and method for closely motion tracking
KR101453815B1 (en) Device and method for providing user interface which recognizes a user's motion considering the user's viewpoint
US9626801B2 (en) Visualization of physical characteristics in augmented reality
WO2020125785A1 (en) Hair rendering method, device, electronic apparatus, and storage medium
US9355574B2 (en) 3D virtual training system and method
CN110457414A (en) Offline map processing, virtual objects display methods, device, medium and equipment
CN107622524A (en) Display methods and display device for mobile terminal
CN109949900B (en) Three-dimensional pulse wave display method and device, computer equipment and storage medium
Ayaz et al. Maze Suite 1.0: A complete set of tools to prepare, present, and analyze navigational and spatial cognitive neuroscience experiments
KR20200093034A (en) Special effects program file package and methods and devices for creating special effects, electronic devices
CN108876934A (en) Key point mask method, device and system and storage medium
US20160049006A1 (en) Spatial data collection
CN103399629B (en) The method and apparatus for obtaining gesture screen display coordinate
KR20210028198A (en) Avatar animation
Colombo et al. Mixed reality to design lower limb prosthesis
CN109683711B (en) Product display method and device
CN109938705B (en) Three-dimensional pulse wave display method and device, computer equipment and storage medium
CN109949928B (en) Three-dimensional pulse wave display method and device, computer equipment and storage medium
CN114116086A (en) Page editing method, device, equipment and storage medium
CN109935318B (en) Three-dimensional pulse wave display method and device, computer equipment and storage medium
CN110741327B (en) Mud toy system and method based on augmented reality and digital image processing
CN115908701A (en) Virtual fitting method and system based on style3d
US11650709B2 (en) 3D models for displayed 2D elements
CN114399358A (en) Holographic commodity display method and system and electronic equipment
Callens et al. A tangible surface for digital sculpting in virtual environments

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20201211

Address after: Room 1001, unit 3, building 1, No. 145, Mingzhu North Road, Xiangzhou District, Zhuhai City, Guangdong Province

Applicant after: Zhimei Kangmin (Zhuhai) Health Technology Co., Ltd

Address before: Room 702-2, 7th floor, No. 18 Futian Road, Xiangzhou District, Zhuhai City, Guangdong Province

Applicant before: ZHUHAI WANNAOTE HEALTH TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant