CN114385108B - Comment display method, comment display equipment and storage medium in music playing process - Google Patents
Comment display method, comment display equipment and storage medium in music playing process Download PDFInfo
- Publication number
- CN114385108B CN114385108B CN202111592494.3A CN202111592494A CN114385108B CN 114385108 B CN114385108 B CN 114385108B CN 202111592494 A CN202111592494 A CN 202111592494A CN 114385108 B CN114385108 B CN 114385108B
- Authority
- CN
- China
- Prior art keywords
- comment
- information
- music
- target
- target audience
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 124
- 238000004458 analytical method Methods 0.000 claims abstract description 48
- 230000006399 behavior Effects 0.000 claims description 65
- 238000001514 detection method Methods 0.000 claims description 57
- 230000007613 environmental effect Effects 0.000 claims description 11
- 238000011156 evaluation Methods 0.000 claims description 6
- 230000003542 behavioural effect Effects 0.000 claims 2
- 230000000694 effects Effects 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 7
- 230000036391 respiratory frequency Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000001121 heart beat frequency Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000029058 respiratory gaseous exchange Effects 0.000 description 2
- 230000036387 respiratory rate Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/63—Querying
- G06F16/635—Filtering based on additional data, e.g. user or group profiles
- G06F16/636—Filtering based on additional data, e.g. user or group profiles by using biological or physiological data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/64—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/683—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/685—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using automatically derived transcript of audio data, e.g. lyrics
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physiology (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Cardiology (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Library & Information Science (AREA)
- Pathology (AREA)
- Pulmonology (AREA)
- Artificial Intelligence (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Human Computer Interaction (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
- Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
Abstract
The application discloses a comment display method, comment display equipment and a storage medium in a music playing process, wherein the comment display method in the music playing process comprises the following steps: in the music playing process, personal behavior characteristics of a target audience are analyzed, lyric information played by current music is determined based on the characteristic analysis result, and comment information associated with the lyric information is displayed based on the target position of the lyric information. The technical problem that the experience effect of a user is poor in the song listening process is solved.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to a comment display method, apparatus, and storage medium in a music playing process.
Background
With the rapid development of computer technology and mobile terminals, music application has become one of the important functions of consumers highly depending on mobile phones, in traditional music application, a comment box is provided below songs, users need to actively click the comment box and then input comment information to comment on listening music, and then in the song listening process, the comment content of the user on the songs is displayed at the bottommost part of all lyrics of the songs in the existing song comment display mode, so that the substitution sense of the user listening to the songs is reduced, and the user experience effect is poor.
Disclosure of Invention
The main purpose of the application is to provide a comment display method, comment display equipment and a storage medium in the music playing process, and aims to solve the technical problem that in the prior art, a user experiences poor effect in the song listening process.
In order to achieve the above object, the present application provides a comment display method in a music playing process, where the comment display method in the music playing process includes:
during the music playing process, analyzing the personal behavior characteristics of a target audience;
determining lyric information played by the current music based on the feature analysis result;
and displaying comment information associated with the lyric information based on the target position of the lyric information.
The application also provides a comment display device in the music playing process, wherein the comment display device in the music playing process is a virtual system, and the comment display device in the music playing process comprises:
the characteristic analysis module is used for analyzing the personal behavior characteristics of the target audience in the music playing process;
and the determining module is used for determining lyric information played by the current music based on the characteristic analysis result.
And the comment display module is used for displaying comment information associated with the lyric information based on the target position of the lyric information.
The application also provides comment display equipment in the music playing process, wherein the comment display equipment in the music playing process is entity equipment, and the comment display equipment in the music playing process comprises: the system comprises a memory, a processor and a comment display program stored in the memory during music playing, wherein the comment display program during music playing is executed by the processor to realize the steps of the comment display method during music playing.
The application also provides a storage medium, which is a computer readable storage medium, wherein the computer readable storage medium stores a comment display program in the music playing process, and the comment display program in the music playing process is executed by a processor to realize the steps of the comment display method in the music playing process.
Compared with the technical means that users in the prior art need to manually input comment information by clicking a comment box to comment on listening music, the method, device and storage medium for displaying comments in the music playing process, the method and device for displaying the lyrics in the music playing process analyze personal behavior characteristics of target listeners, and further determine lyrics information played by current music based on characteristic analysis results, so that whether a comment display system is automatically triggered in the music playing process or not is determined based on analysis of the personal behavior characteristics of the target listeners, further, comment information related to the lyrics information is displayed based on target positions of the lyrics information, further comment information related to the lyrics information is displayed based on target positions of the lyrics information, detection and analysis of the personal behavior characteristics of the target listeners in the playing process are achieved, and accordingly whether the lyrics or melodies in songs of the target listeners can cause resonance of the target listeners can be judged according to the personal behavior characteristics of the target listeners in the music playing process, further, comment display time points of the comments are determined according to comment display time points, comment display information corresponding to the current comment time points are determined, and comment display information is displayed according to the comment display time points, and different comment information related to the music playing positions are different in the music playing positions, and different comment states are displayed according to the different comment information.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic flow chart of a first embodiment of a comment display method in a music playing process of the present application;
fig. 2 is a schematic flow chart of a second embodiment of a comment display method in the music playing process of the present application;
fig. 3 is a schematic flow chart of a third embodiment of a comment display method in the music playing process of the present application;
fig. 4 is a flowchart of a fourth embodiment of a comment display method in the music playing process of the present application;
fig. 5 is a flowchart of a fifth embodiment of a comment display method in the music playing process of the present application;
fig. 6 is a flowchart of a sixth embodiment of a comment display method in the music playing process of the present application;
fig. 7 is a flowchart of a seventh embodiment of a comment display method in the music playing process of the present application;
fig. 8 is a schematic structural diagram of a comment display device in a music playing process in a hardware running environment according to an embodiment of the present application;
fig. 9 is a schematic diagram of functional modules of a comment display device in the music playing process of the present application.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In a first embodiment of the comment display method in the music playing process of the present application, referring to fig. 1, the comment display method in the music playing process includes:
step S10, analyzing personal behavior characteristics of a target audience in the music playing process;
in this embodiment, it should be noted that, when a target listener opens a music application of a mobile terminal to start listening to a song, the mobile terminal of the target listener detects a current music playing mode, where the mobile terminal includes a terminal device such as a mobile phone, a tablet, and a palmtop, the music playing mode includes an earphone playing mode and a music play mode, the earphone playing mode is a mode in which the target listener plays using an earphone, for example, plays using a bluetooth earphone, a wired earphone, and the like, the music play mode is a mode in which music playing is performed through a play speaker device, and the personal behavior feature includes feature information such as heartbeat, respiration, pulse, and geographic position information of the target listener.
It should be further noted that, for the personal behavior feature of the earphone playing mode, before playing music, normal feature values such as the heartbeat frequency and the respiratory frequency of the target audience are recorded in advance through the mobile terminal, and are set as the pre-feature threshold according to the normal feature values, for example, the range corresponding to the feature threshold of the heartbeat frequency is 60-80 times/minute, and the range corresponding to the feature threshold of the respiratory frequency is 15-25 times/minute.
In the music playing process, analyzing personal behavior characteristics of a target audience, specifically, performing characteristic analysis based on the personal behavior characteristics corresponding to different music playing modes, comparing and analyzing the personal behavior characteristic information of the earphone playing modes with a preset characteristic threshold value to obtain a characteristic analysis result, and determining whether to start a comment display system according to the characteristic analysis.
Further, for the personal behavior feature of the music playing mode, determining the current position information of the target audience, after determining the specific position information of the target audience, starting the video recording function of the mobile terminal of the target audience to continuously update the target state image of the target audience, and further judging whether the target audience is in a silence rest state based on the state similarity of the target state image, namely judging whether the target audience is in the same position, and further comparing and analyzing the silence time and the preset duration of the silence rest state of the target audience to determine whether to start the comment presentation system according to the feature analysis result, thereby realizing automatic triggering of the comment presentation system according to the personal behavior feature of the audience.
Step S20, determining lyric information played by the current music based on the feature analysis result;
in this embodiment, it should be noted that, the comment information includes lyric information of playing music, comment text information, recorded video information, and the like, and in this application, the comment information may include comment information of a current target audience, and may also include comment information of other listeners.
If the current music is in the earphone playing mode, when the comment display system is started, determining comment display time points corresponding to the characteristic analysis result exceeding a preset characteristic threshold value, and further returning specific lyric information for searching the comment display time points according to the comment display time points, further, if the music playing mode is the music play mode, when the comment display system is started, determining comment display time points corresponding to the target audience and having the silence time exceeding a preset duration, and inquiring the lyric information corresponding to the current music based on the comment display time points.
Wherein, based on the feature analysis result, the step of determining lyric information to which the current music is played includes:
step S21, if the current music is in the earphone playing mode, determining comment showing time points corresponding to the personal behavior characteristics exceeding a preset characteristic threshold based on the characteristic analysis result; inquiring lyric information corresponding to the comment presentation time point;
in this embodiment, specifically, for a feature analysis result corresponding to the earphone playing mode, a comment showing time point corresponding to a person behavior feature exceeding a preset feature threshold in the feature analysis result is determined, and then lyric information played by current music is queried based on the comment showing time point, for example, in a song listening process of a target listener, 1 st: the comment for 06 seconds shows that the heartbeat, breath or pulse at the time point exceeds the preset characteristic threshold, and returns to query 1: lyric information corresponding to 06 seconds.
Step S22, if the current music is in a music playing mode, determining comment showing time points of the silence time corresponding to the target audience exceeding a preset duration based on the characteristic analysis result; and inquiring lyric information corresponding to the comment display time point.
In the application, specifically, if the current music is in the music playing mode, determining a comment display time point when the silence time corresponding to the target audience exceeds a preset duration according to a feature analysis result of feature analysis performed by the personal behavior feature, that is, determining a comment display time point when the time of the target audience at the same position exceeds the preset duration, and querying lyric information played by the current music based on the comment display time point.
Step S30, displaying comment information associated with the lyric information based on the target position of the lyric information.
In this embodiment, it should be noted that, the target position is a position where the comment information is displayed, and in this application, comment information associated with the lyric information is displayed at the target position, so that state features such as different personal operation behaviors of different listeners when listening to songs are achieved, comment display positions are different, that is, different audience members can feel different about different lyric information in songs corresponding to the same song, and further positions of the viewed comment information are different and comment contents are different.
Compared with the technical means that users in the prior art need to actively input comment information by clicking a comment box to comment on music in the process of playing the music, the method provided by the embodiment of the invention is used for analyzing the personal behavior characteristics of a target audience in the process of playing the music, further determining the lyric information played by the current music based on the characteristic analysis result, determining whether to automatically trigger a comment display system in the process of playing the song based on the analysis of the personal behavior characteristics of the target audience, further displaying comment information related to the lyric information based on the target position of the lyric information, further realizing detection and analysis of the personal behavior characteristics of the target audience in the process of playing the song, judging whether the lyric or melody of the target audience can cause resonance of the target audience according to the personal behavior characteristics of the target audience in the process of playing the song, further determining whether to start the comment display system according to the comment time point, further determining whether to display the corresponding comment information of the current comment time point, further displaying the comment information at the position of the lyric information, and further displaying the comment information related to the same comment information of the lyric information in the process of the song, and viewing different comments of different positions of the audience, and different comments are displayed according to different comments, and different states of the music are displayed.
Further, referring to fig. 2, in another embodiment of the present application, the step of acquiring the personal behavior feature of the target audience includes:
step A10, if the current music is in a music playing mode, sending a detection signal through a mobile terminal of the target audience, and detecting the detection signal to obtain the information of the environmental objects in a column;
in this embodiment, the detection signal includes a sound wave signal, a infrasonic wave signal, and the like, and the playing audio of the mobile terminal is used as a detector to send the detection signal to the surrounding.
Specifically, when the music playing mode is a music playing mode, the mobile terminal transmits the detection signal to the surrounding environment, records the transmission time of the detection signal, simultaneously starts a receiver of the detection signal to receive the detection signal emitted to the mobile terminal, records the receiving angle and the receiving time of the detection signal, calculates the distance between surrounding objects and the mobile terminal respectively based on the transmission time, the receiving time and the preset propagation speed of the detection signal, and simulates the object position information of the current environmental object by taking a three-dimensional sphere as a basic model, thereby obtaining the environmental object array information.
The step of obtaining the information of the environmental objects in a column includes the steps of:
step A11, sending a detection signal through the mobile terminal, and recording the emission time of the detection signal and the signal receiving information reflected to the mobile terminal by the detection signal;
in this embodiment, the signal receiving information includes a receiving time and a receiving angle of the probe signal reflected to the mobile terminal.
Specifically, a detection signal is sent through the mobile terminal, the emission time corresponding to the detection information is recorded, a signal receiver of the mobile terminal is started to receive the detection signal reflected to the mobile terminal, and the receiving time and the receiving angle of the detection signal are recorded.
And step A12, calculating object position information of the surrounding environment of the mobile terminal based on the transmitting time, the signal receiving information and the preset propagation speed corresponding to the detection signals, and obtaining the environment object array information.
In this embodiment, it should be noted that, the detected signals all have their corresponding propagation speeds in air propagation, and the environmental object column information is object information of a calculation range of 360 ° three-dimensional surrounding space.
Specifically, based on the emission time, the receiving time and the preset propagation speed corresponding to the detection signal, calculating the distance between the surrounding environment and the mobile terminal according to a preset calculation mode, obtaining object position information of the surrounding environment, further constructing object position information of a 360-degree three-dimensional surrounding space according to the object position information and the angle information, thereby obtaining the environment object column information, for example, the mobile terminal records that the emission time of the detection signal is T0, further records that the receiving angle is X, the receiving time is Ti, the preset propagation speed is V, further calculates the distance between the surrounding environment object and the mobile terminal according to a preset calculation formula m=V (Ti-T0)/2, further simulates the object information of the 360-degree three-dimensional surrounding space according to the receiving angle and the distance, and further forms the environment object column information.
A20, performing temperature detection on the array information of the environmental objects to obtain a temperature detection result;
in this embodiment, it should be noted that the temperatures of the human body and the object are different, and the target audience and other objects can be distinguished by temperature sensing.
Specifically, infrared detection signals are emitted through an infrared detector of the mobile terminal, and temperature detection is carried out on objects in the surrounding environment of the mobile terminal, so that a temperature detection result is obtained. In another embodiment, the temperature sensor may be used to detect the temperature of an object in the environment surrounding the mobile terminal.
And step A30, determining the personal behavior characteristics corresponding to the target audience based on the temperature detection result.
In this embodiment, specifically, according to the temperature detection result, an object in a normal human body temperature range is searched, and an object of other position information is deleted, so that the position information of the target audience is determined, and the position information is used as the personal behavior feature.
The embodiment of the application provides a comment display method in a music playing process, namely, if current music is in a music playing mode, a detection signal is sent through a mobile terminal of a target audience, the detection signal is detected, environment object column information is obtained, further, temperature detection is carried out on the environment object column information, a temperature detection result is obtained, further, based on the temperature detection result, personal behavior characteristics corresponding to the target audience are determined, and therefore when the mobile terminal is in the music playing mode, the environment object column information is simulated through emitting the detection signal to the surrounding environment, and the temperature detection is carried out on objects in the environment object column information, so that an object close to a human body temperature range is selected, and the personal behavior characteristics of the target audience are determined.
Further, referring to fig. 3, based on the first embodiment of the present application, in another embodiment of the present application, before the step of analyzing the personal behavior characteristics of the target audience, the comment display method in the music playing process further includes:
and step B10, if the current music is in the earphone playing mode, detecting the personal behavior characteristics of the target audience through a preset sensing device.
In this embodiment, it should be noted that the preset sensing device may be disposed on the earphone of the target audience or disposed on the mobile terminal, and preferably, the preset sensing device is disposed on the earphone of the target audience.
Specifically, if the current music is in the earphone playing mode, the characteristics of the heartbeat frequency, the respiratory frequency and the like of the target audience are detected through the preset sensing device corresponding to the earphone worn by the target audience, so as to obtain the personal behavior characteristics, the song listening state of the target audience is determined based on the personal behavior characteristics, in another implementation, the geographic position information corresponding to the target user is collected when the personal behavior characteristics of the target audience such as the heartbeat frequency, the respiratory frequency and the like are detected and obtained, so that the characteristic analysis is performed later, and further when other listeners are in the geographic position information for playing the music, comment information of the music is displayed in a popup window.
Further, referring to fig. 4, in another embodiment of the present application, the step of analyzing the personal behavior characteristics of the target audience includes:
step C10, if the current music is in the earphone playing mode, comparing and analyzing the personal behavior characteristics with a preset frequency threshold;
in this embodiment, it should be noted that, before playing music, a piece of normal characteristic values such as heartbeat and respiratory rate of a target audience are recorded and recorded in advance through the mobile terminal, and the normal characteristic values are set as a preset characteristic threshold.
Specifically, if the current music is in the earphone playing mode, comparing and analyzing the personal behavior characteristic with a preset frequency threshold, if the personal behavior characteristic is determined to exceed the preset characteristic threshold according to the comparison result, proving that the lyrics or melodies of the music cause resonance of a target audience, and further starting the comment display system, for example, setting the normal characteristic values of heart beat, respiratory frequency and the like to be 70 times/minute and 20 times/minute respectively, on the basis, setting the preset frequency threshold to be +/-10, namely, the preset frequency threshold corresponding to heart beat to be 60-80 times/minute or the preset frequency threshold corresponding to respiratory frequency to be 10-30 times/minute, and if the heart beat or respiratory frequency is detected to be out of the range of the preset frequency threshold, judging that the comment display system can be started, thereby realizing automatic triggering of the comment display system according to the characteristics of physical characteristics, personal operation behavior and the like of the audience in the song listening process.
Further, referring to fig. 5, in another embodiment of the present application, the step of analyzing the personal behavior characteristics of the target audience includes:
step D10, if the current music is in the music playing mode, determining the position information corresponding to the target audience based on the personal behavior characteristics;
in this embodiment, it should be noted that, if the current music is in the music play mode, the personal behavior feature includes the location information of the target audience.
Step D20, continuously recording each target state image of the target audience through the mobile terminal of the target audience based on the position information;
in this embodiment, specifically, based on the location information, a video recording function is further turned on to continuously record and update the target status image of the target audience, so as to determine whether the target audience is in the same location based on the target status image.
Step D30, calculating the state similarity of each target state image, and determining the silence time of the target audience according to the state similarity;
in this embodiment, the state similarity is a similarity between each target state image of the target audience.
Specifically, the state similarity of two adjacent target state images is calculated through a preset similarity calculation method, the state similarity is obtained, if the state similarity exceeds a preset similarity threshold, the target audience is proved to be in the same position, that is, the target audience is in a silence rest state, therefore, only one target state image is required to be reserved, further, the state similarity of the target state image and the adjacent target state image is continuously calculated, therefore, the silence time of the target audience is determined according to the state similarity, if the state similarity does not exceed the preset similarity threshold, the target audience is proved to be not in the same position, therefore, for example, the two adjacent target state images are cut into 100 x 100 small square grids, the number of similarity points of the target audience is found in 10000 square grids and is respectively marked as s1= (m 1, m2, m3, m4..........) and s2= (n 1, n2, n3, n4..........), if the number of similarity points of the target audience is not to be found in the same position, that is, for example, the number of similarity points of the target audience is 100 x 100, and the total number of similarity points of the target audience is found in 10000 square grids is calculated, and the total number of similarity points is 100% of the two similarity points of the target state images is reserved, and the total number of similarity points is 100% of the two similarity points is found in the state images, and the total number of the two similarity points is 100% is found.
And D40, comparing and analyzing the silence time and the preset duration.
In this embodiment, it should be noted that the preset duration is a duration of continuous silence of the listener, that is, a duration of time that the listener is at the same location, and in this application, the preset duration may be set to be between 1 minute and 3 minutes, and preferably, the preset duration is set to be 2 minutes.
Specifically, the silence time and the preset duration are compared and analyzed, if the silence time exceeds the preset duration, it is proved that the lyrics or melodies of the current music possibly cause resonance of a target audience, and then the comment display system is started, so that the comment display system is automatically triggered according to the silence duration of the audience at the same position in the song listening process.
Further, referring to fig. 6, based on the first embodiment of the present application, in another embodiment of the present application, if the current music is in the headphone playing mode, before determining the lyric information played by the current music based on the result of the feature analysis, the method further includes:
e10, if the personal behavior characteristics in the characteristic analysis result exceed a preset characteristic threshold value, starting comment operation;
step E20, inquiring lyric information corresponding to a first target time point according to the first target time point started by the evaluation operation, and recording target video information of the target audience through a mobile terminal;
and E30, generating comment information corresponding to the lyric information based on the target video information.
In this embodiment, specifically, if the current music is in the earphone playing mode, performing feature analysis on the personal behavior feature, and determining a first target time point corresponding to the feature analysis result exceeding a preset feature threshold, where, for the earphone playing mode, specific content of feature analysis on the personal behavior feature may refer to specific content in steps B10 to B20, and further, specific lyric information searching for the first target time point is returned according to the first target time point, and a recording function of a mobile terminal of the target listener is started to record a current environment and a personal face state of the target listener, so as to obtain the target video information, and further comment information of the target listener is generated based on the current recorded target video information and the target lyric information, and, if comment text of the target listener is input based on a comment elastic frame by the target listener, the comment text of the target listener and the current recorded target video information, and the lyric information corresponding to the target time point are packaged and stored, so as to generate the comment information of the target listener, for example, the target listener is assumed to play music by using a player in a camera, in a process of playing 1: and marking comment information of the target audience as a position corresponding to lyric information of 1:06 seconds of the music when the heartbeat, the respiration or the pulse of the time point of 06 seconds exceeds a preset characteristic threshold value.
Further, referring to fig. 7, based on the first embodiment of the present application, in another embodiment of the present application, before determining lyric information to which the current music is played based on the result of the feature analysis, the method further includes:
step F10, if the silence time corresponding to the feature analysis result exceeds the preset duration, starting comment operation;
step F20, inquiring lyric information corresponding to a second target time point according to the second target time point started by the evaluation operation, and recording target video information of the target audience through a mobile terminal;
and step F30, generating comment information corresponding to the lyric information based on the target video information.
In this embodiment, specifically, if the music playing mode is the music playing mode, based on the personal behavior feature, determining location information corresponding to the target audience, further starting a video recording function of a mobile terminal of the target audience to continuously update a target state image of the target audience, further determining whether the target audience is in a silence rest state based on a state similarity of the target state image, if the silence time of the target audience in the silence rest state exceeds a preset duration, determining whether the silence time of the target audience in the same location information exceeds the preset duration, starting a comment operation, wherein for the music playing mode, the specific content of the feature analysis on the personal behavior feature may refer to the specific content in steps C10 to C30, which is not described herein, further starts the camera device of the mobile terminal, continuously records the surrounding environment of the target audience according to the preset recording time, obtains the target video information, stores the target video information and the music, generates the personal comment log of the target audience, and pushes the target video information to the target audience after the target audience stops playing the music, so as to allow the target audience to view and determine whether to input comment characters of the music for posting, thereby realizing automatic triggering of the comment system for comment, for example, the target audience uses a mobile phone to play the music, provided that in the music playing process, in the 1 st: the target audience at the time point of 06 seconds corresponds to the silence time and exceeds the preset duration, comment information of the target audience is marked as the position of lyric information of 1:06 seconds of the music, detection and analysis are carried out on personal behavior characteristics of the target audience in the playing process, whether lyrics or melodies in songs can cause resonance of the target audience is judged according to the personal behavior characteristics of the target audience in the playing process, so that whether a comment system is started for the audience to share the listening experience is determined, namely, comment behaviors are automatically triggered according to the personal behavior characteristics of the target audience, users do not need to click comment popup windows manually, comment operation convenience is improved, and comments aiming at the music are more targeted.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a comment display device in a music playing process of a hardware running environment according to an embodiment of the present application.
As shown in fig. 8, the comment display apparatus in the music playing process may include: a processor 1001, such as a CPU, memory 1005, and a communication bus 1002. Wherein a communication bus 1002 is used to enable connected communication between the processor 1001 and a memory 1005. The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the comment display device in the music playing process may further include a rectangular user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. The rectangular user interface may include a Display screen (Display), an input sub-module such as a Keyboard (Keyboard), and the optional rectangular user interface may also include a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WIFI interface).
It will be appreciated by those skilled in the art that the comment display device structure during music playing shown in fig. 8 does not constitute a limitation of the comment display device during music playing, and may include more or less components than those illustrated, or may combine certain components, or a different arrangement of components.
As shown in fig. 8, an operating system, a network communication module, and a comment display program during music playback may be included in a memory 1005 as one type of computer storage medium. The operating system is a program for managing and controlling hardware and software resources of comment display devices in the music playing process, and supports the operation of comment display programs and other software and/or programs in the music playing process. The network communication module is used for realizing communication among components in the memory 1005 and communication with other hardware and software in the comment display device in the music playing process.
In the comment display apparatus during music playing shown in fig. 8, the processor 1001 is configured to execute a comment display program during music playing stored in the memory 1005, to implement the steps of the comment display method during music playing described in any one of the above.
The specific implementation manner of the comment display device in the music playing process is basically the same as the above embodiments of the comment display method in the music playing process, and will not be described herein.
Further, referring to fig. 9, fig. 9 is a schematic functional block diagram of a comment display device in the music playing process of the present application, and the present application further provides a comment display device in the music playing process, where the comment display device in the music playing process includes:
the characteristic analysis module is used for analyzing the personal behavior characteristics of the target audience in the music playing process;
and the determining module is used for determining lyric information played by the current music based on the characteristic analysis result.
And the comment display module is used for displaying comment information associated with the lyric information based on the target position of the lyric information.
Optionally, the acquiring module is further configured to:
if the current music is in the music playing mode, sending a detection signal through the mobile terminal of the target audience, and detecting the detection signal to obtain the listed information of the environmental objects;
performing temperature detection on the array information of the environmental objects to obtain a temperature detection result;
and determining the personal behavior characteristics corresponding to the target audience based on the temperature detection result.
Optionally, the acquiring module is further configured to:
transmitting a detection signal through the mobile terminal, and recording the transmitting time of the detection signal and the signal receiving information of the detection signal reflected to the mobile terminal;
and calculating object position information of the surrounding environment of the mobile terminal based on the transmitting time, the signal receiving information and the preset propagation speed corresponding to the detection signal, and obtaining the environment object array information.
Optionally, the acquiring module is further configured to:
if the current music is in the earphone playing mode, detecting personal behavior characteristics of the target audience through a preset sensing device.
Optionally, the feature analysis module is further configured to:
if the current music is in the earphone playing mode, comparing and analyzing the personal behavior characteristics with a preset frequency threshold;
if the current music is in the music playing mode, determining the position information corresponding to the target audience based on the personal behavior characteristics; continuously recording each target state image of the target audience through the mobile terminal of the target audience based on the position information; calculating the state similarity of each target state image, and determining the silence time of the target audience in the position information according to the state similarity; and comparing and analyzing the silence time and the preset duration.
Optionally, the comment display device in the music playing process is further used for:
if the personal behavior characteristics in the characteristic analysis result exceed a preset characteristic threshold value, starting comment operation;
inquiring lyric information corresponding to a first target time point according to the first target time point started by the evaluation operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
Optionally, the comment display device in the music playing process is further used for:
if the silence time corresponding to the feature analysis result exceeds the preset duration, starting comment operation;
inquiring lyric information corresponding to a second target time point according to the second target time point started by the evaluation operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
Optionally, the comment presentation module is further configured to:
if the current music is in the earphone playing mode, determining comment display time points corresponding to the personal behavior characteristics exceeding a preset characteristic threshold based on the characteristic analysis result;
and if the current music is in the music playing mode, determining comment display time points of the target audience, corresponding to the silence time exceeding the preset duration, based on the characteristic analysis result.
The specific implementation manner of the comment display device in the music playing process is basically the same as the above embodiments of the comment display method in the music playing process, and will not be repeated here.
The embodiment of the application provides a storage medium, which is a computer readable storage medium, and the computer readable storage medium stores one or more programs, and the one or more programs are further executable by one or more processors to implement the steps of the comment display method in the music playing process.
The specific implementation manner of the computer readable storage medium is basically the same as the above embodiments of the comment display method in the music playing process, and will not be repeated here.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims.
Claims (10)
1. The comment display method in the music playing process is characterized by comprising the following steps of:
during music playing, analyzing personal behavior characteristics of a target audience, including: if the current music is in the earphone playing mode, comparing and analyzing the personal behavior characteristics with a preset characteristic threshold value; if the current music is in the music playing mode, determining position information and silence time corresponding to the target audience based on the personal behavior characteristics, and comparing and analyzing the silence time with a preset duration;
if the personal behavior characteristics in the characteristic analysis result exceed a preset characteristic threshold value under the condition that the current music is in the earphone playing mode, starting comment operation;
if the silence time corresponding to the feature analysis result exceeds the preset duration under the condition that the current music is in the music play mode, starting comment operation;
determining lyric information played by the current music based on the feature analysis result;
and displaying comment information associated with the lyric information based on the target position of the lyric information.
2. The comment displaying method during music playing of claim 1 wherein prior to said step of analyzing the personal behavioral characteristics of the target audience, said comment displaying method during music playing further comprises:
if the current music is in the music playing mode, sending a detection signal through the mobile terminal of the target audience, and detecting the detection signal to obtain the listed information of the environmental objects;
performing temperature detection on the array information of the environmental objects to obtain a temperature detection result;
and determining the personal behavior characteristics corresponding to the target audience based on the temperature detection result.
3. The comment displaying method of claim 2 wherein said step of transmitting a detection signal through a mobile terminal of said target audience and detecting said detection signal to obtain environmental object list information includes:
transmitting a detection signal through the mobile terminal, and recording the transmitting time of the detection signal and the signal receiving information of the detection signal reflected to the mobile terminal;
and calculating object position information of the surrounding environment of the mobile terminal based on the transmitting time, the signal receiving information and the preset propagation speed corresponding to the detection signal, and obtaining the environment object array information.
4. The comment displaying method during music playing of claim 1 wherein prior to said step of analyzing the personal behavioral characteristics of the target audience, said comment displaying method during music playing further comprises:
if the current music is in the earphone playing mode, detecting personal behavior characteristics of the target audience through a preset sensing device.
5. The comment displaying method of claim 1 wherein said step of determining location information and silence time corresponding to said target audience based on said personal behavior characteristics comprises:
determining position information corresponding to the target audience based on the personal behavior characteristics;
continuously recording each target state image of the target audience through the mobile terminal of the target audience based on the position information;
and calculating the state similarity of each target state image, and determining the silence time of the target audience at the position information according to the state similarity.
6. The comment displaying method during music playing of claim 1 further comprising, if the current music is in an earphone playing mode, before determining lyric information to which the current music is played based on the feature analysis result:
inquiring lyric information corresponding to a first target time point according to the first target time point started by the evaluation operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
7. The comment displaying method during music play of claim 1 further comprising, if the current music is in a music play-out mode, before determining lyric information to which the current music is played based on the feature analysis result:
inquiring lyric information corresponding to a second target time point according to the second target time point started by the evaluation operation, and recording target video information of the target audience through a mobile terminal;
and generating comment information corresponding to the lyric information based on the target video information.
8. The comment displaying method of claim 1 wherein the step of determining lyric information to which the current music is played based on a result of the feature analysis includes:
if the current music is in the earphone playing mode, determining comment display time points corresponding to the personal behavior characteristics exceeding a preset characteristic threshold based on the characteristic analysis result; inquiring lyric information corresponding to the comment presentation time point;
if the current music is in the music playing mode, determining comment display time points of the silence time corresponding to the target audience exceeding a preset duration based on the characteristic analysis result; and inquiring lyric information corresponding to the comment display time point.
9. A comment display apparatus in a music playing process, characterized in that the comment display apparatus in a music playing process includes: a memory, a processor, and a comment display program during music playing stored on the memory, the comment display program during music playing being executed by the processor to implement the steps of the comment display method during music playing as claimed in any one of claims 1 to 8.
10. A storage medium which is a computer-readable storage medium having stored thereon a comment display program in a music playing process, the comment display program in the music playing process being executed by a processor to implement the steps of the comment display method in the music playing process as claimed in any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592494.3A CN114385108B (en) | 2021-12-23 | 2021-12-23 | Comment display method, comment display equipment and storage medium in music playing process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592494.3A CN114385108B (en) | 2021-12-23 | 2021-12-23 | Comment display method, comment display equipment and storage medium in music playing process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114385108A CN114385108A (en) | 2022-04-22 |
| CN114385108B true CN114385108B (en) | 2024-03-22 |
Family
ID=81197550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111592494.3A Active CN114385108B (en) | 2021-12-23 | 2021-12-23 | Comment display method, comment display equipment and storage medium in music playing process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114385108B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012113589A (en) * | 2010-11-26 | 2012-06-14 | Nec Corp | Action motivating device, action motivating method and program |
| WO2015062337A1 (en) * | 2013-10-29 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Displaying lyrics of a song on a mobile computing device in a lock screen state |
| CN105979312A (en) * | 2016-07-13 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Information sharing method and device |
| CN107944040A (en) * | 2017-12-14 | 2018-04-20 | 维沃移动通信有限公司 | The display methods and mobile terminal of a kind of lyrics |
| WO2018223837A1 (en) * | 2017-06-08 | 2018-12-13 | Oppo广东移动通信有限公司 | Music playing method and related product |
| CN109582821A (en) * | 2018-11-27 | 2019-04-05 | 努比亚技术有限公司 | A kind of music object recommendation method, terminal and computer readable storage medium |
| CN109982129A (en) * | 2019-03-26 | 2019-07-05 | 北京达佳互联信息技术有限公司 | Control method for playing back, device and the storage medium of short-sighted frequency |
| CN110324647A (en) * | 2019-07-15 | 2019-10-11 | 北京字节跳动网络技术有限公司 | The determination method, apparatus and electronic equipment of information |
| CN112995654A (en) * | 2021-02-08 | 2021-06-18 | 咪咕音乐有限公司 | Video playing pause detection method and device, server and readable storage medium |
| CN113793578A (en) * | 2021-08-12 | 2021-12-14 | 咪咕音乐有限公司 | Tune generation method, device, equipment and computer readable storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008004134A (en) * | 2006-06-20 | 2008-01-10 | Sony Corp | Music reproducing method and music reproducing device |
| CN101895799B (en) * | 2010-07-07 | 2015-08-12 | 中兴通讯股份有限公司 | The control method of music and music player |
| US10552479B2 (en) * | 2013-04-11 | 2020-02-04 | Hungama Digital Media Entertainment Private Limited | System to search and play music |
| CN105992099A (en) * | 2015-02-03 | 2016-10-05 | 中兴通讯股份有限公司 | Terminal and method for terminal to broadcast audio signals directionally |
| CN108429972B (en) * | 2018-05-28 | 2019-12-27 | Oppo广东移动通信有限公司 | Music playing method, device, terminal, earphone and readable storage medium |
-
2021
- 2021-12-23 CN CN202111592494.3A patent/CN114385108B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012113589A (en) * | 2010-11-26 | 2012-06-14 | Nec Corp | Action motivating device, action motivating method and program |
| WO2015062337A1 (en) * | 2013-10-29 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Displaying lyrics of a song on a mobile computing device in a lock screen state |
| CN105979312A (en) * | 2016-07-13 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Information sharing method and device |
| WO2018223837A1 (en) * | 2017-06-08 | 2018-12-13 | Oppo广东移动通信有限公司 | Music playing method and related product |
| CN107944040A (en) * | 2017-12-14 | 2018-04-20 | 维沃移动通信有限公司 | The display methods and mobile terminal of a kind of lyrics |
| CN109582821A (en) * | 2018-11-27 | 2019-04-05 | 努比亚技术有限公司 | A kind of music object recommendation method, terminal and computer readable storage medium |
| CN109982129A (en) * | 2019-03-26 | 2019-07-05 | 北京达佳互联信息技术有限公司 | Control method for playing back, device and the storage medium of short-sighted frequency |
| CN110324647A (en) * | 2019-07-15 | 2019-10-11 | 北京字节跳动网络技术有限公司 | The determination method, apparatus and electronic equipment of information |
| CN112995654A (en) * | 2021-02-08 | 2021-06-18 | 咪咕音乐有限公司 | Video playing pause detection method and device, server and readable storage medium |
| CN113793578A (en) * | 2021-08-12 | 2021-12-14 | 咪咕音乐有限公司 | Tune generation method, device, equipment and computer readable storage medium |
Non-Patent Citations (2)
| Title |
|---|
| Weighted-based summarization of music comments;Wenxing Hong;2013 8th International Conference on Computer Science & Education;140-143 * |
| 基于移动终端的呼吸频率实时监护研究;柳鹏;中国优秀硕士学位论文全文数据库电子期刊;1-65 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114385108A (en) | 2022-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Tung et al. | Expansion of human-phone interface by sensing structure-borne sound propagation | |
| WO2018223837A1 (en) | Music playing method and related product | |
| CN106303733B (en) | Method and device for playing live special effect information | |
| CN107515925A (en) | Method for playing music and device | |
| CN107483597B (en) | Resource transfer method, related equipment and system | |
| WO2017215652A1 (en) | Sound effect parameter adjustment method, and mobile terminal | |
| CN107680614B (en) | Audio signal processing method, apparatus and storage medium | |
| CN1937462A (en) | Content-preference-score determining method, content playback apparatus, and content playback method | |
| US8963722B2 (en) | Apparatus and method for playing and/or generating audio content for an audience | |
| CN104967932B (en) | Earphone uses based reminding method and device, intelligent terminal | |
| EP2431900A1 (en) | Audiovisual content tagging using biometric sensor | |
| CN109859730A (en) | A kind of audio-frequency processing method and device | |
| CN109348239A (en) | Piece stage treatment method, device, electronic equipment and storage medium is broadcast live | |
| US10704914B2 (en) | Positioning method using broadcast speeches | |
| CN111370018A (en) | Audio data processing method, electronic device and medium | |
| CN109254752A (en) | 3D sound effect treatment method and Related product | |
| CN109243488A (en) | Audio-frequency detection, device and storage medium | |
| KR20140041266A (en) | System and method for providing dance and song studying service using mobile content | |
| CN111435377A (en) | Application recommendation method and device, electronic equipment and storage medium | |
| US9594148B2 (en) | Estimation device and estimation method using sound image localization processing | |
| CN114385108B (en) | Comment display method, comment display equipment and storage medium in music playing process | |
| CN110297543B (en) | Audio playing method and terminal equipment | |
| CN114827651B (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN110113256A (en) | Information interaction method, device, server, user terminal and readable storage medium storing program for executing | |
| CN107835323B (en) | Song processing method, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |