CN113590872B - Method, device and equipment for generating dancing spectrum surface - Google Patents

Method, device and equipment for generating dancing spectrum surface Download PDF

Info

Publication number
CN113590872B
CN113590872B CN202110856072.6A CN202110856072A CN113590872B CN 113590872 B CN113590872 B CN 113590872B CN 202110856072 A CN202110856072 A CN 202110856072A CN 113590872 B CN113590872 B CN 113590872B
Authority
CN
China
Prior art keywords
beat
dance
spectrum
audio data
action
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110856072.6A
Other languages
Chinese (zh)
Other versions
CN113590872A (en
Inventor
黎财可
何衍浩
徐焕芬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aimyunion Technology Ltd
Original Assignee
Aimyunion Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aimyunion Technology Ltd filed Critical Aimyunion Technology Ltd
Priority to CN202110856072.6A priority Critical patent/CN113590872B/en
Publication of CN113590872A publication Critical patent/CN113590872A/en
Application granted granted Critical
Publication of CN113590872B publication Critical patent/CN113590872B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/64Browsing; Visualisation therefor
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B26/00Exercising apparatus not covered by groups A63B1/00 - A63B25/00
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/686Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Library & Information Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Auxiliary Devices For Music (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, and a device for editing a dance spectrum plane. The method comprises the following steps: acquiring audio data; obtaining beat points of the audio data according to the audio data and a preset beat point identification algorithm; according to the audio data and the beat points, obtaining first spectrum face beats and first beat lines corresponding to the beat points; responding to the adjustment operation of the dance spectral plane generation control interface on the first spectral plane beat and the first beat line, and obtaining an adjusted second spectral plane beat and a second beat line; and according to the adjusted beats of the second spectrum surface and the second beat line, responding to the dance action indication data added through the dance spectrum surface generation control interface, generating a corresponding dance spectrum surface, and displaying the dance spectrum surface in the dance spectrum surface generation control interface.

Description

Method, device and equipment for generating dancing spectrum surface
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, and a device for generating a dance spectrum plane.
Background
Dance machines are one of many entertainment games loved by young people, and are based on existing songs, and the dance machines prompt the user for corresponding dance movements by displaying corresponding dance indication symbols in the process of playing the songs. The existing dancing machine is based on the existing songs, dance indication symbols are preset by dancing machine operators to be solidified on the dancing machine, so that general users cannot design own dance movements by themselves, and can only dance along with the dance indication symbols on the dancing machine, and game experience is not good enough.
Disclosure of Invention
Based on the above, the application aims to provide a method, a device and equipment for generating a dancing spectrum surface, which improve the marking efficiency of beat points, facilitate the design of the dancing spectrum surface by a user and the modification of the dancing spectrum surface, and enhance the user experience, and the technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a method for generating a dance spectrum plane, including the following steps:
acquiring audio data;
obtaining beat points of the audio data according to the audio data and a preset beat point identification algorithm;
according to the audio data and the beat points, obtaining first spectrum face beats and first beat lines corresponding to the beat points, and displaying the first spectrum face beats and the first beat lines in a dance spectrum face generation control interface generated by a computer;
Responding to the adjustment operation of the dance spectral plane generation control interface on the first spectral plane beat and the first beat line, and obtaining an adjusted second spectral plane beat and a second beat line;
editing corresponding dance action indicating data according to the adjusted beats of the second spectrum surface and the second beat line, generating a corresponding dancing spectrum surface, and displaying the dancing spectrum surface in a dancing spectrum surface generation control interface; each dance action indication data corresponds to an action indication element displayed by dance entertainment equipment, the dance entertainment equipment binds the audio data with the dance spectrum surface, and when the audio data is played, the corresponding action indication element is displayed according to dance action indication data in the dance spectrum surface corresponding to a beat point of the audio data.
In a second aspect, an embodiment of the present application provides a dance profile generation apparatus, including:
the acquisition module is used for acquiring the audio data;
the recognition module is used for obtaining beat points of the audio data according to the audio data and a preset beat point recognition algorithm;
the processing module is used for obtaining a first spectral face beat and a first beat line corresponding to the beat point according to the audio data and the beat point, and displaying the first spectral face beat and the first beat line in a dancing spectral face generation control interface generated by a computer;
The adjusting module is used for responding to the adjusting operation of the dance spectral surface generation control interface on the first spectral surface beat and the first beat line to obtain an adjusted second spectral surface beat and a second beat line;
the editing module is used for editing corresponding dance action indication data according to the adjusted beats of the second spectrum surface and the second beat line, generating a corresponding dance spectrum surface, and displaying the dance spectrum surface in the dance spectrum surface generation control interface; each dance action indication data corresponds to an action indication element displayed by dance entertainment equipment, the dance entertainment equipment binds the audio data with the dance spectrum surface, and when the audio data is played, the corresponding action indication element is displayed according to dance action indication data in the dance spectrum surface corresponding to a beat point of the audio data.
In a third aspect, an embodiment of the present application provides a device for generating a dance spectrum plane, including: a processor, a memory, and a computer program stored on the memory and executable on the processor; the computer program when executed by the processor implements the steps of the method of dance profile generation as described in the first aspect.
In the embodiment of the application, corresponding first spectrum surface beats and first beat lines are obtained by identifying beat points in audio data, the first spectrum surface beats and the first beat lines can be adjusted through a dance spectrum surface generation control interface, adjusted second spectrum surface beats and second beat lines are obtained, corresponding dance action indication data can be added through the dance spectrum surface generation control interface, and corresponding dance spectrum surfaces are generated. The method and the device have the advantages that corresponding and accurate spectrum face beats and beat lines are obtained according to the audio data, marking efficiency of beat points is improved, a control interface is generated through the dancing spectrum face, a user can conveniently modify the dancing spectrum face and add corresponding dance action indication data, the corresponding dancing spectrum face is generated, and user experience is enhanced.
For a better understanding and implementation, the present application is described in detail below with reference to the drawings.
Drawings
FIG. 1 is a schematic flow chart of a dance profile generation method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a partial flow of a dance profile generation method according to an embodiment of the present application;
FIG. 3 is a flowchart of S102 in a method for generating a dance profile according to an embodiment of the present application;
Fig. 4 is a schematic flow chart of S104 in the method for generating a dance profile according to an embodiment of the present application;
FIG. 5 is another flow chart of S104 in the method for generating a dance profile according to an embodiment of the present application;
FIG. 6 is a flowchart of S105 in a method for generating a dance profile according to an embodiment of the present application
Fig. 7 is another flow chart of S105 in the method for generating a dance profile according to another embodiment of the present application;
FIG. 8 is a schematic structural diagram of a device for generating a dance profile according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of an apparatus according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the application. The word "if"/"if" as used herein may be interpreted as "at … …" or "at … …" or "in response to a determination", depending on the context.
The execution subject of the dance profile generation method of the present application is an editing apparatus (hereinafter, abbreviated as editing apparatus) of dance profile generation. The editing device can be a computer, a smart phone or a professional dancing entertainment device, etc. In an alternative embodiment, the editing device may be a stand-alone device that establishes a data connection with the server, or may be a component of the stand-alone device, for example: a processor or microprocessor within the stand-alone device, etc.
Referring to fig. 1, fig. 1 is a flowchart of a dance profile generation method according to an embodiment of the present application, where the method includes the following steps:
S101: audio data is acquired.
In an alternative embodiment, the audio data may be audio data pre-stored in the editing apparatus, and in another alternative embodiment, the audio data may also be audio data in a network audio database.
If the audio data is the audio data in the network audio database, the editing device needs to pre-establish the data connection with the remote server, wherein the remote server is loaded with the network audio database, and receives the audio data sent by the remote server.
Specifically, the user may select the target audio data from the several audio data in the network audio database by touching, clicking, voice control, and the like, which is not limited herein.
S102: and obtaining beat points of the audio data according to the audio data and a preset beat point identification algorithm.
The beat is a sudden change signal with a certain rule in the audio data and is used for reflecting the rhythm of the audio data; the beat is at the time point when the audio data appears, namely, the beat point.
In the embodiment of the application, the editing equipment processes the acquired audio data according to a preset beat point identification algorithm to acquire the beat points of the audio data. The beat point identification algorithm can be implemented by any existing audio data analysis tool, and is not limited herein.
In an alternative embodiment, in order to obtain more accurate beat points, the audio data is processed, referring to fig. 2, fig. 2 is a schematic partial flow diagram of a dance spectrum surface generating method according to an embodiment of the present application, including steps S106 to S108, where the steps before step S102 are specifically as follows:
s106: and responding to the audio tone changing instruction, and acquiring the audio tone changing parameters.
In an embodiment of the present application, when the audio data requires audio tone modification, the editing apparatus may receive an audio tone modification parameter input by a user through the input apparatus in response to the audio tone modification instruction, and store the setting thereof in the editing apparatus.
The input device may be an input device built in an editing device, for example: a touch screen or microphone, etc. Specifically, the user may touch-input the audio tone variation parameters by operating the touch screen, or the user may input the audio tone variation parameters by voice by operating the microphone.
The input device may also be an external input device connected to the editing device, for example: external keyboard or mobile terminal, etc. Specifically, the user can input the audio tone variation parameters by controlling the external keyboard or controlling the mobile terminal.
S107: and obtaining the processed first audio data according to the audio data, the audio tone variation parameters and a preset audio tone variation algorithm.
In the embodiment of the application, the editing equipment carries out tone changing processing on the audio data according to the audio tone changing parameters and a preset audio tone changing algorithm to obtain first audio data after tone changing.
S108: and obtaining processed second audio data according to the first audio data and a preset fundamental tone synchronous superposition algorithm.
In an embodiment of the present application, the editing apparatus samples the first audio data to obtain a sampled value of the first audio data.
According to the sampling value of the first audio data and a preset pitch synchronous superposition algorithm, the first audio data is processed to obtain processed second audio data, and the effects that the tone is changed and the sound speed is not changed under the condition that the semantics of the audio data are not lost are achieved.
In an alternative embodiment, the editing device sets the standard sampling value to 1, and when the sampling rate of the first audio data obtained by the editing device is greater than 1, the editing device processes the first audio data according to a preset pitch synchronous superposition algorithm.
Secondly, setting the corresponding resampling point number according to the sampling rate of the first audio data, and carrying out interpolation processing on the processed first audio data.
And finally, processing the processed first audio data through a corresponding filter to obtain second audio data, so that the continuity of the audio data after tone change is ensured, and the accurate output of the voice semantics of the audio data is ensured.
In another optional embodiment, the editing device sets a standard sampling value to 1, and when the sampling rate of the first audio data obtained by the editing device is smaller than 1, the editing device performs stretching processing on the spectrum of the first audio data through resampling on the first audio data, and the stretched first audio data is processed through a corresponding filter to remove noise;
and secondly, processing the first audio data processed by the filter according to a preset fundamental tone synchronous superposition algorithm to obtain second audio data, so that continuity of the audio data after tone modification is ensured, and accurate output of voice semantics of the audio data is ensured.
In the embodiment of the application, the editing equipment realizes accurate tone variation of the audio data by carrying out frequency spectrum stretching processing and pitch synchronous superposition processing on the audio data, and better realizes generation of a dancing spectrum surface according to the audio data.
In an alternative embodiment, in order to obtain more accurate beat points, referring to fig. 3, fig. 3 is a schematic flow diagram of step S102 in a method for generating a dance profile according to an embodiment of the present application, where step S102 includes steps S1021 to S1023, specifically as follows:
s1021: and obtaining beat characteristics of the audio data according to the audio data and a preset beat characteristic recognition model.
Beat characteristics refer to the rule of combining strong beats and weak beats of beats in audio data, and single beat characteristics cannot fully reflect the beats of the audio data because the beats have multiple characteristics such as pitch, abrupt impact and the like.
In the embodiment of the present application, a beat feature recognition model is preset in the editing device, and after the audio data is acquired, the corresponding beat feature of each frame of the audio data may be acquired according to the preset beat feature recognition model.
When a significant abrupt impact occurs in an audio signal in the audio data, a dominant beat characteristic of the audio data occurs in a low frequency signal of the audio data.
In an alternative embodiment, the editing device acquires the low-frequency signal of the audio data, analyzes the spectrum information of the low-frequency signal according to the low-frequency signal of the audio data and the beat characteristic identification model, and acquires the beat characteristic corresponding to each frame of the low-frequency signal of the audio data as the low-frequency beat characteristic of the audio data.
Because the audio data is too gentle, the obtained beat features are not obvious, and the beat of the audio data cannot be well reflected.
In an optional embodiment, the editing device divides the audio data into a plurality of sub-bands according to the audio data and a preset sub-band separation algorithm, enhances signals in each sub-band of the audio data, obtains enhanced audio data, and obtains beat characteristics corresponding to each frame of the audio data as the enhanced beat characteristics of the audio data according to the enhanced audio data and a beat characteristic recognition model.
The Mel frequency spectrum characteristics are similar to the auditory characteristics of the human ear, so that the characteristics of the auditory beat of the human ear can be well simulated, and the recognition efficiency is higher for the audio data with obvious beat.
In an alternative embodiment, the editing device obtains the mel spectrum of the audio data according to the audio data and the mel spectrum algorithm, and obtains the beat characteristics corresponding to each frame of the audio data as the mel spectrum beat characteristics of the audio data according to the mel spectrum of the audio data and the beat characteristic identification model.
When the audio signal in the audio data has obvious abrupt change impact, a stronger instantaneous level signal is generated; in an alternative embodiment, the editing device detects the audio data, acquires the stronger instantaneous level signal, and acquires the beat characteristic corresponding to each frame of the audio data as the level beat characteristic of the audio data according to the level signal output by the audio data and the beat characteristic identification model.
In an alternative embodiment, the editing device obtains the phase information of the audio data, and obtains the beat characteristic corresponding to each frame of the audio data as the phase beat characteristic of the audio data according to the phase information of the audio data and a preset beat characteristic identification model.
S1022: and obtaining a first node corresponding to the beat characteristic according to the beat characteristic and a preset Markov model.
And the editing equipment carries out autocorrelation calculation on the beat characteristics of the audio data according to the beat characteristics corresponding to each frame of the audio data and the Markov model to obtain an autocorrelation curve.
Next, a corresponding period of the autocorrelation curve is obtained by a Viterbi algorithm (Viterbi), and a first beat node corresponding to the beat feature is obtained from the period.
In an embodiment of the present application, an editing apparatus divides the audio data into a plurality of time periods; the length of the time period may be 512 data frames, and the time period includes the low-frequency beat feature, the enhancement beat feature, the mel spectrum beat feature, the level beat feature and the phase beat feature.
The editing device carries out autocorrelation calculation on beat characteristics of the audio data in the time period according to the beat characteristics of the audio data in the time period and the Markov model, obtains an autocorrelation curve, obtains a corresponding period of the autocorrelation curve through a Viterbi algorithm (Viterbi), obtains first beat points corresponding to each beat characteristic of the audio data in the time period according to the period, and realizes generation of the beat points to represent the beat characteristics of the audio data.
S1023: and obtaining a second beat point according to the first beat point and a preset beat point screening algorithm.
The beat point screening algorithm is a joint algorithm of a Bayesian estimation algorithm (Bayesian estimation) and an information entropy algorithm.
The Bayesian estimation algorithm combines new evidence and the prior probability by using the Bayesian theorem to obtain new probability.
In the embodiment of the application, editing equipment calculates deviation information of a first node corresponding to the same beat characteristic of audio data in the time period according to a Bayesian estimation algorithm; the deviation information refers to the distance between the first beat nodes corresponding to the same beat characteristic of the audio data in the time period.
According to the deviation information and the information entropy algorithm, a first beat point with the minimum deviation information is obtained and used as a second beat point, so that the beat point is screened, and the beat point which is more in line with the audio data is obtained.
S103: according to the audio data and the beat points, obtaining first spectrum face beats and first beat lines corresponding to the beat points, and displaying the first spectrum face beats and the first beat lines in a dance spectrum face generation control interface generated by a computer.
The dancing spectrum surface reflects the beat characteristics of the audio data and can be input to a dancing machine, so that the dancing machine can display the beat characteristics of the audio data according to the dancing spectrum surface.
The first spectral plane beat is used for indicating the position of the beat point of the audio data in a dance spectral plane generation control interface, wherein the dance spectral plane generation control interface is generated by a computer, a corresponding first beat line is generated according to the first spectral plane beat, and the first spectral plane beat and the first beat line are displayed in the dance spectral plane generation control interface.
In an alternative embodiment, the editing device obtains the BPM of the audio data according to the audio data and the obtained beat points; the BPM refers to the number of beats per minute in the audio data, is a speed standard independent of a music score, and refers to beat points appearing per minute in the audio data.
Editing equipment generates corresponding spectrum face beats corresponding to the beat points in the dance spectrum face generation control interface according to the BPM of the audio data; the spectrum surface beat is a time point on a time axis of the audio data, and the spectrum surface beat is an intersection point of the beat line and the time axis of the audio data.
The editing equipment generates corresponding beat lines according to the position parameters of the spectrum surface beat in the dancing spectrum surface generation control interface, so that the spectrum surface beat and the beat lines are quickly and accurately generated.
S104: and responding to the adjustment operation of the dance face generation control interface on the first face beat and the first beat line, and obtaining an adjusted second face beat and second beat line.
In the embodiment of the application, a user interacts with the dance spectrum surface generation control interface, the dance spectrum surface generation control interface comprises a parameter input control and an adjustment result storage control, the editing equipment receives an adjustment result input by the user through the parameter input control, adjusts spectrum surface beats and beat lines, the adjustment result storage control triggers the editing equipment to respond to the adjustment operation of the first spectrum surface beats and the first beat lines, and the editing equipment stores the current adjustment result to obtain adjusted second spectrum surface beats and second beat lines. The user can modify and confirm the spectrum surface beat and the beat line through the editing equipment, and the like, so that the user can conveniently adjust the spectrum surface beat and the beat line.
In an alternative embodiment, referring to fig. 4, fig. 4 is a schematic flow chart of step S104 in the method for generating a dance profile according to an embodiment of the present application, including steps S1041 to S1043, specifically as follows:
s1041: responding to a spectrum face beat editing instruction sent by the dance spectrum face generation control interface, and editing the spectrum face beat; the spectrum plane beat editing instruction comprises a spectrum plane beat adding instruction and a spectrum plane beat deleting instruction.
When the spectrum surface beat needs to be modified, a user enters the dancing spectrum surface generation control interface, a spectrum surface beat processing control in the dancing spectrum surface generation control interface is triggered, and a spectrum surface beat editing instruction is triggered.
S1042: and adding the spectrum surface beat at the position of the beat line indicated by the spectrum surface beat adding instruction according to the spectrum surface beat adding instruction.
In the embodiment of the application, the editing equipment obtains the position parameters of the beat line indicated by the spectrum face beat adding instruction by responding to the spectrum face beat adding instruction, and generates the position parameters in the control interface according to the dance spectrum face of the beat line, and adds the spectrum face beat on the beat line.
S1043: and deleting the spectrum surface beat indicated by the spectrum surface beat deleting instruction according to the spectrum surface beat deleting instruction.
In the embodiment of the application, the editing equipment acquires the position parameters of the spectrum surface beat indicated by the spectrum surface beat deleting instruction in the dance spectrum surface generation control interface by responding to the spectrum surface beat deleting instruction, and deletes the spectrum surface beat.
In an alternative embodiment, referring to fig. 5, fig. 5 is another flow chart of step S104 in the method for generating a dance profile according to an embodiment of the present application, including step S1044, specifically as follows:
s1044: and responding to a beat line deviation instruction, and moving the beat line to a designated position of the dancing spectrum surface.
In the embodiment of the application, the editing equipment acquires the beat line indicated by the beat line deviation instruction and the target position parameter of the beat line in the dance spectrum surface generation control interface by responding to the beat line deviation instruction, and modifies the current position parameter of the beat line to the target position parameter indicated by the beat line deviation instruction.
S105: editing corresponding dance action indicating data according to the adjusted beats of the second spectrum surface and the second beat line, generating a corresponding dancing spectrum surface, and displaying the dancing spectrum surface in a dancing spectrum surface generation control interface; each dance action indication data corresponds to an action indication element displayed by dance entertainment equipment, the dance entertainment equipment binds the audio data with the dance spectrum surface, and when the audio data is played, the corresponding action indication element is displayed according to dance action indication data in the dance spectrum surface corresponding to a beat point of the audio data.
The dance action indication data are used for indicating a user to make corresponding dance actions according to the spectrum surface beats and beat lines.
In the embodiment of the application, the editing equipment responds to adding corresponding dance action indicating data through the dance spectrum surface generation control interface according to the adjusted second spectrum surface beat and the second beat line, adds the corresponding dance action indicating data and generates the corresponding dance spectrum surface.
In an alternative embodiment, referring to fig. 6, fig. 6 is a schematic flow chart of step S105 in a method for generating a dance profile according to an embodiment of the present application, including steps S1051 to S1053, specifically as follows:
s1051: responding to a dance independent action editing instruction sent by the dance spectral plane generation control interface, and editing corresponding dance action indication data; the dance individual action editing instruction comprises an action identification adding instruction and an action identification deleting instruction.
The action mark refers to a mark used for indicating dance actions on a dancing spectrum surface, and the action mark can be in a directional arrow pattern or a specific symbol pattern, and is not limited herein.
In the embodiment of the application, when the dance motion indication data needs to be modified, the user can trigger the sending of the dance single motion editing instruction by triggering the dance single motion processing control in the dance spectrum surface generation control interface, and the editing equipment responds to the dance single motion editing instruction to modify the dance motion indication data according to the spectrum surface beat so as to better indicate the dance motion.
S1052: and responding to the action identification adding instruction, and adding an action identification at the position of the spectrum surface beat indicated by the action identification adding instruction.
In the embodiment of the application, the editing equipment responds to the action identification adding instruction, obtains the position parameter of the spectrum surface beat indicated by the action identification adding instruction in the dance spectrum surface generation control interface, and adds the action identification on the position according to the position parameter.
S1053: and deleting the action identifier indicated by the action identifier deleting instruction in response to the action identifier deleting instruction.
In the embodiment of the application, the editing equipment responds to the action identification deleting instruction to obtain the position parameter of the action identification indicated by the action identification deleting instruction in the dance spectrum surface generation control interface, and deletes the action identification on the position parameter according to the position parameter.
In an alternative embodiment, referring to fig. 7, fig. 7 is another flow chart of step S105 in the method for generating a dance profile according to an embodiment of the present application, including step S1054, specifically as follows:
s1054: responding to a dance continuous motion editing instruction sent by the dance spectral surface generation control interface, and editing corresponding dance motion indication data, wherein the dance continuous motion editing instruction comprises a starting spectral surface beat and a position parameter of a stopping spectral surface beat, which are designated by the dance continuous motion editing instruction; and adding a plurality of action identifiers between the initial spectrum surface beat and the final spectrum surface beat according to the position parameters of the initial spectrum surface beat and the final spectrum surface beat.
In the embodiment of the application, when the dance motion indication data needs to be modified, the user can trigger the sending of the dance continuous motion editing instruction by triggering the dance continuous motion processing control in the dance spectrum surface generation control interface.
Editing equipment acquires position parameters of the initial spectral plane beat and the termination spectral plane beat in the dance spectral plane generation control interface according to the dance continuous action editing instruction; acquiring position parameters of a starting beat line where the starting spectral surface beat is located in the dancing spectral surface generation control interface according to the position parameters of the starting spectral surface beat in the dancing spectral surface generation control interface; and acquiring the position parameters of the stop beat line where the stop spectrum beat is located in the dancing spectrum face generation control interface according to the position parameters of the stop spectrum face beat in the dancing spectrum face generation control interface.
According to the position relation of the starting beat line and the ending beat line in the dance spectrum surface generation control interface, a plurality of action marks are added below the starting spectrum surface beat in the position space between the starting beat line and the ending beat line in the dance spectrum surface generation control interface, and the action marks are used for indicating continuous actions of dance.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an apparatus for generating a dance profile according to an embodiment of the present application, where the apparatus may implement all or a part of the apparatus for generating a dance profile through software, hardware or a combination of both, and the apparatus includes:
an acquisition module 81 for acquiring audio data; obtaining beat points of the audio data according to the audio data and a preset beat point identification algorithm;
the recognition module 82 is configured to obtain beat points of the audio data according to the audio data and a preset beat point recognition algorithm;
the processing module 83 is configured to obtain, according to the audio data and the beat point, a first spectral plane beat and a first beat line corresponding to the beat point, and display the first spectral plane beat and the first beat line in a dance spectral plane generation control interface generated by a computer;
An adjustment module 84, configured to obtain an adjusted second spectral plane tempo and a second tempo line in response to an adjustment operation of the first spectral plane tempo and the first tempo line by the dance spectral plane generation control interface;
the editing module 85 is configured to generate a corresponding dance spectrum surface in response to adding corresponding dance action indication data through the dance spectrum surface generation control interface according to the adjusted second spectrum surface beat and the second beat line, and display the dance spectrum surface in the dance spectrum surface generation control interface; each dance action indication data corresponds to an action indication element of dance entertainment equipment, the dance entertainment equipment binds the audio data with the dance spectrum surface, and the corresponding action indication element is displayed according to dance action indication data in the dance spectrum surface when the audio data is played.
In the embodiment of the application, the audio data are acquired through the acquisition module, the beat points in the audio data are identified through the identification module, the spectrum surface beats and the beat lines corresponding to the beat points are acquired through the processing module, and the corresponding and accurate first spectrum surface beats and first beat lines can be acquired according to the audio data, so that the marking efficiency of the beat points is improved; and through the adjustment module, the first spectral face beat and the first beat line can be adjusted through the dancing spectral face generation control interface, the adjusted second spectral face beat and second beat line are obtained, and through the editing module, corresponding dancing action indication data are added through the dancing spectral face generation control interface, corresponding dancing spectral faces are generated, the dancing spectral faces are conveniently modified by a user, corresponding dancing action indication data are added, and user experience is enhanced.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an apparatus provided in an embodiment of the present application, where the apparatus 9 includes: a processor 91, a memory 92, and a computer program 93 stored on the memory 92 and executable on the processor 91; the apparatus may store a plurality of instructions suitable for being loaded by the processor 91 and executing the steps of the method of the embodiment shown in fig. 1 to 7, and the specific execution process may refer to the specific description of the embodiment shown in fig. 1 to 7, which is not repeated herein.
Wherein processor 91 may include one or more processing cores. The processor 91 connects the various parts within the server using various interfaces and lines, by running or executing instructions, programs, code sets or instruction sets stored in the memory 92, and invoking data in the memory 92, various functions of the dance profile generation device 8 and processing the data, alternatively the processor 91 may be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programble Logic Array, PLA). The processor 91 may integrate one or a combination of several of a central processing unit 91 (Central Processing Unit, CPU), an image processor 91 (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the touch display screen; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 91 and may be implemented by a single chip.
The Memory 92 may include a random access Memory 92 (Random Access Memory, RAM) or a Read-Only Memory 92 (Read-Only Memory). Optionally, the memory 92 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 92 may be used to store instructions, programs, code, a set of codes, or a set of instructions. The memory 92 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as touch instructions, etc.), instructions for implementing the various method embodiments described above, etc.; the storage data area may store data or the like referred to in the above respective method embodiments. The memory 92 may also optionally be at least one memory device located remotely from the aforementioned processor 91.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc.
The present invention is not limited to the above-described embodiments, but, if various modifications or variations of the present invention are not departing from the spirit and scope of the present invention, the present invention is intended to include such modifications and variations as fall within the scope of the claims and the equivalents thereof.

Claims (8)

1. A method for generating a dance profile, comprising the steps of:
acquiring audio data;
obtaining a plurality of beat characteristics of the audio data according to the audio data and a preset beat characteristic recognition model, wherein the beat characteristics comprise low-frequency beat characteristics, enhanced beat characteristics, mel frequency spectrum beat characteristics, level beat characteristics and phase beat characteristics;
obtaining first nodes corresponding to each beat characteristic according to the beat characteristic and a preset Markov model;
obtaining deviation information of a first beat point corresponding to the same beat characteristic according to the first beat point corresponding to each beat characteristic and a Bayesian estimation algorithm;
according to the deviation information and the information entropy algorithm, a first beat point with the minimum deviation information corresponding to the same beat characteristic is obtained and used as a second beat point corresponding to each beat characteristic, and the beat point of the audio data is obtained;
According to the audio data and the beat points, obtaining first spectrum face beats and first beat lines corresponding to the beat points, and displaying the first spectrum face beats and the first beat lines in a dance spectrum face generation control interface generated by a computer;
responding to the adjustment operation of the dance spectral plane generation control interface on the first spectral plane beat and the first beat line, and obtaining an adjusted second spectral plane beat and a second beat line;
editing corresponding dance action indicating data according to the adjusted beats of the second spectrum surface and the second beat line, generating a corresponding dancing spectrum surface, and displaying the dancing spectrum surface in a dancing spectrum surface generation control interface; each dance action indication data corresponds to an action indication element displayed by dance entertainment equipment, the dance entertainment equipment binds the audio data with the dance spectrum surface, and when the audio data is played, the corresponding action indication element is displayed according to dance action indication data in the dance spectrum surface corresponding to a beat point of the audio data.
2. The method for generating a dance profile according to claim 1, wherein before the step of obtaining the beat point of the audio data according to the audio data and a preset beat point recognition algorithm, the method comprises the steps of:
Responding to the audio tone changing instruction, and acquiring audio tone changing parameters;
and performing tone changing processing on the audio data according to the audio data, the audio tone changing parameters and a preset audio tone changing algorithm to obtain processed first audio data.
3. The method of generating a dance surface according to claim 1, wherein the obtaining the adjusted second surface beat and second beat line in response to the adjustment operation of the dance surface generation control interface to the first surface beat and first beat line includes the steps of:
responding to a spectrum face beat editing instruction sent by the dance spectrum face generation control interface, and editing the spectrum face beat; the spectrum plane beat editing instruction comprises a spectrum plane beat adding instruction and a spectrum plane beat deleting instruction;
according to the spectrum face beat adding instruction, adding spectrum face beats at the positions of beat lines indicated by the spectrum face beat adding instruction;
and deleting the spectrum surface beat indicated by the spectrum surface beat deleting instruction according to the spectrum surface beat deleting instruction.
4. The method of generating a dance surface according to claim 1, wherein the obtaining the adjusted second surface beat and second beat line in response to the adjustment operation of the dance surface generation control interface to the first surface beat and first beat line includes the steps of:
And responding to a beat line deviation instruction, and moving the beat line to a designated position of the dancing spectrum surface.
5. The method for generating a dance surface according to claim 1, wherein the adding corresponding dance motion indication data according to the adjusted second surface beat and the second beat line comprises the steps of:
responding to a dance independent action editing instruction sent by the dance spectral plane generation control interface, and editing corresponding dance action indication data; the dance individual action editing instruction comprises an action identification adding instruction and an action identification deleting instruction;
adding a corresponding action identifier on the position of the spectrum surface beat indicated by the action identifier adding instruction according to the action identifier adding instruction;
and deleting the action identifier indicated by the action identifier deleting instruction according to the action identifier deleting instruction.
6. The method for generating a dance profile according to claim 1, wherein the adding corresponding dance motion indication data according to the adjusted spectrum surface beat and beat line comprises the steps of:
responding to a dance continuous motion editing instruction sent by the dance spectral surface generation control interface, and editing corresponding dance motion indication data, wherein the dance continuous motion editing instruction comprises a starting spectral surface beat and a position parameter of a stopping spectral surface beat, which are designated by the dance continuous motion editing instruction; and adding a plurality of action identifiers between the initial spectrum surface beat and the final spectrum surface beat according to the position parameters of the initial spectrum surface beat and the final spectrum surface beat.
7. A device for generating a dance profile, comprising:
the acquisition module is used for acquiring the audio data;
the recognition module is used for obtaining a plurality of beat characteristics of the audio data according to the audio data and a preset beat characteristic recognition model, wherein the beat characteristics comprise low-frequency beat characteristics, enhanced beat characteristics, mel frequency spectrum beat characteristics, level beat characteristics and phase beat characteristics;
obtaining first nodes corresponding to each beat characteristic according to the beat characteristic and a preset Markov model;
obtaining deviation information of a first beat point corresponding to the same beat characteristic according to the first beat point corresponding to each beat characteristic and a Bayesian estimation algorithm;
according to the deviation information and the information entropy algorithm, a first beat point with the minimum deviation information corresponding to the same beat characteristic is obtained and used as a second beat point corresponding to each beat characteristic, and the beat point of the audio data is obtained;
the processing module is used for obtaining a first spectral face beat and a first beat line corresponding to the beat point according to the audio data and the beat point, and displaying the first spectral face beat and the first beat line in a dancing spectral face generation control interface generated by a computer;
The adjusting module is used for responding to the adjusting operation of the dance spectral surface generation control interface on the first spectral surface beat and the first beat line to obtain an adjusted second spectral surface beat and a second beat line;
the editing module is used for editing corresponding dance action indication data according to the adjusted beats of the second spectrum surface and the second beat line, generating a corresponding dance spectrum surface, and displaying the dance spectrum surface in the dance spectrum surface generation control interface; each dance action indication data corresponds to an action indication element displayed by dance entertainment equipment, the dance entertainment equipment binds the audio data with the dance spectrum surface, and when the audio data is played, the corresponding action indication element is displayed according to dance action indication data in the dance spectrum surface corresponding to a beat point of the audio data.
8. An apparatus for generating a dance profile, comprising: a processor, a memory, and a computer program stored on the memory and executable on the processor; the computer program, when executed by the processor, implements the steps of the method of dance profile generation of any one of claims 1 to 6.
CN202110856072.6A 2021-07-28 2021-07-28 Method, device and equipment for generating dancing spectrum surface Active CN113590872B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110856072.6A CN113590872B (en) 2021-07-28 2021-07-28 Method, device and equipment for generating dancing spectrum surface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110856072.6A CN113590872B (en) 2021-07-28 2021-07-28 Method, device and equipment for generating dancing spectrum surface

Publications (2)

Publication Number Publication Date
CN113590872A CN113590872A (en) 2021-11-02
CN113590872B true CN113590872B (en) 2023-11-28

Family

ID=78250900

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110856072.6A Active CN113590872B (en) 2021-07-28 2021-07-28 Method, device and equipment for generating dancing spectrum surface

Country Status (1)

Country Link
CN (1) CN113590872B (en)

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005074156A (en) * 2003-09-03 2005-03-24 Mitsubishi Electric Corp Respiratory synchronizer
CN1683122A (en) * 2004-04-16 2005-10-19 上海科技馆 Interaction device making robot dance with music rhythm
CN101375327A (en) * 2006-01-25 2009-02-25 索尼株式会社 Beat extraction device and beat extraction method
CN104346147A (en) * 2013-07-29 2015-02-11 人人游戏网络科技发展(上海)有限公司 Method and device for editing rhythm points of music games
CN104620313A (en) * 2012-06-29 2015-05-13 诺基亚公司 Audio signal analysis
CN105930723A (en) * 2016-04-20 2016-09-07 福州大学 Intrusion detection method based on feature selection
CN106096720A (en) * 2016-06-12 2016-11-09 杭州如雷科技有限公司 A kind of method that dance movement is automatically synthesized
CN107832048A (en) * 2017-10-20 2018-03-23 周亮 The implementation method and device of editable beat
CN109255295A (en) * 2018-08-03 2019-01-22 百度在线网络技术(北京)有限公司 Dance spectrum generation method, device, equipment and the storage medium of view-based access control model
CN109920449A (en) * 2019-03-18 2019-06-21 广州市百果园网络科技有限公司 Beat analysis method, audio-frequency processing method and device, equipment, medium
CN110517657A (en) * 2019-08-15 2019-11-29 上海若安文化传播有限公司 Beat configuration/playback method, system, medium and equipment of music file
TW201946681A (en) * 2018-05-17 2019-12-16 葉子雋 Method for generating customized hit-timing list of music game automatically, non-transitory computer readable medium, computer program product and system of music game
CN111785237A (en) * 2020-06-09 2020-10-16 Oppo广东移动通信有限公司 Audio rhythm determination method and device, storage medium and electronic equipment
CN111798549A (en) * 2020-07-15 2020-10-20 广州微咔世纪信息科技有限公司 Dance editing method and device and computer storage medium
CN112402952A (en) * 2019-08-23 2021-02-26 福建凯米网络科技有限公司 Interactive method and terminal based on audio and virtual image

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6123995B2 (en) * 2013-03-14 2017-05-10 ヤマハ株式会社 Acoustic signal analysis apparatus and acoustic signal analysis program
GB201310861D0 (en) * 2013-06-18 2013-07-31 Nokia Corp Audio signal analysis

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005074156A (en) * 2003-09-03 2005-03-24 Mitsubishi Electric Corp Respiratory synchronizer
CN1683122A (en) * 2004-04-16 2005-10-19 上海科技馆 Interaction device making robot dance with music rhythm
CN101375327A (en) * 2006-01-25 2009-02-25 索尼株式会社 Beat extraction device and beat extraction method
CN104620313A (en) * 2012-06-29 2015-05-13 诺基亚公司 Audio signal analysis
CN104346147A (en) * 2013-07-29 2015-02-11 人人游戏网络科技发展(上海)有限公司 Method and device for editing rhythm points of music games
CN105930723A (en) * 2016-04-20 2016-09-07 福州大学 Intrusion detection method based on feature selection
CN106096720A (en) * 2016-06-12 2016-11-09 杭州如雷科技有限公司 A kind of method that dance movement is automatically synthesized
CN107832048A (en) * 2017-10-20 2018-03-23 周亮 The implementation method and device of editable beat
TW201946681A (en) * 2018-05-17 2019-12-16 葉子雋 Method for generating customized hit-timing list of music game automatically, non-transitory computer readable medium, computer program product and system of music game
CN109255295A (en) * 2018-08-03 2019-01-22 百度在线网络技术(北京)有限公司 Dance spectrum generation method, device, equipment and the storage medium of view-based access control model
CN109920449A (en) * 2019-03-18 2019-06-21 广州市百果园网络科技有限公司 Beat analysis method, audio-frequency processing method and device, equipment, medium
CN110517657A (en) * 2019-08-15 2019-11-29 上海若安文化传播有限公司 Beat configuration/playback method, system, medium and equipment of music file
CN112402952A (en) * 2019-08-23 2021-02-26 福建凯米网络科技有限公司 Interactive method and terminal based on audio and virtual image
CN111785237A (en) * 2020-06-09 2020-10-16 Oppo广东移动通信有限公司 Audio rhythm determination method and device, storage medium and electronic equipment
CN111798549A (en) * 2020-07-15 2020-10-20 广州微咔世纪信息科技有限公司 Dance editing method and device and computer storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Music analysis with a Bayesian dynamic model;Lu Ren等;《2009 IEEE International Conference on Acoustics, Speech and Signal Processing》;第1681-1684页 *
基于最大最小距离法的音乐节拍跟踪算法研究;何凝;《中国优秀硕士学位论文全文数据库信息科技辑》;第I136-319页 *

Also Published As

Publication number Publication date
CN113590872A (en) 2021-11-02

Similar Documents

Publication Publication Date Title
CN109348274A (en) A kind of living broadcast interactive method, apparatus and storage medium
JP2018532155A (en) Voice detection method, apparatus, and storage medium
CN107113497B (en) Wearable audio mixing
CN110955786A (en) Dance action data generation method and device
CN108346433A (en) A kind of audio-frequency processing method, device, equipment and readable storage medium storing program for executing
CN113192152A (en) Audio-based image generation method, electronic device and storage medium
CN112652041B (en) Virtual image generation method and device, storage medium and electronic equipment
CN111127598B (en) Animation playing speed adjusting method and device, electronic equipment and medium
CN105828254B (en) A kind of voice frequency regulating method and device
CN108877835A (en) Evaluate the method and system of voice signal
US20230290382A1 (en) Method and apparatus for matching music with video, computer device, and storage medium
CN107463684A (en) Voice replying method and device, computer installation and computer-readable recording medium
CN113823250A (en) Audio playing method, device, terminal and storage medium
JP6268287B2 (en) Moving image generating apparatus, moving image generating method, and program
CN113590872B (en) Method, device and equipment for generating dancing spectrum surface
CN107948854B (en) Operation audio generation method and device, terminal and computer readable medium
CN105635418A (en) Method and device for cutting bell
JP5860629B2 (en) Sound source localization control program and sound source localization control device
CN109841232B (en) Method and device for extracting note position in music signal and storage medium
CN109003633B (en) Audio processing method and device and electronic equipment
CN104768106B (en) A kind of conversion method and device of terminal audio
JP6115932B2 (en) Sound generating apparatus and sound generating program
CN111506765A (en) Method and device for controlling music playing rhythm, electronic equipment and storage medium
WO2022202341A1 (en) Sound editing device, sound editing method, and sound editing program
JP6840715B2 (en) Game programs and game devices

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant