WO2022012182A1 - 特效展示方法、装置、电子设备及计算机可读介质 - Google Patents

特效展示方法、装置、电子设备及计算机可读介质 Download PDF

Info

Publication number
WO2022012182A1
WO2022012182A1 PCT/CN2021/096349 CN2021096349W WO2022012182A1 WO 2022012182 A1 WO2022012182 A1 WO 2022012182A1 CN 2021096349 W CN2021096349 W CN 2021096349W WO 2022012182 A1 WO2022012182 A1 WO 2022012182A1
Authority
WO
WIPO (PCT)
Prior art keywords
special effect
effect element
music
display interface
effect display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/096349
Other languages
English (en)
French (fr)
Inventor
谢东巨
郑炜明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing ByteDance Network Technology Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to US18/008,637 priority Critical patent/US12375618B2/en
Publication of WO2022012182A1 publication Critical patent/WO2022012182A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0091—Means for obtaining special acoustic effects
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/368—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/036—Insert-editing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/021—Background music, e.g. for video sequences or elevator music
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/066—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
    • G10H2220/096—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith using a touch screen

Definitions

  • the present disclosure relates to the technical field of human-computer interaction, and in particular, the present disclosure relates to a special effect display method, apparatus, electronic device, and computer-readable medium.
  • An embodiment of the present disclosure provides a special effect display method, the method includes:
  • a special effect display interface is opened, and the video capture device is opened, wherein the special effect display interface displays a first special effect element
  • the special effect is triggered.
  • Another embodiment of the present disclosure provides a special effect display device, the device comprising:
  • an opening module for opening a special effect display interface based on a trigger operation, and opening a video capture device, wherein the special effect display interface displays a first special effect element
  • the special effect element display module is used to obtain the music characteristics of the background music in the special effect display interface and a plurality of second special effect elements generated according to the music characteristics, display each of the second special effect elements in a preset order, and according to the The music feature controls the movement of the second special effect element on the special effect display interface;
  • a special effect element control module configured to identify the target object in the video captured by the video capture device, and control the movement of the first special effect element on the special effect display interface according to the movement of the target object;
  • a special effect display module configured to trigger special effects when the first special effect element and the second special effect element meet a preset condition.
  • processors one or more processors
  • one or more application programs wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs are configured to: execute The above-mentioned special effect display method.
  • a computer-readable medium is provided, the computer-readable medium is used to store computer instructions, which, when executed on a computer, enable the computer to execute the above-mentioned special effect display method.
  • FIG. 1 is a schematic flowchart of a special effect display method provided by an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of displaying a first special effect element according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a background image display provided by an embodiment of the present disclosure.
  • 4-a is a schematic diagram showing a first special effect element and a second special effect element according to an embodiment of the present disclosure
  • FIG. 4-b is a schematic diagram illustrating a display corresponding to a target object and a first special effect element according to an embodiment of the present disclosure
  • FIG. 4-c is a schematic diagram showing a first special effect element corresponding to a target object according to an embodiment of the present disclosure
  • FIG. 5 is a schematic diagram showing a plurality of second special effect elements of different lengths according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of display of a second special effect element at different display position heights according to an embodiment of the present disclosure
  • FIG. 7 is a schematic flowchart of a method for controlling the movement of a first special effect element according to an embodiment of the present disclosure
  • FIG. 8 is a schematic diagram showing a preset area provided by an embodiment of the present disclosure.
  • FIG. 9 is a schematic diagram of displaying a target object according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram of a special effect display provided by an embodiment of the present disclosure.
  • FIG. 11 is a schematic display diagram of an entire special effect display interface provided by a preset area according to an embodiment of the present disclosure
  • FIG. 12 is a schematic flowchart of a music selection method according to an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram of a special effect display device according to an embodiment of the present disclosure.
  • FIG. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
  • the term “including” and variations thereof are open-ended inclusions, ie, "including but not limited to”.
  • the term “based on” is “based at least in part on.”
  • the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; the term “some embodiments” means “at least some embodiments”. Relevant definitions of other terms will be given in the description below.
  • At least one embodiment of the present disclosure aims to solve at least one of the above-mentioned technical defects, especially the technical problem that when displaying special effects in human-computer interaction technology, the special effects are displayed in a single manner and are not interesting.
  • At least one embodiment of the present disclosure obtains the music characteristics of the background music of the special effect display interface, generates a second special effect element based on the music characteristics, and controls the movement of the second special effect element on the special effect display interface according to the music characteristics.
  • the movement in the direction of the target trajectory controls the movement of the first special effect element on the target display interface, and when the first special effect element and the second special effect element satisfy a preset condition, the special effect is triggered.
  • An embodiment of the present disclosure provides a special effect display method, as shown in FIG. 1 , the method includes:
  • Step S101 based on the trigger operation, a special effect display interface is opened, and a video capture device is started, wherein a first special effect element is displayed in the special effect display interface.
  • Step S102 acquiring the music characteristics of the background music in the special effect display interface and a plurality of second special effects elements generated according to the music characteristics, displaying each second special effect element in a preset order, and controlling the second special effect elements in the special effect display according to the music characteristics. Interface movement.
  • Step S103 identifying the target object in the video captured by the video capture device, and controlling the movement of the first special effect element on the special effect display interface according to the movement of the target object.
  • Step S104 when the first special effect element and the second special effect element satisfy the preset condition, trigger the special effect.
  • the provided special effect display method is applied to terminal devices, such as mobile terminals, computer devices (eg, desktop computers, notebook computers, all-in-one computers, etc.), etc.
  • the mobile terminals may include smart phones, handheld computers, tablet computers, etc. , mobile devices such as wearable devices with displays.
  • the above-mentioned video capture device may be a video capture device of the terminal device itself, or may be an external video capture device of the terminal device.
  • the special effect display method provided by the embodiment of the present disclosure may be a special effect display method in an application program installed in the terminal device.
  • special effects refer to special effects produced by, for example, computer software that do not generally appear in reality, and special effects include, for example, visual effects, sound effects, and the like.
  • the first special effect element and the second special effect element are the elements displayed by the special effect in the embodiment of the present disclosure
  • the second special effect element is generated and controlled based on the music feature
  • the first special effect element is controlled by the movement of the target object, to trigger the effect.
  • the first special effect element and the second special effect element may include but are not limited to picture elements such as illustrations and animations.
  • the first special effect element is a virtual tree hole and the second special effect element is a virtual animal.
  • the display of special effects can also be related to music, and by incorporating music elements, it can bring users a better experience.
  • the target object includes a certain object in the video captured by the video capture device, and may be any object with characteristics.
  • a human target object is used as an example for description.
  • the target object may include face feature objects, such as nose, eyes, mouth, etc.
  • the feature object of the part is used as an example for description.
  • the special effect display method provided by the embodiment of the present disclosure is implemented in a terminal device.
  • a special effect display interface is opened based on a trigger operation, and the special effect display interface may be a display interface in an application program installed in the terminal device, such as a game interface, a shooting interface, and the like.
  • the trigger operation may include that the user clicks a specific button to enter the special effect display interface, or the user enters the special effect display interface through a specific voice, and may also include the user enters the special effect display interface through a specific expression, etc. limit.
  • the special effect display interface is shown in FIG. 2 .
  • the special effect display interface 201 displays a first special effect element 202 , where the first special effect element may include various static or dynamic picture elements.
  • a background may also be displayed in the special effect display interface.
  • the special effect display interface 201 is also provided with a background image 203, and the background image 203 may be, for example, a background image including UI (User Interface) elements such as lawns and flowers, so as to provide users with better visual effects. experience, this disclosure does not limit this.
  • UI User Interface
  • step S102 includes: acquiring the music characteristics of the background music in the special effect display interface and a plurality of second special effect elements generated according to the music characteristics, displaying the second special effect elements in a preset order, and according to the music characteristics Controls the movement of the second special effect element on the special effect display interface.
  • background music will be played in the special effect display interface, and for each background music, the server or the terminal device can extract the music features of the background music in advance , and generate a plurality of second special effect elements according to the music feature.
  • the terminal device can also extract the music features of the background music in real time, and generate a plurality of second special effect elements according to the music features.
  • the number of second special effect elements corresponding to the music features of the background music, the length of each second special effect element displayed in the special effect display interface, and the number of each second special effect element in the The height of the position where the special effect display interface appears and the movement speed of each second special effect element in the special effect display interface can be related to the music characteristics of the background music.
  • the feature controls the movement of each second effect element in the effect display interface. As shown in FIG.
  • the special effect display interface 201 is provided with a first special effect element A (that is, the first special effect element 202) and a plurality of second special effect elements C (that is, the second special effect element 204).
  • the second special effect element 204 enters the special effect display interface 201 from a direction opposite to the position of the first special effect element A according to a preset sequence.
  • the terminal device may also play the above-mentioned background music for the user, and the background music may be selected by the user or configured by default.
  • the special effect display interface can also be configured with other functional options to better meet the needs of users. For example, operation options such as pause and start can be configured. The user can click the pause button to pause the movement of the second special effect element in the current interface. , or by clicking the start button, the second special effect element can continue to move in the current interface.
  • step S103 includes: identifying the target object in the video captured by the video capture device, and controlling the movement of the first special effect element on the special effect display interface according to the movement of the target object.
  • the target object is a characteristic object of the user's face, for example, the nose.
  • the video capture device is a camera of the terminal device. After capturing the user's avatar, the camera recognizes the user's nose in the user's avatar, and controls the first special effect element 202 to move in the special effect display interface 201 according to the movement of the user's nose. As shown in FIG.
  • the special effect display interface 201 displays a first special effect element 202 and a plurality of second special effect elements 204.
  • the terminal device recognizes the target object, it adjusts the first special effect element according to the position of the target object in the special effect display interface.
  • the position of a special effect element on the special effect display interface may adjust the position and height of the first special effect element on the special effect display interface according to the position and height of the target object on the special effect display interface.
  • step S104 includes: triggering a special effect when the first special effect element and the second special effect element satisfy a preset condition.
  • a plurality of second special effect elements are controlled to move on the special effect display interface according to the music characteristics, and the user controls the first special effect element with a target object (for example, a nose) Move on the special effect display interface; when the first special effect element and the second special effect element meet the preset conditions, the special effect is triggered.
  • a target object for example, a nose
  • the animation special effect of the animal entering the tree hole is triggered, and graphics such as score, musical note pattern, celebration pattern and other graphics are also displayed at the same time.
  • the element special effect may play a certain sound effect or play a sound associated with the second special effect element.
  • the animal's cry can be played, etc., which is not limited in the present disclosure.
  • first special effect elements there may be multiple first special effect elements, and correspondingly, there may also be multiple target objects, wherein one first special effect element corresponds to one target object, and different target objects control different A special effect element moves, which can realize, for example, interaction between multiple users.
  • a game mode such as double/multiplayer mode
  • two or more first special effect elements will be displayed on the special effect display interface accordingly.
  • the terminal device turns on the video capture device to identify the target object in the video, such as the nose.
  • the multiple target objects such as noses
  • the motion trajectories of each nose are identified respectively, and the corresponding control corresponding to the motion trajectories of each nose is controlled respectively.
  • the first special effect element moves on the special effect display interface, so that each first special effect element contacts the second special effect element, and different special effects are displayed according to the contact result.
  • the terminal device may also display a corresponding number of multiple first special effect elements on the special effect display interface when the video capture device is turned on and recognize that there are multiple target objects in the video, and identify them respectively.
  • the movement track of each target object, according to the movement track of each target object, the corresponding first special effect element is controlled to move on the special effect display interface, so that each first special effect element contacts the second special effect element, and different effects are displayed according to the contact result. special effects.
  • multiple users can control the first special effect element to contact the second special effect element on the same device, thereby increasing the competitiveness of the game.
  • the embodiment of the present disclosure obtains the music characteristics of the background music in the special effect display interface, generates a second special effect element based on the music characteristics, and controls the movement of the second special effect element on the special effect display interface based on the music characteristics.
  • the movement in the direction of the track controls the movement of the first special effect element on the target display interface; when the first special effect element and the second special effect element meet the preset conditions, the special effect is triggered.
  • the display of the special effects according to the embodiments of the present disclosure is related to music, and by incorporating music elements, a better experience is brought to the user. Specifically, the user controls the movement of the first special effect element in the special effect display interface through the nose, so that a greater number of the second special effect element contacts the first special effect element and obtains points, which can further improve user interaction and game experience.
  • the embodiment of the present disclosure provides a possible implementation manner, in which the music feature includes the number of characteristic music segments of background music, wherein the number of second special effect elements corresponds to the number of characteristic music segments.
  • the music characteristics of the background music of the special effect display interface include the number of characteristic music segments, wherein the characteristic music segments may include information segments that can characterize the characteristics of the music elements included in the music, wherein the music elements may include However, it is not limited to the duration of the music, the characters and notes contained in the music, etc.
  • the characteristic music segments may be divided according to the characters contained in the music. For example, for the music of a Chinese song, a music segment corresponding to a Chinese character in the lyrics of the music can be used as a characteristic music segment.
  • the characteristic music segment may be divided according to the duration, for example, the music may be divided into multiple music segments according to a certain duration, and in this case, one music segment may be used as a characteristic music segment.
  • different ways of dividing characteristic music segments can also be adopted according to the speed of the music rhythm. For example, for two pieces of music with the same duration, the number of characteristic music segments of music with fast music rhythm can be more than that of music with slow rhythm. The number of characteristic music segments of the music, correspondingly, the music with fast music rhythm may correspond to a larger number of second special effect elements.
  • the music feature of a piece of background music includes the number of characteristic music pieces in the piece of background music, and the number of second special effect elements corresponds to the number of the characteristic music pieces.
  • one characteristic music piece may correspond to one second special effect element.
  • the song can include 32 characteristic music segments, correspondingly generating 32 second special effects elements, namely , a Chinese character corresponds to a second special effect element.
  • multiple second effect elements are displayed in sequence according to the music characteristics of "Two Tigers".
  • the user controls the first effect element and the second effect through a target object such as a nose. Elements come into contact and trigger contact effects, which can further trigger score effects, music effects, and more.
  • the second special effect element is generated according to the number of characteristic music segments of the music, and the special effect display process is related to the music, thereby improving user experience and interactive fun.
  • the embodiment of the present disclosure provides a possible implementation manner, in which the music feature further includes the playing time of each characteristic music segment, and for each second special effect element, the second special effect element is displayed on the special effect display interface
  • the length of is positively related to the playing time of the characteristic music segment corresponding to the second special effect element.
  • the music feature further includes the playing time of each feature music segment.
  • the length displayed in the special effect display interface is positively correlated with the playback duration of the characteristic music segment corresponding to the special effect element. The longer the playback duration of the characteristic music segment, the corresponding second special effect. The longer the element is displayed in the special effect display interface. For example, as shown in Figure 5, for the three second special effect elements generated by the sentence "running fast” in the music "Two Tigers", the length of the second special effect element 501 corresponding to "fast” is longer than that of "running” The second special effect element 502 and the second special effect element 503 corresponding to "got” are longer.
  • the setting ratio between the playing duration of the characteristic music segment and the length of the corresponding second special effect element displayed in the special effect display interface may be preset, which is not limited in the present disclosure.
  • different second special effect elements have different lengths on the special effect display interface.
  • each second The contact time between the special effect element and the first special effect element may be different, and the gameplay is more diverse, which improves the user's fun.
  • the length of the corresponding second special effect element on the special effect display interface is controlled by the playing time of the characteristic music segment, so that the visual effects on the interface are richer, the gameplay is more varied, and the user experience is better.
  • the embodiment of the present disclosure provides a possible implementation manner, in which the music feature further includes the pitch of each characteristic music segment, and for each second special effect element, the second special effect element is displayed on the special effect display interface
  • the position height of is positively correlated with the pitch of the characteristic music segment corresponding to the second special effect element.
  • the music feature further includes the pitch of each characteristic music segment, and the pitch refers to the pitch of the note corresponding to the characteristic music segment. If the characteristic music segment corresponds to a note, the pitch of the characteristic music segment is the pitch of the note; if the characteristic music segment corresponds to multiple notes, the pitch of the characteristic music segment is the multiple notes. high average.
  • the position and height of the second special effect element corresponding to each characteristic music segment on the special effect display interface is positively correlated with the pitch of the characteristic music segment. For example, as shown in FIG.
  • the position and height of the second special effect elements corresponding to the characteristic music segments of different pitches on the special effect display interface are different, wherein the pitch of the characteristic music segment corresponding to the second special effect element 601 is higher than that of the second special effect element 601.
  • the pitch of the characteristic music segment corresponding to the special effect element 602 is higher. Therefore, as shown in FIG. 6 , the position and height of the second special effect element 601 in the special effect display interface is higher than the position and height of the second special effect element 602 in the special effect display interface.
  • the position and height of the second special effect element on the special effect display interface are different.
  • This embodiment of the present disclosure determines the position and height of the corresponding second special effect element on the special effect display interface according to the pitch of the characteristic music segment, and the user can continuously control the first special effect element to move up and down on the special effect display interface, thereby increasing the user interaction experience and improving the game. pleasure.
  • the embodiment of the present disclosure provides a possible implementation manner, in which the music feature further includes the beat number of each characteristic music segment, and for each special effect element, the movement speed of the second special effect element on the special effect display interface The number of beats of the characteristic music section corresponding to the special effect element is positively correlated.
  • the music feature further includes the number of beats of each feature music segment, wherein the movement speed of the second special effect element on the special effect display interface is the beat within the unit time period of the feature music segment corresponding to the second special effect element The number is positively correlated. The more beats in a unit time period, the faster the corresponding second special effect element moves on the special effect display interface.
  • the movement speed of different second special effect elements is set to be different, and the user controls the first special effect element to contact the second special effect element through the nose, which increases the fun of game interaction.
  • the embodiments of the present disclosure control the movement speed of the second special effect element on the special effect display interface through the beat number of the characteristic music segment.
  • the movement speed of the second special effect element in different music is different, and the game difficulty is different, so that the gameplay can be increased and the user experience can be improved.
  • the embodiment of the present disclosure provides a possible implementation manner, in which the preset order includes the playing order of the characteristic music segments.
  • the order in which the second special effect element appears on the special effect display interface is the playing order of the characteristic music segment corresponding to the second special effect element.
  • the second special effect element is controlled to appear in the special effect display interface according to the music playing sequence, so as to ensure that the user can control the first special effect element to contact the second special effect element and ensure the smooth progress of the game.
  • controlling the movement of the first special effect element on the special effect display interface according to the movement of the target object includes: acquiring the movement trajectory of the target object; And control the movement of the first special effect element on the special effect display interface according to the movement track of the target object.
  • the terminal device can acquire the movement trajectory of the target object; and control the first special effect element to move on the special effect display interface according to the movement trajectory of the target object, thereby controlling the first special effect element to contact the second special effect element.
  • controlling the movement of the first special effect element on the special effect display interface according to the movement of the target object includes:
  • Step S701 obtaining the movement track of the target object in the target direction
  • Step S702 controlling the movement of the first special effect element on the special effect display interface according to the movement track of the target object in the target direction.
  • the target direction may include a movement direction of the first special effect element, wherein the movement direction of the first special effect element may be perpendicular to the movement direction of the second special effect element.
  • the target direction is the vertical direction; if the first special effect element moves in the horizontal direction, then The movement direction of the second special effect element is the vertical direction, in this case, the target direction is the horizontal direction.
  • the target direction may include the movement direction of the first special effect element, wherein the movement direction of the first special effect element may be consistent with the movement direction of the second special effect element.
  • the movement direction of the second special effect element can also be the vertical direction; when the first special effect element moves in the horizontal direction, the movement direction of the second special effect element can also be horizontal direction, the present disclosure does not limit this.
  • the terminal device first determines the target direction, then obtains the movement trajectory of the target object in the target direction from the video captured by the video capture device, and controls the first special effect element to move on the special effect display interface based on the movement trajectory.
  • the first special effect element 801 can move on the preset area 802. Assuming that the target direction is the vertical direction, the user is passing the target object (for example, the nose). )
  • the terminal device recognizes the movement trajectory of the nose in the vertical direction, and then controls the first special effect element to contact the second special effect element according to the movement trajectory of the nose in the vertical direction.
  • the movement direction of the first special effect element is determined as the target direction, and the movement trajectory of the target object in the target direction is obtained, and the movement of the first special effect element is controlled based on the movement trajectory, so as to ensure the normal progress of the game and increase the number of users.
  • Interactive fun and experience is determined as the target direction, and the movement trajectory of the target object in the target direction is obtained, and the movement of the first special effect element is controlled based on the movement trajectory, so as to ensure the normal progress of the game and increase the number of users.
  • the method further includes: displaying the target object on the special effect display interface, and displaying the target object on the special effect display interface according to the target object.
  • the position of the special effect display interface adjusts the position of the first special effect element on the special effect display interface.
  • the terminal device may adjust the position and height of the first special effect element on the special effect display interface according to the position and height of the target object on the special effect display interface, so that the position of the first special effect element in the special effect display interface is the same as that of the target object horizontal line.
  • the terminal device displays the video captured by the video capture device in the special effect display interface, wherein the video includes a target object, and the target object is displayed according to the target object.
  • the position in the video adjusts the position of the first special effect element on the special effect display interface.
  • a video 902 captured by a video capture device is displayed, wherein the video 902 includes a target object 903, and the target object may be The nose of the user; then according to the position of the target object 903 in the video, adjust the position of the first special effect element 904 in the special effect display interface to be on the same horizontal line as the target object, such as the first special effect element 904 in the dotted line part is the special effect display that has just appeared The position of the interface 901, and then realizes that part of the first special effect element 904 is adjusted to the position when the target object 903 is on the same horizontal line, which is convenient for the user to control the movement of the first special effect element through the target object.
  • the user can easily see the position of the target object, and adjust the position of the first special effect element on the special effect display interface according to the initial position of the target object, which facilitates setting the initial interface and improves the user experience.
  • triggering the special effect includes: when the second special effect element moves on the special effect display interface When the second special effect element is in contact with the first special effect element, the first special effect is triggered; and when the second special effect element moves to the preset area on the special effect display interface, and the second special effect element and the first special effect element are not Upon contact, a second special effect is triggered, wherein the preset area is the movable area of the first special effect element.
  • the preset area may be a movable area of the first special effect element, and the size of the preset area may be an area of a preset size on one side of the special effect display interface, as shown in FIG. 10 , for convenience
  • a first special effect element 1002 ie, the first special effect element A
  • the first special effect element 1002 can move in the preset area 1003 .
  • the special effect display interface 1001 a plurality of second special effect elements 1004 generated according to the music characteristics are displayed, and the second special effect elements 1004 move close to the first special effect element 1002 from the opposite direction of the position of the first special effect element 1002.
  • the target object such as a nose, controls the first special effect element 1002 to move on the preset area 1003 .
  • the second special effect element 1004 moves to the preset area 1003 if the user controls the first special effect element 1002 to contact the second special effect element 1004 through the nose, the first special effect is triggered; when the second special effect element 1004 moves to the preset area At 1003, if the user controls the first special effect element 1002 through the nose and cannot contact the second special effect element 1004, the second special effect is triggered.
  • displaying the first special effect may include playing the first preconfigured music, such as the sound associated with the second special effect element, background music, etc., and may also include playing the first preconfigured animation, using the first special effect element as a tree hole
  • the element and the second special effect element are animal elements.
  • the animation of the first configuration may include special effects such as glare around the tree hole and the disappearance of the animal after the animal enters the tree hole.
  • Displaying the second special effect may include playing the second preconfigured music or playing the second preconfigured animation.
  • the second configured music may include the sound of the animal hitting the wall or the sound of the animal whimpering
  • the animation of the second configuration can include animation such as the animal stops moving, the rotating star appears on the animal head, and after a period of time, the animal and the star on the animal head disappear at the same time, etc. special effects.
  • the terminal device may set a bonus point for the user, and record the user's score for the entire song.
  • the motion range (ie, the preset area) of the first special effect element may include the entire special effect display interface or a part of the special effect display interface.
  • the first special effect element 1102 that is, the first special effect element A
  • the second special effect element 1104 ie, the second special effect element C
  • the user controls the first special effect element 1102 to move in the preset area 1103 to contact the second special effect element 1104 .
  • the specific size of the preset area and its position in the special effect display interface can be set according to the actual situation.
  • the user can control the movement trajectory of the first special effect element is also different. Users can experience more gaming fun.
  • the method further includes:
  • Step S1201 receiving a user's music selection operation
  • Step S1202 determining the background music of the special effect display interface according to the music selection operation.
  • the user can select different background music to play the game, corresponding to different game difficulties.
  • a music selection operation can be performed on the special effect display interface.
  • the background music of the special effect display interface is determined according to the music selection operation, and the terminal device is directed to Different background music, the number of the second special effect elements produced, the length, position, height and movement speed displayed on the special effect display interface are also different.
  • the music selection button on the special effect display interface the music selection interface is displayed in the special effect display interface.
  • the server or the terminal device may extract the music feature of the background music in advance, and generate a plurality of second special effect elements according to the music feature.
  • the terminal device can also extract the music features of the background music in real time, and generate a plurality of second special effect elements according to the music features.
  • the user can select different background music according to their own preferences, so as to correspondingly select different game difficulty, and the game experience is richer.
  • the embodiment of the present disclosure obtains the music characteristics of the background music of the special effect display interface, generates a second special effect element based on the music characteristics, and controls the movement of the second special effect element on the special effect display interface, and obtains the target object's movement in the direction of the target trajectory by obtaining the music characteristics of the target object.
  • the motion controls the movement of the first special effect element on the target display interface, and when the first special effect element and the second special effect element satisfy a preset condition, the special effect is triggered.
  • the display of special effects is related to music, and by incorporating music elements, it brings a better experience to users. Specifically, the user controls the movement of the first special effect element on the special effect display interface through the target object, so as to ensure that a greater number of second special effect elements are in contact with the first special effect element and score points, thereby further improving the user's game experience.
  • the special effect display device 130 may include: an interface opening module 1301 , a special effect element display module 1302 , a special effect element control module 1303 , and a special effect display module 1304 .
  • the interface opening module 1301 is configured to open the special effect display interface based on the trigger operation, and start the video capture device, wherein the special effect display interface displays the first special effect element.
  • the special effect element display module 1302 is used to obtain the music characteristics of the background music in the special effect display interface and a plurality of second special effect elements generated according to the music characteristics, display each second special effect element in a preset order, and control the second special effect according to the music characteristics Elements move in the special effects display interface.
  • the special effect element control module 1303 is configured to identify the target object in the video captured by the video capture device, and control the movement of the first special effect element on the special effect display interface according to the movement of the target object.
  • the special effect display module 1304 is configured to trigger the special effect when the first special effect element and the second special effect element meet the preset conditions.
  • the music feature includes the number of characteristic music pieces of the background music, wherein the number of the second special effect elements corresponds to the number of the characteristic music pieces.
  • the music feature also includes the playing time of each characteristic music segment, and for each second special effect element, the length of the second special effect element displayed on the special effect display interface is the playback of the characteristic music segment corresponding to the second special effect element. Time is positively correlated.
  • the music feature also includes the pitch of each characteristic music segment, and for each second special effect element, the position height of the second special effect element displayed on the special effect display interface is the same as the height of the characteristic music segment corresponding to the second special effect element. Pitch is positively correlated.
  • the music feature further includes the beat number of each characteristic music segment, and for each special effect element, the movement speed of the second special effect element on the special effect display interface is positively correlated with the beat number of the characteristic music segment corresponding to the special effect element.
  • the preset order includes the playing order of the characteristic music pieces.
  • the special effect element control module 1303 controls the movement of the first special effect element in the special effect display interface according to the movement of the target object, it can be used to: obtain the movement track of the target object in the target direction; and according to the movement of the target object in the target direction The movement track of the control the movement of the first special effect element in the special effect display interface.
  • the special effect display device provided by the embodiment of the present disclosure further includes a target object display module, and the target object display module is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the position of the special effect element in the special effect display interface is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the position of the special effect element in the special effect display interface is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the position of the special effect element in the special effect display interface is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the special effect display module 1304 can be used to: trigger the first special effect when the second special effect element moves to the preset area on the special effect display interface and the second special effect element contacts the first special effect element; and when the second special effect element is in contact with the first special effect element; When the element moves to a preset area on the special effect display interface, and the second special effect element is not in contact with the first special effect element, the second special effect is triggered, wherein the preset area is the movable area of the first special effect element.
  • the first special effect includes: playing a first preconfigured sound effect; and/or playing a first preconfigured animation.
  • the second special effect includes: playing a second preconfigured sound effect; and/or playing a second preconfigured animation.
  • the first preconfigured sound effect includes background music.
  • the special effect display device provided by the embodiment of the present disclosure further includes a music selection module, which is configured to: receive a user's music selection operation; and determine background music of the special effect display interface according to the music selection operation.
  • a music selection module configured to: receive a user's music selection operation; and determine background music of the special effect display interface according to the music selection operation.
  • the special effect display apparatus provided by the embodiment of the present disclosure can implement the special effect display method in the foregoing embodiments, and the implementation principle is the same, which will not be repeated in this disclosure.
  • the embodiment of the present disclosure obtains the music characteristics of the background music of the special effect display interface, generates a second special effect element based on the music characteristics, and controls the movement of the second special effect element on the special effect display interface, and obtains the target object's movement in the direction of the target trajectory by obtaining the music characteristics of the target object.
  • the motion controls the movement of the first special effect element on the target display interface, and when the first special effect element and the second special effect element satisfy a preset condition, the special effect is triggered.
  • the display of special effects is related to music, and by incorporating music elements, it brings a better experience to users.
  • the user controls the movement of the first special effect element on the special effect display interface through the target object, so as to ensure that a greater number of second special effect elements are in contact with the first special effect element and score points, thereby further improving the user's game experience.
  • modules may be implemented as software components executing on one or more general-purpose processors, or as hardware, such as programmable logic devices and/or application specific integrated circuits, that perform certain functions or combinations thereof.
  • the modules may be embodied in the form of a software product that may be stored in non-volatile storage media including a computer device (eg, a personal computer, a server, a network device, mobile terminal, etc.) to implement the methods described in the embodiments of the present disclosure.
  • a computer device eg, a personal computer, a server, a network device, mobile terminal, etc.
  • the above-mentioned modules may also be implemented on a single device, or may be distributed on multiple devices. The functions of these modules can be combined with each other or further split into multiple sub-modules.
  • FIG. 14 it shows a schematic structural diagram of an electronic device 1400 suitable for implementing an embodiment of the present disclosure.
  • the electronic devices in the embodiments of the present disclosure may include, but are not limited to, such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (eg, Vehicle navigation terminals), mobile terminals such as wearable devices with display screens, etc., and stationary terminals such as digital TVs, desktop computers, and the like.
  • the electronic device shown in FIG. 14 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.
  • the electronic device includes: a memory and a processor.
  • the memory is used to store programs for executing the methods described in the above method embodiments; the processor is configured to execute the programs stored in the memory, so as to realize the functions of the above-described embodiments of the present disclosure and/or other desired functions.
  • the processor here may be referred to as the processing device 1401 below, and the memory may include at least one of a read-only memory (ROM) 1402, a random access memory (RAM) 1403, and a storage device 1408, as shown below. .
  • an electronic device 1400 may include a processing device (eg, a central processing unit, a graphics processor, etc.) 1401, which may be loaded into random access according to a program stored in a read only memory (ROM) 1402 or from a storage device 1408 Various appropriate actions and processes are executed by the programs in the memory (RAM) 1403 . In the RAM 1403, various programs and data necessary for the operation of the electronic device 1400 are also stored.
  • the processing device 1401, the ROM 1402, and the RAM 1403 are connected to each other through a bus 1404.
  • An input/output (I/O) interface 1405 is also connected to bus 1404 .
  • I/O interface 1405 the following devices can be connected to the I/O interface 1405: input devices 1406 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 1407 of a computer, etc.; a storage device 1408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1409. Communication means 1409 may allow electronic device 1400 to communicate wirelessly or by wire with other devices to exchange data. While FIG. 14 shows an electronic device 1400 having various means, it should be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
  • input devices 1406 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.
  • LCD liquid crystal display
  • speakers vibration
  • embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
  • the computer program may be downloaded and installed from the network via the communication device 1409, or from the storage device 1408, or from the ROM 1402.
  • the processing device 1401 the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable medium, or any combination of the above two.
  • the computer readable medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable Read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • a computer-readable medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium can also be any computer-readable medium other than a computer-readable medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.
  • the client and server can use any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol) to communicate, and can communicate with digital data in any form or medium Communication (eg, a communication network) interconnects.
  • HTTP HyperText Transfer Protocol
  • Examples of communication networks include local area networks ("Local Area Network, LAN”), wide area networks ("Wide Area Network, WAN”), the Internet (eg, the Internet), and peer-to-peer networks (eg, ad hoc peer-to-peer networks), and any currently known or future developed networks.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or may exist alone without being assembled into the electronic device.
  • the above computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device causes the electronic device to execute the programs of the methods described in the above embodiments.
  • the electronic device when the above-mentioned one or more programs are executed by the electronic device, the electronic device is caused to execute: based on the trigger operation, a special effect display interface is opened, and a video capture device is opened, wherein the special effect display interface displays the first Special effects elements; obtain the music characteristics of the background music in the special effects display interface and multiple second special effect elements generated according to the music characteristics, display the second special effect elements in a preset order, and control the second special effect elements in the special effect display according to the music characteristics Interface movement; identify the target object in the video captured by the video capture device, and control the movement of the first special effect element on the special effect display interface according to the movement of the target object; when the first special effect element and the second special effect element meet the preset conditions, trigger the special effect .
  • Computer program code for performing operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and This includes conventional procedural programming languages, such as the "C" language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any kind of network, including, for example, a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through Internet connection).
  • LAN local area network
  • WAN wide area network
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.
  • the modules or units involved in the embodiments of the present disclosure may be implemented in software or hardware.
  • exemplary types of hardware logic components include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical Devices (CPLDs) and more.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs Systems on Chips
  • CPLDs Complex Programmable Logical Devices
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing.
  • machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM compact disk read only memory
  • magnetic storage or any suitable combination of the foregoing.
  • a method for displaying special effects includes:
  • the special effect display interface is opened based on the trigger operation, and the video capture device is opened, wherein the special effect display interface displays the first special effect element;
  • the special effect is triggered.
  • the music feature includes the number of characteristic music pieces of the background music, wherein the number of the second special effect elements corresponds to the number of the characteristic music pieces.
  • the music feature also includes the play time of each characteristic music segment, and for each second special effect element, the length of the second special effect element displayed on the special effect display interface is the play time of the characteristic music segment corresponding to the second special effect element. positive correlation.
  • the music feature also includes the pitch of each characteristic music segment, and for each second special effect element, the height displayed by the second special effect element on the special effect display interface is the pitch of the characteristic music segment corresponding to the second special effect element. positive correlation.
  • the music feature further includes the beat number of each characteristic music segment, and for each special effect element, the movement speed of the second special effect element on the special effect display interface is positively correlated with the beat number of the characteristic music segment corresponding to the special effect element.
  • the preset sequence includes the playing sequence of the characteristic music pieces.
  • controlling the movement of the first special effect element on the special effect display interface according to the movement of the target object includes: acquiring the movement trajectory of the target object in the target direction; and controlling the first special effect element to be in the special effect according to the movement trajectory of the target object in the target direction. Show interface movement.
  • the special effect display method further includes: displaying the target object on the special effect display interface, and adjusting the position of the first special effect element on the special effect display interface according to the position of the target object on the special effect display interface. Where to display the interface.
  • triggering the special effect includes: when the second special effect element moves to the preset area on the special effect display interface, and the second special effect element is in contact with the first special effect element when the first special effect is triggered; and when the second special effect element moves to the preset area on the special effect display interface, and the second special effect element is not in contact with the first special effect element, the second special effect is triggered, wherein the preset area is the first special effect The movable area of the effect element.
  • the first special effect includes: playing a first preconfigured sound effect; and/or playing a first preconfigured animation.
  • the second special effect includes: playing a second preconfigured sound effect; and/or playing a second preconfigured animation.
  • the first preconfigured sound effects include background music.
  • the method further includes: receiving a user's music selection operation; and determining background music of the special effect display interface according to the music selection operation.
  • a special effect display device includes:
  • an opening module used for opening the special effect display interface based on the trigger operation, and opening the video capture device, wherein the special effect display interface displays the first special effect element
  • the special effect element display module is used to obtain the music characteristics of the background music in the special effect display interface and a plurality of second special effect elements generated according to the music characteristics, display each second special effect element in a preset order, and control the second special effect according to the music characteristics Elements move in the special effects display interface;
  • the special effect element control module is used to identify the target object in the video captured by the video capture device, and control the movement of the first special effect element on the special effect display interface according to the movement of the target object;
  • the special effect display module is used to trigger the special effect when the first special effect element and the second special effect element meet the preset conditions.
  • the music feature includes the number of characteristic music pieces of the background music, wherein the number of the second special effect elements corresponds to the number of the characteristic music pieces.
  • the music feature also includes the playing time of each characteristic music segment, and for each second special effect element, the length of the second special effect element displayed on the special effect display interface is the playback of the characteristic music segment corresponding to the second special effect element. Time is positively correlated.
  • the music feature also includes the pitch of each characteristic music segment, and for each second special effect element, the height displayed by the second special effect element on the special effect display interface is the pitch of the characteristic music segment corresponding to the second special effect element. high positive correlation.
  • the music feature further includes the beat number of each characteristic music segment, and for each special effect element, the movement speed of the second special effect element on the special effect display interface is positively correlated with the beat number of the characteristic music segment corresponding to the special effect element.
  • the preset order includes the playing order of the characteristic music pieces.
  • the first special effect element control module controls the movement of the first special effect element on the special effect display interface according to the movement of the target object
  • it can be used to: obtain the movement track of the target object in the target direction; and according to the movement of the target object in the target direction
  • the motion track on the upper part controls the movement of the first special effect element on the special effect display interface.
  • the special effect display device provided by the embodiment of the present disclosure further includes a target object display module, and the target object display module is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the position of the special effect element in the special effect display interface is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the position of the special effect element in the special effect display interface is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the position of the special effect element in the special effect display interface is used to: display the target object on the special effect display interface, and adjust the first target object according to the position of the target object on the special effect display interface.
  • the special effect display module can be specifically used to: trigger the first special effect when the second special effect element moves to the preset area on the special effect display interface and the second special effect element contacts the first special effect element; and when the second special effect element is in contact with the first special effect element; When the element moves to the preset area on the special effect display interface, and the second special effect element is not in contact with the first special effect element, the second special effect is triggered.
  • the first special effect includes: playing a first preconfigured sound effect; and/or playing a first preconfigured animation.
  • the second special effect includes: playing a second preconfigured sound effect; and/or playing a second preconfigured animation.
  • the first preconfigured sound effect includes background music.
  • the special effect display device provided by the embodiment of the present disclosure further includes a music selection module, which is configured to: receive a user's music selection operation; and determine background music of the special effect display interface according to the music selection operation.
  • a music selection module configured to: receive a user's music selection operation; and determine background music of the special effect display interface according to the music selection operation.
  • an electronic device including: one or more processors; a memory; and one or more application programs.
  • One or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: perform the above-described special effect display method.
  • a computer-readable medium is provided, and the computer-readable medium is used to store computer instructions, which, when executed on a computer, enable the computer to execute the above-mentioned special effect display method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种特效展示方法、装置、电子设备及计算机可读介质。该方法包括：基于触发操作开启特效展示界面，并开启视频捕捉装置，特效展示界面中展示有第一特效元素（S101）；获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制各第二特效元素在特效展示界面运动（S102）；识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动（S103）；以及当第一特效元素与第二特效元素满足预设条件时，触发特效（S104）。在该方法中，特效的展示与音乐相关，通过融入音乐元素，给用户带来更好的体验。

Description

特效展示方法、装置、电子设备及计算机可读介质
本申请要求于2020年7月17日递交的中国专利申请第202010699334.8号的优先权，该中国专利申请的全文以引入的方式并入以作为本申请的一部分。
技术领域
本公开涉及人机交互技术领域，具体而言，本公开涉及一种特效展示方法、装置、电子设备及计算机可读介质。
背景技术
随着科技的发展，人机交互的技术也愈发成熟，许多应用程序中都会涉及到人机交互，而娱乐场景的人机交互，更能够为用户带来更多的欢乐。
发明内容
本公开的一个实施例提供了一种特效展示方法，该方法包括：
基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，所述特效展示界面中展示有第一特效元素；
获取所述特效展示界面中背景音乐的音乐特征及根据所述音乐特征生成的多个第二特效元素，按照预设的顺序展示各所述第二特效元素，并根据所述音乐特征控制所述第二特效元素在所述特效展示界面运动；
识别所述视频捕捉装置捕捉的视频中的目标对象，并根据所述目标对象的运动控制所述第一特效元素在所述特效展示界面运动；
当所述第一特效元素与所述第二特效元素满足预设条件时，触发特效。
本公开的另一个实施例提供了一种特效展示装置，该装置包括：
开启模块，用于基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，所述特效展示界面中展示有第一特效元素；
特效元素展示模块，用于获取所述特效展示界面中背景音乐的音乐特征及根据所述音乐特征生成的多个第二特效元素，按照预设的顺序展示各所述第二特效元素，并根据所述音乐特征控制所述第二特效元素在所述特效展示界面运动；
特效元素控制模块，用于识别所述视频捕捉装置捕捉的视频中的目标对象，并根据所述目标对象的运动控制所述第一特效元素在所述特效展示界面运动；
特效展示模块，用于当所述第一特效元素与所述第二特效元素满足预设 条件时，触发特效。
本公开的再一个实施例提供了一种电子设备，该电子设备包括：
一个或多个处理器；
存储器；
一个或多个应用程序，其中所述一个或多个应用程序被存储在所述存储器中并被配置为由所述一个或多个处理器执行，所述一个或多个程序配置用于：执行上述的特效展示方法。
第四方面，提供了一种计算机可读介质，所述计算机可读介质用于存储计算机指令，当其在计算机上运行时，使得计算机可以执行上述的特效展示方法。
附图说明
为了更清楚地说明本公开实施例中的技术方案，下面将对本公开实施例描述中所需要使用的附图作简单地介绍。
图1为本公开实施例提供的一种特效展示方法的流程示意图；
图2为本公开实施例提供的一种第一特效元素的展示示意图；
图3为本公开实施例提供的一种背景图展示意图；
图4-a为本公开实施例提供的一种第一特效元素、第二特效元素展示示意图；
图4-b为本公开实施例提供的一种目标对象与第一特效元素对应的展示示意图；
图4-c为本公开实施例提供的一种第一特效元素与目标对象对应的展示示意图；
图5为本公开实施例提供的一种不同长度的多个第二特效元素的展示示意图；
图6为本公开实施例提供的一种第二特效元素在不同展示位置高度的展示示意图；
图7为本公开实施例提供的一种控制第一特效元素运动的方法的流程示意图；
图8为本公开实施例提供的一种预设区域的展示示意图；
图9为本公开实施例提供的一种显示目标对象的展示示意图；
图10为本公开实施例提供的一种特效展示示意图；
图11为本公开实施例提供的一种预设区域为整个特效展示界面的展示示意图；
图12为本公开实施例提供的一种音乐选择方法的流程示意图；
图13为本公开实施例提供的一种特效展示装置的结构示意图；以及
图14为本公开实施例提供的一种电子设备的结构示意图。
结合附图并参考以下具体实施方式，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。贯穿附图中，相同或相似的附图标记表示相同或相似的元素。应当理解附图是示意性的，原件和元素不一定按照比例绘制。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对装置、模块或单元进行区分，并非用于限定这些装置、模块或单元一定为不同的装置、模块或单元，也并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
发明人注意到，一些娱乐场景的人机交互技术都是简单的获取用户操作，并根据用户操作对人机交互进行简单的应答，人机交互的乐趣不大，也没有较为丰富的特效展示，而且没有结合音乐特效的人机交互场景，无法基于音乐特质进行特效展示，实用范围不广。
由此可见，这些人机交互技术中在对特效进行展示时，特效展示单一，没有趣味性，有待改进。
本公开的至少一个实施例旨在至少能解决上述的技术缺陷之一，特别是人机交互技术中在对特效进行展示时，特效展示单一，没有趣味性的技术问 题。
本公开的至少一个实施例通过获取特效展示界面的背景音乐的音乐特征，基于该音乐特征生成第二特效元素，并根据音乐特征控制第二特效元素在该特效展示界面运动，通过获取目标对象在目标轨迹方向上的运动控制第一特效元素在目标展示界面上运动，当该第一特效元素和第二特效元素满足预设条件时，触发特效。
本公开实施例中提供了一种特效展示方法，如图1所示，该方法包括：
步骤S101，基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，特效展示界面中展示有第一特效元素。
步骤S102，获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制第二特效元素在特效展示界面运动。
步骤S103，识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动。
步骤S104，当第一特效元素与第二特效元素满足预设条件时，触发特效。
在本公开实施例中，提供的特效展示方法应用于终端设备，比如移动终端、计算机设备(如，台式机、笔记本电脑、一体机等)等，移动终端可以包括智能手机、掌上电脑、平板电脑、带显示屏的可穿戴设备等移动设备。上述视频捕捉装置可以为该终端设备自身的视频捕捉装置，也可以是该终端设备外接的视频捕捉装置。可选的，本公开实施例提供的特效展示方法可以是该终端设备中安装的应用程序中的特效展示方法。
需要说明的是，在本公开中，“特效”是指由例如电脑软件制作出的现实中一般不会出现的特殊效果，特效例如包括视觉特效、声音特效等。
在本公开实施例中，第一特效元素和第二特效元素是本公开实施例中特效展示的元素，基于音乐特征生成和控制第二特效元素，并通过目标对象的运动控制第一特效元素，以触发特效。其中，第一特效元素和第二特效元素可以包括但不限于插画、动图等画面元素。例如，第一特效元素为虚拟树洞、第二特效元素为虚拟动物，当第一特效元素与第二特效元素满足预设条件，例如虚拟动物进入虚拟树洞中时，触发特效。
特效的展示还可以与音乐相关，通过融入音乐元素，给用户带来更好的体验。
在本公开实施例中，目标对象包括视频捕捉装置捕捉到的视频中的某个对象，可以是任何具有特征的对象。对于本公开实施例，为了提升用户的人机交互体验，以人体目标对象为例进行说明，该目标对象可以包括人脸特征对象，如鼻子、眼睛、嘴巴等，也可以包括手或者手指等其他部位的特征对象。
对于本公开实施例，为方便说明，以一个具体实施例为例，在本公开实施例中，在终端设备中实现本公开实施例提供的特效展示方法。在一个实施例中，基于触发操作开启特效展示界面，该特效展示界面可以为终端设备中安装的某个应用程序中的显示界面，如游戏界面、拍摄界面等等。该触发操作可以包括用户点击某个特定的按钮进入特效展示界面，也可以包括用户通过特定的语音进入特效展示界面，还可以包括用户通过特定的表情进入特效展示界面，等等，本公开不对此进行限制。其中，该特效展示界面如图2所示，在本公开实施例中，特效展示界面201中展示有第一特效元素202，其中，该第一特效元素可以包括各种静态或动态的画面元素。可选的，在进入特效展示界面时，特效展示界面中还可以显示有背景。如图3所示，特效展示界面201中还设置有背景图像203，背景图像203例如可以是包含有草坪、花朵等UI(User Interface，用户界面)元素的背景图像，为用户提供更好的视觉体验，本公开不对此进行限制。
在本公开实施例中，步骤S102包括：获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制第二特效元素在特效展示界面运动。在本公开实施例中，为方便说明，以上述具体实施例为例，特效展示界面中会播放背景音乐，对于每一首背景音乐，服务器或者终端设备可以提前将该背景音乐的音乐特征提取出来，并根据该音乐特征生成多个第二特效元素。此外，对于每一首背景音乐，终端设备还可以实时提取背景音乐的音乐特征，并根据该音乐特征生成多个第二特效元素。为方便说明，以一首背景音乐为例，该首背景音乐的音乐特征对应的第二特效元素的数量、每个第二特效元素在特效展示界面中展示的长度、每个第二特效元素在特效展示界面出现位置的高度以及每个第二特效元素在特效展示界面的运动速度，都可以与该背景音乐的音乐特征有关，通过预设的顺序对各第二特效元素进行展示，并根据音乐特征控制每个第二特效元素在特效展示界面的运动。如图4-a所示，特效展示界面201中设置有第一特效元素A(也即，第一特效元素202)以及多个第二特效元素C(也即，第二特效元素204)，每个第二特效元素204按照预设的顺序从与第一特效元素A所在位置相对的方向进入特效展示界面201。
可选的，在开启特效展示界面之后，终端设备还可以为用户播放上述背景音乐，该背景音乐音乐可以是用户自己选择的，也可以是默认配置的。在该特效展示界面中还可以配置有其他功能选项，以更好的满足用户的需求，如可以配置有暂停、开始等操作选项，用户可以通过点击暂停按钮暂停当前界面中第二特效元素的运动，或者通过点击开始按钮还可以继续使得第二特效元素继续在当前界面中运动。
在本公开实施例中，步骤S103包括：识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动。在本公开实施例中，为方便说明，目标对象为用户脸部的一个特征对象，例如，鼻子。视频捕捉装置为终端设备的摄像头，摄像头捕捉到用户头像后，识别用户头像中的用户鼻子，并根据用户鼻子的运动控制第一特效元素202在特效展示界面201中运动。如图4-b所示，特效展示界面201中显示有第一特效元素202以及多个第二特效元素204，当终端设备识别到目标对象时，则根据目标对象在特效展示界面的位置调节第一特效元素在特效展示界面的位置。在一个实施例中，终端设备可以根据目标对象在特效展示界面的位置高度调节第一特效元素在特效展示界面的位置高度。例如，以图4-b为例，当终端设备检测到鼻子在特效展示界面201的中间位置时，则调节第一特效元素202显示在特效显示界面201的中间；在图4-c中，当终端设备检测到鼻子移动到特效展示界面的下部时，则调节第一特效元素202显示在特效显示界面201的下部。
在本公开实施例中，步骤S104包括：当第一特效元素与第二特效元素满足预设条件时，触发特效。在本公实施例中，为方便说明，以上述具体实施例为例，根据音乐特征控制多个第二特效元素在特效展示界面运动，用户则用目标对象(例如，鼻子)控制第一特效元素在特效展示界面运动；当第一特效元素与第二特效元素满足预设条件时，触发特效。在一个实施例中，当第一特效元素与第二特效元素接触时，触发第一特效元素与第二特效元素接触的特效。例如，当第一特效元素为树洞、第二特效元素为动物时，当动物与树洞接触时，触发动物进入树洞的动画特效，还会同时显示如得分、音符图案、庆祝图案等图形元素特效或播放某个音效或者播放与第二特效元素关联的声音，例如，第二特效元素为动物元素时，可以播放该动物的叫声等等，本公开不对此进行限制。
在本公开实施例中，可选的，第一特效元素可以有多个，对应的，目标对象也有多个，其中，一个第一特效元素对应一个目标对象，不同的目标对象分别控制不同的第一特效元素运动，进而可实现例如多个用户之间的互动。为方便说明，以一个具体实施例为例，在开启特效展示界面时，可以选择游戏模式，如双人/多人模式，此时在特效展示界面会相应地显示两个或者多个第一特效元素，终端设备开启视频捕捉装置，识别视频中的目标对象，如鼻子。当视频捕捉装置捕捉到有多个用户在视频捕捉装置捕捉的视频中，则识别该多个目标对象，例如鼻子，并分别识别每个鼻子的运动轨迹，分别根据每个鼻子的运动轨迹控制对应的第一特效元素在特效展示界面运动，以使得每个第一特效元素接触第二特效元素，并根据接触结果展示不同的特效。在另一个实施例中，终端设备也可以在开启视频捕捉装置、识别视频中存在多 个目标对象的情况下，在特效展示界面会相应地显示对应数目的多个第一特效元素，并分别识别每个目标对象的运动轨迹，根据每个目标对象的运动轨迹控制对应的第一特效元素在特效展示界面运动，以使得每个第一特效元素接触第二特效元素，并根据接触结果展示不同的特效。在本公开实施例中，多个用户可以在同一设备上控制第一特效元素分别接触第二特效元素，从而增加游戏竞技性。
本公开实施例通过获取特效展示界面中的背景音乐的音乐特征，基于该音乐特征生成第二特效元素，并基于该音乐特征控制第二特效元素在该特效展示界面运动，通过获取目标对象在目标轨迹方向上的运动控制第一特效元素在目标展示界面上运动；当该第一特效元素和第二特效元素满足预设条件时，触发特效。此外，根据本公开实施例的特效的展示与音乐相关，通过融入音乐元素，给用户带来更好的体验。具体的，用户通过鼻子控制第一特效元素在特效展示界面中的移动，使得更多数量的第二特效元素与第一特效元素接触并获得得分，还可以进一步提升用户交互和游戏体验。
本公开实施例提供了一种可能的实现方式，在该实现方式中，音乐特征包括背景音乐的特征音乐段的数量，其中，第二特效元素的数量与特征音乐段的数量对应。
在本公开实施例中，特效展示界面的背景音乐的音乐特征包括特征音乐段的数量，其中，特征音乐段可以包括能够表征音乐所包含的音乐元素的特征的信息段，其中，音乐元素可以包括但不限于音乐的时长、音乐所包含的字符、音符等。在一个实施例中，可以根据音乐所包含的字符划分特征音乐段。例如对于一首中文歌曲的音乐，该音乐的歌词中一个汉语字符对应的音乐段可以作为一个特征音乐段。在一个实施例中，可以根据时长划分特征音乐段，例如，可以依据一定的时长将音乐划分为多个音乐段，此时一个音乐段可以作为一个特征音乐段。可选的，对于不同的音乐，还可以根据音乐节奏的快慢采用不同的特征音乐段划分方式，比如，对于两首时长相同的音乐，音乐节奏快的音乐的特征音乐段数可以多于音乐节奏慢的音乐的特征音乐段的数量，相应的，音乐节奏快的音乐可以对应有更多数量的第二特效元素。
一首背景音乐的音乐特征包括该首背景音乐中的特征音乐段的数量，而第二特效元素的数量与该特征音乐段的数量对应，具体地，一个特征音乐段可以对应一个第二特效元素。例如，以歌曲《两只老虎》为例，歌曲中总共有汉字32个，则可以根据字符划分特征音乐段，该歌曲中可以包括32个特征音乐段，对应生成32个第二特效元素，即，一个汉字对应一个第二特效元素。特效展示界面在对多个第二特效元素进行展示时，根据《两只老虎》的音乐特征依次展示多个第二特效元素，用户通过诸如鼻子等的目标对象控制第一特效元素与第二特效元素接触，并触发接触特效，还可以进一步触发得 分特效、音乐特效等等。
本公开实施例通过根据音乐的特征音乐段的数量生成第二特效元素，特效展示过程与音乐相关，提升用户体验和交互乐趣。
本公开实施例提供了一种可能的实现方式，在该实现方式中，音乐特征还包括每个特征音乐段的播放时间，对于每个第二特效元素，该第二特效元素在特效展示界面展示的长度与该第二特效元素对应的特征音乐段的播放时间正相关。
在本公开实施例中，音乐特征还包括每个特征音乐段的播放时间。而对于每个第二特效元素而言，其在特效展示界面中展示的长度与该特效元素对应的特征音乐段的播放时长正相关，特征音乐段的播放时长越长，其对应的第二特效元素在特效展示界面中展示的长度越长。例如，如图5所示，对于音乐《两只老虎》中“跑得快”这一句生成的三个第二特效元素，其中“快”对应的第二特效元素501的长度要比“跑”和“得”对应的第二特效元素502和第二特效元素503要长。而对于特征音乐段的播放时长与对应的第二特效元素在特效展示界面中展示的长度的设置比例，可以预先设置，本公开对此不作限定。特效展示界面在对第二特效元素进行展示时，不同的第二特效元素在特效展示界面的长度不同，用户通过诸如鼻子等目标对象控制第一特效元素接触第二特效元素时，每个第二特效元素与第一特效元素的接触时间可能不同，玩法更多样，提升用户乐趣。
本公开实施例中通过特征音乐段的播放时间控制对应的第二特效元素在特效展示界面的长度，从而使得界面上的视觉效果更加丰富，游戏玩法更多样，用户体验更佳。
本公开实施例提供了一种可能的实现方式，在该实现方式中，音乐特征还包括每个特征音乐段的音高，对于每个第二特效元素，该第二特效元素在特效展示界面展示的位置高度与该第二特效元素对应的特征音乐段的音高正相关。
在本公开实施例中，音乐特征还包括每个特征音乐段的音高，音高是指该特征音乐段对应音符的音高。若该特征音乐段对应一个音符，则该特征音乐段的音高即为该音符的音高；若该特征音乐段对应有多个音符，则该特征音乐段的音高为该多个音符音高的平均值。其中，每个特征音乐段对应的第二特效元素在特效展示界面的位置高度与该特征音乐段的音高正相关。例如，如图6所示，对于不同音高的特征音乐段对应的第二特效元素在特效展示界面的位置高度不同，其中，第二特效元素601对应的特征音乐段的音高要比第二特效元素602对应的特征音乐段的音高要高。从而，如图6所示，第二特效元素601在特效展示界面的位置高度要比第二特效元素602在特效展示界面的位置高度高。在进行特效展示时，第二特效元素在特效展示界面的位 置高度不同，用户在通过鼻子控制第一特效元素接触第二特效元素时，可以上下移动鼻子，从而增加用户的交互体验。
本公开实施例根据特征音乐段的音高确定对应的第二特效元素在特效展示界面的位置高度，用户可以不断控制第一特效元素在特效展示界面上下移动，从而能够增加用户交互体验，提升游戏乐趣。
本公开实施例提供了一种可能的实现方式，在该实现方式中，音乐特征还包括每个特征音乐段的节拍数，对于每个特效元素，该第二特效元素在特效展示界面的运动速度与该特效元素对应的特征音乐段的节拍数正相关。
在本公开实施例中，音乐特征还包括每个特征音乐段的节拍数，其中，第二特效元素在特效展示界面的运动速度与该第二特效元素对应的特征音乐段单位时间段内的节拍数正相关，单位时间段内的节拍数越多，则其对应的第二特效元素在特效展示界面的运动速度越快。在进行特效展示时，根据背景音乐的节奏，设置不同第二特效元素的运动速度不同，用户通过鼻子控制第一特效元素接触第二特效元素，增加游戏互动的乐趣。
本公开实施例通过特征音乐段的节拍数控制第二特效元素在特效展示界面的运动速度，不同音乐第二特效元素的运动速度不同，游戏难度不同，从而能够增加游戏玩法，提升用户体验。
本公开实施例提供了一种可能的实现方式，在该实现方式中，预设的顺序包括特征音乐段的播放顺序。在本公开实施例中，第二特效元素在特效展示界面出现的顺序是该第二特效元素对应的特征音乐段的播放顺序。为方便说明，以上述具体实施例为例，按照音乐播放顺序控制第二特效元素在特效展示界面中出现，保证用户能够控制第一特效元素接触第二特效元素，保证游戏顺利进行。
本公开实施例提供了一种可能的实现方式，在该实现方式中，如图7所示，根据目标对象的运动控制第一特效元素在特效展示界面运动，包括：获取目标对象的运动轨迹；并根据目标对象的运动轨迹控制第一特效元素在特效展示界面运动。在一个实施例中，终端设备可以获取目标对象的运动轨迹；并根据目标对象的运动轨迹控制第一特效元素在特效展示界面运动，从而控制第一特效元素与第二特效元素接触。
在一个实施例中，根据目标对象的运动控制第一特效元素在特效展示界面运动，包括：
步骤S701，获取目标对象在目标方向上的运动轨迹；
步骤S702，根据目标对象在目标方向上的运动轨迹控制第一特效元素在特效展示界面运动。
在本公开实施例中，目标方向可以包括第一特效元素的运动方向，其中，第一特效元素的运动方向可以与第二特效元素的运动方向垂直。例如，当第 一特效元素在垂直方向上运动时，第二特效元素的运动方向为水平方向，在这种情况下，目标方向即为垂直方向；若第一特效元素在水平方向上运动，那么第二特效元素的运动方向为垂直方向，在这种情况下，目标方向为水平方向。此外，在一个实施例中，目标方向可以包括第一特效元素的运动方向，其中，第一特效元素的运动方向可以与第二特效元素的运动方向一致。例如，当第一特效元素在垂直方向上运动时，第二特效元素的运动方向也可以为垂直方向；当第一特效元素在水平方向上运动时，第二特效元素的运动方向也可以为水平方向，本公开不对此进行限制。
作为本公开一个实施例，终端设备先确定目标方向，然后在视频捕捉装置捕捉的视频中获取目标对象在该目标方向的运动轨迹，基于该运动轨迹控制第一特效元素在特效展示界面运动。为方便说明，以上述一个实施例为例进行说明，如图8所示，第一特效元素801可以在预设区域802上运动，假设目标方向为垂直方向，则用户在通过目标对象(例如鼻子)控制第一特效元素在垂直方向上运动时，终端设备识别鼻子在垂直方向上的运动轨迹，然后根据鼻子在垂直方向上的运动轨迹控制第一特效元素接触第二特效元素。
本领域技术人员应当理解的是，图8中的预设区域的大小和位置仅是示例性的，预设区域的具体大小以及其在特效展示界面的位置都是可以根据实际情况进行设置的，本公开不对此进行限制。
本公开实施例通过将第一特效元素的运动方向确定为目标方向，并获取目标对象在该目标方向上的运动轨迹，基于该运动轨迹控制第一特效元素运动，保证游戏正常进行并增加了用户交互的乐趣和体验。
本公开实施例提供了一种可能的实现方式，在该实现方式中，在识别视频捕捉装置捕捉的视频中的目标对象之后，还包括：将目标对象显示在特效展示界面，并根据目标对象在特效展示界面的位置调节第一特效元素在特效展示界面的位置。
在一个实施例中，终端设备可以根据目标对象在特效展示界面的位置高度调节第一特效元素在特效展示界面的位置高度，从而使得第一特效元素在特效展示界面中的位置与目标对象处于同一水平线上。在本公开实施例中，如图9所示，在开启特效展示界面时，终端设备将视频捕捉装置捕捉到的视频显示在特效展示界面中，其中，该视频中包括目标对象，并根据目标对象在视频中的位置调节第一特效元素在特效展示界面的位置。为方便说明，以上述具体实施例为例，如图9所示，在特效展示界面901中，显示视频捕捉装置捕捉到的视频902，其中，视频902中包含目标对象903，该目标对象可以是用户鼻子；然后根据目标对象903在视频中的位置，调节第一特效元素904在特效展示界面中的位置与目标对象处于同一水平线上，如虚线部分的第一特效元素904为刚出现的特效展示界面901时的位置，进而实现部分的 第一特效元素904为调整至于目标对象903处于同一水平线时的位置，方便用户通过目标对象对第一特效元素进行运动控制。
本公开实施例通过将目标对象显示在特效展示界面中，用户方便看到目标对象的位置，并根据目标对象的初始位置调节第一特效元素在特效展示界面的位置，方便设置初始界面，并提升用户体验。
本公开实施例提供了一种可能的实现方式，在该实现方式中，当第一特效元素与第二特效元素满足预设条件时，触发特效，包括：当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素接触时，触发第一特效；以及当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素不接触时，触发第二特效，其中，预设区域为第一特效元素的可运动区域。
在本公开实施例中，预设区域可以是第一特效元素的可运动区域，其中，预设区域的大小可以是特效展示界面一边的一块预设大小的区域，如图10所示，为方便说明，以上述具体实施例为例，在特效展示界面1001中显示有第一特效元素1002(也即，第一特效元素A)，第一特效元素1002可以在预设区域1003内运动。在特效展示界面1001中，展示有多个按照音乐特征生成的第二特效元素1004，并且，第二特效元素1004从第一特效元素1002的位置相对的方向靠近第一特效元素1002移动，用户通过目标对象，例如鼻子，控制第一特效元素1002在预设区域1003上运动。当第二特效元素1004运动到预设区域1003时，若用户通过鼻子控制第一特效元素1002与第二特效元素1004接触时，则触发第一特效；当第二特效元素1004运动到预设区域1003时，若用户通过鼻子控制第一特效元素1002没有能够与第二特效元素1004接触时，则触发第二特效。
其中，展示第一特效可以包括播放第一预配置的音乐，如与第二特效元素相关联的声音、背景音乐等，还可以包括播放第一预配置的动画，以第一特效元素为树洞元素、第二特效元素为动物元素为例，该第一配置的动画可以包括如动物进入树洞后树洞周围发出炫光且动物消失等特效。展示第二特效可以包括播放第二预配置的音乐，或者播放第二预配置的动画，以第一特效元素为树洞元素、第二特效元素为动物元素为例，该第二配置的音乐可以包括如动物撞墙的声音或者动物呜咽的声音，该第二配置的动画可以包括如动物停止运动、动物头上出现旋转的星星，并在一段时间后，动物和动物头上的星星同时消失等动画特效。可选的，当用户通过鼻子移动第一特效元素在预设区域范围内接接触到第二特效元素时，终端设备可以为用户设置加分，并记录整首歌曲用户的得分。通过提供不同的背景音乐，第二特效元素在特效展示界面上的运动速度不同，从而，游戏难度不同，用户有更多选择和挑战。
可选的，本公开实施例提供的特效展示方法中，第一特效元素的运动范围(即，预设区域)可以包括整个特效展示界面或者特效展示界面的一部分。如图11所示，在特效展示界面1101中，第一特效元素1102(也即，第一特效元素A)可以在预设区域1103中任意移动，其移动轨迹由目标对象的运动轨迹控制，第二特效元素1104(也即，第二特效元素C)可以从特效展示界面的一边出现，用户控制第一特效元素1102在预设区域1103中运动与第二特效元素1104接触。当然，预设区域的具体大小以及其在特效展示界面的位置都是可以根据实际情况进行设置的，针对不同大小和设置位置的预设区域，用户可控制第一特效元素运动的轨迹也不同，用户可以体验更多游戏乐趣。
本公开实施例通过为第一特效元素和第二特效元素接触或者没有接触设置不同的特效，用户在通过诸如鼻子等目标对象控制第一特效元素接触或者没有接触到第二特效元素时，触发展示的特效不同，从而使得用户的体验更丰富。
本公开实施例提供的一种可能的实现方式中，如图12所示，该方法还包括：
步骤S1201，接收用户的音乐选择操作；以及
步骤S1202，根据音乐选择操作确定特效展示界面的背景音乐。
在本公开实施例中，用户可以选择不同的背景音乐进行游戏，对应不同的游戏难度。当用户想要选择不同的背景音乐时，可以在特效展示界面进行音乐选择操作，终端设备接收到该音乐选择操作时，根据该音乐选择操作确定该特效展示界面的背景音乐，并且，终端设备针对不同的背景音乐，所生产的第二特效元素的数量、在特效展示界面展示的长度、位置高度以及运动速度也不相同。例如，用户点击特效展示界面的音乐选择按钮，特效展示界面中显示音乐选择界面，该音乐选择界面中有多个音乐可供选择，用户可以通过点击其中一个音乐，将该音乐确定为特效展示界面的背景音乐。在一个实施例中，对于每一首背景音乐，服务器或者终端设备可以提前将该背景音乐的音乐特征提取出来，并根据该音乐特征生成多个第二特效元素。此外，对于每一首背景音乐，终端设备还可以实时提取背景音乐的音乐特征，并根据该音乐特征生成多个第二特效元素。
本公开实施例中，用户可以根据自身喜好选择不同的背景音乐，从而相应地选择不同的游戏难度，游戏体验更丰富。
本公开实施例通过获取特效展示界面的背景音乐的音乐特征，并基于该音乐特征生成第二特效元素，并控制第二特效元素在该特效展示界面运动，通过获取目标对象在目标轨迹方向上的运动控制第一特效元素在目标展示界面上运动，当该第一特效元素和第二特效元素满足预设条件时，触发特效。特效的展示与音乐相关，通过融入音乐元素，给用户带来更好的体验。具体 的，用户通过目标对象控制第一特效元素在特效展示界面上的移动，保证更多数量的第二特效元素与第一特效元素接触并得分，进一步提升用户游戏体验。
本公开实施例提供了一种特效展示装置，如图13所示，该特效展示装置130可以包括：界面开启模块1301、特效元素展示模块1302、特效元素控制模块1303以及特效展示模块1304。
界面开启模块1301用于基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，特效展示界面中展示有第一特效元素。
特效元素展示模块1302用于获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制第二特效元素在特效展示界面运动。
特效元素控制模块1303用于识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动。
特效展示模块1304用于当第一特效元素与第二特效元素满足预设条件时，触发特效。
可选的，音乐特征包括背景音乐的特征音乐段的数量，其中，第二特效元素的数量与特征音乐段的数量对应。
可选的，音乐特征还包括每个特征音乐段的播放时间，对于每个第二特效元素，该第二特效元素在特效展示界面展示的长度与该第二特效元素对应的特征音乐段的播放时间正相关。
可选的，音乐特征还包括每个特征音乐段的音高，对于每个第二特效元素，该第二特效元素在特效展示界面展示的位置高度与该第二特效元素对应的特征音乐段的音高正相关。
可选的，音乐特征还包括每个特征音乐段的节拍数，对于每个特效元素，该第二特效元素在特效展示界面的运动速度与该特效元素对应的特征音乐段的节拍数正相关。
可选的，预设的顺序包括特征音乐段的播放顺序。
可选的，特效元素控制模块1303在根据目标对象的运动控制第一特效元素在特效展示界面运动时，可以用于：获取目标对象在目标方向上的运动轨迹；以及根据目标对象在目标方向上的运动轨迹控制第一特效元素在特效展示界面运动。
可选的，本公开实施例提供的特效展示装置还包括目标对象展示模块，该目标对象展示模块用于：将目标对象显示在特效展示界面，并根据目标对象在特效展示界面的位置调节第一特效元素在特效展示界面的位置。
可选的，特效展示模块1304可以用于：当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素接触时，触发第一特效； 以及当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素不接触时，触发第二特效，其中，预设区域为第一特效元素的可运动区域。
可选的，第一特效包括：播放第一预配置的音效；和/或播放第一预配置的动画。第二特效包括：播放第二预配置的音效；和/或播放第二预配置的动画。
可选的，第一预配置的音效包括背景音乐。
可选的，本公开实施例提供的特效展示装置还包括音乐选择模块，该音乐选择模块用于：接收用户的音乐选择操作；以及根据音乐选择操作确定特效展示界面的背景音乐。
本公开实施例提供的特效展示装置可以实现前述实施例中的特效展示方法，且实现原理一致，对此，本公开不再赘述。
本公开实施例通过获取特效展示界面的背景音乐的音乐特征，并基于该音乐特征生成第二特效元素，并控制第二特效元素在该特效展示界面运动，通过获取目标对象在目标轨迹方向上的运动控制第一特效元素在目标展示界面上运动，当该第一特效元素和第二特效元素满足预设条件时，触发特效。特效的展示与音乐相关，通过融入音乐元素，给用户带来更好的体验。
用户通过目标对象控制第一特效元素在特效展示界面上的移动，保证更多数量的第二特效元素与第一特效元素接触并得分，进一步提升用户游戏体验。
上述模块可以被实现为在一个或多个通用处理器上执行的软件组件，也可以被实现为诸如执行某些功能或其组合的硬件，诸如可编程逻辑设备和/或专用集成电路。在一些实施例中，这些模块可以体现为软件产品的形式，该软件产品可以存储在非易失性存储介质中，这些非易失性存储介质中包括使得计算机设备(例如个人计算机、服务器、网络设备、移动终端等)实现本公开实施例中描述的方法。在一个实施例中，上述模块还可以在单个设备上实现，也可以分布在多个设备上。这些模块的功能可以相互合并，也可以进一步拆分为多个子模块。
下面参考图14，其示出了适于用来实现本公开实施例的电子设备1400的结构示意图。本公开实施例中的电子设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)、带显示屏的可穿戴设备等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图14示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
电子设备包括：存储器以及处理器。存储器用于存储执行上述各个方法 实施例所述方法的程序；处理器被配置为执行存储器中存储的程序，以实现上文所述的本公开的实施例的功能以及/或者其它期望的功能。其中，这里的处理器可以称为下文的处理装置1401，存储器可以包括下文中的只读存储器(ROM)1402、随机访问存储器(RAM)1403以及存储装置1408中的至少一项，具体如下所示。
如图14所示，电子设备1400可以包括处理装置(例如中央处理器、图形处理器等)1401，其可以根据存储在只读存储器(ROM)1402中的程序或者从存储装置1408加载到随机访问存储器(RAM)1403中的程序而执行各种适当的动作和处理。在RAM 1403中，还存储有电子设备1400操作所需的各种程序和数据。处理装置1401、ROM 1402以及RAM 1403通过总线1404彼此相连。输入/输出(I/O)接口1405也连接至总线1404。
通常，以下装置可以连接至I/O接口1405：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置1406；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置1407；包括例如磁带、硬盘等的存储装置1408；以及通信装置1409。通信装置1409可以允许电子设备1400与其他设备进行无线或有线通信以交换数据。虽然图14示出了具有各种装置的电子设备1400，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置1409从网络上被下载和安装，或者从存储装置1408被安装，或者从ROM 1402被安装。在该计算机程序被处理装置1401执行时，执行本公开实施例的方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读介质或者是上述两者的任意组合。计算机可读介质例如可以是但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序 代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(“Local Area Network，LAN”)、广域网(“Wide Area Network，WAN”)、网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备执行上述各个实施例所述方法的程序。在一个实施例中，当上述一个或者多个程序被该电子设备执行时，使得该电子设备执行：基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，特效展示界面中展示有第一特效元素；获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制第二特效元素在特效展示界面运动；识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动；当第一特效元素与第二特效元素满足预设条件时，触发特效。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言，诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言，诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络，例如包括局域网(LAN)或广域网(WAN)，连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或 框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的模块或单元可以通过软件的方式实现，也可以通过硬件的方式来实现。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开提供的一个或多个实施例，提供了一种特效展示方法，该方法包括：
基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，特效展示界面中展示有第一特效元素；
获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制第二特效元素在特效展示界面运动；
识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动；以及
当第一特效元素与第二特效元素满足预设条件时，触发特效。
进一步的，音乐特征包括背景音乐的特征音乐段的数量，其中，第二特效元素的数量与特征音乐段的数量对应。
进一步的，音乐特征还包括每个特征音乐段的播放时间，对于每个第二 特效元素，该第二特效元素在特效展示界面展示的长度与该第二特效元素对应的特征音乐段的播放时间正相关。
进一步的，音乐特征还包括每个特征音乐段的音高，对于每个第二特效元素，该第二特效元素在特效展示界面展示的高度与该第二特效元素对应的特征音乐段的音高正相关。
进一步的，音乐特征还包括每个特征音乐段的节拍数，对于每个特效元素，该第二特效元素在特效展示界面的运动速度与该特效元素对应的特征音乐段的节拍数正相关。
进一步的，预设的顺序包括特征音乐段的播放顺序。
进一步的，根据目标对象的运动控制第一特效元素在特效展示界面运动，包括：获取目标对象在目标方向上的运动轨迹；以及根据目标对象在目标方向上的运动轨迹控制第一特效元素在特效展示界面运动。
进一步的，在识别视频捕捉装置捕捉的视频中的目标对象之后，该特效展示方法还包括：将目标对象显示在特效展示界面，并根据目标对象在特效展示界面的位置调节第一特效元素在特效展示界面的位置。
进一步的，当第一特效元素与第二特效元素满足预设条件时，触发特效，包括：当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素接触时，触发第一特效；以及当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素不接触时，触发第二特效，其中，预设区域为第一特效元素的可运动区域。
进一步的，第一特效包括：播放第一预配置的音效；和/或播放第一预配置的动画。第二特效包括：播放第二预配置的音效；和/或播放第二预配置的动画。
进一步的，第一预配置的音效包括背景音乐。
进一步的，该方法还包括：接收用户的音乐选择操作；以及根据音乐选择操作确定特效展示界面的背景音乐。
根据本公开提供的一个或多个实施例，提供了一种特效展示装置，该特效展示装置包括：
开启模块，用于基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，特效展示界面中展示有第一特效元素；
特效元素展示模块，用于获取特效展示界面中背景音乐的音乐特征及根据音乐特征生成的多个第二特效元素，按照预设的顺序展示各第二特效元素，并根据音乐特征控制第二特效元素在特效展示界面运动；
特效元素控制模块，用于识别视频捕捉装置捕捉的视频中的目标对象，并根据目标对象的运动控制第一特效元素在特效展示界面运动；
特效展示模块，用于当第一特效元素与第二特效元素满足预设条件时， 触发特效。
可选的，音乐特征包括背景音乐的特征音乐段的数量，其中，第二特效元素的数量与特征音乐段的数量对应。
可选的，音乐特征还包括每个特征音乐段的播放时间，对于每个第二特效元素，该第二特效元素在特效展示界面展示的长度与该第二特效元素对应的特征音乐段的播放时间正相关。
可选的，音乐特征还包括每个特征音乐段的音高，对于每个第二特效元素，该第二特效元素在特效展示界面展示的高度与该第二特效元素对应的特征音乐段的音高正相关。
可选的，音乐特征还包括每个特征音乐段的节拍数，对于每个特效元素，该第二特效元素在特效展示界面的运动速度与该特效元素对应的特征音乐段的节拍数正相关。
可选的，预设的顺序包括特征音乐段的播放顺序。
可选的，第一特效元素控制模块在根据目标对象的运动控制第一特效元素在特效展示界面运动时，可以用于：获取目标对象在目标方向上的运动轨迹；以及根据目标对象在目标方向上的运动轨迹控制第一特效元素在特效展示界面运动。
可选的，本公开实施例提供的特效展示装置还包括目标对象展示模块，该目标对象展示模块用于：将目标对象显示在特效展示界面，并根据目标对象在特效展示界面的位置调节第一特效元素在特效展示界面的位置。
可选的，特效展示模块具体可以用于：当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素接触时，触发第一特效；以及当第二特效元素在特效展示界面运动到预设区域，且第二特效元素与第一特效元素不接触时，触发第二特效。
可选的，第一特效包括：播放第一预配置的音效；和/或播放第一预配置的动画。
第二特效包括：播放第二预配置的音效；和/或播放第二预配置的动画。
可选的，第一预配置的音效包括背景音乐。
可选的，本公开实施例提供的特效展示装置还包括音乐选择模块，该音乐选择模块用于：接收用户的音乐选择操作；以及根据音乐选择操作确定特效展示界面的背景音乐。
根据本公开提供的一个或多个实施例，提供了一种电子设备，该电子设备包括：一个或多个处理器；存储器；以及一个或多个应用程序。一个或多个应用程序被存储在存储器中并被配置为由一个或多个处理器执行，一个或多个程序配置用于：执行上述的特效展示方法。
根据本公开提供的一个或多个实施例，提供了一种计算机可读介质，该 计算机可读介质用于存储计算机指令，当其在计算机上运行时，使得计算机可以执行上述的特效展示方法。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (15)

  1. 一种特效展示方法，包括：
    基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，所述特效展示界面中展示有第一特效元素；
    获取所述特效展示界面中背景音乐的音乐特征及根据所述音乐特征生成的多个第二特效元素，按照预设的顺序展示各所述第二特效元素，并根据所述音乐特征控制各所述第二特效元素在所述特效展示界面运动；
    识别所述视频捕捉装置捕捉的视频中的目标对象，并根据所述目标对象的运动控制所述第一特效元素在所述特效展示界面运动；以及
    当所述第一特效元素与所述第二特效元素满足预设条件时，触发特效。
  2. 根据权利要求1所述的方法，其中，所述音乐特征包括所述背景音乐的特征音乐段的数量，所述第二特效元素的数量与所述特征音乐段的数量对应。
  3. 根据权利要求2所述的方法，其中，所述音乐特征还包括每个所述特征音乐段的播放时间，
    对于每个所述第二特效元素，该所述第二特效元素在所述特效展示界面展示的长度与该所述第二特效元素对应的所述特征音乐段的播放时间正相关。
  4. 根据权利要求2或3所述的方法，其中，所述音乐特征还包括每个所述特征音乐段的音高，
    对于每个所述第二特效元素，该所述第二特效元素在所述特效展示界面展示的位置高度与该所述第二特效元素对应的所述特征音乐段的音高正相关。
  5. 根据权利要求2-4任一项所述的方法，其中，所述音乐特征还包括每个所述特征音乐段的节拍数，
    对于每个所述第二特效元素，该所述第二特效元素在所述特效展示界面的运动速度与该所述第二特效元素对应的所述特征音乐段的节拍数正相关。
  6. 根据权利要求2-5任一项所述的方法，其中，所述预设的顺序包括所述特征音乐段的播放顺序。
  7. 根据权利要求1-6任一项所述的方法，其中，根据所述目标对象的运动控制所述第一特效元素在所述特效展示界面运动，包括：
    获取所述目标对象在目标方向上的运动轨迹；以及
    根据所述目标对象在所述目标方向上的运动轨迹，控制所述第一特效元素在所述特效展示界面运动。
  8. 根据权利要求1-7任一项所述的方法，其中，在识别所述视频捕捉装 置捕捉的视频中的所述目标对象之后，所述方法还包括：
    将所述目标对象显示在所述特效展示界面，并根据所述目标对象在所述特效展示界面的初始位置调节所述第一特效元素在所述特效展示界面的位置。
  9. 根据权利要求1-8任一项所述的方法，其中，当所述第一特效元素与所述第二特效元素满足所述预设条件时，触发所述特效，包括：
    当所述第二特效元素在所述特效展示界面运动到预设区域，且所述第二特效元素与所述第一特效元素接触时，触发第一特效；
    当所述第二特效元素在所述特效展示界面运动到所述预设区域，且所述第二特效元素与所述第一特效元素不接触时，触发第二特效，其中，所述预设区域为所述第一特效元素的可运动区域。
  10. 根据权利要求9所述的方法，其中，所述第一特效包括：
    播放第一预配置的音效；和/或
    播放第一预配置的动画；
    所述第二特效包括：
    播放第二预配置的音效；和/或
    播放第二预配置的动画。
  11. 根据权利要求10所述的方法，其中，所述第一预配置的音效为所述背景音乐。
  12. 根据权利要求1-11任一项所述的方法，还包括：
    接收用户的音乐选择操作；以及
    根据所述音乐选择操作，确定所述特效展示界面的背景音乐。
  13. 一种特效展示装置，包括：
    开启模块，用于基于触发操作开启特效展示界面，并开启视频捕捉装置，其中，所述特效展示界面中展示有第一特效元素；
    特效元素展示模块，用于获取所述特效展示界面中背景音乐的音乐特征及根据所述音乐特征生成的多个第二特效元素，按照预设的顺序展示各所述第二特效元素，并根据所述音乐特征控制各所述第二特效元素在所述特效展示界面运动；
    特效元素控制模块，用于识别所述视频捕捉装置捕捉的视频中的目标对象，并根据所述目标对象的运动控制所述第一特效元素在所述特效展示界面运动；
    特效展示模块，用于当所述第一特效元素与所述第二特效元素满足预设条件时，触发特效。
  14. 一种电子设备，包括：
    一个或多个处理器；
    存储器；
    一个或多个应用程序，其中，所述一个或多个应用程序被存储在所述存储器中并被配置为由所述一个或多个处理器执行，
    所述一个或多个应用程序配置为用于执行根据权利要求1～12任一项所述的特效展示方法。
  15. 一种计算机可读介质，用于存储计算机指令，其中，当所述计算机指令在计算机上运行时，使得所述计算机能够执行根据权利要求1～12中任一项所述的特效展示方法。
PCT/CN2021/096349 2020-07-17 2021-05-27 特效展示方法、装置、电子设备及计算机可读介质 Ceased WO2022012182A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/008,637 US12375618B2 (en) 2020-07-17 2021-05-27 Method and apparatus for showing special effect, electronic device, and computer-readable medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010699334.8A CN111857923B (zh) 2020-07-17 2020-07-17 特效展示方法、装置、电子设备及计算机可读介质
CN202010699334.8 2020-07-17

Publications (1)

Publication Number Publication Date
WO2022012182A1 true WO2022012182A1 (zh) 2022-01-20

Family

ID=73000620

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/096349 Ceased WO2022012182A1 (zh) 2020-07-17 2021-05-27 特效展示方法、装置、电子设备及计算机可读介质

Country Status (3)

Country Link
US (1) US12375618B2 (zh)
CN (1) CN111857923B (zh)
WO (1) WO2022012182A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114531553A (zh) * 2022-02-11 2022-05-24 北京字跳网络技术有限公司 生成特效视频的方法、装置、电子设备及存储介质
CN114915819A (zh) * 2022-03-30 2022-08-16 卡莱特云科技股份有限公司 一种基于互动屏的数据交互方法、装置及系统
CN115098000A (zh) * 2022-02-22 2022-09-23 北京字跳网络技术有限公司 图像处理方法、装置、电子设备及存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111857923B (zh) 2020-07-17 2022-10-28 北京字节跳动网络技术有限公司 特效展示方法、装置、电子设备及计算机可读介质
CN112764711A (zh) * 2021-01-29 2021-05-07 腾讯科技（深圳）有限公司 音乐交互方法、装置、设备以及存储介质
CN112799771A (zh) * 2021-02-09 2021-05-14 珠海豹趣科技有限公司 一种动态壁纸的播放方法、装置、电子设备及存储介质
CN112988027B (zh) * 2021-03-15 2023-06-27 北京字跳网络技术有限公司 对象控制方法及设备
CN113157369B (zh) * 2021-04-07 2023-04-18 杭州网易云音乐科技有限公司 音乐播放互动方法、装置、存储介质与电子设备
CN113744135A (zh) * 2021-09-16 2021-12-03 北京字跳网络技术有限公司 图像处理方法、装置、电子设备及存储介质
CN113938618B (zh) * 2021-09-29 2024-04-30 北京达佳互联信息技术有限公司 特效制作方法、装置、电子设备及存储介质
US12212877B2 (en) * 2022-04-26 2025-01-28 Snap Inc. Camera settings and effects shortcuts

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108322802A (zh) * 2017-12-29 2018-07-24 广州市百果园信息技术有限公司 视频图像的贴图处理方法、计算机可读存储介质及终端
CN109462776A (zh) * 2018-11-29 2019-03-12 北京字节跳动网络技术有限公司 一种视频特效添加方法、装置、终端设备及存储介质
CN109615682A (zh) * 2018-12-07 2019-04-12 北京微播视界科技有限公司 动画生成方法、装置、电子设备及计算机可读存储介质
CN111077984A (zh) * 2018-10-19 2020-04-28 北京微播视界科技有限公司 人机交互方法、装置、电子设备及计算机存储介质
CN111240482A (zh) * 2020-01-10 2020-06-05 北京字节跳动网络技术有限公司 一种特效展示方法及装置
CN111857923A (zh) * 2020-07-17 2020-10-30 北京字节跳动网络技术有限公司 特效展示方法、装置、电子设备及计算机可读介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5533165B2 (ja) * 2010-04-09 2014-06-25 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
CN103077701B (zh) * 2012-11-28 2015-10-28 福建星网视易信息系统有限公司 一种音准评定方法、装置和系统
JP2015203933A (ja) * 2014-04-11 2015-11-16 キヤノンイメージングシステムズ株式会社 コンテンツ抽出装置およびコンテンツ抽出方法
US10319410B1 (en) * 2015-12-21 2019-06-11 Amazon Technologies, Inc. Video story assembly
CN107329980B (zh) * 2017-05-31 2022-04-12 福建星网视易信息系统有限公司 一种基于音频的实时联动显示方法及存储设备
CN107770596A (zh) * 2017-09-25 2018-03-06 北京达佳互联信息技术有限公司 一种特效同步方法、装置及移动终端
CN108111909A (zh) * 2017-12-15 2018-06-01 广州市百果园信息技术有限公司 视频图像处理方法及计算机存储介质、终端
CN108810597B (zh) * 2018-06-25 2021-08-17 百度在线网络技术（北京）有限公司 视频特效处理方法及装置
CN112911182B (zh) * 2018-06-28 2022-08-23 腾讯科技（深圳）有限公司 游戏互动方法、装置、终端及存储介质
CN109040615A (zh) * 2018-08-10 2018-12-18 北京微播视界科技有限公司 视频特效添加方法、装置、终端设备及计算机存储介质
CN109120875A (zh) * 2018-09-27 2019-01-01 乐蜜有限公司 视频渲染方法及装置
KR102148006B1 (ko) * 2019-04-30 2020-08-25 주식회사 카카오 동영상에 특수 이펙트를 제공하는 방법 및 장치
CN110769309B (zh) * 2019-11-04 2023-03-31 北京字节跳动网络技术有限公司 用于展示音乐点的方法、装置、电子设备和介质
CN111177610A (zh) * 2020-01-06 2020-05-19 北京字节跳动网络技术有限公司 素材展示方法、装置、电子设备及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108322802A (zh) * 2017-12-29 2018-07-24 广州市百果园信息技术有限公司 视频图像的贴图处理方法、计算机可读存储介质及终端
CN111077984A (zh) * 2018-10-19 2020-04-28 北京微播视界科技有限公司 人机交互方法、装置、电子设备及计算机存储介质
CN109462776A (zh) * 2018-11-29 2019-03-12 北京字节跳动网络技术有限公司 一种视频特效添加方法、装置、终端设备及存储介质
CN109615682A (zh) * 2018-12-07 2019-04-12 北京微播视界科技有限公司 动画生成方法、装置、电子设备及计算机可读存储介质
CN111240482A (zh) * 2020-01-10 2020-06-05 北京字节跳动网络技术有限公司 一种特效展示方法及装置
CN111857923A (zh) * 2020-07-17 2020-10-30 北京字节跳动网络技术有限公司 特效展示方法、装置、电子设备及计算机可读介质

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114531553A (zh) * 2022-02-11 2022-05-24 北京字跳网络技术有限公司 生成特效视频的方法、装置、电子设备及存储介质
CN114531553B (zh) * 2022-02-11 2024-02-09 北京字跳网络技术有限公司 生成特效视频的方法、装置、电子设备及存储介质
US12387406B2 (en) 2022-02-11 2025-08-12 Beijing Zitiao Network Technology Co., Ltd. Method and apparatus for generating effect video, electronic device and storage medium
CN115098000A (zh) * 2022-02-22 2022-09-23 北京字跳网络技术有限公司 图像处理方法、装置、电子设备及存储介质
CN115098000B (zh) * 2022-02-22 2023-10-10 北京字跳网络技术有限公司 图像处理方法、装置、电子设备及存储介质
CN114915819A (zh) * 2022-03-30 2022-08-16 卡莱特云科技股份有限公司 一种基于互动屏的数据交互方法、装置及系统
CN114915819B (zh) * 2022-03-30 2023-09-15 卡莱特云科技股份有限公司 一种基于互动屏的数据交互方法、装置及系统

Also Published As

Publication number Publication date
CN111857923A (zh) 2020-10-30
US12375618B2 (en) 2025-07-29
US20230254436A1 (en) 2023-08-10
CN111857923B (zh) 2022-10-28

Similar Documents

Publication Publication Date Title
WO2022012182A1 (zh) 特效展示方法、装置、电子设备及计算机可读介质
US20210029305A1 (en) Method and apparatus for adding a video special effect, terminal device and storage medium
CN107096221B (zh) 用于提供时移智能同步游戏视频的系统和方法
WO2022121557A1 (zh) 一种直播互动方法、装置、设备及介质
CN113852767B (zh) 视频编辑方法、装置、设备及介质
WO2020107908A1 (zh) 多用户视频特效添加方法、装置、终端设备及存储介质
WO2023000918A1 (zh) 视频互动方法、装置、电子设备和存储介质
US11886484B2 (en) Music playing method and apparatus based on user interaction, and device and storage medium
CN112988027B (zh) 对象控制方法及设备
JP7667312B2 (ja) ビデオのアニメーション追加方法、装置、機器及び媒体
EP4531391A1 (en) Video processing method and apparatus, electronic device, and storage medium
CN108012195B (zh) 一种直播方法、装置及其电子设备
CN111857482B (zh) 一种互动方法、装置、设备和可读介质
JP2025526335A (ja) ビデオ処理方法、装置、電子機器および記憶媒体
WO2022206335A1 (zh) 图像显示方法、装置、设备及介质
CN114895787B (zh) 多人互动方法、装置、电子设备及存储介质
US20250328302A1 (en) Image display method and apparatus, device, and storage medium
WO2023151554A1 (zh) 视频图像处理方法、装置、电子设备及存储介质
WO2023078069A1 (zh) 一种直播互动方法、系统及相关装置
CN116017061A (zh) 媒体内容生成方法、装置、设备、可读存储介质及产品
WO2024169923A1 (zh) 基于虚拟对象的互动方法、装置、设备、存储介质及产品
CN115393766A (zh) 视频处理方法、装置、电子设备和存储介质
CN115607965A (zh) 游戏交互方法、装置、设备及介质
CN116248945A (zh) 视频互动方法、装置、存储介质及电子设备
WO2024007834A1 (zh) 视频播放方法、装置、设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21841723

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21841723

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 18008637

Country of ref document: US