CN108965990B

CN108965990B - Method and device for controlling movement of sound altitude line

Info

Publication number: CN108965990B
Application number: CN201810803617.5A
Authority: CN
Inventors: 张志鹏
Original assignee: Guangzhou Kugou Computer Technology Co Ltd
Current assignee: Guangzhou Kugou Computer Technology Co Ltd
Priority date: 2018-07-20
Filing date: 2018-07-20
Publication date: 2020-11-17
Anticipated expiration: 2038-07-20
Also published as: CN108965990A

Abstract

The application provides a method and a device for controlling movement of a sound altitude line, and belongs to the technical field of computers. The method comprises the following steps: every other preset time, when the playing time of the currently played audio is obtained from a player, determining a playing progress deviation value according to the playing time of the currently stored sound altitude, determining a target calibration value corresponding to the playing progress deviation value range to which the playing progress deviation value belongs according to the corresponding relation between a preset playing progress deviation value range and a calibration value, determining the moving speed of the sound altitude corresponding to the audio in the next preset time according to the target calibration value and the preset time, updating the playing time of the currently stored sound altitude, and controlling the sound pitch line to move based on the moving speed in the next preset time. By the method and the device, jitter in the moving process of the high-speed line can be reduced.

Description

Method and device for controlling movement of sound altitude line

Technical Field

The invention relates to the field of audio and video, in particular to a method and a device for controlling the movement of a sound altitude.

Background

With the development of computer technology and network technology, a user can not only listen to songs by using an audio application program, but also record songs by using the audio application program, the user can select songs sung by himself in a terminal, the terminal is triggered to display a song recording interface, lyrics, high pitch lines and the like are displayed in the song recording interface, and the high pitch lines move along with the recording progress.

In the related art, in the process of recording a song, a terminal may obtain a current playing time from a player every preset time (e.g., 60 ms) by using a timer, and immediately move a pitch line to the playing time when the playing time is obtained, so that the pitch line moves based on the playing time of the player.

In the process of implementing the invention, the inventor finds that the related art has at least the following problems:

because the player provides the broadcast progress for the timer, is the broadcast time point of the accompaniment data that obtains from the buffer, when the speed of obtaining the accompaniment data from the buffer is inhomogeneous, the broadcast progress that provides for the timer is inhomogeneous so, and then leads to the uneven removal of pitch-contour.

Disclosure of Invention

In order to solve the problems in the prior art, embodiments of the present invention provide a method and an apparatus for controlling the movement of a pitch contour. The technical scheme is as follows:

in a first aspect, a method for controlling the movement of a pitch line is provided, the method comprising:

determining a playing progress deviation value according to the playing duration of the currently stored sound altitude line every preset duration when the playing duration of the currently played audio is obtained from the player;

determining a target calibration value corresponding to the playing progress deviation value range to which the playing progress deviation value belongs according to the corresponding relation between the preset playing progress deviation value range and the calibration value;

determining the moving speed of the sound altitude corresponding to the audio within the next preset time length according to the target calibration value and the preset time length, and updating the playing time length of the currently stored sound altitude;

and controlling the pitch line to move based on the moving speed in the next preset time length.

Optionally, the updating the playing time length of the currently stored pitch line includes:

adding the target calibration value, the preset time length and the playing time length of the currently stored sound altitude line to obtain a first numerical value;

replacing the play duration of the currently stored pitch line with the first numerical value.

Optionally, the determining, when the playing duration of the currently played audio is obtained from the player, a playing progress deviation value according to the playing duration of the currently stored audio line includes:

and when the playing time of the currently played audio is acquired from the player, subtracting the currently stored playing time of the pitch line from the acquired playing time to obtain a playing progress deviation value.

Optionally, the determining, according to the target calibration value and the preset time duration, a moving speed of a sound height line corresponding to the audio frequency within a next preset time duration includes:

determining the sum of the target calibration value and the preset duration to obtain a second numerical value;

determining the ratio of the second value to the preset time;

and multiplying the ratio by a preset moving speed to determine the moving speed of the sound height line corresponding to the audio in the next preset time length.

Optionally, the controlling the pitch line to move based on the moving speed in the next preset time period includes:

and controlling the pitch line to move from right to left based on the moving speed within the next preset time length.

In a second aspect, there is provided an apparatus for controlling movement of a pitch contour, the apparatus comprising:

the first determining module is used for determining a playing progress deviation value according to the playing duration of a currently stored sound altitude line every preset duration when the playing duration of the currently played audio is acquired from the player;

the second determining module is used for determining a target calibration value corresponding to the playing progress deviation value range to which the playing progress deviation value belongs according to the corresponding relation between the preset playing progress deviation value range and the calibration value;

a third determining module, configured to determine, according to the target calibration value and the preset duration, a moving speed of a pitch line corresponding to the audio within a next preset duration, and update a playing duration of the currently stored pitch line;

and the moving module is used for controlling the pitch line to move based on the moving speed in the next preset time length.

Optionally, the third determining module is configured to:

Optionally, the first determining module is configured to:

Optionally, the third determining module is configured to:

determining the ratio of the second value to the preset time;

Optionally, the moving module is configured to:

The technical scheme provided by the embodiment of the invention has the beneficial effects that at least:

in the embodiment of the invention, the calibration value is used for controlling the moving speed of the sound altitude line in the next preset time length, so that the moving speed of the sound altitude line is close to a constant speed, and the jitter of the sound altitude line is reduced.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of a pitch line according to an embodiment of the present invention;

fig. 2 is a flowchart of a method for controlling the movement of a sound altitude according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of an apparatus for controlling movement of a pitch line according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The embodiment of the invention provides a method for controlling the movement of a sound altitude, and the execution main body of the method can be a terminal. The terminal can be a mobile phone, a tablet and the like, and can be provided with an audio application program, the terminal can be provided with a processor, a memory, a transceiver, a player and a recorder, the processor can be used for controlling the Processing of the process of the movement of the music wire, the processor can be a Central Processing Unit (CPU) and the like, the memory can be used for storing data required in the process of controlling the movement of the music wire and generated data, the transceiver can be used for receiving the data and sending the data, and can be used for receiving the audio data and the like, the player can be used for playing the audio data, and the recorder can be used for recording the audio data of songs sung by a user. The terminal is also provided with input and output devices such as a screen and the like, wherein the screen can be a touch screen, and the screen can be used for displaying a sound altitude, lyrics and the like. The embodiment of the invention takes the terminal as a mobile phone as an example to carry out detailed description of the scheme, other situations are similar to the scheme, and the embodiment is not described repeatedly.

Before implementation, an application scenario of the embodiment of the present invention is first introduced:

the terminal is provided with an audio application program, a user can operate the terminal to display a main interface of the audio application program, a listening option, a singing option and other options are displayed in the main interface, the terminal can be triggered to display a song playing interface by touching the listening option, the terminal can be triggered to display a song singing interface by touching the singing option, and the song singing interface is displayed with the options of 'I want to sing' and the options of 'searching'. The user can click the option of 'i want to sing' to record a song, the terminal can receive a click instruction of the option and display a song search interface, the user can find a song which the user wants to record through the interface, the K song option is displayed beside the song, the user can click the K song option, and the terminal can display a song recording interface. As shown in fig. 1, a pitch line display area, a lyric display area, a playing time (which may also be referred to as a playing progress or recording time, etc.) display area, and some operation options are displayed in the song recording interface. As the recording duration of the song increases, the pitch line moves from right to left, and the pitch contour line is a horizontal line in the pitch line display area. In addition, a vertical line is displayed in the pitch line display area, and when the pitch line moves to the left of the vertical line, the accompaniment data corresponding to the pitch line is played.

In the related art, a timer in a terminal acquires a play time from a player every preset time, and controls a sound height line to move based on the play time. For example, the preset duration is 60ms, the timer is 60ms, the player obtains a play duration, the play duration obtained at time a is 60ms, at this time, the pitch line suddenly moves by a displacement corresponding to 60ms, the interval is 60ms (time B), the obtained play duration is 120ms, and at this time, the pitch line suddenly moves by a displacement corresponding to 60 ms.

However, in the using process, the playing progress provided by the player to the timer is the playing time point of the accompaniment data acquired from the buffer, and when the speed of acquiring the accompaniment data from the buffer is not uniform, the playing progress provided to the timer is also not uniform. For example, the preset duration is 60ms, the timer is 60ms, the player obtains a play duration, the play duration obtained at time a is 0ms, the interval of 60msB is 10ms, which is equivalent to a shift of 10ms in 60ms, and the interval of 60msC is equivalent to a play duration of 110ms, which is equivalent to a shift of 100ms in 60 ms. Theoretically, after 60ms (i.e., time B), the obtained playback time should be 0ms +60 ms-60 ms, and every other 60ms (i.e., time C), the obtained playback time should be 0ms +60ms +60 ms-120 ms. Thus, in the first 60ms, a displacement corresponding to 10ms (10ms-0ms) is actually moved, and in the second 60ms, a displacement corresponding to 100ms (110ms-10ms) is actually moved. This results in uneven pitch line movement, which is more jittery. The solution of the embodiment of the present invention is provided based on this.

As shown in fig. 2, the execution flow of the method for controlling the movement of the pitch contour may be as follows:

step 201, every preset time length, when the playing time length of the currently played audio is obtained from the player, determining a playing progress deviation value according to the playing time length of the currently stored audio line.

The preset time duration may be preset and stored in the terminal, and is typically 60 ms. The audio refers to the audio corresponding to the song selected by the user (the audio contains the original song) or the accompaniment audio (the accompaniment audio does not contain the original song). The playing time reflects the playing progress, for example, when the current playing time reaches 1500ms, the playing time is 1500 ms.

In an implementation, after the user selects a song to sing, the terminal may play audio (the audio includes audio corresponding to the song selected by the user (the audio includes original singing) or accompaniment audio (the accompaniment audio does not include original singing)). When the audio starts to be played, the terminal starts a timer, the timer sends a playing time length acquisition request to the player every other preset time length, and the player can return the playing time length of the currently played audio to the timer. And then the terminal can obtain the playing time length of the currently stored pitch line, and the playing time length of the currently stored pitch line and the playing time length obtained from the timer are used for determining the playing progress deviation value.

Optionally, the play progress deviation value may be determined as follows:

In implementation, the terminal may subtract the currently stored playing time of the pitch line from the obtained playing time to obtain a playing progress deviation value. And if the deviation value of the playing progress is less than zero, determining that the playing progress of the pitch line is slower than that of the audio played by the player.

Step 202, according to the corresponding relationship between the preset playing progress deviation value range and the calibration value, determining a target calibration value corresponding to the playing progress deviation value range to which the playing progress deviation value belongs.

The corresponding relationship between the playing progress deviation value range and the calibration value can be preset and stored in the terminal, and generally, the larger the absolute value of the endpoint value of the playing progress deviation value range is, the larger the absolute value of the calibration value is.

In implementation, the terminal may obtain a corresponding relationship between a pre-stored playing progress deviation value range and a calibration value, and then determine a playing progress deviation value range to which the playing progress deviation value belongs by using the corresponding relationship, and in the corresponding relationship, determine a target calibration value corresponding to the playing progress deviation value range.

It should be noted that, in the above corresponding relationship, if the endpoint value of a certain deviation range of the playing progress is a negative number, the corresponding calibration value is a positive number, and if the endpoint value of a certain deviation range of the playing progress is a positive number, the corresponding calibration value is a negative number, as shown in table one.

Watch 1

Deviation value range of playing progress	Calibration value
		30～35ms	-10ms
25～30ms	-8ms
		20～25ms	-6ms
…	…
		-35～-30ms	10ms

It should be noted that the first table is only an exemplary corresponding relationship, and can be adjusted in the subsequent use process.

Step 203, determining the moving speed of the pitch line corresponding to the audio frequency in the next preset time length according to the target calibration value and the preset time length, and updating the playing time length of the currently stored pitch line.

In implementation, after the terminal determines the target calibration value, the terminal may determine the moving speed of the pitch line corresponding to the played audio within the next preset time period by using the target calibration value and the preset time period, and then update the playing time period of the currently stored pitch line by using the target calibration value and the preset time period.

Optionally, the method for updating the stored playing time length may be as follows:

adding the target calibration value, the preset time length and the playing time length of the currently stored sound altitude line to obtain a first numerical value; the playing time length of the currently stored tone line is replaced with the first numerical value.

In implementation, the terminal may add the target calibration value, the preset time length, and the currently stored playing time length of the sound altitude line to obtain a first value, then store the first value as the playing time length corresponding to the sound altitude line, and delete the previously stored playing time length of the sound altitude line. Thus, the playback time length of one sound line is stored every time.

Alternatively, the moving speed of the pitch line may be determined as follows:

determining the sum of the target calibration value and a preset duration to obtain a second numerical value; determining the ratio of the second value to a preset time length; and multiplying the ratio by the preset moving speed to determine the moving speed of the sound line corresponding to the audio in the next preset time length.

The preset moving speed may be stored in the terminal in advance, and is generally obtained by dividing the width of the screen by 3.6 s. A calculation formula of the moving speed is set in advance in the audio application program, and the terminal can acquire the width of a screen and divide the width by 3.6 seconds to obtain the preset moving speed along with the installation of the audio application program on the terminal.

In implementation, the terminal may calculate a sum of the target calibration value and the preset time length to obtain a second value, and then divide the second value by the preset time length to obtain a ratio of the second value to the preset time length. And multiplying the ratio by the preset moving speed to obtain the moving speed of the sound height line corresponding to the audio within the next preset time length.

Or, the terminal may multiply the preset time length by the preset moving speed to obtain a displacement moving within the preset time length, and then divide the displacement by the second value, which is the moving speed of the sound contour line corresponding to the audio frequency.

In this way, the moving speed of the tone line in the next preset duration can be controlled based on the play duration acquired from the player each time.

And 204, controlling the sound altitude line to move based on the moving speed in the next preset time length.

In implementation, after the terminal determines the moving speed, the moving speed is used when the sound altitude moves within a next preset time period.

Optionally, the pitch line may be controlled to move in the following manner:

and controlling the sound altitude line to move from right to left based on the moving speed in the next preset time length.

In implementation, after the terminal determines the moving speed, the moving speed is used when the pitch line moves from right to left in the next preset time period.

In addition, in order to better understand the embodiment of the present invention, an example is further provided in the embodiment of the present invention:

the preset time is 60ms, when the audio just starts to play, the playing time of the currently stored pitch line is 60ms, the playing time of the pitch line is 0ms, the playing time of the audio is 0ms, the playback time period obtained from the player at 60ms is 30ms, the current playback time period of the pitch line is 60ms, thus, the moving speed of the sound altitude line is faster than that of the player playing audio, the playing progress deviation value is 30ms, the range of the playing progress deviation value is 30 ms-35 ms, the corresponding calibration value is-5 ms, the calibration value is added to the preset time length to obtain 55ms, then in the next 60ms, the moving speed of the sound altitude is determined based on the moving displacement (55ms × preset moving speed) corresponding to 55ms, the moving speed of the sound altitude is equal to 55ms × preset moving speed/preset time length, and the current stored playing time length is updated to 60+55ms × 115 ms. And when the playing time is 120ms, the timer acquires the playing time from the player again, the acquired playing time is 110ms or slower than the playing time of the sound altitude, the deviation value range of the playing progress is 0-5 ms, the corresponding calibration value is-1 ms, the calibration value is added with the preset time to obtain 59ms, then in the next 60ms, the moving speed of the sound altitude is determined based on the moving displacement (59 ms) corresponding to 59ms, the moving speed of the sound altitude is equal to 59ms, the preset moving speed/preset time, and the current stored playing time is updated to 115+59ms, 174 ms. Thus, the pitch line can be shifted nearly uniformly since the shift displacement is close to 60 x the preset speed for each next preset duration.

Based on the same technical concept, an embodiment of the present invention further provides an apparatus for controlling movement of a pitch line, as shown in fig. 3, the apparatus including:

a first determining module 310, configured to determine, every preset time interval, a playing progress deviation value according to a playing time of a currently stored audio line when the playing time of a currently played audio is obtained from a player;

a second determining module 320, configured to determine, according to a corresponding relationship between a preset playing progress deviation value range and a calibration value, a target calibration value corresponding to the playing progress deviation value range to which the playing progress deviation value belongs;

a third determining module 330, configured to determine, according to the target calibration value and the preset time duration, a moving speed of a pitch line corresponding to the audio within a next preset time duration, and update a playing time duration of the currently stored pitch line;

and a moving module 340, configured to control the pitch line to move based on the moving speed in the next preset time period.

Optionally, the third determining module 330 is configured to:

Optionally, the first determining module 310 is configured to:

Optionally, the third determining module 330 is configured to:

determining the ratio of the second value to the preset time;

Optionally, the moving module 340 is configured to:

In the embodiments of the present invention, it should be noted that: in the embodiment, when the control sound height line moves, the division of the function modules is only exemplified, and in practical applications, the function distribution can be completed by different function modules according to needs, that is, the internal structure of the device is divided into different function modules to complete all or part of the functions described above. In addition, the device for controlling the movement of the sound altitude line and the method for controlling the movement of the sound altitude line provided by the above embodiments belong to the same concept, and the specific implementation process thereof is described in detail in the method embodiments and will not be described herein again.

Fig. 4 shows a block diagram of a terminal 400 according to an exemplary embodiment of the present invention. The terminal 400 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. The terminal 400 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, etc.

Generally, the terminal 400 includes: a processor 401 and a memory 402.

Processor 401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 401 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 401 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 401 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed by the display screen. In some embodiments, the processor 401 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.

Memory 402 may include one or more computer-readable storage media, which may be non-transitory. Memory 402 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 402 is used to store at least one instruction for execution by processor 401 to implement the method of controlling the movement of a pitch line provided by the method embodiments herein.

In some embodiments, the terminal 400 may further optionally include: a peripheral interface 403 and at least one peripheral. The processor 401, memory 402 and peripheral interface 403 may be connected by bus or signal lines. Each peripheral may be connected to the peripheral interface 403 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 404, touch screen display 405, camera 406, audio circuitry 407, positioning components 408, and power supply 409.

The peripheral interface 403 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 401 and the memory 402. In some embodiments, processor 401, memory 402, and peripheral interface 403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 401, the memory 402 and the peripheral interface 403 may be implemented on a separate chip or circuit board, which is not limited by this embodiment.

The Radio Frequency circuit 404 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 404 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 404 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 404 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 404 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 405 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 405 is a touch display screen, the display screen 405 also has the ability to capture touch signals on or over the surface of the display screen 405. The touch signal may be input to the processor 401 as a control signal for processing. At this point, the display screen 405 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display screen 405 may be one, providing the front panel of the terminal 400; in other embodiments, the display screen 405 may be at least two, respectively disposed on different surfaces of the terminal 400 or in a folded design; in still other embodiments, the display 405 may be a flexible display disposed on a curved surface or a folded surface of the terminal 400. Even further, the display screen 405 may be arranged in a non-rectangular irregular pattern, i.e. a shaped screen. The Display screen 405 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.

The camera assembly 406 is used to capture images or video. Optionally, camera assembly 406 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 406 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuit 407 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 401 for processing, or inputting the electric signals to the radio frequency circuit 404 for realizing voice communication. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be provided at different portions of the terminal 400. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 401 or the radio frequency circuit 404 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 407 may also include a headphone jack.

The positioning component 408 is used to locate the current geographic position of the terminal 400 for navigation or LBS (Location Based Service). The Positioning component 408 may be a Positioning component based on the GPS (Global Positioning System) of the united states, the beidou System of china, the graves System of russia, or the galileo System of the european union.

The power supply 409 is used to supply power to the various components in the terminal 400. The power source 409 may be alternating current, direct current, disposable or rechargeable. When power source 409 comprises a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the terminal 400 also includes one or more sensors 410. The one or more sensors 410 include, but are not limited to: acceleration sensor 411, gyro sensor 412, pressure sensor 413, fingerprint sensor 414, optical sensor 415, and proximity sensor 416.

The acceleration sensor 411 may detect the magnitude of acceleration in three coordinate axes of the coordinate system established with the terminal 400. For example, the acceleration sensor 411 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 401 may control the touch display screen 405 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 411. The acceleration sensor 411 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 412 may detect a body direction and a rotation angle of the terminal 400, and the gyro sensor 412 may cooperate with the acceleration sensor 411 to acquire a 3D motion of the terminal 400 by the user. From the data collected by the gyro sensor 412, the processor 401 may implement the following functions: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

The pressure sensor 413 may be disposed on a side bezel of the terminal 400 and/or a lower layer of the touch display screen 405. When the pressure sensor 413 is disposed on the side frame of the terminal 400, a user's holding signal to the terminal 400 can be detected, and the processor 401 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 413. When the pressure sensor 413 is disposed at the lower layer of the touch display screen 405, the processor 401 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 405. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 414 is used for collecting a fingerprint of the user, and the processor 401 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 414, or the fingerprint sensor 414 identifies the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, processor 401 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 414 may be disposed on the front, back, or side of the terminal 400. When a physical key or vendor Logo is provided on the terminal 400, the fingerprint sensor 414 may be integrated with the physical key or vendor Logo.

The optical sensor 415 is used to collect the ambient light intensity. In one embodiment, the processor 401 may control the display brightness of the touch display screen 405 based on the ambient light intensity collected by the optical sensor 415. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 405 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 405 is turned down. In another embodiment, the processor 401 may also dynamically adjust the shooting parameters of the camera assembly 406 according to the ambient light intensity collected by the optical sensor 415.

A proximity sensor 416, also known as a distance sensor, is typically disposed on the front panel of the terminal 400. The proximity sensor 416 is used to collect the distance between the user and the front surface of the terminal 400. In one embodiment, when the proximity sensor 416 detects that the distance between the user and the front surface of the terminal 400 gradually decreases, the processor 401 controls the touch display screen 405 to switch from the bright screen state to the dark screen state; when the proximity sensor 416 detects that the distance between the user and the front surface of the terminal 400 gradually becomes larger, the processor 401 controls the touch display screen 405 to switch from the breath screen state to the bright screen state.

Those skilled in the art will appreciate that the configuration shown in fig. 4 is not intended to be limiting of terminal 400 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. A method of controlling the movement of a musical note line, for use in an audio application, the method comprising:

displaying a song recording interface comprising a pitch display area based on the trigger operation of the K song option;

every other preset time length, when the playing time length of the currently played audio is obtained from a player, determining a playing progress deviation value according to the playing time length of a currently stored pitch line, wherein the pitch line is displayed in the pitch display area;

2. The method of claim 1, wherein the updating the play duration of the currently stored tone line comprises:

3. The method according to claim 1 or 2, wherein the determining a playing progress deviation value according to the playing time length of the currently stored sound height line when the playing time length of the currently played audio is acquired from the player comprises:

4. The method according to claim 1 or 2, wherein the determining the moving speed of the corresponding sound line of the audio frequency in the next preset time period according to the target calibration value and the preset time period comprises:

determining the ratio of the second value to the preset time;

5. The method of claim 1, wherein the controlling the pitch line to move based on the moving speed in the next preset time period comprises:

6. An apparatus for controlling movement of a pitch line, applied to an audio application, and displaying a song recording interface including a pitch display area based on a trigger operation of a karaoke option, the apparatus comprising:

the first determining module is used for determining a playing progress deviation value according to the playing time length of a currently stored pitch line every preset time length when the playing time length of the currently played audio is acquired from a player, wherein the pitch line is displayed in the pitch display area;

7. The apparatus of claim 6, wherein the third determining module is configured to:

8. The apparatus of claim 6 or 7, wherein the first determining module is configured to:

9. The apparatus of claim 6 or 7, wherein the third determining module is configured to:

determining the ratio of the second value to the preset time;

10. The apparatus of claim 6, wherein the moving module is configured to: