CN113660512B

CN113660512B - Audio processing method, device, server and computer readable storage medium

Info

Publication number: CN113660512B
Application number: CN202110939181.4A
Authority: CN
Inventors: 朱晓东
Original assignee: Guangzhou Boguan Information Technology Co Ltd
Current assignee: Guangzhou Boguan Information Technology Co Ltd
Priority date: 2021-08-16
Filing date: 2021-08-16
Publication date: 2024-03-12
Anticipated expiration: 2041-08-16
Also published as: CN113660512A

Abstract

The embodiment of the application discloses an audio processing method, an audio processing device, a server and a computer readable storage medium; acquiring current user position, target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; based on the anti-disturbing state of the user, adjusting the amplitude of the original audio to obtain the processed audio; and sending the processed audio. In the embodiment of the application, the user anti-interference state is determined based on the current user position, the target historical user position and the user state information, and the audio with different amplitudes is pushed according to the difference of the user anti-interference state, so that the user is prevented from being interfered, and the user viscosity is improved.

Description

Audio processing method, device, server and computer readable storage medium

Technical Field

The present disclosure relates to the field of audio processing technologies, and in particular, to an audio processing method, an apparatus, a server, and a computer readable storage medium.

Background

In recent years, with the rise of the network live broadcast industry, live broadcast content is rich and diversified, more and more users watch online live broadcast videos by using terminals such as mobile phones, and particularly, many users watch live broadcast before sleeping or during work rest time.

However, playing live broadcast before sleeping and during work rest time is easy to disturb user rest, causes user dislike, reduces user viscosity, and even causes the user to uninstall the live broadcast system.

Disclosure of Invention

The embodiment of the application provides an audio processing method, an audio processing device, computer equipment and a storage medium, wherein a user anti-interference state can be determined according to the current user position, the target historical user position and user state information, audio with different amplitudes is pushed according to the difference of the user anti-interference state, the user is prevented from being interfered, and the user viscosity is improved.

The embodiment of the application provides an audio processing method, which is applicable to a server and comprises the following steps: acquiring current user position, target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; based on the anti-disturbing state of the user, adjusting the amplitude of the original audio to obtain the processed audio; and sending the processed audio.

The embodiment of the application also provides an audio processing device, which comprises: the first acquisition module is used for acquiring the current user position, the target historical user position and the user state information; the first processing module is used for determining the current position state of the user according to the current user position and the target historical user position; the second processing module is used for determining a user anti-disturbing state according to the current position state and the user state information; the first execution module is used for adjusting the amplitude of the original audio based on the anti-disturbance state of the user to obtain the processed audio; and the sending module is used for sending the processed audio.

The embodiment of the application also provides a server, which comprises a memory and a plurality of instructions, wherein the memory stores the instructions; the processor loads instructions from the memory to perform steps in any of the audio processing methods provided by the embodiments of the present application.

Embodiments of the present application also provide a computer readable storage medium storing a plurality of instructions adapted to be loaded by a processor to perform steps in any of the audio processing methods provided by the embodiments of the present application.

The embodiment of the application obtains the current user position, the target historical user position and the user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; based on the anti-disturbing state of the user, adjusting the amplitude of the original audio to obtain the processed audio; and sending the processed audio. Therefore, the user anti-interference state is determined based on the current user position, the target historical user position and the user state information, different amplitudes of audio are pushed according to the user anti-interference state difference, the user is prevented from being interfered, and the user viscosity is improved. The method comprises the steps of determining a current position state of a user according to the current position of the user and a target historical user position, enabling the historical position to be added when determining the current position state to be one of judging factors, enabling the user anti-disturbance state to be associated with the position of the user history, enabling the user anti-disturbance state to be more in line with past behavior habits of the user, and improving user viscosity.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1a is a schematic view of a scenario of an audio processing method according to an embodiment of the present application;

fig. 1b is a schematic flow chart of an audio processing method according to an embodiment of the present application;

FIG. 2 is a flow chart of an audio processing method according to another embodiment of the present application;

fig. 3 is a schematic flowchart of determining a user anti-disturbance state when a current position state is a first state according to an embodiment of the present application;

fig. 4 is a schematic flow chart of determining a user anti-disturbance state when the current position state is the second state according to the embodiment of the present application.

Fig. 5 is a flow chart of a method for adjusting an operation mode according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of an audio processing adjustment device according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an operation mode adjustment device according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The embodiment of the application provides an audio processing method, an audio processing device, a server and a storage medium.

The audio processing device may be integrated in an electronic device, which may be a terminal, a server, or other devices. The terminal can be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, a personal computer (Personal Computer, PC) or the like; the server may be a single server or a server cluster composed of a plurality of servers.

In some embodiments, the audio processing apparatus may be integrated into a plurality of electronic devices, for example, the audio processing apparatus may be integrated into a plurality of servers, and the audio processing method of the present application is implemented by the plurality of servers.

In some embodiments, the server may also be implemented in the form of a terminal.

For example, referring to fig. 1a, in some embodiments, an audio processing system is provided that may include a terminal 1000, a server 700, a database 3000, and a network 4000, wherein an audio processing device is integrated in the server 700 and an operation mode adjustment device is integrated in the terminal 1000. Server 700 and terminal 1000 may interact data via network 4000, and server 700 and database 3000 may interact data via network 4000.

Wherein, the server 700 may obtain the current user location, the target historical user location, and the user status information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; based on the anti-disturbing state of the user, adjusting the amplitude of the original audio to obtain the processed audio; and sending the processed audio. Wherein, terminal 1000 can obtain the operation mode adjustment instruction from the server; in response to the operation mode adjustment instruction, the operation mode is adjusted to a do-not-disturb mode. Wherein database 3000 may be used to store user information. Network 4000 is used for data transmission between server 700 and terminal 1000, and between server 700 and database 3000, and network 4000 may be a wireless network or a wired network, such as a Wireless Local Area Network (WLAN), a Local Area Network (LAN), a cellular network, a 2G network, a 3G network, a 4G network, a 5G network, etc.

The following will describe in detail. The numbers of the following examples are not intended to limit the preferred order of the examples.

In this embodiment, an audio processing method is provided, which is applicable to a server, as shown in fig. 1b, and the specific flow of the audio processing method may be as follows:

110. And acquiring the current user position, the target historical user position and the user state information.

The current user position refers to a geographic position of the user at the current moment and is used for representing the current position of the user.

The target historical user location may refer to one or more target locations determined from a historical geographic location used to characterize the user's historical location, where the historical geographic location refers to the geographic location at which the user is located at a historical time that is a time prior to the current time. The target historical user location may also be a geographic location preset by the user, for example, the user inputs a geographic location as the target historical user location, the geographic location input by the user may be a geographic location of a residence, may be a geographic location of a company, and so on.

The user state information is used to characterize the user state and may include one or more of time information, operational behavior information, and interaction information, but is not limited to these three information. The time information refers to the time of the client used by the user at the current moment, the operation behavior information is the operation behavior of the user at the client, the operation behavior information can comprise clicking, volume adjustment through keys, voice input and the like, the interaction information is generated by interaction between the user and the live broadcast anchor, and the interaction information can comprise appreciation, praise, comments and the like.

In some embodiments, the current user location and the user status information may be reported to the server by the client. The target historical user position can be reported to the server after being determined locally by the client, or the target historical geographic position can be determined by the server after the historical geographic position is reported to the server by the client. The current user position, the target historical user position, the user state information and the target historical user anti-disturbance time are acquired without fixed sequence, and can be acquired simultaneously or in random sequence.

In some embodiments, a user may obtain historical geographic locations of multiple historical dates at the same time when viewing live in the history, may also obtain historical geographic locations of the user at one or more times within a historical date, and so on. When determining the historical user position, the position with highest occurrence frequency can be selected from all obtained historical geographic positions to be used as a target historical user position, one or more historical geographic positions which are acquired most recently from the current time can be selected to be used as target historical user positions, the historical geography of the user which is kept unchanged in the preset duration or exceeds the preset duration can be selected to be used as the target historical user position, the historical position of the user which is kept unchanged for the longest time can be selected to be used as the target historical user position, and the like.

120. And determining the current position state of the user according to the current user position and the target historical user position.

The current position state is used for representing the current position of the user, the current position state of the user can be the current position of the user in the target historical user position, the current position state of the user can also be the current position of the user not in the target historical user position, and the method for determining the current position state of the user can be the comparison of whether the current position of the user is the same with the target historical user position.

In some embodiments, a venue identification may be provided for a target historical user location, such as a home or company, etc., so that the current location status of the user may be whether at home or at company, such that the current location status of the user is at home or at company when the current user location is the same as the target user location, and the current location status of the user is not at home or at company when the current user location is different from the target user location.

In some embodiments, the target historical user location may also be a geographic location preset by the user, the user may input a plurality of geographic locations, and set a location identifier for the input geographic locations according to a plurality of application scenarios, for example, the user inputs geographic location 1 and geographic location 2, and marks the location identifiers of geographic location 1 and geographic location 2 as a residence and a company, respectively. Wherein the application scene may include a user watching live broadcast before sleeping, a user watching live broadcast during a work rest time, and so on. And in step 120, the geographic location corresponding to the current application scenario is taken as the target historical user location, e.g., geographic location 1 is taken as the target historical user location when the user is watching live before sleeping.

130. And determining the anti-disturbance state of the user according to the current position state and the user state information.

The user anti-disturbing state can be a disturbing state or a do-not-disturb state. When the user is in an anti-disturbing state, the user is in a state of not allowing disturbing items to be disturbed, wherein the disturbing items can be sound, light and the like; when the user is in a disturbing state, the user is in a state allowing disturbing items to be disturbed; for example, the distracting item is a sound, when the user is in an anti-distracting state, i.e., the user does not allow the sound to be distracted, at which time the user may be left undisturbed by the sound by reducing the loudness of the sound. The different current position states can be combined with part or all of the user state information to determine the user anti-disturbance state. For example, the current location state includes both in-house and out-of-house, and the user state information includes time information, operation behavior information, and interaction information, so that a plurality of determination rules may be established, each rule including a different current location state and a different user state information, respectively, such as combining in-house and time information, or combining out-of-house and time information and operation behavior information, or combining in-house and operation behavior information and interaction information, or combining out-of-house and time information, operation behavior information, and interaction information, and determining that the user tamper state is a tamper-able state or a tamper-free state according to one or more of these rules.

140. And adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain the processed audio.

The original audio is audio sent to the client by the server, and the original audio can comprise the host broadcast sound, the clapping sound, the whistle sound, the background music and other sound effects. The original live video can be separated into original audio and video from which the audio is separated to obtain the original audio, and audio data can be obtained. Adjusting the amplitude of the original audio may be to increase or decrease the amplitude of the original audio. The amplitude of the audio represents the loudness, the larger the amplitude is, the larger the loudness is, the smaller the amplitude is, the smaller the loudness is, and the volume can be adjusted by adjusting the amplitude of the audio. For example, when the user anti-disturbing state is a disturbing state, the original audio amplitude is increased, the live volume is increased, the user can watch live conveniently, and when the user anti-disturbing state is a non-disturbing state, the original audio amplitude is reduced, the live volume is reduced, and the user is prevented from being disturbed.

150. And sending the processed audio.

After the server adjusts the original audio, the processed audio is sent to the client, which may be the audio processed is sent to the client separately, and the audio processed is synthesized locally by the client, or the audio processed and the video from which the audio is separated are combined and sent to the client.

The audio processing scheme provided by the embodiment of the application can be applied to various scenes in which a user watches live broadcast. For example, taking a scenario that a user watches live broadcast before sleeping as an example, the user watches live broadcast through a client before sleeping, a server acquires the current user position, the target historical user position and user state information, determines the current position state of the user according to the current user position and the target historical user position, for example, whether the user is in a residence or not, determines the user anti-disturbing state according to the current position state and the user state information, adjusts the amplitude of original audio based on the user anti-disturbing state, obtains processed audio, and sends the processed audio. The scheme provided by the embodiment of the application can determine the current position state of the user according to the current user position and the target historical user position, so that the historical position is added as one of judging factors when the current position state is determined, the user anti-interference state is associated with the position of the user history, the user anti-interference state is more in line with the past behavior habit of the user, meanwhile, the user anti-interference state is determined according to the current user position, the target historical user position and the user state information, the audio with different amplitudes is pushed according to the difference of the user anti-interference state, the user is prevented from being interfered, and the user viscosity is improved.

The method described in the above embodiments will be described in further detail below.

As shown in fig. 2, a specific flow of an audio processing method is as follows:

210. and acquiring the current user position, the target historical user position and the user state information.

In some embodiments, step 210 may include steps 211 and 212 as follows:

211. the current time is obtained.

212. And when the current time is within a preset second anti-interference time period, acquiring the current user position, the target historical user position and the user state information.

The current time refers to the time of the current moment, and when the server acquires the current time, the current time can be acquired from the client by the server, can be acquired from the local by the server, and the like.

The preset second tamper-proof time period refers to a preset period of time during which the user may enter a do-not-disturb state. For example, when the application scenario is that the user watches live broadcast before sleeping, the user anti-disturbance state may be whether the user falls asleep, and the non-disturbance state is that the user has fallen asleep, and the preset second anti-disturbance time period may be a user sleeping time period; when the application scene is that the user watches live broadcast in the working rest time, the user anti-disturbing state can be whether the user starts working, and the non-disturbing state is that the user starts working, and the preset second anti-disturbing time period can be the working time period of the user. The preset second anti-disturbing time period can be set manually by a user or can be set automatically by a system, and the embodiment of the application is not limited.

In some embodiments, the preset second tamper-proof time period may be a period of time in a day, or may be a period of time spanning a day.

In some embodiments, when the current user position is acquired in the preset second tamper-proof time period, when the client accesses the server in the preset second tamper-proof time period, the current user position is acquired from the access time, and when the client accesses the server before the preset second tamper-proof time period, the current user position is acquired from the second tamper-proof time period.

In some embodiments, the step 212 of obtaining the current user location, the target historical user location, and the user status information may include steps a and B, as follows:

A. acquiring the current user position;

B. and when the current user position is the valid current user position, acquiring the target historical user position and the user state information.

The valid current user position may be a user position at the current time or a current user position that is constant for a period of time, for example, when the current user position is acquired, a continuous identical current user position in the current user position is determined, and the continuous identical current user position is used as the valid current position. When the obtained current position is a valid current user position, the operation of obtaining the target historical user position and the user state information is executed, and the valid current user position is used as the current user position in the subsequent step. All mentioned positions in this embodiment may be IP positioning positions or GPS positions.

In some embodiments, step B may include steps (1.1) - (1.3), as follows:

(1.1) determining successively identical ones of the current user positions;

(1.2) determining the earliest acquisition time and the latest acquisition time corresponding to the same current user position continuously, and calculating a second time difference value between the earliest acquisition time and the latest acquisition time;

and (1.3) when the second time difference value is greater than or equal to a preset second difference value, determining the continuous identical current user position as a valid current user position, and acquiring the target historical user position and the user state information.

The method comprises the steps of taking the position where the user stays for a certain time period as the effective current user position, adding judgment on the time where the user stays at a certain position no matter before sleeping or during working and resting, more matching the behavior of the user at the history disturbance-free moment, improving user experience, increasing user viscosity, and reducing unnecessary judgment process when the user stays at a certain position for a short time.

In some embodiments, the target historical user location is obtained, which may be a preset location for the server or the user, may be determined based on the historical location, may be obtained from the server, or the like.

In some embodiments, the location identifier may be set according to the application scenario for the target historical user location, for example, when the application scenario is that the user views live broadcast before sleeping, the location identifier for the target historical user location may be recorded as residential or non-residential, and when the application scenario is that the user views live broadcast during work rest time, the location identifier for the target historical user location may be recorded as corporate or non-corporate.

In some embodiments, the method for obtaining the target historical user location in step 210 may include steps (2.1) and (2.2), as follows:

(2.1) obtaining candidate historical geographic locations.

In some implementations, the candidate historical geographic location includes at least one of a location at which the user is at a client historical shutdown time, a location at which the user is at a client historical screen-off time, and a valid historical user location.

The position of the user at the time of the client-side historical closing and the position of the user at the time of the client-side historical screen-extinguishing can represent the position of the user at the time of finishing watching the live broadcast, and the time can represent that the user enters or will enter a no-disturbance state. The effective historical user position can be a preset position of a server or a user, or can be determined according to the historical position.

In some embodiments, the valid historical user location is obtained by:

a. acquiring a user position in a historical preset first anti-disturbance time period;

b. determining consecutive identical ones of the acquired user positions;

c. determining earliest acquisition time and latest acquisition time corresponding to the continuous same user position, and calculating a first time difference value between the earliest acquisition time and the latest acquisition time;

d. and when the first time difference value is greater than or equal to a preset first difference value, determining the continuous identical user positions as effective historical user positions.

The historical preset first tamper time period may refer to a preset first tamper time period in a historical date, or may refer to a preset first tamper time period before the current time, that is, a preset first tamper time period in the historical date and a time period in the current date in the preset first tamper time period and before the current time, and so on. The preset first tamper-proof period of the history of preset first tamper-proof periods refers to a preset period of time during which the user may be to enter a do-not-disturb state. For example, when the application scenario is that the user watches live broadcast before sleeping, the user anti-disturbance state may be whether the user falls asleep, and the non-disturbance state is that the user has fallen asleep, and the preset first anti-disturbance time period may be a user sleeping time period; when the application scene is that the user watches live broadcast in the working rest time, the user anti-disturbing state can be whether the user starts working, and the non-disturbing state is that the user starts working, and the preset first anti-disturbing time period can be the working time period of the user.

The method comprises the steps of taking a position where a user stays for a certain time period as an effective historical user position, reducing the amount of collected historical positions on one hand, reducing data processing amount, and on the other hand, increasing judgment on the time where the user stays at a certain position no matter before sleeping or during work rest time, so that behavior habit of the user at a historical disturbance-free moment can be matched, user experience is improved, and user viscosity is increased.

In some embodiments, the preset first tamper-proof time period may be a period of time in a day, or may be a period of time spanning a day.

In some embodiments, obtaining the user location during a historical, preset first tamper-proof time period includes: and acquiring the user positions in a preset first anti-interference time period of all the historical dates.

In some embodiments, obtaining the user location during a historical, preset first tamper-proof time period includes: and acquiring the user positions of the users in the first anti-disturbance time period of all the historical dates, and acquiring the user positions of the users at the historical moment in the preset first anti-disturbance time period of the current historical date.

In some embodiments, when the user position is acquired in the historical first anti-interference time period, the user position may be acquired according to a preset time interval, and a plurality of user positions may be acquired. Among the plurality of acquired user positions, there may or may not be consecutive identical positions, and when there are consecutive identical positions, the subsequent judgment process is executed, and if there are no consecutive identical positions, the subsequent judgment process is not executed.

In some embodiments, the location of the user at the time of the client history closing and the location of the user at the time of the client history screen-off are locations acquired during a first pre-set tamper time period of the history.

In some embodiments, the preset first tamper-proof time period and the preset second tamper-proof time period are the same time period.

(2.2) determining a target historical user location based on the candidate historical geographic location.

In some embodiments, the candidate historical geographic location with the highest frequency of occurrence among all candidate historical geographies is determined as the target historical user location.

220. And determining the current position state of the user according to the current user position and the target historical user position.

In some embodiments, the user views the live broadcast during the work break, marks the target historical user location as either company or non-company, and determines the current location status as either company or non-company based on the current user status.

In some embodiments, the user views the live before sleeping, marks the target historical user location as residential or non-residential, and determines the current location status as residential or non-residential based on the current user status.

In some embodiments, step 220 may include steps 221 and 222, as follows:

221. when the current user position is the same as the target historical user position, determining the current position state of the user as a first state;

222. and when the current user position and the target historical user position are different, determining the current position state of the user as a second state.

When the application scene is that the user watches live broadcast before sleeping, the first state is in the house, and the second state is not in the house. When the application scene is that the user watches live broadcast in working rest time, the first state is in the company, and the second state is out of the company.

In some embodiments, the same location refers to the same latitude and longitude of the location, and different locations refer to different latitude and longitude of the location.

230. And determining the anti-disturbance state of the user according to the current position state and the user state information.

The user anti-interference state is provided with a plurality of judging rules comprising a current position state and user state information, the judging result of each judging rule corresponds to one situation of the user anti-interference state, when the user anti-interference state is determined, the current position state is determined to be in which state, for example, in a house or not, the user anti-interference state is compared with specific information in the user state information in a crossing manner, the current position state and the acquired user state information meet which judging rule, and according to the judging result, the situation of meeting the user anti-interference state is determined, so that the user anti-interference state is determined.

In some embodiments, the user status information in step 230 includes the current time, and step 230 may include steps 231-232 as follows:

231. and obtaining the target historical user anti-disturbing time.

The target historical user anti-interference time refers to the time for one or more users to enter or to enter a non-interference state, which is determined from the historical time, and is used for representing the user anti-interference time, for example, when an application scene is that the user watches live broadcast before sleeping, the target historical user anti-interference time is used for representing the user sleeping time; when the application scene is that the user watches live broadcast in the working rest time, the target historical user anti-disturbing time is used for representing the starting working time of the user.

The target historical user anti-disturbance time can be obtained, wherein the time can be preset for a server or a user, can be determined according to the historical time, can be obtained from the server, and the like. For example, the server may have obtained the target historical user tamper time before step 230, and in step 230, the target historical user tamper time stored in the server is called, for example, the current user position, the target historical user position, the user status information, and the target historical user tamper time are obtained at the same time in step 210, or may be obtained the candidate historical tamper time, and the target historical user tamper time is determined according to the candidate historical tamper time.

In some embodiments, step 231 may include steps (3.1) - (3.2) as follows:

(3.1) acquiring candidate historical anti-disturbance time, wherein the candidate historical anti-disturbance time comprises at least one of client historical closing time and client historical screen-off time;

and (3.2) determining the target historical user anti-disturbance time according to the candidate historical anti-disturbance time.

The candidate historical anti-interference time with the highest occurrence frequency in all the candidate historical anti-interference times can be determined as the target historical user anti-interference time, the median of the candidate historical anti-interference time can be determined as the target historical user anti-interference time, the time with a preset time interval from the median of the candidate historical anti-interference time can be used as the target historical anti-interference time, and the like.

232. And when the current position state is the first state, determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time.

In some embodiments, the current location state is a user tamper-proof state that is determined by determining whether the user has reached a time to fall asleep or a time to work based on the current time and a target historical user tamper-proof time at home or at company.

In some embodiments, the user anti-disturbance state includes a do-not-disturbance state and a disruptable state, and determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time in step 231 may include steps (4.1) to (4.2) as follows:

(4.1) determining the user anti-disturb state as a do-not-disturb state when the current time is not earlier than the target historical user anti-disturb time;

(4.2) determining the user tamper state as a tamper-able state when the current time is earlier than the target historical user tamper time.

When the current position state is at a residence or a company and the current time is not earlier than the target historical user anti-disturbing time, namely the sleep time or the working time is reached, the user is in a non-disturbing state. When the current time is earlier than the target historical user anti-disturbing time, namely the sleep time is not reached or the working time is not reached, the user is in a disturbing state.

In some embodiments, the user status information in steps 231-232 also includes current user operational behavior.

In some embodiments, the user state information in step 230 includes the current time and the current user operation behavior, and step 230 may include steps 233-234 as follows:

233. And obtaining the target historical user anti-disturbing time.

The method for obtaining the anti-disturbance time of the target historical user in step 233 is the same as that in step 231, and will not be described here again.

234. And when the current position state is the second state, determining the user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior.

In some embodiments, when the current location state is not at home or at company, determining whether the user reaches the time to fall asleep or the working time according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior to determine the user anti-disturbance state. The user operation behavior may include at least one of clicking, adjusting volume by a key, inputting voice, and the like, and the preset user operation behavior may be that the user does not have operation behavior in a preset time period, or that the number of times the user performs operation behavior in the preset time period is lower than the number of times, and the like.

In some embodiments, the user anti-disturbance state includes a do-not-disturbance state and a disruptable state, and determining the user anti-disturbance state in step 234 according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior may include steps (5.1) to (5.3) as follows:

(5.1) when the current time is not earlier than the target historical user anti-disturbing time and when the current user operation behavior is the preset user operation behavior, determining the user anti-disturbing state as a non-disturbing state;

(5.2) determining the user anti-tamper state as a tamper-able state when the current time is not earlier than the target historical user anti-tamper time and when the current user operation behavior is not a preset user operation behavior;

(5.3) determining the user tamper state as a tamper-able state when the current time is earlier than the target historical user tamper time.

In some embodiments, the user is in a do not disturb state when the current location state is not at home or at a company, and the current time does not reach the sleep time or the working time, and the user does not operate for a preset period of time or the number of operations is less than a preset number of times. When the current position state is not at home or at company, the current time reaches sleep time or does not reach working time, and the operation time of the user in the preset time period is higher than the preset time, the user is in a bothersome state. When the current location state is not at home or at company, and the current time does not reach sleep time or work time, whether the user has operation behavior or not, the user is in a bothersome state.

In some embodiments, in determining the user tamper state based on the current location state and the user state information, the determination process is not limited to the order of steps in steps 220 and 230.

240. And adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain the processed audio.

The amplitude of the audio influences the loudness of the sound, and when live broadcasting is performed, the live broadcasting room can generate sounds with different sizes and frequencies, and the loudness of the different sounds can be adjusted by adjusting the amplitude, so that the user is prevented from being disturbed.

In some embodiments, adjusting the amplitude of the original audio may be increasing or decreasing the amplitude of the original audio, and increasing or maintaining the amplitude of the original audio when the user is in a distractable state. When the user is in a do not disturb state, the amplitude of the original audio is reduced.

In some embodiments, the amplitude of the original audio may be adjusted to the amplitude of the entire audio, or may be adjusted to the amplitude of a portion of the audio, etc.

In some embodiments, step 240 may include step 241, as follows:

241. when the user anti-disturbing state is a non-disturbing state, the amplitude of the original audio is adjusted to obtain the processed audio.

In some embodiments, adjusting the amplitude of the original audio in step 241 to obtain processed audio may include steps C and D, as follows:

C. and segmenting the audio signal of the original audio to obtain a plurality of audio sub-signals.

D. And when the amplitude of the audio sub-signal is larger than a preset amplitude threshold value, compressing the audio sub-signal exceeding the preset amplitude threshold value to obtain the processed audio.

Wherein the original audio may be segmented by a preset period of time, may be segmented by frames, may be segmented by random time intervals, etc. The preset amplitude threshold may be a value preset by the server or the user.

In some embodiments, after the audio signal is segmented, the maximum amplitude in each segment of the audio sub-signal is obtained, and when the maximum amplitude exceeds a preset amplitude threshold, the segment of the audio sub-signal is compressed.

In some embodiments, when the user anti-disturbance state is a disturbed state, the operation of adjusting the amplitude of the original audio to obtain the processed audio is not performed.

250. And sending the processed audio.

In some embodiments, the server may send the processed individual audio to the client, may combine the processed audio with the video from which the audio was separated, send the combined audio to the client, and so on.

260. And generating an operating mode adjustment instruction.

In some embodiments, step 260 may include the steps of:

and when the user anti-disturbance state is a non-disturbance state, generating a working mode adjustment instruction.

In some embodiments, the operating mode adjustment instructions may include instructions to adjust the client operating mode to a do-not-disturb mode, the do-not-disturb mode including displaying a window for closing the do-not-disturb mode on the client display interface, the user may close the do-not-disturb mode by clicking the window for closing the do-not-disturb mode, and the operating mode adjustment instructions may also include instructions to close the client vibration interface.

In some embodiments, step 260 may be performed after step 250, may be performed before step 250, may be performed concurrently with step 250, and so forth.

270. And sending the working mode adjusting instruction to the client so that the client adjusts the working mode into a non-disturbing mode according to the working mode adjusting instruction.

In some embodiments, the server issues an operation mode adjustment instruction to the client, and when the user anti-disturbance state is a do-not-disturb state, the client adjusts the operation mode to the do-not-disturb mode.

In some embodiments, the do-not-disturb mode may be marked as a sleep-aiding mode when the application scenario is that the user views live broadcast before sleeping, and the do-not-disturb mode may be marked as a work mode when the application scenario is that the user views live broadcast during work rest time.

According to the audio processing scheme provided by the embodiment of the application, the user is in a bothersome state or a non-bothersome state through the current position state and the user information state, and according to the adjustment of the output audio amplitude, the output audio volume is kept in a stable and low-loudness state by compressing the audio sub-signals which are output to the client audio and exceed the preset amplitude threshold value, so that the user is prevented from being bothered, and the user viscosity is improved. Aiming at different application scenes and different user undisturbed states, differentiated audio pushing is realized, and the working mode of the client is regulated, so that the work of the user can be prevented from being disturbed under different situations, and the viscosity of the user is improved.

In this embodiment, a method of the embodiment of the present application will be described in detail taking a scenario in which a user views a live broadcast before sleeping as an example.

As shown in fig. 3 and fig. 4, a specific flow of an audio processing method is as follows:

310. the current time is obtained.

320. And when the current time is within a preset second anti-interference time period, acquiring the current user position, the target historical user position and the user state information. The user state information includes a current time and a current user operation behavior.

The second tamper time period may be set manually by a user, automatically by a system, and so on. For example, in this embodiment, the second tamper time period may be set to 23:00-6:00, and if the obtained current time is 24:00, then the current time is determined to be within the second tamper time period.

The method for obtaining the target historical user position in step 320 may include steps 321 to 322 as follows:

321. and acquiring candidate historical geographic positions in a preset first anti-disturbance time period of the history.

The preset first anti-disturbing time and the preset second anti-disturbing time can be the same or different. In this embodiment, the preset first tamper time and the preset second tamper time may be set to any values according to the sleep rule of the user. For example, the preset first anti-disturbing time and the preset second anti-disturbing time are set to be 23:00-6:00, the place identification of the target historical user position is recorded as a house, and the candidate historical geographic position obtained in the history is marked as a common house position.

The candidate historical geographic positions comprise positions of a client history closing time user, positions of a client history screen-off time user and effective historical user positions, wherein the positions are acquired in a first anti-interference time period of the history.

In a first preset tamper-proof time period of the history, for example, when the client is closed or the client is off in 23:00-6:00, the user is about to sleep or just falls asleep, so that the position of the user at the time of closing the client history and the position of the user at the time of the screen is also marked as a common residence position.

The effective historical user position is obtained by the following method:

b. determining consecutive identical ones of the acquired user positions;

The multiple user positions may be obtained in a preset first anti-interference time period, for example, in this embodiment, a sequence including multiple user positions is obtained according to a preset time interval, where the sequence is as follows: position 1-position 2-position 1-position 3-position 2, position 1-position 1 is determined as the continuous identical user position, the acquisition time of the first position 1 in position 1-position 1 is the earliest acquisition time, and the acquisition time of the last position 1 is the latest acquisition time.

In this embodiment, the preset first difference may be set to any value that satisfies the behavior rule of the user. For example, setting the preset first difference to 30min, when the first time difference from position 1 to position 1 is 35min, position 1 may be determined as a valid historical user position.

322. And determining the highest frequency position in the candidate historical geographic positions as the target historical user position.

And counting all candidate historical geographic positions, sorting according to the times from high to low or from low to high, selecting the position with the highest frequency as the position of the target user, and recording the place identification of the target historical user as a residence. For example, when all candidate historical geographic locations are counted, location 1 appears 5 times, location 2 appears 10 times, location 3 appears 1 time, and after sorting, location 2, location 1, and location 3 are sequentially ordered, and the location identifier of location 2 is recorded as a house.

330. When the current user position is the same as the target historical user position, determining the current position state of the user as a first state, and executing steps 340-350;

in this embodiment, when the current user location and the target historical user location are the same, i.e., the current user location is home, the first state is that the user is within the home.

340. And obtaining the target historical user anti-disturbing time.

Step 340 may include steps E-F, as follows:

E. acquiring candidate historical anti-disturbance time, wherein the candidate historical anti-disturbance time comprises at least one of client historical closing time and client historical screen-off time;

F. and determining the target historical user anti-disturbance time according to the median of the candidate historical anti-disturbance time.

In this embodiment, the median of the candidate historical anti-disturbance time may be determined as the target historical user anti-disturbance time, or a time having a preset time interval from the median of the candidate historical anti-disturbance time may be determined as the target historical anti-disturbance time, or the like. For example, client closing time of the user on different historical dates is obtained, and the client closing time is ordered from small to large: 23:50, 1:00, 1:30, 1:35 and 1:45, taking 1:30 as a median, taking 0:30 of the previous 1:30 hour as a target historical user anti-interference time, and taking the average value of the middle two numbers in the sorting as the median when the acquired acquisition candidate historical anti-interference time is even.

In some embodiments, a time that is a predetermined time interval from a time represented by a median before the median of the candidate historical tamper time is determined as the target historical tamper time. When the client is closed or screen-off, the user is likely to enter a sleep state, and the time to be in sleep of the user can be set as the target historical anti-disturbing time through a preset time interval, so that the situation that the user is disturbed when the user falls asleep due to too late setting of the target historical anti-disturbing time is avoided.

350. And determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time. The user tamper-proof state includes a do-not-disturb state and a tamper-able state.

Step 350 may include steps 351-352 as follows:

351. and when the current time is not earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a non-disturbance state, and executing the steps G-K.

In this embodiment, if the current time is not earlier than the target historical user anti-disturbance time, it may be determined that the current time is within the user sleep time period, it may be determined that the user is about to fall asleep or has fallen asleep, and the user anti-disturbance state may be determined as a do-not-disturbance state.

G. Segmenting an audio signal of original audio to obtain a plurality of audio sub-signals;

H. when the amplitude of the audio sub-signal is larger than a preset amplitude threshold, compressing the audio sub-signal exceeding the preset amplitude threshold to obtain processed audio;

I. transmitting the processed audio;

J. generating a working mode adjustment instruction;

K. and sending the working mode adjusting instruction to the client so that the client adjusts the working mode into a non-disturbing mode according to the working mode adjusting instruction.

If all the output audio signals are processed, the data processing amount is large, which may cause the audio signals to be delayed to be sent to the client, resulting in the blocking of the live broadcast process of the client. The original audio signal is thus segmented in this embodiment and only audio sub-signals exceeding a preset amplitude threshold are processed. For example, the original audio signal is divided into a plurality of audio sub-signals according to each section of 10ms, the maximum amplitude of each section of audio sub-signal is obtained, and when the maximum amplitude of a section of audio sub-signal exceeds 30dB, the amplitude of the section of audio sub-signal is compressed. Only processing the audio sub-signals exceeding the preset amplitude threshold value can also keep the output audio volume in a stable state, and the stable and lower sound is also beneficial to promoting the sleep of the user.

In this embodiment, the operation mode adjustment instruction may include adjusting the client operation mode to a do-not-disturb mode, where the do-not-disturb mode includes displaying a window for closing the do-not-disturb mode on the client display interface, and the user may close the do-not-disturb mode by clicking the window for closing the do-not-disturb mode. A window for closing the do-not-disturb mode may be displayed at the lower right of the client display interface. The operating mode adjustment instructions may also include instructions to shut down the client shock interface. When the user anti-disturbing state is determined to be a non-disturbing state, the server compresses the amplitude of output audio and closes the vibration interface, so that huge sound suddenly generated in a live broadcasting room is avoided, or a live broadcasting platform triggers a vibration effect generated by certain feedback, and the user is prevented from being disturbed. The embodiment is applied to the situation that a user watches live scenes before sleeping, and the non-disturbing mode can be marked as a sleep-aiding mode.

352. And when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a harassable state.

In this embodiment, if the current time is earlier than the target historical user anti-disturbance time, it may be determined that the user does not enter the sleep state, and the user anti-disturbance state may be determined as a disturbed state.

360. When the current user position and the target historical user position are different, determining the current position state of the user as the second state, and executing the steps 370-380.

In this embodiment, when the current user location and the target historical user location are not the same, i.e., the current user location is non-residential, the first state is that the user is not in a residence.

370. And obtaining the target historical user anti-disturbing time. The method for obtaining the anti-disturbance time of the target historical user in step 340 is the same as that in step 340, and is not described here again to avoid repetition.

380. And determining the anti-disturbance state of the user according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior. The user tamper-proof state includes a do-not-disturb state and a tamper-able state.

Step 380 may include steps 381-385 as follows:

381. Determining whether the current time is not earlier than the target historical user tamper time, executing steps 382-384 when the current time is not earlier than the target historical user tamper time, and executing step 385 when the current time is earlier than the target historical user tamper time.

382. And determining whether the current user operation behavior is a preset user operation behavior.

383. And when the current user operation behavior is the preset user operation behavior, determining the user anti-disturbing state as a non-disturbing state, and executing the steps G-K.

384. And when the current user operation behavior is not the preset user operation behavior, determining the user anti-disturbing state as a disturbing state.

385. And when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a harassable state.

When the user is not in the house, the user anti-disturbance state is determined by combining the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior. The user operation behavior may include at least one of clicking, adjusting volume by a key, and voice input. For example, when the target historical user anti-disturbance time is 0:30, the preset user operation behavior is that the user does not have clicking behaviors within 10min, when the current time is 1:00, the user does not have clicking behaviors within 10min, the user anti-disturbance state is determined to be a non-disturbance state, when the current time is 1:00, the user has clicking behaviors within 10min, the user anti-disturbance state is determined to be a harassable state, and when the current time is 24:00, whether the user has clicking behaviors within 10min or not is determined to be a harassable state.

In some embodiments, after the client is closed, the client automatically closes the do-not-disturb mode, and when the client is opened again, the server resumes executing the audio processing method provided in the embodiments of the present application.

In some embodiments, steps G-K are not performed when the user tamper state is determined to be a tamper-able state in steps 350 and 370. The server sends the original audio to the client, and the client keeps the original working mode.

After the current position state and the user information state of the user are obtained, the audio processing scheme provided by the embodiment of the application takes the current position state as a pre-judging condition, determines that the user is in a bothersome state or a non-bothersome state according to the time and the operation behavior in the user information state as judging basis, compresses the amplitude of the audio output to the client when the user is in the non-bothersome state, and adjusts the working mode of the client. Therefore, by adopting the scheme provided by the embodiment of the application, whether the user is currently in the house or not can be judged according to the current and historical user position information, whether the user is in the house or not is determined according to the current interference-free state of the user, whether the audio is the audio of the user differential pushing is determined, the working mode of the client is adjusted, the interference to the sleeping of the user is avoided, and the user viscosity is improved. In addition, when the current position state is determined, the historical geographic position is taken as one of judging factors, and when the user anti-disturbance state is determined, the factor of the historical user anti-disturbance time is added, so that the obtained user anti-disturbance state is fused with the historical behavior factors of the historical position and the historical anti-disturbance time, the obtained user anti-disturbance state is more in line with the past behavior habit of the user, the accuracy of judging the user state is improved, and the user viscosity is improved. When the amplitude of the audio output to the client is compressed, only the audio sub-signal exceeding the preset amplitude threshold is processed, so that the output audio volume can be kept in a stable state, and the stable and low-loudness audio is pushed to the client to create a sleeping environment, so that the user is prevented from being disturbed, and the user viscosity is improved.

In this embodiment, a method for adjusting a working mode is provided, which is applicable to a client, as shown in fig. 5, and the specific flow of the method for adjusting a working mode may be as follows:

410. and acquiring a working mode adjustment instruction.

In some embodiments, the client may receive the operation mode adjustment instruction and the audio sent by the server.

420. In response to the operation mode adjustment instruction, the operation mode is adjusted to a do-not-disturb mode.

In some embodiments, the client receives an operation mode adjustment instruction, and adjusts the client operation mode to a do-not-disturb mode according to the operation mode adjustment instruction.

In the embodiment of the application, the client receives the working mode adjustment instruction, adjusts the working mode into the do-not-disturb mode, avoids the interference of the content played by the client during live broadcasting to the user, and improves the viscosity of the user.

In order to better implement the above method, the embodiment of the application also provides an audio processing device, which can be integrated in an electronic device, and the electronic device can be a terminal, a server or the like. The terminal can be a mobile phone, a tablet personal computer, an intelligent Bluetooth device, a notebook computer, a personal computer and other devices; the server may be a single server or a server cluster composed of a plurality of servers.

For example, in the present embodiment, a method of the embodiment of the present application will be described in detail by taking an example in which an audio processing apparatus is specifically integrated in an electronic device.

For example, as shown in fig. 6, the audio processing apparatus may include a first acquisition module 510, a first processing module 520, a second processing module 530, a first execution module 540, and a transmission module 550. Wherein:

first obtaining module 510:

the method is used for acquiring the current user position, the target historical user position and the user state information.

In some implementations, the first acquisition module 510 may also be configured to:

acquiring the current time;

and when the current time is within a preset second anti-interference time period, acquiring the current user position, the target historical user position and the user state information.

In some embodiments, obtaining the current user location, the target historical user location, and the user status information includes:

acquiring the current user position;

and when the current user position is the valid current user position, acquiring the target historical user position and the user state information.

In some embodiments, when the current user position is a valid current user position, acquiring the target historical user position and the user state information may include the steps of:

Determining the continuous identical current user position in the current user positions;

determining the earliest acquisition time and the latest acquisition time corresponding to the same continuous current user position, and calculating a second time difference value between the earliest acquisition time and the latest acquisition time;

and when the second time difference value is greater than or equal to a preset second difference value, determining the continuous identical current user position as a valid current user position, and acquiring the target historical user position and the user state information.

In some embodiments, the method for obtaining the target historical user position may include steps (6.1) to (6.2), as follows:

(6.1) obtaining a candidate historical geographic location, wherein the candidate historical geographic location comprises at least one of a location of a user at a client historical closing moment, a location of the user at a client historical screen-off moment and a valid historical user location.

In some embodiments, the valid historical user location is obtained by:

b. determining consecutive identical ones of the acquired user positions;

(6.2) determining the target historical user location based on the candidate historical geographic location.

(two) first processing module 520:

the method is used for determining the current position state of the user according to the current user position and the target historical user position.

In some implementations, the first processing module 520 can be configured to:

when the current user position is the same as the target historical user position, determining the current position state of the user as a first state;

and when the current user position and the target historical user position are different, determining the current position state of the user as a second state.

(III) a second processing module 530:

and the anti-disturbance state of the user is determined according to the current position state and the user state information.

In some embodiments, the user status information includes the current time, and the second processing module 530 may be used in steps (7.1) - (7.2) as follows:

and (7.1) acquiring the target historical user anti-disturbance time.

In some embodiments, obtaining the target historical user tamper time may include the steps of:

a. acquiring candidate historical anti-disturbance time, wherein the candidate historical anti-disturbance time comprises at least one of client historical closing time and client historical screen-off time;

b. and determining the anti-disturbance time of the target historical user according to the candidate historical anti-disturbance time.

And (7.2) when the current position state is the first state, determining the user anti-interference state according to the current time and the target historical user anti-interference time.

In some embodiments, the user anti-disturb state includes a do-not-disturb state and a no-disturb state, and determining the user anti-disturb state according to the current time and the target historical user anti-disturb time may include steps (8.1) to (8.2) as follows:

(8.1) determining the user anti-disturb state as a do-not-disturb state when the current time is not earlier than the target historical user anti-disturb time;

(8.2) determining the user tamper state as a tamper-able state when the current time is earlier than the target historical user tamper time.

In some embodiments, the user status information includes the current time and current user operation behavior, and the second processing module 530 may be used in steps (9.1) - (9.2) as follows:

(9.1) acquiring target historical user anti-disturbance time;

the method for obtaining the anti-interference time of the target historical user is the same as the method for obtaining the anti-interference time of the target historical user, and is not described herein.

And (9.2) when the current position state is the second state, determining the user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior.

In some embodiments, the user anti-disturbance state includes a do-not-disturbance state and a disruptable state, and the user anti-disturbance state is determined according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior, and the steps (10.1) to (10.3) may be included as follows:

(10.1) determining the user anti-disturbance state as a do-not-disturbance state when the current time is not earlier than the target historical user anti-disturbance time and when the current user operation behavior is a preset user operation behavior;

(10.2) determining the user anti-tamper state as a tamper-able state when the current time is not earlier than the target historical user anti-tamper time and when the current user operation behavior is not a preset user operation behavior;

(10.3) determining the user tamper state as a tamper-able state when the current time is earlier than the target historical user tamper time.

(fourth) first execution module 540:

the method is used for adjusting the amplitude of the original audio based on the anti-disturbance state of the user to obtain the processed audio.

In some implementations, the first execution module 540 can be configured to:

when the user anti-disturbing state is a non-disturbing state, the amplitude of the original audio is adjusted to obtain the processed audio.

In some embodiments, adjusting the amplitude of the original audio to obtain processed audio may include the steps of:

segmenting an audio signal of original audio to obtain a plurality of audio sub-signals;

and when the amplitude of the audio sub-signal is larger than a preset amplitude threshold value, compressing the audio sub-signal exceeding the preset amplitude threshold value to obtain the processed audio.

And (fifth) a transmitting module 550:

for transmitting the processed audio.

In some implementations, the transmit module 550 may also be configured to:

and generating an operating mode adjustment instruction.

And sending the working mode adjusting instruction to the client so that the client adjusts the working mode into a non-disturbing mode according to the working mode adjusting instruction.

In some embodiments, generating the operating mode adjustment instruction may include the steps of:

In the implementation, each unit may be implemented as an independent entity, or may be implemented as the same entity or several entities in any combination, and the implementation of each unit may be referred to the foregoing method embodiment, which is not described herein again.

As can be seen from the above, the audio processing apparatus of this embodiment may obtain the current user position, the target historical user position, and the user state information, determine the current position state of the user according to the current user position and the target historical user position, determine the user anti-disturbance state according to the current position state and the user state information, adjust the amplitude of the original audio based on the user anti-disturbance state, obtain the processed audio, and send the processed audio. Therefore, different amplitudes of audio are pushed according to the user anti-disturbance state difference, the disturbance to the user is avoided, and the user viscosity is improved.

In order to better implement the above method, the embodiment of the application further provides a working mode adjusting device, and the audio processing device can be specifically integrated in an electronic device, and the electronic device can be a terminal, a server or the like. The terminal can be a mobile phone, a tablet personal computer, an intelligent Bluetooth device, a notebook computer, a personal computer and other devices; the server may be a single server or a server cluster composed of a plurality of servers.

For example, in the present embodiment, the method of the embodiment of the present application will be described in detail by specifically integrating the operation mode adjustment into the electronic device as an example.

For example, as shown in fig. 7, the operation mode adjustment device may include a second acquisition module 610 and a second execution module 620. The second obtaining module 610 is configured to obtain an operation mode adjustment instruction; the second execution module 620 is configured to adjust the operation mode to a do-not-disturb mode in response to the operation mode adjustment instruction.

As can be seen from the above, in the embodiment of the present application, the second acquisition module receives the operation mode adjustment instruction, and the second execution module adjusts the operation mode to the do-not-disturb mode, so that the user is prevented from being disturbed by the content played by the client during live broadcast, and the user viscosity is improved.

Correspondingly, the embodiment of the application also provides a server which can be realized in the form of a terminal, and the terminal can be terminal equipment such as a smart phone, a tablet personal computer, a notebook computer, a touch screen, a game machine, a personal computer, a personal digital assistant (Personal Digital Assistant, PDA) and the like.

As shown in fig. 8, fig. 8 is a schematic structural diagram of a server according to an embodiment of the present application, where the server 700 includes a processor 710 with one or more processing cores, a memory 720 with one or more computer readable storage media, and a computer program stored on the memory 720 and executable on the processor. The processor 710 is electrically connected to the memory 720. It will be appreciated by those skilled in the art that the server architecture shown in the figures is not limiting of the server and may include more or fewer components than shown, or certain components may be combined, or a different arrangement of components.

Processor 710 is a control center of server 700, connects various portions of the entire server 700 using various interfaces and lines, and performs various functions of server 700 and processes data by running or loading software programs and/or modules stored in memory 720, and invoking data stored in memory 720, thereby performing overall monitoring of server 700.

In the embodiment of the present application, the processor 710 in the server 700 loads the instructions corresponding to the processes of one or more application programs into the memory 720 according to the following steps, and the processor 710 executes the application programs stored in the memory 720, so as to implement various functions:

Acquiring current user position, target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; based on the anti-disturbing state of the user, adjusting the amplitude of the original audio to obtain the processed audio; and sending the processed audio.

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

Optionally, as shown in fig. 8, the server 700 further includes: touch display 730, radio frequency circuitry 740, audio circuitry 750, input unit 760, and power supply 770. The processor 710 is electrically connected to the touch display 730, the rf circuit 740, the audio circuit 750, the input unit 760, and the power supply 770, respectively. Those skilled in the art will appreciate that the server architecture shown in fig. 4 is not limiting of the server and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.

The touch display 730 may be used to display a graphical user interface and receive operation instructions generated by a user acting on the graphical user interface. Touch display 730 may include a display panel and a touch panel. Wherein the display panel may be used to display information entered by a user or provided to a user and various graphical user interfaces of the server, which may be composed of graphics, text, icons, video and any combination thereof. Alternatively, the display panel may be configured in the form of a liquid crystal display (LCD, liquid Crystal Display), an Organic Light-Emitting Diode (OLED), or the like. The touch panel may be used to collect touch operations on or near the user (such as operations on or near the touch panel by the user using any suitable object or accessory such as a finger, stylus, etc.), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Alternatively, the touch panel may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 710, and can receive commands from the processor 710 and execute them. The touch panel may overlay the display panel, and upon detection of a touch operation thereon or thereabout, the touch panel is passed to the processor 710 to determine the type of touch event, and the processor 710 then provides a corresponding visual output on the display panel based on the type of touch event. In the embodiment of the present application, the touch panel and the display panel may be integrated into the touch display screen 730 to implement the input and output functions. In some embodiments, however, the touch panel and the touch panel may be implemented as two separate components to perform the input and output functions. I.e., touch display 730 may also implement input functions as part of input unit 760.

The rf circuit 740 may be configured to receive and transmit rf signals to and from a network device or other server via wireless communication.

Audio circuitry 750 may be used to provide an audio interface between a user and a server through speakers, microphones, and so on. The audio circuit 750 may transmit the received electrical signal converted from audio data to a speaker, and convert the electrical signal into a sound signal to be output; on the other hand, the microphone converts the collected sound signals into electrical signals, which are received by the audio circuit 750 and converted into audio data, which are processed by the audio data output processor 710 for transmission to, for example, another server via the radio frequency circuit 740, or which are output to the memory 720 for further processing. Audio circuitry 750 may also include an ear bud jack to provide communication between the peripheral ear bud and the server.

The input unit 760 may be used to receive input numbers, character information, or user characteristic information (e.g., fingerprint, iris, facial information, etc.), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

A power supply 770 is used to power the various components of server 700. Alternatively, the power supply 770 may be logically connected to the processor 710 through a power management system, so that functions of managing charge, discharge, and power consumption are performed through the power management system. The power supply 770 may also include one or more of any components, such as a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown in fig. 8, the server 700 may further include a camera, a sensor, a wireless fidelity module, a bluetooth module, etc., which will not be described herein.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.

As can be seen from the above, the server provided in this embodiment may obtain the current user position, the target historical user position, and the user state information, determine the current position state of the user according to the current user position and the target historical user position, determine the user anti-disturbance state according to the current position state and the user state information, adjust the amplitude of the original audio based on the user anti-disturbance state, obtain the processed audio, and send the processed audio.

Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present application provide a computer readable storage medium having stored therein a plurality of computer programs that can be loaded by a processor to perform steps in any of the audio processing methods provided by the embodiments of the present application. For example, the computer program may perform the steps of:

Wherein the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.

The steps in any audio processing method provided in the embodiments of the present application may be executed by the computer program stored in the storage medium, so that the beneficial effects that any audio processing method provided in the embodiments of the present application may be achieved, which are detailed in the previous embodiments and are not repeated herein.

The foregoing has described in detail the methods, apparatuses, servers and computer readable storage media for audio processing according to the embodiments of the present application, and specific examples have been applied to illustrate the principles and embodiments of the present application, where the foregoing examples are provided to assist in understanding the methods and core ideas of the present application; meanwhile, those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, and the present description should not be construed as limiting the present application in view of the above.

Claims

1. An audio processing method, which is suitable for a server, comprising:

acquiring current user position, target historical user position and user state information; the user state information comprises one or more of current time and current user operation behaviors, and the current user operation behaviors comprise at least one of clicking, adjusting volume through keys and inputting voice;

Determining the current position state of the user according to the current user position and the target historical user position; the current location state is used for representing whether the user is currently located at the target historical user location;

determining a user anti-disturbance state according to the current position state and the user state information; the user anti-disturbing state comprises a do-not-disturb state and a disturbing state;

based on the anti-disturbing state of the user, adjusting the amplitude of the original audio to obtain the processed audio; transmitting the processed audio;

based on the user anti-disturbing state, the method adjusts the amplitude of the original audio to obtain the processed audio, and comprises the following steps:

when the user anti-disturbing state is a non-disturbing state, reducing the amplitude of the original audio to obtain the processed audio;

when the user anti-disturbing state is a disturbing state, increasing the amplitude of the original audio to obtain the processed audio;

the determining the user anti-disturbing state according to the current position state and the user state information comprises the following steps:

acquiring the anti-disturbing time of a target historical user;

when the current position state represents that the user is currently positioned at the target historical user position, determining a user anti-disturbance state according to the current time and the target historical user anti-disturbance time;

When the current position state represents that the user is not currently positioned at the target historical user position, determining a user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior;

the obtaining the target historical user anti-disturbing time comprises the following steps:

acquiring candidate historical anti-disturbance time, wherein the candidate historical anti-disturbance time comprises at least one of client historical closing time and client historical screen-off time;

and determining the anti-disturbance time of the target historical user according to the candidate historical anti-disturbance time.

2. The audio processing method of claim 1, wherein the determining the current location status of the user based on the current user location and the target historical user location comprises:

when the current user position and the target historical user position are the same, determining the current position state of the user as a first state;

3. The audio processing method of claim 1, wherein the determining the user anti-tamper state based on the current time and the target historical user anti-tamper time comprises:

When the current time is not earlier than the target historical user anti-disturbing time, determining a user anti-disturbing state as a non-disturbing state;

and when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a harassable state.

4. The audio processing method as claimed in claim 1, wherein the determining a user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior, and a preset user operation behavior comprises:

when the current time is not earlier than the target historical user anti-disturbing time and when the current user operation behavior is a preset user operation behavior, determining a user anti-disturbing state as a non-disturbing state;

when the current time is not earlier than the target historical user anti-disturbing time and when the current user operation behavior is not a preset user operation behavior, determining a user anti-disturbing state as a disturbing state;

5. The audio processing method as claimed in claim 3 or 4, wherein the adjusting the amplitude of the original audio based on the user anti-disturbance status to obtain the processed audio comprises:

And when the user anti-disturbing state is the non-disturbing state, adjusting the amplitude of the original audio to obtain the processed audio.

6. The audio processing method as claimed in claim 1, wherein the target historical user position acquisition method comprises:

acquiring candidate historical geographic positions;

and determining the target historical user position according to the candidate historical geographic position.

7. The audio processing method of claim 6, wherein the candidate historical geographic location comprises at least one of a location of a user at a client historical closing time, a location of a user at a client historical screen-off time, and a valid historical user location, wherein the valid historical user location is obtained by:

acquiring a user position in a historical preset first anti-disturbance time period;

determining consecutive identical ones of the acquired user positions;

determining the earliest acquisition time and the latest acquisition time corresponding to the continuous identical user positions, and calculating a first time difference value between the earliest acquisition time and the latest acquisition time;

and when the first time difference value is greater than or equal to a preset first difference value, determining the continuous identical user positions as effective historical user positions.

8. The audio processing method of claim 1, wherein the obtaining the current user position, the target historical user position, and the user status information comprises:

acquiring the current time;

9. The audio processing method of claim 1, wherein the obtaining the current user position, the target historical user position, and the user status information comprises:

acquiring the current user position;

and when the current user position is the effective current user position, acquiring the target historical user position and the user state information.

10. The audio processing method of claim 9, wherein the obtaining the target historical user location and the user status information when the current user location is a valid current user location comprises:

determining the earliest acquisition time and the latest acquisition time corresponding to the continuous same current user position, and calculating a second time difference value between the earliest acquisition time and the latest acquisition time;

And when the second time difference value is greater than or equal to a preset second difference value, determining the continuous identical current user position as an effective current user position, and acquiring target historical user position and user state information.

11. The audio processing method of claim 1, wherein said adjusting the amplitude of the original audio to obtain the processed audio comprises:

and when the amplitude of the audio sub-signal is larger than a preset amplitude threshold value, compressing the audio sub-signal exceeding the preset amplitude threshold value to obtain processed audio.

12. The audio processing method of claim 1, further comprising:

generating a working mode adjustment instruction;

13. An audio processing apparatus, comprising:

the first acquisition module is used for acquiring the current user position, the target historical user position and the user state information; the user state information comprises one or more of current time and current user operation behaviors, and the current user operation behaviors comprise at least one of clicking, adjusting volume through keys and inputting voice;

The first processing module is used for determining the current position state of the user according to the current user position and the target historical user position; the current location state is used for representing whether the user is currently located at the target historical user location;

the second processing module is used for determining a user anti-disturbing state according to the current position state and the user state information; the user anti-disturbing state comprises a do-not-disturb state and a disturbing state;

the first execution module is used for adjusting the amplitude of the original audio based on the anti-disturbance state of the user to obtain the processed audio;

the sending module is used for sending the processed audio;

acquiring the anti-disturbing time of a target historical user;

14. A server comprising a processor and a memory, the memory storing a plurality of instructions; the processor loads instructions from the memory to perform the steps in the audio processing method according to any of claims 1-12.

15. A computer readable storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps in the audio processing method of any of claims 1 to 12.