WO2015074548A1

WO2015074548A1 - Method for sound control in browser, and browser

Info

Publication number: WO2015074548A1
Application number: PCT/CN2014/091469
Authority: WO
Inventors: 耿兆贺; 熊鹏; 任寰
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2012-12-03
Filing date: 2014-11-18
Publication date: 2015-05-28
Also published as: CN103034695A; CN103646046A

Abstract

Disclosed are a method for sound control in a browser, and a browser. The method for sound control in a browser provided in an embodiment of the present invention comprises: creating a webpage label in a browser, and creating a label process independent of a master process of the browser for the webpage label; establishing a mapping relationship between the webpage label and the label process and storing the mapping relationship into the master process, so that a sound in the webpage label is controlled in a display interface of the master process; sending a sound control instruction input through the display interface of the master process to the label process; and controlling the sound in the webpage label through an audio application interface of the webpage label according to the sound control instruction.

Description

Method and browser for sound control in a browser

Technical field

The present invention relates to the field of computer network technologies, and in particular, to a method and a browser for performing sound control in a browser.

Background technique

A web browser is an application that displays files within a web server or file system and lets users interact with them. With the development of technology, the content presented by web pages is more and more abundant. In addition to simple text information, web pages can also present information with sound, such as music files, multimedia files, and so on.

At present, the sound control of the webpage in the browser is realized by the webpage mute button in the browser, and the button is added in the status bar of the browser, and the sound data outputted by the browser to the sound card is shielded, thereby realizing All browser sound data is not played.

However, the mute function of the existing browser webpage is to turn off the sound of all the browser tabs, that is, all the sound output in the webpage process is closed, so that the user can not obtain any sound data; or the sound of all the tabs It does not turn off. If there is audio data in multiple tags that need to be played, the sounds will be mixed together, affecting the original sound playback in each tag.

Summary of the invention

In view of the above problems, the present invention has been made in order to provide a method and corresponding browser for performing sound control in a browser that overcomes the above problems or at least partially solves or alleviates the above problems.

According to an aspect of the present invention, a method for sound control in a browser is provided, comprising: creating a webpage tag in a browser, and creating a tag process independent of a main process of the browser for the webpage tag; creating a webpage The mapping relationship between the label and the label process, and the mapping relationship is saved in the main process to control the sound in the webpage label in the display interface of the main process; and the sound control instruction input through the display interface of the main process is sent to the label The process controls the sound in the webpage tag through the audio application interface in the webpage tag according to the sound control command.

According to another aspect of the present invention, a browser is provided, comprising:

Creating a unit adapted to create a web page tag in the browser and create a tag process for the web page tag that is separate from the main process of the browser;

The mapping unit is adapted to establish a mapping relationship between the webpage label and the labeling process, and save the mapping relationship in the main process to control the sound in the webpage label in the display interface of the main process;

a sending unit, configured to send a sound control instruction input through a display interface of the main process to the label process;

The control unit is adapted to control the sound in the webpage label through the audio application interface in the webpage tag according to the sound control instruction.

The beneficial effects of the invention are:

The embodiment of the present invention separates different webpage label processes by establishing a technical process of a label process independent of the main process of the browser, thereby avoiding the influence of the sound control of one webpage on the sound state of other webpages, and ensuring that each The sounds in the webpages are individually controlled; and the embodiment of the present invention provides a specific implementation manner of sound control in a single webpage by receiving sound control commands through the display interface of the main process and calling the technical means of the corresponding audio application interface. The technical solution can separately control the sound of each browser tab, thereby improving the performance and user experience of the browser.

According to still another aspect of the present invention, a computer program is provided, comprising computer readable code, when the computer readable code is run on a computing device, causing the computing device to perform the browsing described in any of the above The method of sound control in the device.

According to still another aspect of the present invention, a computer readable medium is provided, wherein the computer program described above is stored.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below.

DRAWINGS

Various other advantages and benefits will become apparent to those skilled in the art from a The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

1 is a schematic structural diagram of an apparatus for performing sound control in a browser according to an embodiment of the present invention;

2 is a flowchart showing a process of a method for performing sound control in a browser according to an embodiment of the present invention;

3 is a flow chart showing specific steps of a process of finding a page where a web page tag is located, in accordance with one embodiment of the present invention;

4 is a flowchart showing a process of controlling sound in a first web page tag according to an embodiment of the present invention;

FIG. 5 is a flow chart showing the opening of a webpage according to an embodiment of the present invention; FIG.

6 is a flowchart showing a process of a user performing a mute operation on a webpage by clicking a control icon according to an embodiment of the present invention;

FIG. 7 is a diagram showing information for displaying a plurality of web page tags in a floating window according to an embodiment of the present invention; FIG.

FIG. 8 is a diagram showing control information for displaying a sound file in a floating window according to an embodiment of the present invention; FIG.

FIG. 9 is a flow chart showing a method for performing sound control in a browser according to still another embodiment of the present invention; FIG.

FIG. 10 is a flow chart showing a method for performing sound control in a browser according to still another embodiment of the present invention; FIG.

FIG. 11 is a schematic structural diagram of a browser according to still another embodiment of the present invention; FIG.

Figure 12 is a schematic illustration of a computing device for performing a method of sound control in a browser in accordance with the present invention Prepared block diagram;

Fig. 13 schematically shows a storage unit for holding or carrying program code for implementing a method of sound control in a browser according to the present invention.

detailed description

The invention is further described below in conjunction with the drawings and specific embodiments.

Embodiments of the present invention provide an apparatus for performing sound control in a browser. FIG. 1 is a block diagram showing the structure of an apparatus for performing sound control in a browser according to an embodiment of the present invention.

Referring to FIG. 1, the apparatus for performing sound control in the browser includes at least an establishing module 110, a searching module 120, and a control module 130. The architecture and functions of each of the above modules are described in detail.

First, the building module 110 is introduced. The browser can open multiple webpages at the same time, each webpage will create a webpage label accordingly, and in the background, each webpage will have a corresponding process. Therefore, the creation module 110 can be used to create a webpage label and establish a mapping relationship between the webpage label and the page process where the webpage label is located.

Then, the lookup module 120 is introduced. Referring to FIG. 1, the lookup module 120 is coupled to the setup module 110. When the user opens a plurality of webpage tabs at the same time, if the sound of one of the webpage tabs is selected for control, an instruction to control the sound in the webpage tab is issued. Here, in order to distinguish the webpage label selected by the user and to be controlled by the sound, it may be referred to as a first webpage label. The first here is only used as a distinguishing identifier, and has no meaning to the webpage label and the corresponding webpage itself. When receiving an instruction input by the user to control the sound in the first webpage label, the searching module 120 may find the page process where the first webpage label is located according to the mapping relationship between the established webpage label and the page process.

Finally, the control module 130 is introduced. Referring to FIG. 1, control module 130 is coupled to lookup module 120. After the search module 120 finds the page process of the first webpage tag, the control module 130 controls the sound in the first webpage tag by using the found page process of the first webpage tag.

In the embodiment of the present invention, when there is at least one webpage label, the sound of the webpage label may be controlled by using the page process of each webpage label separately, instead of all the webpage labels by a unified mute function or function. The sound in the control is unified. It can be seen that the embodiment of the present invention can separately control the sound in each webpage label, improve the accuracy of the webpage sound control, and improve the user's feeling experience.

The above mentioned building module 110 is capable of establishing a mapping relationship between a web page tag and a page process where the web page tag is located. There are various mapping methods used in the mapping relationship, for example, random mapping, digital mapping, sort mapping, etc., and the mapping elements used may also be various, such as keywords, weights, and the like. In this example, a preferred mapping relationship is provided, that is, a mapping relationship between a webpage label identifier (ID) and a page process ID where the webpage label is located is established. The establishing module 110 can establish a mapping relationship between the webpage label and the page process where the webpage label is located when the webpage process in which the webpage label is located is created.

If the mapping relationship is a mapping relationship between the webpage tag ID and the page process ID, the user may carry the webpage tag ID in the instruction to control the voice. Correspondingly, the search module 120 receives the sound control instruction input by the user for the first webpage label in the first webpage label, where the sound control instruction includes the first webpage label Sign the ID. Then, the search module 120 searches the mapping relationship between the established webpage label and the page process according to the first webpage label ID, obtains the ID of the page process corresponding to the first webpage label, and notifies the ID of the page process to the ID of the page process. Control module 130.

After learning the ID of the page process, the control module 130 searches for the corresponding page process according to the ID of the page process corresponding to the first webpage tag. Further, the control module 130 controls the sound in the first webpage tag through the sound API (Application Program Interface) function of the operating system in the page process.

Since the browser includes a plurality of webpage tags, and the control of the sounds in the webpage tags, if each webpage tag is opened and then controlled, time is wasted, and the processing result is not ideal. Therefore, the device for performing sound control in the browser may further set a window generating module 140 coupled to the searching module 120 for generating a floating window. Specifically, in this example, the window generating module 140 may generate a floating window prompting for sound control at a label header of the first webpage label or a webpage element of the first webpage that generates sound, wherein the floating window is loaded with An entry to receive an instruction to control the sound in the first web page tag. Further, the user can issue an instruction to control the sound in the first webpage tab at the floating window, and the window generation module 140 receives the corresponding instruction and transfers it to the lookup module 120 for subsequent processing. Floating windows have certain advantages over control icons set on the page. Floating windows can float on a specific page or float on all pages, even if the first page that is open is not required for sound control. The label can also control the sound in the first webpage label, making the control of the sound more convenient and quick.

The foregoing has always mentioned the control of the sound in the first webpage label. Here, it should be noted that the sound in the first webpage label includes a plurality of sounds, such as the sound generated by the video plug-in in the webpage, and the sound generated by the audio plug-in, for example. , or both, and so on. Multiple plugins can sound at the same time in a web page tag.

When the control module 130 controls the sound in the first webpage tab, at least one of the following operational controls may be performed:

Turn off the sound in the first webpage tab;

Open the sound in the first webpage tab;

Adjust the size of the sound in the first web page tab.

The above is just an enumeration of the basic control of sound. If the sound has other attributes, such as two-channel, Chinese and English switching, you can also select the left or right channel for sound playback, or select the language of the sound, etc., depending on the situation.

Further, since the browser mentioned in the embodiment of the present invention can simultaneously open a plurality of webpage tags, when some of the webpage tags have sound data at the same time, the prompting module 150 can be set in the device for performing sound control in the browser, and The establishing module 110 is coupled to provide a prompt for the webpage label in which the sound data exists after each webpage label and the corresponding process are established. It should be noted that there may be multiple prompting manners herein, and the webpage label with the sound data may be identified. For example, the webpage label with the sound data may be prompted by the highlighting of the label item, or The webpage label with the sound data is prompted by the background color of the label item, and the webpage label with the sound data can be prompted by using the title font size, color, and the like of the label item, and the like. Since the highlighting effect is more obvious, it is preferable to prompt by means of highlighting the label item.

Since there are more than one web page display, and there may be more than one file capable of providing sound data in each web page, in order to facilitate the user to select a file that generates sound and control in time, it may be considered to set the display module in the device for sound control in the browser. 160. Referring to FIG. 1, display module 160 is coupled to window generation module 140 and lookup module 120, respectively. When a plurality of webpage tags have sound data at the same time, the display module 160 may display information of the sound data in the plurality of webpage tags in a floating window. Of course, if there is a plurality of sound data in the first webpage label, the display module 160 may also display information of the plurality of sound data that the first webpage label exists at the same time in a floating window. The information of multiple sound data is presented in a floating window, and the information is centrally managed, which is convenient for the user to select according to needs and improve the efficiency of sound control.

To facilitate user selection, the display module 160 can display any information of the sound file or the sound data on the floating window, and generally preferably displays the following information:

The title of the web page label;

The type of sound data in the web page;

The name of the sound data in the web page.

If the sound data still has other information that can play a certain role in the user's selection, other information such as the remaining playing time of the sound data can also be displayed.

The advantages of using the floating window for information display have also been explained in the previous section, and need not be described here. Correspondingly, the control module 130 can select to control the sound in the first webpage label in the floating window. For convenience of operation, different icon buttons may be set in the floating window according to different operations on the sound data, for example, a start icon, a pause icon, a stop icon, an acceleration icon, a slow icon, and the like may be set. When the user inputs an instruction, the user can click the icon to achieve the purpose.

If a web page tag has been processed, the display module 160 can display the currently processed web page tag in a plurality of web page tags. This sorting method is beneficial for improving the control efficiency of the sound data and reducing the waste of time caused by finding the webpage where the sound data is located. For example, the user closes the sound file in the first web page tab, and the display module 160 sorts the web page label to the first position displayed by the browser. Subsequently, if the user wants to open the sound file, the first webpage label can be directly opened, and no one webpage label is needed to search, so as to improve the control efficiency of the sound data.

After the sound file selected by the user is controlled, the control module 130 may also provide other information in the floating window, for example, may provide a recommended link of the audio/video file that has not been muted or has been muted, and for example, may also provide Links to search tools related to audio/video files. The provision of these other information may be analyzed by the browser according to the information related to the user's selection of the sound file, or may be analyzed by the browser according to the usual browsing history of the user.

In implementation, after the sound file in the first webpage tab is controlled, the information of the sound file controlled in the first webpage tab may be saved in the saving module 170. In order to facilitate subsequent processing operations such as re-extracting or accessing the controlled sound file, the saving module 170 may also save the saved sound file information as part of the browser user information on the local side of the browser, or Synchronize it on the network side. If If it is saved on the network side, when the corresponding information is extracted again, the browser needs to obtain the related information stored on the network side first, and then open and perform subsequent control operations.

Based on the same inventive concept, the embodiment of the present invention further provides a method for performing sound control in a browser, and the implementation of the method is based on the device for performing sound control in the browser provided in any one of the above embodiments. 2 is a process flow diagram of a method of sound control in a browser in accordance with one embodiment of the present invention. The method includes steps S202 to S206.

Step S202: Create a webpage label, and establish a mapping relationship between the webpage label and the page process where the webpage label is located.

Step S204: When receiving an instruction input by the user to control the sound in the first webpage label, according to the mapping relationship between the established webpage label and the page process, the page process where the first webpage label is located is found.

Step S206: Control the sound in the first webpage label in the page process of the found first webpage label.

Referring to the process shown in FIG. 2, step S202 refers to establishing a mapping relationship between a webpage label and a page process where the webpage label is located. There are various mapping methods used in the mapping relationship, for example, random mapping, digital mapping, sort mapping, etc., and the mapping elements used may also be various, such as keywords, weights, and the like. In this example, a preferred mapping relationship is provided, that is, a mapping relationship between a webpage label identifier (ID) and a page process ID where the webpage label is located is established. When the page process where the webpage label is located is created, the mapping relationship between the webpage label and the page process where the webpage label is located can be established synchronously.

In a preferred embodiment, the specific step of receiving the user-input command to control the sound in the first webpage label and searching for the page process where the first webpage label is located may be referred to in step S204. S302 to step S306.

Step S302, receiving, in the first webpage label, a sound control instruction input by the user for the first webpage label, where the sound control instruction includes a first webpage label ID;

Step S304: Perform a search in a mapping relationship between the established webpage label and the page process according to the first webpage label ID.

Step S306: Obtain an ID of a page process corresponding to the first webpage label.

After the step S306 is completed, the step S206 is triggered. In the step of controlling the sound in the first webpage label in the page process of the first webpage label that is found, please refer to FIG. 4, including steps S402 to S404.

In step S402, the ID of the page process corresponding to the first webpage label is obtained according to the search, and the corresponding page process is found.

Step S404: Control the sound in the first webpage label through the sound API function of the operating system in the found page process.

It should be noted that, in the process of controlling the sound data or the sound file, a floating window prompting for sound control may be generated at a label head of the first webpage label or a webpage element of the first webpage label that generates sound. The floating window is loaded with an entry for receiving an instruction to control the sound in the first webpage label. Floating windows have certain advantages over control icons set on the page. Floating windows can float on a specific page or float on all pages, even if the first page that is open is not required for sound control. The label can also control the sound in the first webpage label, making the control of the sound more convenient and quick.

It should be noted here that the sounds in the first webpage label include various types, such as sounds generated by video plug-ins in webpages, such as sounds generated by audio plug-ins, or sounds generated simultaneously, and the like. Multiple plugins can sound at the same time in a web page tag.

Preferably, the sound in the first webpage label is controlled, including at least one of the following operational controls:

Turn off the sound in the first webpage tab;

Open the sound in the first webpage tab;

Adjust the volume level in the first web page tab.

Further, when a plurality of webpage tags have sound data at the same time, a prompt is provided for the webpage tag in which the sound data exists. It should be noted that there may be multiple prompting manners herein, and the webpage label with the sound data may be identified. For example, the webpage label with the sound data may be prompted by the highlighting of the label item, or The webpage label with the sound data is prompted by the background color of the label item, and the webpage label with the sound data can be prompted by using the title font size, color, and the like of the label item, and the like. Since the highlighting effect is more obvious, it is preferable to prompt by means of highlighting the label item.

Since there are more than one web page display and more than one file capable of providing sound data in each web page, the advantage of the floating window can be fully utilized in order to facilitate the user to select a file that generates sound and control in time. When sound data is simultaneously present in a plurality of webpage tags, information of the sound data in the plurality of webpage tags is displayed in a floating window. Of course, if the first webpage label has a plurality of sound data at the same time, the information of the plurality of sound data that the first webpage label exists at the same time may be displayed in a floating window. The information of multiple sound data is presented in a floating window, and the information is centrally managed, which is convenient for the user to select according to needs and improve the efficiency of sound control.

For the convenience of the user, any information of the sound file or the sound data can be displayed on the floating window, and the following information is usually preferably displayed:

The title of the web page label;

The type of sound data in the web page;

The name of the sound data in the web page.

The advantages of using the floating window for information display have also been explained in the previous section, and need not be described here. corresponding, You can choose to control the sound in the first web page label in the floating window. For convenience of operation, different icon buttons may be set in the floating window according to different operations on the sound data, for example, a start icon, a pause icon, a stop icon, an acceleration icon, a slow icon, and the like may be set. When the user inputs an instruction, the user can click the icon to achieve the purpose.

If a web page tag has been processed, the currently processed web page tag can be displayed in front of the plurality of web page tags. This sorting method is beneficial for improving the control efficiency of the sound data and reducing the waste of time caused by finding the webpage where the sound data is located. For example, the user closes the sound file in the first web page tab and sorts the web page label to the first place displayed by the browser. Subsequently, if the user wants to open the sound file, the first webpage label can be directly opened, and no one webpage label is needed to search, so as to improve the control efficiency of the sound data.

After the sound file selected by the user is controlled, other information may also be provided in the floating window, for example, a recommended link of the audio/video file that is not muted or muted may be provided, and for example, may also be provided for audio/video. File related search tool links. The provision of these other information may be analyzed by the browser according to the information related to the user's selection of the sound file, or may be analyzed by the browser according to the usual browsing history of the user.

In implementation, after the sound file in the first webpage label is controlled, the information of the sound file controlled in the first webpage label may be saved. In order to facilitate subsequent processing operations such as re-extracting or accessing the controlled sound file, the information of the saved sound file may be saved as a part of the browser user information on the local side of the browser, or may be performed. Synchronization on the network side. If it is saved on the network side, when the corresponding information is extracted again, the browser needs to obtain the related information stored on the network side first, and then open and perform subsequent control operations.

The specific method for performing sound control in the browser provided by the embodiment of the present invention is described and illustrated in detail by using a specific embodiment to take the mute of the webpage as an example.

In this case, the system sound can be controlled by using the new Core Audio APIs function in Windows. The application can control the sound behavior through this set of API functions, such as playing music and muting.

In this example, when the process is the basic unit (each web page label corresponds to one process), the process can contain multiple sound channels (correspondingly, there may be multiple sound files or sound data in each web page label). If you mute a process, it will not sound from all of the sound channels it contains. For example, a web page tag can play both flash and mp3 music, which includes two sound channels. If you mute this process, there is no sound in both flash and mp3.

In this example, the browser is first set up, and the web pages in each web page tab are opened in a separate process. When you open a new tab, a new process is created. For multi-tab browsers, the newly opened web page is located in a new tab with an id as the identifier, referred to as "tag ID" or "tabid".

When the process is created, note the correspondence between the process ID (process_id) and the tag ID.

The data structure is: [{tabid:process_id}, {tabid:process_id}...]

When the user chooses to mute a webpage tab, the process_id is found according to the tabid, and the process_id is passed to the operating system's API function MuteProcess(process_id) to achieve the purpose of muting.

Referring to FIG. 5, the process of opening the webpage includes steps S502 to S506.

Step S502, opening a new webpage, and creating a new webpage label;

Step S504, creating a new webpage process for the webpage;

Step S506, recording the tabid of the webpage label and the process_id of the webpage process and the mapping relationship between the two.

Please refer to FIG. 6 for the process of the user performing the mute operation on the webpage by clicking the control icon, including steps S602 to S606.

Step S602, the user selects to mute a certain webpage, and finds an ID of the corresponding webpage label;

Step S604, searching for the process ID according to the tag ID, and then finding the corresponding process;

Step S606: Calling the system API to mute the process.

When there are multiple webpage tags with sound, an interface (equivalent to a floating window) is popped up for the user to control the process sound (set the webpage that can make a sound). FIG. 7 shows a schematic diagram of displaying information of a plurality of web page tags in a floating window in accordance with one embodiment of the present invention. In Figure 7, there are 4 webpage tabs, where the current webpage is labeled with the home page of Baidu website, and the other webpage label is the webpage of the flash video plug-in that plays "Diagram 2", and another webpage label is playing "The Cost of Love". The webpage of the MP3 audio plug-in; there is also a webpage tag loaded with the Flash plug-in web game "Imperial Age", which also plays the background sound of the game. When each of the above webpage tags is loaded on the browser side, the browser recognizes the identification of the plugin that may play the sound file in the loaded webpage, such as the loading of the Flash plugin or the loading of the MP3 audio plugin (can be called according to the called The CLSID of the plugin is installed to identify which plugin is called, thereby obtaining related description information of the audio, video or game webpage played by the plugin, such as the name, category, and singer information of the sound file. In this way, after clicking on the sound control button in the status bar of the browser, a floating window (also called a pop-up window) can be generated, and three sound files are displayed in the pop-up window. The first one is "Diagram 2" Flash video, the second is the mp3 file "The Cost of Love", and the third is the game "Imperial Age". See Figure 7 for details. The checked file will be muted, that is, the sound related to the page label. Will be muted. In the floating window, a control button or icon of each sound file can be set, such as the open or close logo in FIG. 7, and clicking the logo enables the sound of the corresponding sound file to be turned on or off. Or, the webpage containing the mute or unmute is changed into the current webpage label, and the webpage label header is highlighted. The sound file and the control icon in FIG. 7 are enumerated, and the specific web page label and the sound file on the opposite side are not limited. In practical applications, the number of sound files depends on the number of open webpage tags, which can be four or more. The control icon can also include other identifications, such as adjusting the volume level identification, playing the identification, and the like. The trigger condition shown in Figure 7 for the floating window to appear on the page may be that the user clicks on the sound symbol in the browser status bar (usually appears as a horn in the status bar). Of course, other trigger conditions can also occur, such as clicking on a file plugin or other plugin. It can also be set to automatically appear when you open a web page label each time. The mute processing for the sound in the above embodiment is performed using the solution in the foregoing embodiment of the present invention, and details are not described herein.

When a webpage with a sound needs to be directly opened, the specified page can be directly opened through the interface shown in FIG. 7 above, so that the user can directly open the webpage with sound in a plurality of webpage notes, for example, the label is placed high. Brightly displayed, so that users can not find it in many webpage tags.

For the information loaded in the interface presented in FIG. 7, the title of the webpage label and the sound played by the webpage may also be included. The type of the file, the name of the sound file, etc., can be obtained from the web page label.

FIG. 8 shows a schematic diagram of control information for displaying a sound file in a floating window in accordance with one embodiment of the present invention. The control information can be integrated into the existing plug-in of the browser, or a new plug-in can be generated in the browser for implementing the control information. Referring to Figure 8, this example is implemented by integrating control information into an existing plug-in of the browser. When the user opens a pop-up window (for example, the user right-clicks on the web page tab), the control information of the sound file is presented in the pop-up window. In Figure 8, there are two web page tags, one of which is Baidu's search page. The other one is Baidu's music box, which is playing the song of "Never Retreat" by Ren Xianqi through the MP3 player plug-in. When loading the page of the Baidu music box, it recognizes that the MP3 player plug-in is loaded (see Figure 7 for details). In the corresponding embodiment, the song name, the singer information, the current web page title information, and the like of the played music are acquired. The sound file is the mp3 file of Ren Xianqi's "Never Retreat". The information of the sound file can be obtained from the webpage label, such as the author, the album, the file type, the duration, and so on. The control information may preferably include a start, a louder sound, a smaller sound, and a mute option, the given link triggering an API that generates a corresponding command for the sound control in the current web page process and concurrently to the browser side. The function performs corresponding sound control. For specific technical details, please refer to the technical disclosure in the foregoing embodiments of the present invention. As shown in FIG. 8, although there is no sound file in the current webpage label, when right-clicking in the current webpage tab, the information of the file having the sound playing in all the webpage tabs can be viewed, and the corresponding control operation can be performed. . Of course, the current webpage label can also carry a sound file, and will not be described here. It should be noted that, similar to FIG. 7, FIG. 8 is only a schematic diagram. If other sound files exist in the browser, related information of other sound files and corresponding control information may also be displayed in the floating window, that is, Floating windows can control the sound playback of multiple sound files in a web page tag, or control the sound playback of sound files in multiple web page tags. The control processing for the sound in the above embodiment is performed using the solution in the foregoing embodiment of the present invention, and details are not described herein.

In addition to the control information, FIG. 8 also illustrates providing some links related to the controlled sound file in the floating window, such as the recommendation of other songs of Ren Xianqi, which may be actively recommended by the server side corresponding to the browser. Further, for example, a search box of a song (ie, a commonly used search engine) may be provided to facilitate the user to obtain more song information.

As can be seen from the description of the foregoing embodiment, this embodiment adds a function of separately controlling the mute of the webpage, thereby improving the user experience.

According to the method and apparatus provided by the embodiments of the present invention, the following beneficial effects can be achieved:

A further embodiment of the present invention provides a method for performing sound control in a browser, which implements a tab-based scheme for separately controlling sounds in different labels. Referring to FIG. 9, the method includes the following steps:

S900: Create a web page tag in the browser and create a tag process for the web page tag that is independent of the browser's main process.

When a new webpage label is created in the browser, a notification is generated for generating a page. In this embodiment, the notification of the page creation is intercepted, and an independent process is created for each webpage label of the browser.

Optionally, before creating a label process independent of the main process of the browser for the webpage label, the method further includes: identifying whether the created webpage label includes an audio/video file, and if so, creating a The browser's main process is a separate tag process. If not, a tag process that is independent of the browser's main process is not created for the web page tag. This type of processing, for web pages that do not contain audio and video files, is not loaded in a separate process, so as to avoid too many processes starting in the browser and reduce the efficiency of the browser.

Optionally, the foregoing creating a webpage label in the browser includes:

If at least one muted webpage label exists in the browser, and it is determined that the newly created webpage label includes an audio/video file, the browser user is sent a prompt message to enter the silent mode, or the display interface of the main process is set to enter the mute control interface. In this way, when the sound of one or more webpage tags is already intercepted (mute), if it is judged that there is sound in the newly opened webpage label (that is, when the new tabpage is loaded, it is judged that the webpage label also has Sound), send a message prompting the user to enter the silent mode, or enter the mute control interface, receive the user's selection instruction for whether the webpage label is muted, and control the sound in the newly opened webpage label according to the instruction to ensure that Only one of the webpage tags with multiple audio and video tags is playing a sound.

S902: Establish a mapping relationship between the webpage label and the labeling process, and save the mapping relationship in the main process to control the sound in the webpage label in the display interface of the main process.

Optionally, in a manner, establishing a mapping relationship between the label process identifier (ID) and the title of the webpage label, in this manner, the label process ID and the title of the webpage label are saved in the main process; In this manner, the mapping relationship between the label process ID and the title of the webpage label and the URL (Uniform Resource Locator) is established. In this manner, the label process ID, the title of the webpage label, and the URL are saved in the main process. in.

When establishing a mapping relationship, either of the above two methods or both of the above methods may be used.

S904: Send a sound control instruction input through the display interface of the main process to the label process.

The sound control command includes at least a sound control command for prohibiting sound output in the web page tab and a sound control command for instructing sound output in the web page tab.

That is, in this step, the call of the webpage label to the audio application interface is intercepted according to the sound control instruction to prohibit the output of the sound in the webpage label, that is, the sound signal is prohibited from being transmitted to the sound card; and/or, according to the sound control instruction, the webpage label is allowed to interface with the audio application. The call to achieve the output of the sound in the web page tag. The operation of allowing the webpage tag to call the audio application interface, in one case, the webpage tag is allowed to call the audio application interface to output the sound according to the sound control instruction when the newly opened webpage tag is loaded, and the other case is After the sound in the webpage tag is intercepted, the interception operation is cancelled according to the sound control instruction, and the call to the audio application interface is resumed.

S906: Control the sound in the webpage label through the audio application interface in the webpage label according to the sound control instruction.

Optionally, the foregoing audio application interface includes at least one interface function as follows:

WaveOutWrite interface function, midi stream output interface (midiStreamOut) interface function, client audio rendering (IAudioRenderClient) interface function, audio creation (DirectSoundCreate) interface function and audio creation 8 (DirectSoundCreate8) interface function.

The specific content of the above interface function will be described below.

waveOutWrite interface function

The waveOutWrite interface function can send a data to the waveform audio output device, as shown in the following code:

Among them, the parameter hwo represents the handle of the waveform audio output device, the parameter pwh points to the WAVEHDR structure pointer, and the parameter cbwh represents the size of the WAVEHDR structure.

For the return value of the waveOutWrite interface function, MMSYSERR_NOERROR is returned when the function call succeeds. The values returned on failure are shown in Table 1 below.

Table 1

值(Value)Value	描述(Description)Description
值(Value)Value	描述(Description)Description	MMSYSERR_INVALHANDLEMMSYSERR_INVALHANDLE	设备句柄无效Device handle is invalid
MMSYSERR_NODRIVERMMSYSERR_NODRIVER	当前没有播放设备There is currently no playback device	MMSYSERR_INVALHANDLEMMSYSERR_INVALHANDLE	设备句柄无效Device handle is invalid
MMSYSERR_NODRIVERMMSYSERR_NODRIVER	当前没有播放设备There is currently no playback device	MMSYSERR_NOMEMMMSYSERR_NOMEM	内存不足Not enough storage
WAVERR_UNPREPAREDWAVERR_UNPREPARED	数据块没有准备好The data block is not ready	MMSYSERR_NOMEMMMSYSERR_NOMEM	内存不足Not enough storage

midiStreamOut interface function

The midiStreamOut interface function plays a stream (buffer) or MIDI (Musical Instrument Digital Interface) data to a MIDI output device, as shown in the following code:

Among them, the parameter hMidiStream represents the handle of the MIDI stream; the parameter lpMidiHdr points to the MIDIHDR structure for representing a midi data; the parameter cbMidiHdr represents the size of the MIDIHDR structure.

For the return value of the midiStreamOut interface function, MMSYSERR_NOERROR is returned when the function call succeeds. The values returned on failure are shown in Table 2 below.

Table 2

值(Value)Value	描述(Description)Description
值(Value)Value	描述(Description)Description	MMSYSERR_NOMEMMMSYSERR_NOMEM	内存不足Not enough storage
MIDIERR_STILLPLAYINGMIDIERR_STILLPLAYING	Midi流以及在播放了Midi stream and playing	MMSYSERR_NOMEMMMSYSERR_NOMEM	内存不足Not enough storage
MIDIERR_STILLPLAYINGMIDIERR_STILLPLAYING	Midi流以及在播放了Midi stream and playing	MIDIERR_UNPREPAREDMIDIERR_UNPREPARED	Midi流没有准备好Midi stream is not ready
MMSYSERR_INVALHANDLEMMSYSERR_INVALHANDLE	Midi句柄无效Midi handle is invalid	MIDIERR_UNPREPAREDMIDIERR_UNPREPARED	Midi流没有准备好Midi stream is not ready
MMSYSERR_INVALHANDLEMMSYSERR_INVALHANDLE	Midi句柄无效Midi handle is invalid	MMSYSERR_INVALPARAMMMSYSERR_INVALPARAM	Midi流无效Midi stream is invalid

IAudioRenderClient interface function

The IAudioRenderClient interface function allows the client to write data buffers to render endpoints. The client obtains a stream object referenced by the IAudioRenderClient interface by calling the IAudioClient::GetService method and setting the parameter to REFIID IID_IAudioRenderClient riid.

The data packet managed by this interface function contains audio rendering data. The length of a packet is expressed as the number of packets of the audio frame. The size of an audio frame specifies the member structure of nBlockAlign WAVEFORMATEX. The number of audio frames in a byte size is equal to the channel stream multiplied by the sample size per channel. For example, the audio frame size is 4 bytes for a stereo (2 channel) stream with 16 bit samples. A packet always contains an integer number of audio frames.

DirectSoundCreate8 interface function

The DirectSoundCreate8 interface function uses the DSound.h file and the Dsound.lib file. The specific structure of the function is shown in the following code:

HRESULT DirectSoundCreate8(

LPCGUID lpcGuidDevice, / / sound card device global flag, generally NULL, indicating the default sound card

LPDirectSOUND8*ppDS8, / / returned IDirectSound8 interface object pointer

LPUNKNOWN pUnkOuter / / must be NULL, because the collection is not supported

)

A webpage tag may include one or more of a waveOutWrite interface function, a midiStreamOut interface function, an IAudioRenderClient interface function, a DirectSoundCreate interface function, and a DirectSoundCreate8 interface function, and the webpage is present through the audio application interface existing in the webpage tag according to the sound control instruction. The sound in the label is controlled.

A method for performing sound control in a browser provided by still another embodiment of the present invention will be described below with reference to FIG. In this embodiment, the manner in which the main process of the browser controls the label process and the communication mode between the two are mainly described. Other contents in the method for performing sound control in the browser are referred to other embodiments of the present invention. Referring to Figure 10, the method includes the following steps:

S1000: Create a label process that is independent of the browser's main process.

When a new web page tag is opened in the browser, a tag process separate from the main browser process is created and a mapping relationship between the web page tag and the tag is established. The tag process and the running of the main process do not affect each other. The operation of data in a tag process does not affect the data running in the main process or other tag processes.

After the label process is successfully created, a message indicating that the label process is created is generated in the browser, and the label process is completed when the message is detected.

S1002: Pass the mapping relationship to the main process.

When a tag opens a page, the tag process in which the tag is located sends its own information (mapping relationship) to the main process and can be displayed in the display interface. After that, the user can individually control whether each webpage label is muted through the display interface.

When the specific content of the established mapping relationship is different, the information transmitted to the main process is also different. For example, in one mode, the mapping relationship between the label process ID and the title of the webpage label is established, and the label process ID is set in this manner. And the title of the webpage label is passed to the main process; in another way, the mapping relationship between the label process ID and the title of the webpage label and the URL of the webpage label is established, and in this way, the label process ID and the webpage label are The title and URL are passed to the main process.

Further, in this embodiment, when it is required to transfer information from the label process to the main process or needs to transfer information from the main process to the label process, the sender of the information firstly sets the content of the information (for example, a function to be executed and a parameter of the function). Encoding is a unified format, and then the encoded information is sent to the corresponding process message loop through the IPC (Inter-Process Communication) channel, and the receiving end receives the content of the information according to the unified encoding format, and then Call the relevant function to perform the operation.

In this implementation, a message loop is created for the main process and the label process respectively, and the main process and the label process respectively use the message loop to receive information from the peer, parse the content in the information, and execute the operation according to the content calling function.

In addition, the communication mechanism between processes of some browsers (such as the 360 security browser) is synchronous and asynchronous. In the solution of this embodiment, considering that the control operation of the sound is not required for real-time performance, the adoption is Asynchronous communication scheme.

S1004: Save the mapping relationship.

The process in which the main interface of the browser is located is the main process, and the main process manages the status display of each web page label and controls whether each web page label is muted. The mapping between the web page tag and the tag process is saved in the main process. The main process displays information about the webpage label on the display interface according to the mapping relationship, such as the title of each label, the URL, and the status of whether or not to mute.

S1006: The main process notifies the label process to mute.

The user can send a sound control command to the main process by clicking on the information of the tag process on the display interface. After the main process receives the voice control command of the user to modify the mute state, the main process notifies the process of the corresponding tag, and the process of the tag receives the mute control signal, and then changes whether the current play is intercepted.

In the scenario shown in FIG. 10, in order to modify the mute state of the webpage label to be muted, it can be understood that the mute state of the webpage label can also be modified to play by the same method.

S1008: Intercept the audio application interface that plays the sound.

The audio application interface existing in the webpage tag of the voice control command that receives the notification mute is intercepted, and the sound signal in the webpage tag is prohibited from being output to the sound card.

S1010: The sound in the webpage label is intercepted, and the label of the webpage is muted.

Yet another embodiment of the present invention provides a browser. Referring to FIG. 11, the browser includes a creating unit 1110, a mapping unit 1112, a transmitting unit 1114, a control unit 1116, an identifying unit 1118, and a determining unit 1120. The following description will be respectively made.

The creation unit 1110 is adapted to create a web page tag in the browser and create a tag process for the web page tag that is separate from the main process of the browser. The tag process and the running of the main process do not affect each other. The operation of data in a tag process does not affect the data running in the main process or other tag processes.

The mapping unit 1112 is adapted to establish a mapping relationship between the webpage label and the labeling process, and save the mapping relationship in the main process to control the sound in the webpage label in the display interface of the main process. Optionally, the mapping unit 1112 is adapted to establish a mapping relationship between the label process ID and the title of the webpage label, and/or establish a mapping relationship between the label process ID and the title of the webpage label, and the uniform resource locator URL; The tag process ID and the title of the web page tag are saved in the main process, and/or, the tag process ID, the title of the web page tag, and the URL are saved in the main process.

The transmitting unit 1114 is adapted to send a sound control instruction input through the presentation interface of the main process to the tag process.

The control unit 1116 is adapted to control the sound in the web page tag via the audio application interface in the web page tag in accordance with the sound control command. Optionally, the audio application interface includes at least one of the following interface functions: a waveOutWrite interface function, a midiStreamOut interface function, an IAudioRenderClient interface function, a DirectSoundCreate interface function, and a DirectSoundCreate8 interface function. Optionally, the control unit 1116 is adapted to intercept the call of the webpage label to the audio application interface according to the sound control instruction to prohibit the output of the sound in the webpage label; and/or, according to the sound control instruction, allow the webpage label to invoke the audio application interface, To achieve the output of the sound in the web page tag.

Optionally, the browser further includes an identifying unit 1118, configured to: before creating a label process independent of the main process of the browser for the webpage label, identifying whether the created webpage label includes an audio/video file, and if so, the webpage The tag creates a tag process that is separate from the browser's main process. If not, it does not create a tag process that is separate from the browser's main process for the page tag.

Optionally, the browser further includes: the determining unit 1120 is configured to: if there is at least one muted webpage label in the browser, and determine that the newly created webpage label includes the audio and video file, send the prompt information to the browser user to enter the silent mode. , or set the display interface to enter the mute control interface

For the specific working mode of each unit in the embodiment of the present invention, reference may be made to the related content of the method embodiment of the present invention, and details are not described herein again.

In the description provided herein, numerous specific details are set forth. However, it is understood that the embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of the description.

Similarly, the various features of the invention are sometimes grouped together into a single embodiment, in the above description of the exemplary embodiments of the invention, Figure, or a description of it. However, the method disclosed is not to be interpreted as reflecting the intention that the claimed invention requires more features than those recited in the claims. Rather, as the following claims reflect, inventive aspects reside in less than all features of the single embodiments disclosed herein. Therefore, the claims following the specific embodiments are hereby explicitly incorporated into the embodiments, and each of the claims as a separate embodiment of the invention.

Those skilled in the art will appreciate that the modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and further they may be divided into a plurality of sub-modules or sub-units or sub-components. In addition to such features and/or at least some of the processes or units being mutually exclusive, any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed, or All processes or units of the device are combined. Each feature disclosed in this specification (including the accompanying claims, the abstract and the drawings) may be replaced by alternative features that provide the same, equivalent or similar purpose.

In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features that are included in other embodiments and not in other features, combinations of features of different embodiments are intended to be within the scope of the present invention. Different embodiments are formed and formed. For example, in the following claims, any one of the claimed embodiments can be used in any combination.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of some or all of the components of the browser for sound control in a browser in accordance with an embodiment of the present invention. All features. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the present invention may be stored on a computer readable medium or may have The form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, Figure 12 illustrates a computing device that can implement a method of sound control in a browser in accordance with the present invention. The computing device conventionally includes a processor 1210 and a computer program product or computer readable medium in the form of a memory 1220. The memory 1220 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. Memory 1220 has a memory space 1230 for program code 1231 for performing any of the method steps described above. For example, storage space 1230 for program code may include various program codes 1231 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have storage segments, storage spaces, and the like that are similarly arranged to memory 1220 in the computing device of FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit includes computer readable code 1231 ', ie, code readable by a processor, such as 1210, that when executed by a computing device causes the computing device to perform each of the methods described above step.

"an embodiment," or "an embodiment," or "an embodiment," In addition, it is noted that the phrase "in one embodiment" is not necessarily referring to the same embodiment.

It is to be noted that the above-described embodiments are illustrative of the invention and are not intended to be limiting, and that the invention may be devised without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word "comprising" does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

In addition, it should be noted that the language used in the specification has been selected for the purpose of readability and teaching, and is not intended to be construed or limited. Therefore, many modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The disclosure of the present invention is intended to be illustrative, and not restrictive, and the scope of the invention is defined by the appended claims.

Claims

A method for sound control in a browser, comprising:

Create a web page tag in the browser and create a tag process for the web page tag that is separate from the main process of the browser;

Establishing a mapping relationship between the webpage label and the labeling process, and saving the mapping relationship in the main process, so as to control the sound in the webpage label in the display interface of the main process;

Sending a sound control command input through the display interface of the main process to the label process;

The sound in the webpage tag is controlled according to the sound control command through the audio application interface in the webpage tag.
The method of claim 1, wherein the establishing a mapping relationship between the webpage label and the labeling process, and saving the mapping relationship in the main process comprises:

Establishing a mapping relationship between the label process ID and the title of the webpage label, and/or establishing a mapping relationship between the label process ID and the title of the webpage label and the uniform resource locator URL;

as well as,

The tag process ID and the title of the web page tag are saved in the main process, and/or the tag process ID, the title of the web page tag, and the URL are saved in the main process.
The method of claim 1 wherein said audio application interface comprises at least one interface function described below:

Wave output WaveOutWrite interface function, midi data stream output midiStreamOut interface function, client audio rendering IAudioRenderClient interface function, audio creation DirectSoundCreate interface function and audio creation DirectSoundCreate8 interface function.
The method of claim 3, wherein the controlling the sound in the webpage tag through the audio application interface in the webpage tag according to the sound control instruction comprises:

Intersecting, by the sound control instruction, a call of the webpage tag to the audio application interface to prohibit output of sound in the webpage tag; and/or,

The call of the web application tag to the audio application interface is allowed according to the sound control instruction to implement output of sound in the webpage tag.
The method of claim 3, wherein before the creating a tag process for the web page tag that is independent of the main process of the browser, the method further comprises:

Identifying whether the created webpage tag includes an audio/video file, and if so, creating a tag process independent of the browser's main process for the webpage tag, if not, creating a webpage tag with the main process of the browser Independent label process.
The method of claim 1 wherein said creating a web page tag in the browser comprises:

If at least one muted webpage label exists in the browser, and it is determined that the newly created webpage label includes an audio/video file, the browser user is sent a prompt message to enter the silent mode, or the display interface is set to be muted. Control interface.
A browser that includes:

Creating a unit adapted to create a web page tag in the browser and create a tag process for the web page tag that is separate from the main process of the browser;

The mapping unit is adapted to establish a mapping relationship between the webpage label and the labeling process, and save the mapping relationship in the main process to control the sound in the webpage label in the display interface of the main process;

a sending unit, configured to send a sound control instruction input through a display interface of the main process to the label process;

The control unit is adapted to control the sound in the webpage label through the audio application interface in the webpage tag according to the sound control instruction.
The browser according to claim 7, wherein the mapping unit is adapted to establish a mapping relationship between the label process ID and the title of the webpage label, and/or establish a label process ID and a title of the webpage label, and a unified resource. The mapping relationship between locator URLs; and,

The tag process ID and the title of the web page tag are saved in the main process, and/or the tag process ID, the title of the web page tag, and the URL are saved in the main process.
The browser of claim 7, wherein the audio application interface comprises at least one interface function described below:

Wave output WaveOutWrite interface function, midi data stream output midiStreamOut interface function, client audio rendering IAudioRenderClient interface function, audio creation DirectSoundCreate interface function and audio creation DirectSoundCreate8 interface function.
The browser according to claim 9, wherein the control unit is adapted to intercept a call of the web application tag to the audio application interface according to the sound control instruction to prohibit output of sound in a webpage tag; and/or, The call of the web application tag to the audio application interface is allowed according to the sound control instruction to implement output of sound in the webpage tag.
The browser according to claim 9, wherein said browser further comprises an identification unit adapted to identify the created webpage label before said creating a webpage tag that is separate from the main process of the browser Whether the audio and video file is included, if so, a label process independent of the main process of the browser is created for the webpage label, and if not, a label process independent of the main process of the browser is not created for the webpage label.
The browser according to claim 7, wherein the browser further comprises a determining unit, configured to: if there is at least one muted webpage label in the browser, and determine that the newly created webpage label includes an audiovisual file, The browser user sends a prompt message to enter the silent mode, or sets the display interface to enter the mute control interface.
A computer program comprising computer readable code, when said computer readable code is run on a computing device, causing said computing device to perform sound in a browser according to any one of claims 1-6 The method of control.
A computer readable medium storing the computer program of claim 13.