JP6193901B2 - Output control program, output control device, and output control method - Google Patents

Description

  The present invention relates to an output control program, an output control apparatus, and an output control method for adjusting an output state of a plurality of contents in a client terminal.

  In an audio device including a speaker or the like, there are various sounds such as BGM, dialogue, and sound effects that are reproduced. Here, depending on the type of sound output in parallel, there is a relative priority, and the volume etc. may be adjusted. For example, in the situation where BGM is output constantly, if the line is output intermittently, the BGM level is adjusted to be lowered according to the line output level in order to make the line easy to hear. Ducking processing is performed (see Patent Document 1).

Various contents are also provided to users who use computer terminals such as smartphones. Such content may be provided by a web page. This web page is described in a markup language such as HTML (HyperText Markup Language). Furthermore, standards that can provide various media contents such as audio and moving images on a web page are also disclosed (see Non-Patent Documents 1 and 2). In this standard, media content can be played back by media elements (<audio> element, <video> element) and Web Audio API.

JP 2012-70137 A

The World Wide Web Consortium (W3C), "HTML5 A vocabulary and associated APIs for HTML and XHTML W3C Candidate Recommendation 04 February 2014", [online] homepage, [Search March 20, 2014], Internet <http: / /www.w3.org/TR/html5/embedded-content-0.html#media-elements> The World Wide Web Consortium (W3C), “Web Audio API W3C Working Draft 10 October 2013”, [online] homepage, [searched March 20, 2014], Internet <http://www.w3.org/ TR / webaudio / ＞

  Even on a web page, a plurality of contents (for example, audio files) may be reproduced simultaneously. For example, a narration (main audio) may be output while outputting BGM (sub audio) on a game screen. In this case, the volume of the sub sound is lowered while the main sound is being output. Then, after the main voice is finished, a process for restoring the volume of the sub voice is performed.

  However, when the audio contents change according to the situation as in a game, it is difficult to create an optimal audio material. In addition, when content is output using a browser of a client terminal, the volume may vary depending on the playback environment. In this case, it is cumbersome to prepare content whose volume is adjusted according to the playback environment.

The present invention has been made in view of the above-described problems, and an object of the present invention is to output an output control program for adjusting the output status of content when outputting a plurality of content in the same scene in a client terminal, and output A control device and an output control method are provided.

An output control program that solves the above-described problem is a program that functions as an execution unit that reproduces a plurality of contents included in a web page in a computer terminal that includes a browser that displays the web page based on a file described in a markup language. The control unit of the computer terminal, when playing back the markup language constituting the web page acquired by the browser, determines the main content and the sub-content for the plurality of contents to be output by the logic for determining the main content and the sub-content. Main / sub specification means for specifying content, output condition setting means for acquiring the volume as the output condition of the main content and sub content at the time of ducking according to the output condition associated with the file playback scene in which the event has occurred, The markup In terms, when detecting an event for performing ducking, the main change the output content and sub-contents to said volume, at the end of the event, to function as an output adjusting means for returning the volume. Thereby, it is possible to perform ducking for a plurality of contents in the web page.

  ADVANTAGE OF THE INVENTION According to this invention, when outputting a some content in the same scene in a client terminal, the output condition of a content can be adjusted efficiently.

The system schematic of this embodiment. Explanatory drawing of the process sequence of this embodiment. An explanatory view of a part of a source code example of the present embodiment. An explanatory view of a part of a source code example of the present embodiment. Explanatory drawing of the process sequence of other embodiment.

<First Embodiment>
Hereinafter, an embodiment of the output control program will be described with reference to FIGS.
In the present embodiment, as illustrated in FIG. 1, it is assumed that the client terminal 20 reproduces a plurality of contents based on a file (markup language file) acquired from the server 10.

A client terminal 20 used by a user is connected to the server 10 via a network. The server 10 includes a file storage unit 12.
The file storage unit 12 stores a file to be provided to the client terminal 20. Here, a file described in a markup language is recorded. As will be described later, this file includes descriptions (output control programs) for realizing various means in the client terminal 20. In this embodiment, descriptions for realizing a ducking management unit 213, a main / sub specification unit 214, and an output condition setting unit 215, which will be described later, are included.

Further, this file includes information (content information) regarding a plurality of contents used at the time of output. The content information includes information related to a content acquisition destination such as audio and video. Here, when using this item, the acquisition destination is address information (for example, URL: Uniform Resource Locator) in which an object that can be provided is stored.
Further, the file includes main / sub setting information for specifying either main content or sub content in each content.

  The client terminal 20 is a computer (information processing terminal such as a smartphone) used by a user who browses a file, and functions as an output control device. The client terminal 20 includes a control unit 21 including a CPU, a memory (RAM and ROM), a terminal storage unit 22, and an input / output unit 23.

Various settings and programs used in the client terminal 20 are recorded in the terminal storage unit 22. In the present embodiment, a browser (program) that displays a file written in a markup language is stored.
The input / output unit 23 is configured by a touch panel display or the like, and outputs and inputs data.

  The control unit 21 activates the browser 210 by executing the browser program stored in the terminal storage unit 22. The browser 210 includes a file acquisition unit 211 and an output processing unit 212.

The file acquisition unit 211 reads a file (markup language file).
The output processing means 212 outputs the markup language file to the input / output unit 23 as a web page.

  Further, the browser 210 executes the description included in this file. By executing this description, the control unit 21 functions as the ducking management unit 213, the main / sub specification unit 214, and the output condition setting unit 215. Specifically, JavaScript (registered trademark) stored in the file storage unit 12 of the server 10 is acquired by the file acquisition unit 211 of the browser 210. Then, based on the description of JavaScript (registered trademark), the control unit 21 causes the ducking management means 213, the main / sub specification means 214, and the output condition setting means 215 to function.

The ducking management means 213 detects the necessity of ducking processing.
The main / sub specification unit 214 specifies main content or sub content for a plurality of contents used for file reproduction.

  The output condition setting unit 215 sets an output condition when main content and sub content are output simultaneously. The output condition setting means 215 holds information related to the output conditions (output levels) of the main content and sub-content when the main content and sub-content are output simultaneously. For example, in the case of content related to audio, information related to a setting for increasing the volume ratio between main content and sub-content is stored. Thereby, main content can be made conspicuous with respect to subcontent.

Next, with reference to FIG. 2, processing when the client terminal 20 outputs content included in a file will be described.
First, the control unit 21 of the client terminal 20 executes a file reading process (step S1-1). Specifically, the URL of the file to be output is input to the browser 210 via the input / output unit 23. In this case, the browser 210 requests the content of the URL from the server 10 by the file acquisition unit 211. Then, the browser 210 acquires a file from the server 10. Here, it is assumed that a markup language file is acquired as a file. This file includes descriptions for realizing the ducking management means 213, the main / sub-specification means 214, and the output condition setting means 215. Further, this file includes information on content (for example, audio) used at the time of output.

  Next, the control unit 21 of the client terminal 20 executes a file reproduction process (step S1-2). Specifically, the output processing means of the browser 210 of the control unit 21 outputs a file acquired from the server 10. Here, when outputting a single content included in the file, it is reproduced as it is.

In this case, the control unit 21 of the client terminal 20 executes a ducking process.
In this ducking process, first, the control unit 21 of the client terminal 20 executes an event standby process (step S2-1). Specifically, the browser 210 of the control unit 21 waits for an event in which a plurality of contents are simultaneously output by the ducking management unit 213.

  When detecting an event in which a plurality of contents are output at the same time, the control unit 21 of the client terminal 20 executes a determination process as to whether or not ducking is necessary (step S2-2). Specifically, in the browser 210 of the control unit 21, the ducking management unit 213 confirms the presence / absence of main / sub setting information for a plurality of contents included in the file. If main / sub setting information is included, it is determined that ducking is necessary.

If it is determined that ducking is not necessary (“NO” in step S2-2), the event standby process (step S2-1) is continued.
On the other hand, when it is determined that ducking is necessary (in the case of “YES” in step S2-2), the control unit 21 of the client terminal 20 executes a main / sub content specifying process (step S2-3). Specifically, the browser 210 of the control unit 21 uses the main / sub specifying unit 214 to specify the main content based on the main / sub setting information included in the file.

  Next, the control unit 21 of the client terminal 20 executes a process for changing the output condition of the main / sub content (step S2-4). Specifically, the browser 210 of the control unit 21 acquires a preset output condition by the output condition setting means 215 and changes to this output condition. For example, in the case of audio content, the output condition is changed to increase the volume of the main content and decrease the volume of the sub-content.

  Next, the control part 21 of the client terminal 20 performs the determination process about whether it is the end of ducking (step S2-5). Specifically, the browser 210 of the control unit 21 waits for the end of an event in which a plurality of contents are simultaneously output by the ducking management unit 213.

If it is determined that the ducking is not completed ("NO" in step S2-5), the changed output condition is maintained.
On the other hand, when it is determined that the ducking is finished (in the case of “YES” in step S2-5), the control unit 21 of the client terminal 20 executes a process for restoring the output condition (step S2-6). Specifically, in the browser 210 of the control unit 21, the output condition setting unit 215 restores the changed output condition. For example, in the audio content, the lowered volume is raised to return to the original volume.

  Next, an example of a code (program) provided in the file (markup language file) to the client terminal 20 will be described with reference to FIGS. Here, it is assumed that a code written using JavaScript (registered trademark) is provided. In this code example, it is assumed that audio content is ducked. Hereinafter, this code will be described by dividing it into two first parts 500 (FIG. 3) and second parts 510 (FIG. 4).

The first part 500 shown in FIG. 3 includes descriptions 501 to 507.
In the description 501, the object “scene” is generated based on the object “AudioScene”.

In the description 502, an environmental sound (“EnvironmentSound-1”, “EnvironmentSound-2”) and a character voice (“Speech”) are added to the object “scene” in the scene.

In the description 503, the environmental sound is reproduced.
In the description 504, the voice of the character is reproduced. In the case of reproducing the voice of the character, ducking is performed as will be described later.

The description 505 sets a small volume determination function that returns a small volume (output condition) as a return value, and the description 506 sets a large volume determination function that returns a large volume (output condition) as a return value.
In the description 507, a function for adding sound to the scene in the description 502 is set.

The second part 510 shown in FIG. 4 includes descriptions 511 to 515 for ducking.
In the description 511, the primary sound (main voice) is determined. Here, the voice of the character (“Speech”) is used as the main voice.

In the description 512, all sounds included in the scene are operated based on the description 502.
In the description 513, when the primary sound (main sound) is acquired, this sound is reproduced using a large volume according to the length of the main sound.

In the description 514, the volume of the secondary (sub audio) is restored when the reproduction of the primary sound (main audio) is finished.
On the other hand, in the description 515, the sound other than the primary, that is, the secondary sound (sub sound) is reproduced with a small volume.

According to this embodiment, the following effects can be obtained.
(1) In this embodiment, a description for realizing the ducking management means 213 is included in the file. The ducking management unit 213 detects an event of simultaneously outputting a plurality of contents during file reproduction. Thereby, the ducking process can be performed in the reproduction of the content.

  (2) In this embodiment, a description for realizing the main / sub specification unit 214 and the output condition setting unit 215 is included in the file. The main / sub specification unit 214 specifies main content or sub content for a plurality of contents used for file reproduction. The output condition setting unit 215 sets an output condition when the main content and the sub content are output simultaneously. Accordingly, it is not necessary to prepare content material in which main content and sub content according to output conditions are set in advance, and ducking processing can be performed efficiently. Therefore, even in an application in which the content output state and playback time are determined at the time of playback, ducking can be performed without processing the content material.

<Second Embodiment>
Next, a second embodiment of the output control program will be described with reference to FIG. In the first embodiment, preset output conditions are used in the ducking process. In the second embodiment, in the ducking process, the output condition is determined according to the reproduction environment of the file (content), and the description of the same part is omitted.

  In this case, the reproduction condition information is specified by the output condition setting means 215 that is operated by the output control program. For example, ambient environment information is acquired as reproduction environment information using a sensor (such as a microphone or a CCD) provided in the client terminal 20. This ambient environment information is, for example, information regarding the noise level and brightness of the place where the client terminal 20 is used. The output condition setting means 215 holds an output condition determination table for determining an output condition corresponding to the ambient environment information. In this output condition determination table, for example, an output condition (for example, the volume of main / sub content) corresponding to the noise level is recorded. In addition, output conditions (for example, brightness and contrast of main and sub contents) corresponding to the brightness level are recorded.

Next, the ducking process in the present embodiment will be described with reference to FIG.
Here, similarly to steps S2-1 and S2-2, the control unit 21 of the client terminal 20 performs an event standby process (step S3-1) and a determination process (step S3-2) as to whether or not ducking is necessary. Run.

If it is determined that ducking is not necessary (“NO” in step S3-2), the event standby process (step S3-1) is continued.
On the other hand, when it is determined that ducking is necessary (in the case of “YES” in step S3-2), the control unit 21 of the client terminal 20 executes the main / sub content specifying process as in step S2-3 (step S2-3). S3-3).

  Next, the control unit 21 of the client terminal 20 executes a reproduction environment specifying process (step S3-4). Specifically, the browser 210 of the control unit 21 uses the output condition setting unit 215 to acquire information related to the reproduction environment of the client terminal 20 that reproduces the content.

  Next, the control unit 21 of the client terminal 20 executes processing for changing the output condition of the main / sub content according to the reproduction environment (step S3-5). Specifically, the browser 210 of the control unit 21 uses the output condition setting unit 215 to specify an output condition corresponding to the reproduction environment using the output condition determination table. Then, the output processing unit 212 changes the output condition to the main / sub content reproduction.

  Next, the control part 21 of the client terminal 20 performs the determination process about whether it is the end of ducking similarly to step S2-5 (step S3-6). When it is determined that the ducking is not finished (in the case of “NO” in step S3-6), the control unit 21 of the client terminal 20 maintains the changed output condition.

  On the other hand, when it is determined that the ducking is finished (in the case of “YES” in step S3-6), the control unit 21 of the client terminal 20 executes a process for returning the output condition as in step S2-6 (step S2-6). S3-7).

  In the present embodiment, the volume of the object “AudioScene” shown in FIG. 3 is adjusted according to the playback environment in the descriptions 505 and 506. For this purpose, the object “AudioScene” includes a description for acquiring information related to the reproduction environment. Then, in the description 505, a small volume (output condition) corresponding to the reproduction environment is returned as a return value using a small volume determination function using the reproduction environment information as a variable. Also, in the description 506, a large volume (output condition) corresponding to the reproduction environment is returned as a return value using a large volume determination function using the reproduction environment information as a variable.

According to this embodiment, the following effects can be obtained.
(3) In the present embodiment, the control unit 21 of the client terminal 20 executes processing for changing the output condition of the main / sub content according to the reproduction environment (step S3-5). Thereby, ducking according to the reproduction environment can be performed.

In addition, you may change the said embodiment as follows.
In each of the above embodiments, for example, audio content is used, but the content is not limited to audio. It is also possible to use various media contents such as still picture contents and moving picture contents. In this case, for example, the object “MediaScene” is used instead of the object “AudioScene”. In this object, a function (for example, “setOutputLevel”) for changing output conditions such as brightness and contrast of an image is executed. For example, in the ducking process, the main content is brightened or the contrast is enhanced.

  In each of the above embodiments, the file includes a description for realizing the ducking management unit 213, the main / sub specification unit 214, and the output condition setting unit 215. This description is not limited to being included in the file. An acquisition destination may be set in the file, and a description may be acquired from the acquisition destination.

  In each of the above embodiments, the file includes main / sub setting information for specifying either main content or sub content in each content. In this case, the main content or sub-content is not limited to being fixed, and the main content and sub-content may be changed according to the situation. In this case, main / sub determination conditions for main contents are set in the main / sub setting information. In this main / sub determination condition, a logic for determining main contents and sub contents is set in association with the situation. When an event is detected, main contents and sub contents are determined using main / sub determination conditions. Thereby, the main-sub relationship can be determined at the time of file reproduction.

  In the second embodiment, the output condition setting unit 215 specifies reproduction environment information. For example, ambient environment information (reproduction environment information) is acquired using a sensor (such as a microphone or a CCD) provided in the client terminal 20. The reproduction environment information is not limited to the surrounding environment information. For example, a file playback scene (scene on a scenario) where an event has occurred may be specified as playback environment information. In this case, an output condition is set in the output condition setting function in association with the scene information in which the event has occurred.

  It is also possible to use the configuration information of the hardware configuration and software configuration installed in the client terminal 20 as the reproduction environment information. In this case, the output condition is set in the output condition setting function in association with the configuration information of the hardware configuration or software configuration. Then, the output condition setting unit 215 acquires the configuration information of the hardware configuration and the software configuration, and calculates the output condition based on this configuration information.

  Furthermore, it is also possible to use the content reproduction frequency as reproduction environment information. In this case, the number of times of reproduction is recorded for each content in the output condition setting means 215. Then, an output condition is set in the output condition setting function in association with the number of reproductions. For example, when the number of times of reproduction increases, the output level is lowered by decreasing the volume of the content or weakening the contrast. This makes it possible to adjust content that is frequently repeated.

In the second embodiment, when it is determined that ducking is not completed (“NO” in step S3-6), the control unit 21 of the client terminal 20 maintains the changed output condition. Instead of this, the output conditions of the main / sub contents at the time of ducking may be changed sequentially. Here, when it is determined that ducking is not completed (in the case of “NO” in step S3-6), the control unit 21 of the client terminal 20 returns to the reproduction environment specifying process (step S3-4). Thereby, an output condition can be changed dynamically with respect to time passage.

  In each of the above embodiments, the control unit 21 is caused to function as the ducking management unit 213, the main / sub specification unit 214, and the output condition setting unit 215 by causing the client terminal 20 to execute the output control program. Here, the environment for executing the output control program is not limited to the client terminal 20. For example, the output control program may be executed in a management server connected to the client terminal 20 that outputs content. In this case, the management server obtains content output status information and playback environment information from the client terminal 20, and determines the content output conditions using these pieces of information. Then, the client terminal 20 outputs content according to this output condition.

  DESCRIPTION OF SYMBOLS 10 ... Server, 12 ... File storage part, 20 ... Client terminal, 21 ... Control part, 22 ... Terminal storage part, 23 ... Input / output part, 211 ... File acquisition means, 212 ... Output processing means, 213 ... Ducking management means, 214... Main / sub identification means, 215... Output condition setting means.

Claims (7)

In a computer terminal having a browser that displays a web page based on a file described in a markup language, a program that functions as an execution unit that reproduces a plurality of contents included in the web page,
A control unit of the computer terminal;
Main / sub-identifying means for identifying main contents and sub-contents by logic for determining main contents and sub-contents for a plurality of contents to be output at the time of reproduction of a markup language constituting the web page acquired by the browser;
An output condition setting means for acquiring a volume as an output condition of the main content and sub-content at the time of ducking according to an output condition associated with a file playback scene in which an event has occurred;
In the markup language, when an event to perform ducking is detected, the output of the main content and the sub content is changed to the volume, and when the event ends, the markup language functions as an output adjustment unit that returns the volume. Output control program.   The output condition setting means is configured to acquire ambient environment information of a computer terminal that displays the web page, and hold a function for calculating an output condition based on the ambient environment information. The output control program according to 1.   The output condition setting unit is configured to acquire configuration information of a hardware configuration of a computer terminal that displays the web page, and hold a function for calculating an output condition based on the configuration information. The output control program according to claim 1 or 2.   The output condition setting means is configured to acquire configuration information of a software configuration of a computer terminal that displays the web page and hold a function for calculating an output condition based on the configuration information. Item 4. The output control program according to any one of Items 1 to 3.   The output condition setting means specifies a frequency of output of each content in a computer terminal that displays the web page, and a function for calculating an output condition based on the output frequency
The output control program according to any one of claims 1 to 4, wherein the output control program is stored. An output control device including a browser that displays a web page based on a file described in a markup language, and a control unit that functions as an execution unit that reproduces a plurality of contents included in the web page,
The control unit is
When reproducing the markup language that constitutes the web page acquired by the browser, the main content and the sub content are identified by the logic for determining the main content and the sub content for the plurality of contents to be output,
The volume as the output condition of the main content and the sub content at the time of ducking is acquired according to the output condition associated with the file playback scene in which the event has occurred,
In the markup language, when an event for ducking is detected, the output of the main content and the sub-content is changed to the volume, and the volume is returned at the end of the event. Output is controlled using an output control device that includes a browser that displays a web page based on a file written in a markup language, and a control unit that functions as an execution means for playing back a plurality of contents contained in the web page A way to
The control unit is
When reproducing the markup language that constitutes the web page acquired by the browser, the main content and the sub content are identified by the logic for determining the main content and the sub content for the plurality of contents to be output,
The volume as the output condition of the main content and the sub content at the time of ducking is acquired according to the output condition associated with the file playback scene in which the event has occurred,
In the markup language, when an event for ducking is detected, the output of the main content and the sub-content is changed to the volume, and the volume is returned at the end of the event.

Images