WO2016042899A1

WO2016042899A1 - Output control method, information processing device, and control method and control program therefor

Info

Publication number: WO2016042899A1
Application number: PCT/JP2015/070061
Authority: WO
Inventors: 英男長谷川
Original assignee: 日本電気株式会社
Priority date: 2014-09-16
Filing date: 2015-07-13
Publication date: 2016-03-24

Abstract

This device relates to an information processing device that adjusts, with a simple configuration, the output among a plurality of applications that are in operation. This information processing device comprises: a display unit that displays screens corresponding to respective applications in respective ones of at least two display frames; an attribute storage unit that stores attributes in association with the respective display frames; and an output control unit that, in accordance with the attributes stored in the attribute storage unit in association with the respective display frames, controls an output based on the application corresponding to the screen displayed on each display frame.

Description

Output control method, information processing apparatus, control method thereof, and control program

The present invention relates to an output control method, an information processing apparatus, a control method thereof, and a control program.

In the above technical field, in Patent Document 1, in a multi-window system, it is detected whether or not an operated application generates sound, and a window related to the application detecting the sound is displayed in an identifiable manner. Techniques to do this are disclosed.

Japanese Patent Laid-Open No. 5-204355

However, in the technique described in the above document, for example, when sound is generated in a plurality of applications displaying windows, sound generation between applications cannot be adjusted, and a plurality of sounds are mixed and the user is mixed. Will be uncomfortable. That is, it is not easy to adjust output between a plurality of running applications, not limited to voice.

An object of the present invention is to provide a technique for solving the above-described problems.

In order to achieve the above object, an information processing apparatus according to the present invention provides:
Display means for displaying a screen corresponding to the application in each of at least two display frames;
Attribute storage means for storing attributes in association with each of the display frames;
Output control means for controlling output based on the application corresponding to the screen displayed on each of the display frames in accordance with attributes stored in the attribute storage means in association with the display frames;
Is provided.

To achieve the above object, a method for controlling an information processing apparatus according to the present invention includes:
A display step of displaying a screen corresponding to the application in each of at least two display frames;
An output control step of controlling output based on the application corresponding to the screen displayed on each of the display frames according to an attribute stored in association with each of the display frames;
including.

In order to achieve the above object, a control program for an information processing apparatus according to the present invention provides:
A display step of displaying a screen corresponding to the application in each of at least two display frames;
An output control step of controlling output based on the application corresponding to the screen displayed on each of the display frames according to an attribute stored in association with each of the display frames;
Is executed on the computer.

In order to achieve the above object, an output control method according to the present invention includes:
An associated step associating an attribute with each of the at least two display frames;
An output control step of controlling output based on an application corresponding to a screen displayed in each of the display frames according to an attribute associated with each of the display frames;
including.

According to the present invention, it is possible to adjust the output between a plurality of operating applications with a simple configuration.

It is a block diagram which shows the structure of the information processing apparatus which concerns on 1st Embodiment of this invention. It is an operation | movement figure of output control of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is another operation | movement diagram of the output control of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is another operation | movement diagram of the output control of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the function structure of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the display frame information which concerns on 2nd Embodiment of this invention. It is a figure which shows the structure of the operation determination table which concerns on 2nd Embodiment of this invention. It is a figure which shows the software structure of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the process sequence of the information processing apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the procedure of the display frame control which concerns on 2nd Embodiment of this invention. It is a figure which shows the attribute display of the information processing apparatus which concerns on 3rd Embodiment of this invention. It is a figure which shows attribute setting and attribute adjustment of the information processing apparatus which concerns on 3rd Embodiment of this invention. It is a figure which shows the memory | storage structure of the attribute adjustment value of the information processing apparatus which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the procedure of the attribute setting process of the information processing apparatus which concerns on 3rd Embodiment of this invention. It is an operation | movement figure of output control of the information processing apparatus which concerns on 4th Embodiment of this invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the constituent elements described in the following embodiments are merely examples, and are not intended to limit the technical scope of the present invention only to them.
[First Embodiment]
An information processing apparatus 100 as a first embodiment of the present invention will be described with reference to FIG. The information processing apparatus 100 is an apparatus that performs output based on an application.

As shown in FIG. 1, the information processing apparatus 100 includes a display unit 101, an attribute storage unit 102, and an output control unit 103. The display unit 101 displays a screen corresponding to the application on each of at least two display frames 111 and 112 (see screen 110). The attribute storage unit 102 stores an attribute in association with each display frame. The output control unit 103 controls output based on an application corresponding to the screen displayed on each display frame according to the attribute stored in the attribute storage unit 102 in association with the display frame.

According to the present embodiment, since the output based on the application is controlled by the attribute associated with the display frame, it is possible to adjust the output between a plurality of operating applications with a simple configuration.

[Second Embodiment]
Next, an information processing apparatus according to the second embodiment of the present invention will be described. The information processing apparatus according to the present embodiment stores an attribute associated with each of at least two display frames based on an operation on the screen, and outputs an output based on an application corresponding to the screen displayed on each of the display frames. Control according to the attributes associated with each of the display frames. In the present embodiment, the description will focus on audio output. However, the present invention is not limited to audio output as long as output attributes are set in the display frame.

<Output control operation>
FIG. 2A is an operation diagram of output control of the information processing apparatus 200 according to the present embodiment. FIG. 2A shows an example in which application assignment to a display frame is changed in split display. In FIG. 2A, the sound output before the change → the sound output after the change is shown from the left.

2A, a display frame 211 and a display frame 212 are divided and displayed on the display screen 210 of the information processing apparatus 200. The display frame 211 has an audio output permission attribute, and the display frame 212 has an audio output stop attribute. Application A is assigned to the display frame 211, and application B is assigned to the display frame 212. Therefore, only the sound generated by application A is output.

Here, when the assignment of the application to the display frame is switched, the application B is assigned to the display frame 211, and the application A is assigned to the display frame 212, only the sound generated by the application B is output (upper right diagram). reference).

2A, a display frame 213, a display frame 214, and a display frame 215 are divided and displayed on the display screen 210 of the information processing apparatus 200. The display frame 214 has an audio output permission attribute, and the display frames 213 and 215 have an audio output stop attribute. Application A is assigned to the display frame 213, application B is assigned to the display frame 214, and application C is assigned to the display frame 215. Therefore, only the sound generated by the application B is output.

Here, when the assignment of the application to the display frame is changed, the application B is assigned to the display frame 213 and the application A is assigned to the display frame 214, only the sound generated by the application A is output (right center). (See figure). On the other hand, when the assignment of the application to the display frame is changed, the application C is assigned to the display frame 214 and the application B is assigned to the display frame 215, only the sound generated by the application C is output (see the lower right figure). ).

Thus, the audio output generated by the application can be controlled by the audio output attribute set in the display frame.

FIG. 2B is another operation diagram of output control of the information processing apparatus 200 according to the present embodiment. FIG. 2B shows an example in which application assignment to a display frame is changed in superimposed display. In FIG. 2B, the audio output before change → the audio output after change is illustrated from the left.

2B, the display frame 217 is superimposed on the display frame 216 on the display screen 210 of the information processing apparatus 200. The display frame 217 has an audio output permission attribute, and the display frame 216 has an audio output stop attribute. Application A is assigned to the display frame 216, and application B is assigned to the display frame 217. Therefore, only the sound generated by the application B is output.

Here, when the assignment of the application to the display frame is switched, and the application C is assigned to the display frame 217 while the application A is assigned to the display frame 216, only the sound generated by the application C is output (upper right corner). (See figure).

2B, on the display screen 210 of the information processing apparatus 200, four display frames are superimposed and displayed in the order of the display frame 222, the display frame 221, the display frame 224, and the display frame 222 from the front. An audio output permission attribute is set in the display frame 222, and an audio output stop attribute is set in the other display frames 221, 223, and 224. An application A is assigned to the display frame 221, an application B is assigned to the display frame 222, an application C is assigned to the display frame 223, and an application D is assigned to the display frame 224. Therefore, only the sound generated by the application B is output.

Here, when the assignment of the application to the display frame is changed, the application C is assigned to the display frame 222 and the application E is assigned to the display frame 223, only the sound generated by the application C is output (right center). (See figure). On the other hand, when the assignment of the application to the display frame is changed, the application C is assigned to the display frame 214 and the application B is assigned to the display frame 215, only the sound generated by the application C is output (see the lower right figure). ).

FIG. 2C is still another operation diagram of the output control of the information processing apparatus 200 according to the present embodiment. FIG. 2C shows an example in which multiple launches of the same application and audio output for multiple display frames are permitted.

2C, the display frame 211 and the display frame 212 are divided and displayed on the display screen 210 of the information processing apparatus 200. The display frame 211 has an audio output permission attribute, and the display frame 212 has an audio output stop attribute. A plurality of the same applications A are launched, and the same application A is assigned to both the display frames 211 and 212. Accordingly, only the sound generated by the application A assigned to the display frame 211 is output.

2C, a display frame 216 and a display frame 217 are superimposed on the display screen 210 of the information processing apparatus 200. The display frame 217 has an audio output permission attribute, and the display frame 216 has an audio output stop attribute. A plurality of the same applications A are launched, and the same application A is assigned to both the display frames 216 and 217. Therefore, only the sound generated by the application A assigned to the display frame 217 is output.

2C, a display frame 211 and a display frame 212 are divided and displayed on the display screen 210 of the information processing apparatus 200. On both the display frame 211 and the display frame 212, there is a setting display 231 for the presence / absence of audio output and an output level adjustment bar. A plurality of the same applications A are launched, and the same application A is assigned to both the display frames 211 and 212. Therefore, the sound generated by the application A assigned to the display frames 211 and 212 may be output in a mixed manner corresponding to the level setting, and may be used, for example, for stereo sound output.

2C, a display frame 211 and a display frame 212 are divided and displayed on the display screen 210 of the information processing apparatus 200. On both the display frame 211 and the display frame 212, a setting display 231 for the presence / absence of audio output and the output level is displayed. Application A is assigned to the display frame 211, and application C is assigned to the display frame 212. Therefore, the sound generated by the application A assigned to the display frame 211 and the sound generated by the application C assigned to the display frame 212 are mixed and output corresponding to the level setting.

Note that the variety of audio output control by setting the audio output attribute to the display frame is not limited to the above example.

<< Functional configuration of information processing device >>
FIG. 3 is a block diagram illustrating a functional configuration of the information processing apparatus 200 according to the present embodiment.

The information processing apparatus 200 includes a display unit 301 having a display panel and an operation unit 302 having a touch panel or a home button. Among these, the display panel and the touch panel constitute the display screen 210. Further, the information processing apparatus 200 includes a display control unit 303, a display data generation unit 304, an application execution operation determination unit 305, and an application execution unit 306.

The application execution operation determination unit 305 determines an application execution operation in the operation unit 302, and activates and executes the application in the application execution unit 306 in the case of the application execution operation. The display data generation unit 304 generates display data according to the application to be executed. The display control unit 303 has display frame information 330, and performs display control by assigning display data generated by executing the application to the display frame and causing the display unit 301 to display the display data.

Furthermore, the information processing apparatus 200 includes a display frame operation determination unit 307. The display frame operation determination unit 307 has an operation determination table 370 and determines a display frame operation including application assignment based on the operation in the operation unit 302. When the display frame operation determination unit 307 determines a display frame operation, the display control unit 303 performs a display frame operation including application assignment by changing the display frame information 330.

(Display frame information)
FIG. 4 is a diagram showing a configuration of the display frame information 330 according to the present embodiment. The display frame information 330 is used by the display control unit 303 to arrange display information related to the application on the screen, and to store the attribute of the display frame and reflect it in the output based on the application. In FIG. 4, in order to maintain generality, different values are set in the y-axis direction (vertical direction) depending on the display frame in the frame display position and the frame size. However, for example, in the case of a split screen in the x-axis direction (horizontal direction), the values of y and h are the same in any display frame.

4 is a storage configuration of the display frame information 330. The display frame information 330 stores each display frame position 402 and display frame size 403 in association with the display frame ID 401. The display position may be at the upper left of the display frame, but is not limited. Further, instead of the display frame position 402 and the display frame size 403, two display positions of the display frame angle may be used.

The display frame information 330 stores a display frame attribute 404 set for the display frame in association with the display frame ID 401. The details of the display frame attribute 404 include, for example, the presence / absence and output level of audio, whether the display is a document or a moving image, or an operation button displayed in the display frame, as shown in the middle part of FIG. Note that the attributes are not limited to these.

The display frame information 330 stores an application that generates information displayed in the display frame in association with the display frame ID 401 as the display allocation application 405. Then, document data, image data, moving image data, audio data, and the like are stored as the display frame content 406 generated by the application.

Further, as shown in the lower part of FIG. 4, the display frame information 330 stores a default value when a display frame is generated or a setting value of an attribute stored in association with the display frame ID as a default attribute. In this default value, a display frame position 412, a display frame size 413, and a display frame attribute 414 are stored in association with the display frame ID 411. For example, the position, size, and default values of the full-screen display are stored in the first display frame with the display frame ID F001. Then, in the display frame whose designated display frame ID is F00X, a setting value to be saved and reused is stored.

Specifically, for example, regarding the sound volume, settings such as a sound volume of 50% for the right display frame and a sound volume of 20% for the left display frame can be considered. Further, when setting the application of the last dropped screen, the attribute of the display frame to which the last dropped application is assigned is stored in the initial value of the display frame with the display frame ID F001. Alternatively, when determining a preferentially permanent screen frame, control is performed so that a display frame having a display frame ID F00X for storing a predetermined setting value is generated first.

(Operation judgment table)
FIG. 5 is a diagram showing a configuration of the operation determination table 370 according to the present embodiment. The operation determination table 370 is used by the display frame operation determination unit 307 to detect a user's screen operation and instruct the display control unit 303 to perform processing that satisfies the operation determination condition.

The operation determination table 370 stores a determination result 503 instructed to the display control unit 303 in association with the screen operation 501 and the operation determination condition 502. Although all the operations and conditions shown in FIG. 5 are not described in detail, the groups from the top are roughly divided into a display frame processing group, an application processing group, and a special processing group. . Note that the relationship between the screen operation and the instruction to the display control unit 303 is not limited to these.

<< Software configuration of information processing equipment >>
FIG. 6 is a diagram illustrating a software configuration of the information processing apparatus 200 according to the present embodiment. FIG. 6 shows an example in which two applications A and B are activated, but the number of activations is not limited. In FIG. 6, audio output and display are described, but other output control can similarly reflect the attributes of the display frame. Note that FIG. 6 does not show general-purpose software such as an OS (Operating System).

Each application A and B generates audio data output by the audio output driver 611. Each application A and B generates display data output by the display driver 612. The output of the audio output driver 611 is temporarily held in the

audio output buffers

621 and 622, respectively. The output of the display driver 612 is temporarily held in

display buffers

631 and 632, respectively.

The audio output control module 620 that controls the audio output from the audio output unit 311 is temporarily stored in the

audio output buffers

621 and 622 corresponding to the audio output attribute 623 set in the display frame to which each application is assigned. Control the output of audio data.

On the other hand, the display frame control module 630 that controls the display output from the display unit 301 or the operation input from the operation unit 302 corresponds to the display attribute 633 set in the display frame to which each application is assigned, and the display buffer 631. And 632 to control the output of display data temporarily held.

<< Hardware configuration of information processing equipment >>
FIG. 7 is a block diagram illustrating a hardware configuration of the information processing apparatus 200 according to the present embodiment.

In FIG. 7, a CPU (Central Processing Unit) 710 is a processor for arithmetic control, and implements a functional component of the information processing apparatus 200 of FIG. 3 by executing a program. A ROM (Read Only Memory) 720 stores fixed data and programs such as initial data and programs. The communication control unit 730 communicates with other devices via a network. Note that the number of CPUs 710 is not limited to one, and may be a plurality of CPUs or may include a GPU (Graphic Processing Unit) for image processing. The communication control unit 730 preferably includes a CPU independent of the CPU 710 and writes or reads transmission / reception data in a RAM (Random Access Memory) 740 area. Also, it is desirable to provide a DMAC (Direct Memory Access Controller) that transfers data between the RAM 740 and the storage 750 (not shown). Further, the input / output interface 760 preferably has a CPU independent of the CPU 710 and writes or reads input / output data to / from the area of the RAM 740. Therefore, the CPU 710 recognizes that the data has been received or transferred to the RAM 740 and processes the data. Further, the CPU 710 prepares the processing result in the RAM 740 and leaves the subsequent transmission or transfer to the communication control unit 730, the DMAC, or the input / output interface 760.

The RAM 740 is a random access memory that the CPU 710 uses as a temporary storage work area. In the RAM 740, an area for storing data necessary for realizing the present embodiment is secured. The display frame information 330 stores the definition of the display frame including attribute information set in the display frame and the association with the application. The display frame operation determination table 370 is a table for determining an operation on a display frame from a screen operation. The input / output data 741 is transfer data with the display unit 301 and the operation unit 302 via the input / output interface 760. The transmission / reception data 742 is data transmitted / received via the communication control unit 730.

The storage 750 stores a database, various parameters, or the following data or programs necessary for realizing the present embodiment. The application storage unit 751 stores an application executed by the information processing apparatus 200. The display frame format 752 stores the format of the display frame stored in the display frame information 330. The display frame attribute type 753 defines an attribute to be set for the display frame in the present embodiment. The operation determination algorithm 754 stores a display frame operation determination algorithm.

The storage 750 stores the following programs. The information processing device control program 755 is a basic program that controls the entire information processing device 200. The application execution control module 756 is a module that executes an application stored in the application storage unit 751. The display frame control module 630 is a module that controls the arrangement of the display frame to which the display information generated according to the execution of the application is allocated on the display unit 301, and reflects the attribute set in the display frame in the display output based on the application. is there. The audio output control module 620 is a module that reflects the attribute set in the display frame in the audio output based on the application in response to the assignment of the application to the display frame by the display frame control module 630.

The input / output interface 760 interfaces input / output data with input / output devices. A display unit 301, an operation unit 302, a sound output unit 311, and the like are connected to the input / output interface 760. Also, a voice input unit and a GPS (Global Positioning System) position determination unit may be connected.

It should be noted that the RAM 740 and the storage 750 in FIG. 7 do not show programs and data related to general-purpose functions and other realizable functions that the information processing apparatus 200 has.

<< Processing procedure of information processing device >>
FIG. 8 is a flowchart illustrating a processing procedure of the information processing apparatus 200 according to the present embodiment. This flowchart is executed by the CPU 710 in FIG. 6 using the RAM 640, and implements the functional configuration unit in FIG.

In step S811, the information processing apparatus 200 determines whether an application execution operation on the display screen has been performed. When an application execution operation is performed, the information processing apparatus 200 executes the instructed application in step S813. Next, the information processing apparatus 200 generates display data related to the execution of the application in step S815. In step S817, the information processing apparatus 200 passes the generated display data to be displayed within the assigned display frame.

If the operation is not an application execution operation, the information processing apparatus 200 determines in step S821 whether or not an operation for ending the application being executed has been performed. When an operation to end the application being executed is performed, the information processing apparatus 200 ends the instructed application in step S823.

If it is not an application execution operation and an end operation, the information processing apparatus 200 determines in step S831 whether or not an attribute setting operation has been performed on the display frame. If it is determined that the attribute setting operation has been performed, the information processing apparatus 200 instructs the attribute setting on the display frame in which the attribute setting has been operated in step S833.

If neither the application execution operation nor the end operation is an attribute setting for the display frame, the information processing apparatus 200 determines in step S841 whether an operation for assigning an application to the display frame has been performed. If it is determined that an application assignment operation has been performed, the information processing apparatus 200 instructs the display control unit 303 to perform an application assignment operation in step S843.

If it is neither the application execution operation nor the end operation, the attribute setting to the display frame, nor the application assignment operation, the information processing apparatus 200 performs other processing instructed in step S851.

(Display frame control)
FIG. 9 is a flowchart showing a display frame control procedure according to the present embodiment.

In step S911, the information processing apparatus 200 determines whether display frame data has been received in the process of step S817 of FIG. When the display frame data is received, the information processing apparatus 200 generates a display frame in step S913. Next, in step S915, the information processing apparatus 200 sets the display data received in the generated display frame. In step S917, the information processing apparatus 200 divides the display screen to display display frame display data. In steps S913 to S917, the procedure for dividing the display screen is shown. If the divided screen is generated in advance by a plurality of display frames, the display data is assigned to the display frame corresponding to the application, and the generation of the display frame in step S913 is not necessary.

If the display frame data is not received, the information processing apparatus 200 determines in step S921 whether or not an application termination instruction is received in the process of step S823 of FIG. When receiving the application termination instruction, the information processing apparatus 200 deletes the display frame displaying the display data in step S923. Then, the information processing apparatus 200 rearranges the display screen in step S925. As described above, when the divided screen is set in advance, it is only rearranged in the opened display frame, and the display frame is not deleted in step S923.

If the display frame data has not been received and no application termination instruction has been received, the information processing apparatus 200 determines in step S931 whether or not an attribute setting instruction has been received in the process of step S833 of FIG. To do. When receiving the attribute setting instruction, the information processing apparatus 200 executes display frame attribute information setting or updating processing in step S933.

If the display frame data is not received, the application termination instruction is not received, and the attribute setting instruction is not received, the information processing apparatus 200 performs an application assignment operation in step S941 by the process of step S843 in FIG. It is determined whether or not an instruction is received. When receiving the instruction for the application assignment operation, the information processing apparatus 200 executes a processing operation for assigning the application of the display frame in step S943.

According to the present embodiment, since the output from the application is controlled by the attribute associated with the display frame based on the operation on the screen, it is possible to adjust the output between a plurality of operating applications with a simple configuration. it can.

[Third Embodiment]
Next, an information processing apparatus according to the third embodiment of the present invention will be described. The information processing apparatus according to the present embodiment differs from the second embodiment in that the attributes set in the display frame are viewed or set by a dedicated attribute display screen or attribute setting screen. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

《Attribute display》
FIG. 10 is a diagram showing attribute display of the information processing apparatus 1000 according to the present embodiment. FIG. 10 is a browsing screen in which the configuration of the display frame and the attributes set in each display frame are displayed by an operation from the display screen. Such a browsing screen is an example, and the present invention is not limited to this.

The current display frame layout 1011 on the display screen is displayed on the browsing screen. In FIG. 10, horizontal division of two screens is shown. An application assignment 1012 for each display frame is displayed. FIG. 10 shows that application A is assigned to the left display frame 1 and application B is assigned to the right display frame 2.

For each display frame, its arrangement and size, and setting contents of each attribute are listed.

《Attribute setting and attribute adjustment》
FIG. 11 is a diagram showing attribute setting and attribute adjustment of the information processing apparatus 1000 according to the present embodiment. FIG. 11 shows the attribute setting state of display frame 1 in two-screen division and the attribute setting state of display frame 2 in three-screen division. Such an attribute setting screen is an example, and the present invention is not limited to this.

In the left diagram of FIG. 11, various screen division selection and display frame selection menus for attribute setting are displayed. The left diagram of FIG. 11 shows a two-screen division menu 1111 and a three-screen division menu 1112.

When the display frame 1 divided into two screens in the horizontal direction is selected, a menu for setting the position and size of the display frame 1 and attribute settings is displayed on the screen 1121 in the upper center diagram. When voice is selected from the attribute setting menu, a voice attribute detail setting screen 1131 shown in the upper right diagram is displayed. On the audio attribute detail setting screen 1131, the presence / absence of an audio output and the output level are set. When display is selected from the attribute setting menu, a display attribute detail setting screen 1132 shown in the lower right diagram is displayed. On the display attribute detail setting screen 1132, display output brightness, contrast color tone, and the like are set.

On the other hand, when the display frame 2 divided into three screens is selected, a menu for setting the position and size of the display frame 2 and attribute setting is displayed on the screen 1122 in the lower center diagram. Since the subsequent steps are the same as the horizontal two-screen division, illustration and description are omitted.

(Attribute adjustment value)
FIG. 12 is a diagram showing a storage configuration of the attribute adjustment value 1200 of the information processing apparatus according to the present embodiment. The attribute adjustment value 1200 of FIG. 12 is included in the display frame information of FIG.

The adjustment value 1202 is stored in association with each item of the attribute 1201 in correspondence with the setting according to the display screen of FIG.

(Attribute setting process)
FIG. 13 is a flowchart showing a procedure of attribute setting processing of the information processing apparatus 1000 according to the present embodiment. This flowchart is executed by the CPU 710 in FIG. 7 using the RAM 740 and realizes attribute setting for the display frame shown in FIG.

In step S1301, the information processing apparatus 1000 selects an arrangement of display frames for which attributes are to be set (two-divided screen, three-divided screen,..., Three superimposed screen, etc.). Next, in step S1303, the information processing apparatus 1000 selects a display frame for setting an attribute. Next, the information processing apparatus 1000 selects each attribute to be set in step S1305. In step S1307, the information processing apparatus 1000 sets attribute details.

In step S1309, the information processing apparatus 1000 determines whether or not the detailed attribute setting has been completed. If the detailed attribute setting has not been completed, step S1307 is repeated. When the detailed attribute setting is completed, the information processing apparatus 1000 determines in step S1311 whether or not all the attribute settings have been completed. If the attribute setting is not completed, steps S1305 and S1307 are repeated. If the setting of all attributes is completed, the information processing apparatus 1000 determines in step S1313 whether the setting of all display frames has been completed. If the setting of all display frames has not been completed, steps S1303 to S1307 are repeated. When the setting of all display frames is completed, the attribute setting ends.

According to the present embodiment, the attributes set in the display frame can be browsed and the attributes can be set.

[Fourth Embodiment]
Next, an information processing apparatus according to the fourth embodiment of the present invention will be described. The information processing apparatus according to the present embodiment is different from the second embodiment and the third embodiment in that display frame attribute setting is realized by a simple operation. Since other configurations and operations are the same as those of the second embodiment and the third embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

<Output control operation>
FIG. 14 is an operation diagram of output control of the information processing apparatus 1400 according to the present embodiment. FIG. 14 shows an example in which audio output is limited to one application in divided display. In FIG. 14, from the left, mixed audio output before restriction → one audio output after restriction is illustrated.

14, a display frame 211 and a display frame 212 are divided and displayed on the display screen 210 of the information processing apparatus 1400. An audio output permission attribute is set in the display frames 211 and 212. Application A is assigned to the display frame 211, and application B is assigned to the display frame 212. Therefore, the voices generated by the application A and the application B are mixed and output.

Here, when the home button 1412 is pressed while long touching the area of the display frame 211, the audio output attribute of the display frame 212 is changed to audio output stop while the audio output attribute of the display frame 211 is set to enable audio output. Is done. As a result, only the sound generated by the application A assigned to the display frame 211 is output (see the upper right diagram).

14, a display frame 211 and a display frame 212 are divided and displayed on the display screen 210 of the information processing apparatus 1400. An audio output permission attribute is set in the display frames 211 and 212. Application A is assigned to the display frame 211, and application B is assigned to the display frame 212. Therefore, the voices generated by the application A and the application B are mixed and output. Further, a software key area 1411 is displayed, and an audio output stop button 1413 is displayed.

If the audio output stop button 1413 is touched while long touching the area of the display frame 211, the audio output attribute of the display frame 212 is set to audio output permission while the audio output attribute of the display frame 211 is set to audio output enable. Changed to As a result, only the sound generated by the application A assigned to the display frame 211 is output (see the lower right diagram).

Although FIG. 14 shows the setting of the audio output attribute by long touch of the display frame, the operation is not limited to this. For example, the audio output attribute can be set so that the audio output related to the display frame that has been long touched is stopped and the audio output related to the display frame that has not been long touched is maintained.

According to the present embodiment, the attributes of the display frame can be set with a simple operation.

[Other Embodiments]
In the above embodiment, the association between the display frame attribute and the application attribute has not been described in detail. For example, the application frame is turned off so that the sound is turned off for the display frame of the browser and the sound is not turned off for the display frame of the game. You may associate with the attribute of.

Although the relationship with the volume adjustment of the entire information processing apparatus has not been described, the volume adjustment of the entire information processing apparatus is preferably performed independently of the volume adjustment of the present embodiment. Furthermore, the volume adjustment of the present embodiment can be performed in consideration of the volume adjustment of the entire information processing apparatus.

Further, although the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, a system or an apparatus in which different features included in each embodiment are combined in any way is also included in the scope of the present invention.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

This application claims priority based on Japanese Patent Application No. 2014-188305 filed on September 16, 2014, the entire disclosure of which is incorporated herein.

Claims

Display means for displaying a screen corresponding to the application in each of at least two display frames;
Attribute storage means for storing attributes in association with each of the display frames;
Output control means for controlling output based on the application corresponding to the screen displayed on each of the display frames in accordance with attributes stored in the attribute storage means in association with the display frames;
An information processing apparatus comprising:
The attribute is related to a sound output level generated by the application,
The output control unit includes an audio output control unit that controls audio output based on the application corresponding to the screen displayed in the display frame based on the attribute stored in the attribute storage unit. The information processing apparatus described.
3. The information processing according to claim 2, wherein the attribute storage unit stores a setting of an adjustment bar displayed on the display frame that adjusts an audio output based on the application corresponding to a screen displayed on the display frame. apparatus.
The output control means permits the output of sound based on an application corresponding to one of the at least two display frames, and stops the output of sound based on an application corresponding to another display frame. The information processing apparatus according to claim 2 or 3, which controls output.
5. The information processing apparatus according to claim 1, further comprising a related unit that associates an application with each of the at least two display frames.
The information processing apparatus according to any one of claims 1 to 5, further comprising attribute display means for displaying an attribute stored in association with each of the at least two display frames.
The information processing apparatus according to claim 6, wherein the attribute display means includes attribute adjustment means for adjusting an attribute associated with the display frame.
The information processing apparatus according to claim 1, wherein the attribute storage unit stores a default attribute set in the generated display frame.
A display step of displaying a screen corresponding to the application in each of at least two display frames;
An output control step of controlling output based on the application corresponding to the screen displayed on each of the display frames according to an attribute stored in association with each of the display frames;
A method for controlling an information processing apparatus including:
A display step of displaying a screen corresponding to the application in each of at least two display frames;
An output control step of controlling output based on the application corresponding to the screen displayed on each of the display frames according to an attribute stored in association with each of the display frames;
Control program for information processing apparatus for causing computer to execute
An associated step associating an attribute with each of the at least two display frames;
An output control step of controlling output based on an application corresponding to a screen displayed in each of the display frames according to an attribute associated with each of the display frames;
Output control method.