JP2007068110A - Image sound output apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image sound output apparatus and a program to output each sound corresponding to two displayed images or more at the same time. <P>SOLUTION: The apparatus is provided with a first image information acquiring portion 101 to acquire the first image information which is an information of the image to be displayed on a first display area, a second image information acquiring portion 102 to acquire the second image information which is the information of the image to be displayed on a second display area, an image output portion 103 to output the image to be displayed on the first display portion and the second display portion based on the first image information and the second image information, a first sound information acquiring portion 104 to acquire the first sound information which is the information of the first sound regarding the first image information, a second sound information acquiring portion 105 to acquire the second sound information which is the information of the first sound regarding the second image information, a first sound output portion 106 to output the first sound based on the first sound information, and a second sound output portion 107 to output the second sound based on the second sound information. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an audio / video output device that can simultaneously display two or more images.

Some conventional video / audio output devices such as a television display two video signals simultaneously (see, for example, Patent Document 1).
Japanese Patent Laid-Open No. 11-27500 (first page, FIG. 1 etc.)

  However, in the conventional image / sound output device that outputs a plurality of images, only the sound of one image is output, and therefore the displayed content of the image that is not output often cannot be grasped. However, there is a problem that it is difficult to fully understand and enjoy the content of the content including images and sounds.

  The image / audio output device of the present invention includes a first image information acquisition unit that acquires first image information that is information of an image to be displayed in a first display area in an image display area in which an image can be displayed, and the image display area. A second image information acquisition unit for acquiring second image information which is information of an image to be displayed in the second display area, and display in the first display area based on the first image information and the second image information An image output unit that outputs an image to be displayed and an image to be displayed in the second display area, and a first audio information acquisition unit that acquires first audio information that is information of the first audio that is audio relating to the first image information; A second voice information acquisition unit that acquires second voice information that is second voice information that is voice related to the second image information, and a first voice output that outputs the first voice based on the first voice information And the second audio information An image sound output apparatus and a second audio output unit for outputting a second sound Zui.

  With this configuration, sound corresponding to two or more displayed images can be simultaneously output, and each image can be viewed with sound. The contents including the displayed images can be individually displayed. Can fully understand and enjoy.

  The image / audio output device according to the present invention is the image / audio output device in which the second sound output unit outputs the directional second sound to a predetermined space.

  With this configuration, it is possible to prevent the second sound from hindering listening to the first sound.

  In the image / audio output device of the present invention, in the image / audio output device, the first sound output unit may transmit the directional first sound to a space different from a space for outputting the second sound. The image / sound output device outputs the image.

  With this configuration, it is possible to separate the space where the first sound and the second sound can be heard so that the second sound does not interfere with listening to the first sound.

  The image / audio output system of the present invention is an image / audio output system including the image / audio output device and a remote control device, wherein the remote control device receives the second sound. And a third audio output unit that outputs the second audio.

  With this configuration, it is possible to listen to the second sound freely at a place where the remote control device is located.

  In the image / audio output device according to the present invention, in the image / audio output device, the second sound output unit includes a plurality of output units that output the second sound to different spaces. The image / sound output device outputs the second sound from at least one of the output means.

  With this configuration, the output means for outputting the second sound can be freely selected.

  The image / audio output device of the present invention is the image / audio output device in which the output means outputs the directional second sound to a predetermined space.

  With this configuration, the output means for outputting the second sound can be freely selected. Further, the second sound can be prevented from hindering listening to the first sound.

  The image / audio output system of the present invention is an image / audio output system comprising the image / audio output device and a remote control device, wherein the remote control device receives position information which is information for indicating a position. A position information output unit that outputs the position information receiving unit; and a position information receiving unit that receives the position information; and a position detection unit that detects the position of the remote control device based on the position information. The second audio output unit is an image audio output system that outputs the second audio from an output unit corresponding to the position detected by the position detection unit.

  With this configuration, it is possible to listen to the second sound at a place where the remote control device is located. For this reason, by having a remote control device, for example, even if the place is moved freely, it is possible to listen to the optimum second sound corresponding to the position of the user.

  According to the image / sound output device or the like according to the present invention, sound corresponding to two or more displayed images can be output simultaneously, so that each image can be viewed and displayed with sound. It becomes possible to fully understand and enjoy the contents of the content including each image individually.

  Hereinafter, embodiments of an image / audio output device and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.

(Embodiment 1)
FIG. 1 is a block diagram of an audio / video output apparatus according to this embodiment.

  The image / audio output system includes an image / audio output device 100 and a remote control device 200. The image / audio output device 100 includes a first image information acquisition unit 101, a second image information acquisition unit 102, an image output unit 103, a first audio information acquisition unit 104, a second audio information acquisition unit 105, and a first audio output unit 106. , And a second audio output unit 107. The remote control device 200 includes a second audio reception unit 201 and a third audio output unit 202.

  The image / audio output device 100 is a device capable of outputting images and sounds, and is, for example, a television, a projector capable of outputting sound, a DVD player, a video tape recorder, a hard disk recording / playback device, or the like.

  The first image information acquisition unit 101 acquires first image information that is information about an image to be displayed in the first display area in an image display area in which an image can be displayed. The image displayed in the first display area may be a moving image or a still image. Further, the resolution is not limited. The image display area is an area in which an image can be displayed by the output of the audio / video output apparatus 100. Specifically, the image display area is an entire area in which an image on a display unit such as a display or a projector screen can be displayed. The shape of the displayable area is usually a rectangle, but the shape may be any shape such as a circle, an ellipse, or a rectangle with rounded corners. When the shape of the display storage area is rectangular, the aspect ratio is, for example, 3: 4 or 9:16, which is the aspect ratio of a general television display area. Here, the first display area is an area for displaying an image based on the first image information in the image display area, and may be the entire area of the image display area or a part of the area. Also good. The shape of the first display area is usually a rectangle, but the shape may be any shape such as a circle, an ellipse, or a rectangle with rounded corners. When the shape of the display area is rectangular, the aspect ratio is, for example, 3: 4 or 9:16, which is the aspect ratio of a general television display area. It does not matter how the first image information acquisition unit 101 acquires the first image information. For example, if the audio / video output device 100 is a television, the first image information acquisition unit 101 acquires image information of a television program, which is first image information, from a tuner or the like that receives a television broadcast. Further, the first image information acquisition unit 101 acquires the image information of the content read from the DVD disk by a pickup or the like if the audio / video output device 100 is a DVD player. The first image information acquisition unit 101 acquires image information via the Internet if the audio / video output device 100 is an Internet-connected television capable of displaying Internet information. The first image information may be analog information or digital information. The data structure of the first image information does not matter. The first image information acquisition unit 101 can usually be realized by an MPU, a memory, or the like. The processing procedure of the first image information acquisition unit 101 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The second image information acquisition unit 102 acquires second image information that is information of an image to be displayed in the second display area in the image display area. About the structure of the 2nd image information acquisition part 102, since it is the structure similar to the 1st image information acquisition part 101 mentioned above, detailed description is abbreviate | omitted. Here, the second display area is an area for displaying an image based on the second image information in the image display area, and is a partial area of the image display area. Note that the first display area and the second display area may or may not overlap.

  The image output unit 103 outputs an image to be displayed in the first display area and an image to be displayed in the second display area based on the first image information and the second image information. The output is a concept including display on a display, transmission to an external device, and the like. Specifically, the image output unit 103 configures and outputs an image to be displayed in the first display area and an image to be displayed in the second display area based on the first image information and the second image information. For example, the image output unit 103 uses the first image information and the second image information, such as bitmap data for displaying an image to be displayed in the first display area and an image to be displayed in the second display area. Data used for image display is configured and temporarily stored in a VRAM or the like, and this data is read from the VRAM or the like and output. The image output unit 103 may individually configure an image to be displayed in the first display area and an image to be displayed in the second display area, and output each of them individually, or synthesize and output them. Also good. The image output unit 103 may configure an image obtained by combining the image displayed in the first display area and the image displayed in the second display area, and output the combined image. When the first display area and the second display area overlap each other, the image output unit 103 normally displays the second image on the front surface. However, you may make it display how the image displayed on the overlapping part is displayed. For example, only the second image may be displayed, the second image may be displayed translucently, and the first image on the back may be displayed through the second image. Further, when there is no first image information or second image information, the image output unit 103 may display only one of the images in the first display area or the second display area. The image output unit 103 may be considered as including or not including a display device such as a display. When the display device is not included, the image output unit 103 may transmit an image obtained based on the first image information and the second image information to an external display device or the like. The display device is, for example, a plasma display, a liquid crystal display, a projector, or the like. The image output unit 103 can be implemented by display device driver software, or display device driver software and a display device.

  The 1st audio | voice information acquisition part 104 acquires the 1st audio | voice information which is the information of the 1st audio | voice which is an audio | voice regarding 1st image information. The sound related to the first image information is specifically the sound output together with the image output based on the first image information, and is usually synchronized with the image, but is it synchronized with the image? It doesn't matter. The sound may be monaural sound, stereo sound or bilingual sound, and the form in which the sound is provided does not matter. It does not matter how the first voice information acquisition unit 104 acquires the first voice information. For example, if the audio / video output device 100 is a television, the first audio information acquisition unit 104 acquires audio information of a TV program that is the first audio information from a tuner or the like that receives a television broadcast. The first audio information acquisition unit 104 acquires the first audio information of the content read from the DVD disk by a pickup or the like if the image / audio output device 100 is a DVD player. The first audio information acquisition unit 104 acquires the first audio information corresponding to the image information via the Internet if the image / audio output device 100 is an Internet-connected television capable of displaying Internet information. The first audio information may be analog information or digital information. The data structure of 1st audio | voice information is not ask | required. The first audio information acquisition unit 104 can usually be realized by an MPU, a memory, or the like. The processing procedure of the first audio information acquisition unit 104 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The second sound information acquisition unit 105 acquires second sound information that is second sound information that is sound related to the second image information. The configuration of the second audio information acquisition unit 105 is the same as the configuration of the first audio information acquisition unit 104 described above except that the second audio information is acquired instead of the first audio information, and detailed description thereof is omitted. To do.

  The first sound output unit 106 outputs the first sound based on the first sound information. Specifically, the first voice is composed of the first voice information and is output. The first audio output unit 106 may be considered as including or not including an output device such as a speaker or an earphone. The first sound output unit 106 may include an output device such as a speaker that outputs directional sound, and the directional first sound may be output to a predetermined space. Since the configuration for outputting such directional sound is a known technique, a detailed description thereof will be omitted. Also, the first audio output unit 106 encodes the first audio, for example, and obtains encoded audio information via the other network via the network such as a LAN. Then, it may be transmitted to the output device. Further, the first sound output unit 106 may convert the first sound into a radio wave or the like, and transmit it to a device that receives the radio wave and outputs the sound, such as a wireless headphone or a wireless speaker. The first audio output unit 106 can be implemented by output device driver software, or output device driver software and an output device. The first audio output unit 106 may include an MPU, a memory, and the like for performing encoding and the like. Further, the first audio output unit 106 may include transmission means for performing transmission by a modem, a network, or the like. This transmission means is realized by, for example, a communication means such as a LAN, an infrared communication, a short-range wireless communication means such as Bluetooth (registered trademark), or an e-mail transmission means. The first audio output unit 106 may include conversion means such as an FM transmitter for converting the first audio into radio waves. The output here is a concept including sound output, transmission to an external device, and the like.

  The second sound output unit 107 outputs the second sound based on the second sound information. Specifically, the second sound is composed of the second sound information and output. The second audio output unit 107 may or may not include an output device such as a speaker or an earphone. The second sound output unit 107 may include an output device such as a speaker that outputs directional sound, and the directional second sound may be output to a predetermined space. In this case, in particular, it is possible to separate the space where the first sound can be heard and the space where the second sound can be heard by making the second sound output in a space different from the space where the first sound is output. preferable. Since the configuration for outputting such directional sound is a known technique, a detailed description thereof will be omitted. Further, the second audio output unit 107 encodes the second audio, for example, and acquires the encoded second audio via a network such as a LAN via another network. Then, it may be transmitted to the output device. The second audio output unit 107 converts the second audio into infrared rays or radio waves, and transmits the infrared rays or radio waves to a device that outputs the sound by receiving the infrared rays or radio waves, such as wireless headphones or wireless speakers. May be. The second audio output unit 107 can be implemented by output device driver software, or output device driver software and an output device. The second audio output unit 107 may include an MPU, a memory, and the like for performing encoding and the like. Further, the second audio output unit 107 may include transmission means for performing transmission by a modem, a network, or the like. This transmission means is realized by, for example, a communication means such as a LAN, an infrared communication, a short-range wireless communication means such as Bluetooth (registered trademark), or an e-mail transmission means. Further, the second sound output unit 107 may include conversion means for converting the second sound into radio waves and the second sound into infrared rays. The output here is a concept including sound output, transmission to an external device, and the like. In the present embodiment, the case where second audio output section 107 transmits the second audio to remote control device 200 will be described.

  The remote control device 200 is a device for remotely operating the video / audio output device 100, and may or may not be connected by wire. The remote control device 200 has a configuration for operating the image / sound output device 100. However, since such a technique is a known technique, the description thereof is omitted here.

  The second sound receiving unit 201 receives the second sound output from the image / sound output device 100. Specifically, for example, the second sound converted into the radio wave transmitted from the image / sound output apparatus 100 or the encoded second sound is received. If the remote control device 200 and the audio / video output device 100 are connected by wire, the analog second audio output from the audio / video output device 100 may be input as it is. In addition, the second sound may be received from a device other than the image / sound output device 100, or the second sound receiving unit 201 may include a tuner for receiving a television broadcast or the like. May be received. The second voice reception unit 201 may or may not include an input device. The second voice receiving unit 201 may be realized by input device driver software or input device driver software and an input device. Further, the second voice receiving unit 201 may include an MPU, a memory, and the like for performing encoding and the like. Further, the second voice receiving unit 201 may include receiving means for receiving a modem, a network, or the like. In this case, the second voice receiving unit 201 is realized by, for example, a communication unit such as a LAN, infrared communication, a short-range wireless communication unit such as Bluetooth (registered trademark), an electronic mail transmission unit, or the like. The second voice receiving unit 201 includes a receiving unit such as a tuner for receiving the second voice converted into radio waves, an infrared receiving unit for receiving the second voice converted into infrared rays, and the like. It may be.

  The third sound output unit 202 outputs the second sound received by the second sound receiving unit 201. Specifically, when the second sound is encoded, the third sound output unit 202 configures and outputs the second sound by decoding. In addition, when the second sound is converted into a radio wave, the third sound output unit 202 modulates to form and output the second sound. You may think that the 3rd audio | voice output part 202 is not included even if it thinks that output devices, such as a speaker and an earphone, are included. The third audio output unit 202 can be implemented by output device driver software, or output device driver software and an output device. The third audio output unit 202 may include an MPU, a memory, and the like for performing encoding and the like. In addition, a modulator or the like may be provided for demodulating the second sound converted from the sound received by the second sound receiving unit 201 into a radio wave. The output here is a concept including sound output, transmission to an external device, and the like.

  Next, the operation of the audio / video output apparatus 100 will be described using the flowchart of FIG.

  (Step S201) The first image information acquisition unit 101 determines whether first image information has been acquired. If acquired, the process proceeds to step S202. If not acquired, the process proceeds to step S204.

  (Step S202) The image output unit 103 configures an image to be displayed in the first display area based on the first image information.

  (Step S203) The second image information acquisition unit 102 determines whether or not second image information has been acquired. If acquired, the process proceeds to step S205. If not acquired, the process proceeds to step S206.

  (Step S204) The second image information acquisition unit 102 determines whether or not the second image information has been acquired. If acquired, the process proceeds to step S205. If not acquired, the process returns to step S201.

  (Step S205) The image output unit 103 configures an image to be displayed in the second display area based on the second image information.

  (Step S206) The image output unit 103 outputs the configured image. Here, when only the image displayed in the first image information is configured, only the image of the first image information is displayed, and only the image displayed in the second image information is configured, the second Display only the image information image. When the image of the first image information and the image of the second image information are configured, an image obtained by combining both images is output.

  (Step S207) The first audio information acquisition unit 104 determines whether or not the first audio information has been acquired. If acquired, the process proceeds to step S208. If not acquired, the process proceeds to step S209.

  (Step S208) The first sound output unit 106 configures and outputs the first sound based on the first sound information.

  (Step S209) The second audio information acquisition unit 105 determines whether or not the second audio information has been acquired. If acquired, the process proceeds to step S210. If not acquired, the process returns to step S201.

  (Step S210) The second sound output unit 107 outputs the second sound based on the second sound information. Here, as an example, the second sound is transmitted to the remote control device 200. Then, the process returns to step S201.

  Note that, in the flowchart of FIG. 2, the processing target for the first image information and the processing step for the second image information may be switched between the processing target and the processing unit that performs the processing. For example, the process of step S201 and step S202 may be changed to the process for the second image information, and the process from step S203 to step S205 may be changed to the process for the first image information. Further, the process for the first image information and the process for the second image information may be processed in parallel.

  In the flowchart of FIG. 2, when the image of the first image information and the image of the second image information are configured in the process of step S <b> 206, a case where an image obtained by combining both images is output will be described. However, both images may be individually output within the image display area without being combined.

  Also, in the flowchart of FIG. 2, the processing target for the first voice information and the processing step for the second voice information may be replaced with the processing target and the processing unit that performs the processing. For example, the processing of step S207 and step S208 may be changed to processing for the second audio information, and the processing from step S209 to step S210 may be changed to the processing for the first audio information. Further, the process for the first audio information and the process for the second audio information may be processed in parallel.

  Further, in the flowchart of FIG. 2, the process in which the same result is obtained even when the order is changed may be changed as appropriate. For example, the process in step S202 may be changed to a process after the process in step S203. Further, the process in step S208 may be changed to a process after the process in step S209.

  In the flowchart of FIG. 2, the process is terminated by powering off or a process termination interrupt.

  Next, the operation of the remote control device 200 will be described using the flowchart of FIG. Here, the operation for controlling the image / sound output apparatus 100 by the remote control apparatus 200 is the same as that of a generally widely known remote control apparatus, and thus the description thereof is omitted.

  (Step S301) The second sound receiving unit 201 determines whether or not a second sound has been received. If accepted, the process proceeds to step S302. If not accepted, the process returns to step S301. Here, the second sound reception unit 201 receives the second sound.

  (Step S302) The third sound output unit 202 outputs the second sound received in step S301. When the second sound is encoded or modulated, the second sound is decoded or demodulated and output. Then, the process returns to step S301.

  In the flowchart of FIG. 3, the process ends when the power is turned off or the process ends.

  Hereinafter, a specific operation of the video / audio output system according to the present embodiment will be described. FIG. 4 is a conceptual diagram of the video / audio output system. Here, as an example, a case where the audio / video output apparatus 100 is a television will be described. The image / audio output device 100 displays an image based on the first image information in the first display area 41 of the image display area 40, and displays an image based on the second image information in the second display area 42. Here, the first image information and the second image information are information on images of two different programs received by the television. Further, it is assumed that the first audio information and the second audio information are audio information of each program. It is assumed that the first audio output unit 106 includes a speaker as an output device. The second sound output unit 107 converts the second sound into an infrared signal and outputs the infrared signal to the remote control device 200. The remote control device 200 includes a second voice receiving unit 201 that receives an infrared signal. It is assumed that the third audio output unit 202 includes a speaker as an output device.

  When the user turns on the power of the audio / video output apparatus 100, the channel setting that was viewed immediately before the power was turned off last time is read from the memory or the like. Here, it is assumed that channel settings are read such that a 12-channel program is displayed in the first display area 41 and a 2-channel program is displayed in the second display area 42. Based on this channel setting, the first image information acquisition unit 101 acquires image information of a 12-channel program, and the second image information acquisition unit 102 acquires image information of a 2-channel program.

  FIG. 5 is an output image management table for managing images output by the image output unit 103. The output image management table has attributes of “display area” and “image information”. The “display area” is an attribute for indicating in which of the first display area and the second display area the image is displayed. Here, since there are two display areas, the first display area and the second display area, the attribute value of “display area” is set to one of them. “Image information” is an attribute indicating what kind of image information is to be displayed. Here, a channel name is set as an attribute value.

  The image output unit 103 stores the output image management table shown in FIG. 5 in a memory or the like. From the 12-channel image information acquired by the first image information acquisition unit 101 based on the output image management table, A 12-channel program image is constructed. In addition, the image output unit 103 configures a 2-channel program image from the 2-channel image information acquired by the second image information acquisition unit 102. Then, these composed images are combined to display a 12-channel program in the first display area 41 and a 2-channel program in the second display area 42, respectively. FIG. 6 shows a display example of an image in the image display area 40 of the audio / video output apparatus 100.

  FIG. 7 is an audio information management table for managing audio information acquired by the first audio information acquisition unit 104 and the second audio information acquisition unit 105. The voice information management table has attributes of “voice” and “voice information”. “Voice” is an attribute indicating whether the voice is the first voice or the second voice. Further, “audio information” is an attribute indicating what kind of audio information is acquired, and here, a channel name is set as an attribute value. Since the first audio is obtained based on the audio information of the 12-channel program that is the same as the image in the first display area, the “audio” of the first audio record is set to “12 channels”. Yes. Similarly, since the second sound is obtained based on the sound information of the two-channel program that is the same as the image in the second display area, the “voice information” of the record in which “sound” is “second sound” is “two channels”. "Is set.

  The first audio information acquisition unit 104 acquires the audio information of the 12-channel program as the audio information of the first audio based on the audio information management table shown in FIG. And the 1st audio | voice output part 106 comprises and outputs the audio | voice of the 12-channel program which is the 1st audio | voice from this audio | voice information. As a result, audio corresponding to the 12-channel program displayed in the first display area 41 is output from the speaker of the first audio output unit 106 of the image / audio output device 100.

  The second audio information acquisition unit 105 acquires the audio information of the 2-channel program as the audio information of the second audio based on the audio information management table shown in FIG. The second audio output unit 107 configures the audio of the 2-channel program as the second audio from the audio information, converts the second audio into an infrared signal, and the second audio output unit 107 Outputs the second sound converted into the infrared signal.

  The second sound receiving unit 201 of the remote control device 200 receives the second sound transmitted as an infrared signal from the image / sound output device 100. The third sound output unit 202 demodulates and outputs the second sound. As a result, the remote control device 200 outputs sound corresponding to the 2-channel program displayed in the second display area 42.

  Note that the image displayed in the first display area and the first sound associated therewith and the image displayed in the second display area and the second sound associated therewith are set to be output separately. It may be possible to perform. For example, when the image displayed in the second display area and the second sound related thereto are not output, the second image information acquisition unit 102 is controlled so as not to acquire the second image information. The audio information acquisition unit 105 may be controlled so that the second audio information is not acquired. The same applies to other embodiments.

  As described above, according to the present embodiment, the sound corresponding to each of the two images displayed in the image display area 40 can be output separately from different sound output units at the same time. It is possible to view and to fully understand and enjoy the contents of the content including each displayed image individually.

  Further, the second sound that is the sound related to the image displayed in the second display area 42 is output from the speaker of the third sound output unit 202 of the remote control device 200, thereby being displayed in the second display area 42. A user who views a program or the like can view the program by moving to a free position with the remote control device 200. For example, if the user listens to the second sound near the user who is viewing the program displayed in the first display area 41, the user who is viewing the program in the first display area 41 will be Two sounds can be heard, which hinders viewing, but the first display can be obtained by moving to a position away from the user viewing the program displayed in the first display area 41 and listening to the second sound. The viewing of the user who is viewing the program displayed in the area 41 can be prevented from being hindered. Moreover, it is not necessary to prepare a new device by outputting the second sound from the remote control device 200 that is normally used for the operation of a television or the like, and as a remote control device even when the second sound is not output. Since it can be used, unnecessary devices can be prevented from increasing.

  In addition, according to the present embodiment, the case where two screens are displayed and the sound of each screen is output has been described. However, in the present invention, three or more screens are displayed, May be output individually. In this case, for example, the image information acquisition unit, the audio information acquisition unit, and the audio information output unit can be provided by the number of images that can be displayed simultaneously. The same applies to other embodiments.

  Further, in the present embodiment, instead of outputting the second sound from the remote control device, the second sound output unit 107 of the image and sound output device 100 has an output device such as a speaker that outputs sound, The second sound output unit 107 may output a second sound.

  Further, in the present embodiment, instead of outputting the second sound from the remote control device, the second sound output unit 107 of the image / sound output device 100 uses an output device such as a speaker that outputs directional sound. The second audio output unit 107 may output the second audio to a predetermined space. By doing in this way, the user can enjoy the image displayed in the second display area together with the second sound that is the sound related to the image by moving to a space where the second sound can be heard. Become. In addition, since the second sound is output as a directional sound, the viewing of the user who is listening to the first sound is not hindered. The same applies to other embodiments.

  Furthermore, the first sound is also output as the first sound having directivity, and the first sound is output by setting the space where the first sound is output and the space where the second sound is output as different spaces. And the second voice can be separated, so that viewing by users other than the user who is listening to each voice can be prevented. The same applies to other embodiments.

  Note that the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. Note that the software that realizes the image and sound output apparatus according to the present embodiment is the following program. That is, the program includes a first image information acquisition step of acquiring first image information that is information of an image to be displayed in a first display area in an image display area in which an image can be displayed on the computer, and the image display area. A second image information acquisition step of acquiring second image information which is information of an image to be displayed in the second display area, and display in the first display area based on the first image information and the second image information An image output step for outputting an image to be displayed and an image to be displayed in the second display area; and a first audio information acquisition step for acquiring first audio information that is information of the first audio that is audio related to the first image information; A second voice information acquisition step of acquiring second voice information that is second voice information that is voice related to the second image information, and a first voice based on the first voice information. A first voice output step of force, is a program for executing a second audio output step of outputting a second audio based on the second audio information.

  In the program, the second sound output step is a program for outputting the second sound having directivity to a predetermined space.

  The program for realizing the remote control device according to the present embodiment outputs an image to be displayed in each of the first display area and the second display area in the image display area in which an image can be displayed, and the first image Processing in a remote control device in an audio / video output system including an audio / video output device that outputs a first audio that is audio related to information, and a second audio that is audio related to the second image information, and a remote control device Is a program for causing a computer to execute a second voice receiving step for receiving the second voice and a third voice output step for outputting the second voice.

(Embodiment 2)
In the present embodiment, the position of the remote control device 200 in the first embodiment is detected, and the second sound is output to the position.

  FIG. 8 is a block diagram of the audio / video output system according to the present embodiment.

  The video / audio output system includes a video / audio output device 800 and a remote control device 900. The image / audio output device 800 includes a first image information acquisition unit 101, a second image information acquisition unit 102, an image output unit 103, a first audio information acquisition unit 104, a second audio information acquisition unit 105, and a first audio output unit 106. , And a second audio output unit 801, a position information receiving unit 804, and a position detecting unit 805. The second audio output unit 801 includes a first output unit 802 and a second output unit 803. The remote control device 900 includes a position information output unit 901.

  The configurations of the first image information acquisition unit 101, the second image information acquisition unit 102, the image output unit 103, the first audio information acquisition unit 104, the second audio information acquisition unit 105, and the first audio output unit 106 are described above. Since it is the same as that of Embodiment 1, detailed description is abbreviate | omitted.

  The second sound output unit 801 outputs the second sound based on the second sound information acquired by the second sound information acquisition unit 105. Specifically, the second sound is composed of the second sound information and output. In the present embodiment, in particular, the second sound output unit 801 has a plurality of output means for outputting the second sound to different spaces. From at least one of the plurality of output means, Output second audio. Here, as an example of a plurality of output means, a case where two first output means 802 and a second output means 803 are provided will be described, but the same applies to the case where three or more output means are provided. Specifically, the first output unit 802 and the second output unit 803 are output devices such as a speaker and an earphone. The second sound output unit 801 may select one or more output means for outputting the second sound from among a plurality of output means. For example, one or more output means designated by an instruction from the user may be selected. In addition, each output unit of the second audio output unit 801 has information on the position of the output device that outputs the second audio, and acquires the information on the position where the second display area is displayed. The output means having the output device at the position closest to the second display area is selected from the information on the displayed position of the second display area and the information on the position of the output device of the output means, and the selected output means The second sound may be output from Moreover, you may make it output a 2nd audio | voice from the output means according to the position of the remote control apparatus 900 which the position detection part 805 mentioned later detected. For example, the position detection unit 805 has information about the position of the space where each output unit outputs sound, the position information of the remote control device 900 detected by the position detection unit 805, and each output unit outputs sound. From the information on the position of the space to be output, an output means for outputting the second sound is selected in the space including the position of the remote control device 900 detected by the position detection unit 805, and the second sound is output from the selected output means. You may make it output. Alternatively, the preset position detection unit 805 has a table or the like indicating the correspondence between the position of the remote control device 900 and each output unit selected for the position, and this table is used. Alternatively, an output unit corresponding to the position of the remote control device 900 detected by the position detection unit 805 may be selected, and the second sound may be output from the selected output unit. Note that the “output means according to the position of the remote control device 900” specifically means an output means suitable for outputting the second sound as locally as possible to the position of the remote control device 900. That is. For example, as such output means, if each output means has a speaker or the like that outputs sound with no directivity, the output means having the speaker closest to the position of the remote control device 900 is selected, and each output means If the means has a speaker or the like that outputs directional sound, an output means that can output sound in a space closest to the position of the remote control device 900 is selected. The second audio output unit 801 can be realized by an output device, or output device driver software and an output device. The output here is a concept including sound output, transmission to an external device, and the like.

  The first output means 802 outputs the second sound. The first output unit 802 may output, for example, directional second sound to a predetermined space. The first output means 802 may or may not include an output device such as a speaker. The first output means 802 can be realized by an output device driver or an output device and a driver.

  The second output means 803 has the same configuration as the first output means 802, and detailed description thereof is omitted here.

  The position information output unit 901 outputs position information that is information for indicating the position of the remote control device 900. The position information may be any information as long as it can be used for detecting the position of the remote control device. For example, the position information output unit 901 may output a signal such as a directional infrared signal, a laser beam, or an ultrasonic wave as the position information. That is, the position information output unit 901 outputs a directional signal such as an infrared signal or a laser beam as position information, so that a device or the like that has received the signal detects the direction or position in which the signal is output. Thus, the output position can be detected, and the position of the remote control device 900 can be detected. In this case, the positional information and information such as an infrared signal output for operating the image / sound output device 800 from the remote control device 900 may be used together. Further, the position information may be visible light, sound of a specific frequency, radio wave, or the like as long as the position of the remote control device 900 can be finally specified. Further, the position information may include information on the position of the remote control device 900. For example, the user inputs information indicating a relative position with respect to the audio / video output device 800, for example, information indicating the left side, the right side, or near, far, etc. of the audio / video output device 800 to the remote control device 900. Position information including information may be output. Further, a GPS receiver or the like may be provided in the remote control device, and information such as longitude and latitude acquired by the GPS receiver may be output as position information. There is no limitation on the timing or trigger at which the position information output unit 901 transmits position information. The position information may be transmitted periodically or irregularly. Alternatively, it may be transmitted when an instruction is received from the user or when the image / sound output device 800 is powered on. The data structure of position information does not matter. The position information output unit 901 may or may not include an output device that outputs infrared signals, laser light, sound of a specific frequency, visible light, or a transmission device such as a modem or a network. Also good. The position information output unit 901 may be realized by hardware, or may be realized by software such as a driver that drives an output device or the like. The position information output unit 901 is realized by an output device that outputs an infrared signal or laser light, communication means such as a LAN, infrared communication, short-range wireless communication means such as Bluetooth (registered trademark), or e-mail transmission means. Is done. Further, the position information output unit 901 may be realized by a wireless or wired broadcasting unit.

  The position information receiving unit 804 receives position information transmitted from the remote control device 900. Specifically, the position information receiving unit 804 receives position information such as an infrared signal, laser light, visible light, and sound. For example, when the position information is an infrared signal or laser light that does not include information indicating the position of the remote control device 900, the position information reception unit 804 includes a plurality of receiving devices for receiving the position information. The position information is received by each receiving device. By doing in this way, the position detection unit 805 (to be described later) can detect the position where the position information is output from the received time difference of the received position information, the strength of the received position information, and the like. It becomes possible. When the position information includes information indicating the position of the remote control device 900, the position information may simply be received in the same manner as a receiving device of communication means such as a normal network. Here, the input received by the position information receiving unit 804 is an input from the remote control device 900 using an infrared signal, laser light, or the like, or an input using wired or wireless communication. The position information receiving unit 804 can be realized by an MPU and a memory, a receiving device such as an infrared signal or laser light, a wired or wireless communication receiving device such as a LAN, infrared ray, or Bluetooth (registered trademark).

  The position detection unit 805 detects the position of the remote control device 900 based on the position information. Specifically, when the position information includes information indicating the position of the remote control device 900, the position is detected by acquiring the information indicating the position. Further, as described above, the position information is information such as an infrared signal, laser light, visible light, and sound that does not include information indicating the position of the remote control device 900, and the position information receiving unit 804 includes a plurality of receiving devices. If the remote control device 900 has a position of the remote control device 900, the timing of receiving the position information of each receiving device, the strength of the received position information, which receiving device received the position information, etc. The position may be detected. In addition, since the technique which detects the position where those were output based on the infrared signal, laser beam, visible light, sound, etc. which the some receiving device received is a well-known technique, description is abbreviate | omitted here. The position detection unit 805 can be realized by an MPU, a memory, and the like.

  In this embodiment as well, the remote control device 900 has a configuration for operating the image / sound output device 800. However, since such a technique is a known technique, the description thereof is omitted here. .

  Next, the operation of the audio / video output apparatus will be described with reference to the flowchart of FIG. In the flowchart of FIG. 9, the same reference numerals as those in the flowchart of FIG. 2 indicate the same or corresponding steps, and description thereof is omitted.

  (Step S901) The second sound output unit 801 determines the output means for outputting the second sound as at least one of the first output means 802 and the second output means 803. For example, the second audio output unit 801 outputs the second audio from which output means stored in the memory or the like immediately before the image audio output device 800 is powered off or immediately before the end of the output of the second audio. Such information (hereinafter referred to as output means selection information) may be acquired, or output means selection information set as an initial value in a memory or the like may be acquired. Any trigger may be used for the second audio output unit 801 to acquire the output unit selection information. For example, it may be a trigger that the image / sound output device 800 is turned on, or a trigger that receives an instruction to display an image in the second display area from a remote control device or the like.

  (Step S902) The position information receiving unit 804 determines whether position information has been received. If accepted, the process proceeds to step S903, and if not accepted, the process proceeds to step S207.

  (Step S903) The position detection unit 805 detects the position of the device that outputs the position information, here, the remote control device 900, based on the position information received in step S902.

  (Step S904) The second sound output unit 801 outputs either the first output means 802, the second output means 803, or both based on the position detection result of Step S903, and outputs the second sound. The output means selection information is updated so that the selected output means is used as an output means for outputting the second sound. A specific example of processing for selecting either the first output unit 802 or the second output unit 803 or both as the output unit will be described later. Then, the process proceeds to step S207.

  (Step S905) The second sound output unit 801 outputs the second sound from the output means for outputting the second sound based on the output means selection information. Then, the process returns to step S201.

  In the flowchart of FIG. 9, the process from step S902 to step S904 may be performed before any step as long as the process is performed as a process before step S905.

  In the flowchart of FIG. 9, the process is terminated by power-off or a process termination interrupt.

  Next, the operation of the remote control device 900 will be described using the flowchart of FIG. Here, the operation for controlling the image / sound output device 800 by the remote control device 900 is the same as that of a widely known remote control device, and therefore, the description thereof is omitted.

  (Step S1001) The position information output unit 901 determines whether an instruction to output position information has been received. If accepted, the process proceeds to step S1002, and if not accepted, the process returns to step S1001. It does not matter how the position information output unit 901 receives an instruction to output position information. For example, the position information output unit 901 may receive an instruction by a key operation or the like for receiving an instruction to transmit position information from the user, or is input periodically or irregularly from a control unit (not shown) or the like. An instruction may be accepted. Since the position of the remote control device 900 can be automatically detected and the user's labor can be reduced, it is preferable that the position information is automatically output without any user instruction. In addition, an instruction such as a key operation for operating the image and sound output apparatus may be accepted as an instruction to output position information. With this configuration, every time the user performs some operation using the remote control device 900, for example, an operation signal for performing this operation and the position information of the remote control device 900 are superimposed and output. can do. As a result, it is not necessary for the user to perform an operation only for notifying the position of the remote control device 900, and the user's labor can be reduced.

  (Step S1002) The position information output unit 901 outputs position information. Then, the process returns to step S1001.

  In the flowchart of FIG. 10, the process ends when the power is turned off or the process ends.

  Hereinafter, a specific operation of the video / audio output system according to the present embodiment will be described. FIG. 11 is a conceptual diagram of an image / audio output system. Here, as an example, a case where the audio / video output device 800 is a television will be described. The image / audio output device 800 displays an image based on the first image information in the first display area 41 of the image display area 40, and displays an image based on the second image information in the second display area 42. Here, the first image information and the second image information are information on images of two different programs received by the television. Further, it is assumed that the first audio information and the second audio information are audio information of each program. It is assumed that the first audio output unit 106 includes a speaker as an output device. Further, the first output unit 802 and the second output unit 803 of the second audio output unit 801 are provided with non-directional speakers. The first output unit 802 has a speaker disposed on the left side of the image / sound output device 800, and the second output unit 803 has a speaker disposed on the right side of the image / sound output device 800. The audio / video output apparatus 800 includes a light receiving unit 8041 and a light receiving unit 8042 that receive infrared signals from the remote control device 900 as the position information receiving unit 804. The light receiving unit 8041 is disposed on the left side of the image / sound output device 800, and the light receiving unit 8042 is disposed on the right side of the image / sound output device 800. The position information output unit 901 of the remote control device 900 transmits an infrared signal that is position information.

  When the user turns on the power of the image / sound output device 800, the output means selection information for setting the output means that output the second sound immediately before the power is turned off as the output means for outputting the second sound again is stored in the memory. Etc. are read out. Here, output means selection information for using the second output means 803 as the second sound output means is read out.

  FIG. 12 is a diagram showing an output means selection information management table for managing output means selection information. The output means selection information management table has an attribute “output means ID”. The “output unit ID” is identification information of the output unit that outputs the second sound. Here, the identification information of the first output unit 802 is “001”, and the identification information of the second output unit 803 is “002”. Suppose that The data structure of “output unit ID” is not limited. When the power is turned on, output means selection information whose “output means ID” is “002” is managed in the output means selection information management table, and this output means selection information is read.

  Also, the channel setting that was viewed immediately before the power was turned off last time is read from the memory or the like. Here, it is assumed that channel settings are read such that a 12-channel program is displayed in the first display area 41 and a 2-channel program is displayed in the second display area 42. Based on this channel setting, the first image information acquisition unit 101 acquires image information of a 12-channel program, and the second image information acquisition unit 102 acquires image information of a 2-channel program.

  The image output unit 103 stores the output image management table shown in FIG. 5 in a memory or the like. From the 12-channel image information acquired by the first image information acquisition unit 101 based on the output image management table, A 12-channel program image is constructed. In addition, the image output unit 103 configures a 2-channel program image from the 2-channel image information acquired by the second image information acquisition unit 102. Then, these configured images are combined to display a 12-channel program in the first display area 41 and a 2-channel program in the second display area 42 as shown in FIG.

  Here, for example, it is assumed that an infrared signal as position information is periodically output from the position information output unit 901 of the remote control device 900. Then, when the light receiving unit 8041 and the light receiving unit 8042 of the position information receiving unit 804 receive the infrared signal that is the position information, the position detecting unit 805 receives the infrared light intensity of the infrared signal from the light receiving unit 8041 and the infrared light from the light receiving unit 8042. The received light intensity of the signal is obtained to determine which received light intensity is strong. Then, the position of the remote control device 900 is detected from the position of the light receiving unit with the higher received light intensity. Specifically, if the light receiving intensity of the light receiving unit 8041 provided on the left side of the audio / video output device 800 is high, it is detected that the remote control device 900 is located on the left side of the audio / video output device 800, The detection result “left” is output. Also, if the light receiving intensity of the light receiving unit 8042 provided on the right side of the image / sound output device 800 is high, it is detected that the remote control device 900 is located on the right side of the image / sound output device 800, and “right”. The detection result is output. Here, since the remote control device 900 is located on the left side of the image / sound output device 800, and the light receiving intensity of the left light receiving unit 8041 is stronger than the light receiving intensity of the right light receiving unit 8042, the position detecting unit 805 The detection result “left” is output.

  FIG. 13 shows an output means selection table showing the relationship between the position of the remote control device 900 and the output means to be selected for outputting the second sound, which is held in the memory or the like by the second sound output unit 801. FIG. The output means selection table has an attribute “detection position” and an attribute “output means ID”. “Detection position” is a detection result output from the position detection unit 805. The “output means ID” corresponds to the “output means ID” shown in FIG. The data structure of “detection position” and “output means ID” is not limited.

  The second audio output unit 801 searches the output unit selection table shown in FIG. 13 for a record including the detection result output by the position detection unit 805 as the “detection position” attribute value, and the “output unit ID” of the record. ”Attribute value is acquired, and the“ output means ID ”attribute value in the output means selection information management table shown in FIG. Specifically, since the position detection unit 805 outputs the detection result “left”, the “output means ID” attribute value of the record having the attribute value “left” from the output means selection table shown in FIG. “001” is acquired, and the “output means ID” attribute value of the output means selection information management table is updated from “002” to “001”. FIG. 14 is a diagram showing an updated output means selection information management table.

  The first audio information acquisition unit 104 acquires the audio information of the 12-channel program as the audio information of the first audio based on the audio information management table shown in FIG. And the 1st audio | voice output part 106 comprises and outputs the audio | voice of the 12-channel program which is the 1st audio | voice from this audio | voice information. As a result, audio corresponding to the 12-channel program displayed in the first display area 41 is output from the speaker of the image / audio output device 800.

  The second audio information acquisition unit 105 acquires the audio information of the 2-channel program as the audio information of the second audio based on the audio information management table shown in FIG. Then, the second audio output unit 801 composes the audio of the 2-channel program as the second audio from the audio information, and the second audio is selected as the output means in the output means selection information management table shown in FIG. Output from the output means corresponding to the information. That is, the second sound is output from the first output means 802 whose “output means ID” is “001”. As a result, the second sound is output from the “left” speaker that is the position of the remote control device 900 detected by the position detection unit 805, that is, the speaker of the first output means 802 on the left side of the image / sound output device 800. As a result, the second sound is output from the speaker close to the position of the remote control device 900.

  In this specific example, the second sound is output from the output means closest to the position of the remote control device 900, but the output means is an output device such as a speaker that outputs directional sound. An output unit that outputs sound in a space closest to the position of the remote control device 900 may be selected, and the second sound may be output from the output unit.

  As described above, according to the present embodiment, the sound corresponding to each of the two images displayed in the image display area 40 can be output separately from different sound output units at the same time. It is possible to view and to fully understand and enjoy the contents of the content including each displayed image individually.

  Furthermore, since the second sound that is the sound of the image displayed in the second display area can be output from one or more of the plurality of output means, the image displayed in the second display area and the second sound related thereto can be viewed. Depending on the user's position, the second sound can be output from the output means arranged at an optimal position where the user can easily listen to the second sound. In addition, the sound is output only in the vicinity of the user who wants to listen to the second sound, and the user who listens to the first sound is unlikely to interfere with viewing.

  In the present embodiment, the user who wants to listen to the second sound can detect the position of the remote control device 900 and output the second sound from the output means corresponding to the position. Thus, even when the place is freely moved, it is possible to listen to the optimal second sound corresponding to the position of the user. In addition, by determining the output means for outputting the second sound according to the position of the remote control device 900 that is normally used for the operation of a television or the like, it is not necessary to prepare a new device, Even when not outputting, since it can be used as a remote control device, unnecessary devices can be prevented from being increased.

  Further, in the present embodiment, instead of outputting the second sound from the remote control device, the second sound output unit 801 of the image / sound output device 800 uses an output device such as a speaker that outputs directional sound. The second sound output unit 801 may output the second sound to a predetermined space. By doing in this way, the user can enjoy the image displayed in the second display area together with the second sound that is the sound related to the image by moving to a space where the second sound can be heard. Become. In addition, since the second sound is output only in a predetermined space as a directional sound, the viewing of the user who is listening to the first sound is not hindered.

  In the specific example of the present embodiment, the position of the remote control device 900 is detected based on the position where the light receiving unit having the strongest light receiving intensity is present. The position where the information is output may be calculated to detect the position of the remote control device 900. For example, if the light receiving intensities of two light receiving units are approximately the same, it may be detected that the position of the remote control device 900 exists at a position that is substantially equidistant from the two light receiving units. There are various known techniques for detecting the position where light, radio waves, etc. are output, and any of these techniques may be used in the present invention.

  Further, in the specific example of the present embodiment, either one of the first output unit 802 and the second output unit 803 is selected to output the second sound. However, in the present invention, from both, The second sound may be output by changing the output volume or the like. For example, when it is detected that the position of the remote control device 900 is on the left side of the audio / video output device 800, the first output means 802 having the left speaker outputs the second sound at a predetermined volume and You may make it output the 2nd audio | voice from the 2nd output means 803 which has a speaker with a volume smaller than the 1st output means 802. FIG.

  In the present embodiment, the output means is selected according to the position of the remote control device. However, when the second display area is movable, the position of the second display area is detected, You may make it output the 2nd audio | voice by selecting the output means nearest to the position of a 2nd display area.

  Furthermore, the processing in the present embodiment may be realized by software. The software that realizes the video / audio output apparatus according to the present embodiment is the following program. That is, the program includes a first image information acquisition step of acquiring first image information that is information of an image to be displayed in a first display area in an image display area in which an image can be displayed on the computer, and the image display area. A second image information acquisition step of acquiring second image information which is information of an image to be displayed in the second display area, and display in the first display area based on the first image information and the second image information An image output step for outputting an image to be displayed and an image to be displayed in the second display area; and a first audio information acquisition step for acquiring first audio information that is information of the first audio that is audio related to the first image information; A second voice information acquisition step of acquiring second voice information that is second voice information that is voice related to the second image information, and a first voice based on the first voice information. A first voice output step of force, is a program for executing a second audio output step of outputting a second audio based on the second audio information.

  In the program, the second sound output step is a program for outputting the second sound from one or more of a plurality of different positions.

  In the program, the second sound output step is a program for outputting the second sound having directivity.

  The program for realizing the remote control device according to the present embodiment outputs an image to be displayed in each of the first display area and the second display area in the image display area in which an image can be displayed, and the first image Processing in a remote control device in an audio / video output system including an audio / video output device that outputs a first audio that is audio related to information, and a second audio that is audio related to the second image information, and a remote control device This is a program for causing a computer to execute a position information output step for outputting position information that is information for indicating the position of the remote control device.

  Further, the program for realizing the image / sound output device in the present embodiment is a program for causing the image / sound output device to execute processing in the image / sound output system including the image / sound output device and the remote control device. A first image information acquisition step for acquiring first image information, which is information of an image to be displayed in a first display area in an image display area in which an image can be displayed on a computer, and a second display area in the image display area A second image information acquisition step of acquiring second image information which is information of an image to be displayed on the display, and an image to be displayed in the first display area and a second display based on the first image information and the second image information An image output step for outputting an image to be displayed in the area, and first audio information which is information of the first audio which is audio relating to the first image information A first audio information acquisition step to acquire; a second audio information acquisition step to acquire second audio information which is information of a second audio which is an audio related to the second image information; and a first audio information based on the first audio information. A first sound output step for outputting one sound, a position information receiving step for receiving position information which is information for indicating a position of the remote control device, and a position of the remote control device is detected based on the position information. And a second sound output step of outputting the second sound from one or more of a plurality of different positions according to the position of the remote control device detected in the position detection step. It is a program.

  In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.

  In each program in each of the above embodiments, processing performed by hardware in a transmission step for transmitting information, a reception step for receiving information, and the like, for example, processing performed by a modem or an interface card in the transmission step (Processing performed only by hardware) is not included.

  Each of these programs may be executed by being downloaded from a server or the like, and a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, or a semiconductor memory) is read out. May be executed.

  Further, the computer that executes each of these programs may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the image / audio output device and the like according to the present invention can listen to the sound of each of a plurality of displayed images at the same time, and can serve as an image / audio output device or the like that outputs two or more contents. Useful.

Block diagram of a video / audio output system according to Embodiment 1 A flowchart for explaining the operation of the image / audio output device Flow chart for explaining the operation of the remote control device Conceptual diagram Figure showing the same output image management table Figure showing the display example The figure which shows the same voice information management table Block diagram of a video / audio output system according to the second embodiment A flowchart for explaining the operation of the image / audio output device Flow chart for explaining the operation of the remote control device Conceptual diagram The figure which shows the output means selection information management table The figure which shows the output means selection table The figure which shows the output means selection information management table

Explanation of symbols

DESCRIPTION OF SYMBOLS 100, 800 Image audio | voice output apparatus 101 1st image information acquisition part 102 2nd image information acquisition part 103 Image output part 104 1st audio | voice information acquisition part 105 2nd audio | voice information acquisition part 106 1st audio | voice output part 107,801 2nd Audio output unit 200, 900 Remote control device 201 Second audio reception unit 202 Third audio output unit 802 First output unit 803 Second output unit 804 Position information reception unit 805 Position detection unit 901 Position information output unit 8041, 8042 Light receiving unit

Claims (15)

A first image information acquisition unit for acquiring first image information which is information of an image to be displayed in a first display area in an image display area capable of displaying an image;
A second image information acquisition unit for acquiring second image information which is information of an image to be displayed in a second display area in the image display area;
An image output unit for outputting an image to be displayed in the first display area and an image to be displayed in the second display area based on the first image information and the second image information;
A first voice information acquisition unit that acquires first voice information that is first voice information that is voice related to the first image information;
A second voice information acquisition unit that acquires second voice information that is second voice information that is voice related to the second image information;
A first sound output unit that outputs a first sound based on the first sound information;
And a second sound output unit that outputs a second sound based on the second sound information. The image / audio output device according to claim 1, wherein the second sound output unit outputs the second sound having directivity to a predetermined space. The image audio output device according to claim 2, wherein the first audio output unit outputs the directional first audio to a space different from a space for outputting the second audio. An image and audio output system comprising the image and audio output device according to claim 1 and a remote control device,
The remote control device is
A second voice receiving unit for receiving the second voice;
An image sound output system comprising a third sound output unit for outputting the second sound. The second sound output unit includes a plurality of output units that output the second sound to different spaces, and outputs the second sound from at least one of the plurality of output units. The image / audio output device according to 1. 6. The image / audio output device according to claim 5, wherein each of the output means outputs the second sound having directivity to a predetermined space. The image / audio output system according to claim 5, wherein the output unit includes a speaker. An image / audio output system comprising the image / audio output device according to claim 5 and a remote control device,
The remote control device includes a position information output unit that outputs position information that is information for indicating a position,
The image / audio output device includes a position information receiving unit that receives the position information;
A position detector that detects the position of the remote control device based on the position information;
The second sound output unit is an image sound output system that outputs the second sound from output means corresponding to the position detected by the position detection unit. On the computer,
A first image information acquisition step of acquiring first image information which is information of an image to be displayed in the first display area in the image display area capable of displaying an image;
A second image information acquisition step of acquiring second image information which is information of an image to be displayed in a second display area in the image display area;
An image output step for outputting an image to be displayed in the first display area and an image to be displayed in the second display area based on the first image information and the second image information;
A first voice information acquisition step of acquiring first voice information that is information of a first voice that is voice related to the first image information;
A second voice information acquisition step of acquiring second voice information which is second voice information which is voice related to the second image information;
A first voice output step for outputting a first voice based on the first voice information;
The program for performing the 2nd audio | voice output step which outputs a 2nd audio | voice based on said 2nd audio | voice information. The program according to claim 9, wherein the second sound output step outputs the second sound having directivity to a predetermined space. The program according to claim 9, wherein the second sound output step outputs the second sound from one or more of a plurality of different positions. The program according to claim 11, wherein the second sound output step outputs the second sound having directivity. An image to be displayed in each of the first display area and the second display area in the image display area in which an image can be displayed is output, and the first sound that is a sound related to the first image information and the second image information A program for causing a remote control device to execute processing in an image / audio output system including an image / audio output device that outputs second audio that is audio and a remote control device,
On the computer,
A second voice receiving step for receiving the second voice;
A program for executing the third voice output step of outputting the second voice. An image to be displayed in each of the first display area and the second display area in the image display area in which an image can be displayed is output, and the first sound that is a sound related to the first image information and the second image information A program for causing a remote control device to execute processing in an image / audio output system including an image / audio output device that outputs second audio that is audio and a remote control device,
On the computer,
A program for executing a position information output step for outputting position information, which is information for indicating the position of the remote control device. In a video / audio output system including a video / audio output device and a remote control device, a program for causing the video / audio output device to execute processing,
On the computer,
A first image information acquisition step of acquiring first image information which is information of an image to be displayed in the first display area in the image display area capable of displaying an image;
A second image information acquisition step of acquiring second image information which is information of an image to be displayed in a second display area in the image display area;
An image output step for outputting an image to be displayed in the first display area and an image to be displayed in the second display area based on the first image information and the second image information;
A first voice information acquisition step of acquiring first voice information that is information of a first voice that is voice related to the first image information;
A second voice information acquisition step of acquiring second voice information which is second voice information which is voice related to the second image information;
A first voice output step for outputting a first voice based on the first voice information;
A position information receiving step for receiving position information which is information for indicating the position of the remote control device;
A position detecting step for detecting the position of the remote control device based on the position information;
A program for executing a second sound output step of outputting the second sound from one or more of a plurality of different positions according to the position of the remote control device detected in the position detection step.

Images