JP2012049723A - Video sound output device and video sound output method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide various functions without increasing processing capacity of a server and an occupied transmission bandwidth of a network when a multiple picture display is constituted by combining a plurality of video sound output devices.SOLUTION: The video sound output device includes: a network processing means receiving a stream of video sound data through the network; a decoding means decoding the video sound data received by the network processing means; a video display means displaying a video signal decoded by the decoding means; a sound output means outputting a sound signal decoded by the decoding means; a control means controlling the video display means and the sound output means; and an input means inputting an installation position in the multiple picture display. The video signals which the respective video sound output devices are to display are cut out among the video signals decoded by the control means in accordance with installation position information from the input means, and the video signals are outputted to the video display means.

Description

  The present invention relates to a video / audio output device that outputs video and audio.

With the spread of computer networks, for example, as seen in Patent Document 1 below, a large-screen multi-screen display is developed in which this type of video / audio output device is connected by a LAN and provided with a synchronous playback function. Yes.
In the future, it is anticipated that video playback devices having more advanced communication functions will be widely used in accordance with the improvement in image quality, sound quality, and multi-functionality of such large-screen multi-screen displays.

JP 2007-183654 A

  In the multi-screen display described in the above-mentioned Patent Document 1, a plurality of video playback devices can smoothly reproduce the original video if the server processing capacity and the network transmission bandwidth are not sufficiently secured. I couldn't.

  Therefore, in this specification, for example, the cut-out position and enlargement ratio of the video signal to be displayed and the output balance of the audio signal to be output are controlled in accordance with the installation position of a device that reproduces the video signal and the audio signal. .

  According to the video / audio output device or the video / audio output method, it is possible to smoothly reproduce the video signal and the audio signal of the multi-screen display without increasing the processing capacity of the server and the occupied transmission bandwidth of the network.

The figure which shows an example of the audio-video transmission system containing an audio-video output apparatus The figure which shows an example of a structure of an audio-video output apparatus Diagram showing an example of server configuration The figure which shows an example of a structure of the timepiece part of an audio-video output apparatus The figure which shows an example of the flowchart of the synchronous reproduction process of an audio-video output apparatus The figure which shows an example of the image | video transmitted to the audio-video output apparatus from a server The figure which shows an example of the display screen at the time of displaying an image | video by combining four audio-video output apparatuses. The figure which shows an example of the block configuration of an audio-video output apparatus The figure which shows an example of the installation position detection method of an audio-video output apparatus

Example 1
FIG. 1 is an example of a video / audio transmission system including a video / audio output device. Here, a state in which four video / audio output devices 11 to 14 are used as a large-screen multi-screen display and each is connected via a network is shown.
Reference numeral 2 denotes a server that distributes video / audio data, and 3 denotes a network such as the Internet. Each device is connected to the network 3 via a LAN (Local Area Network) 5 and a router 4. In the network, standard IP (Internet Protocol) is used as a network protocol, and TCP (Transmission Control Protocol) and UDP (User Datagram Protocol) are used as upper transport protocols. For transmission of content, higher-level application protocols such as RTP (Real-time Transport Protocol), HTTP (Hyper Text Transfer Protocol), FTP (File Transfer Protocol) and the like are used. The video / audio output devices 11, 12, 13, and 14 receive the video / audio data distributed from the server 2 and output video and audio.

FIG. 2 is a diagram showing an example of the configuration of the video / audio output device 11.
The video / audio output device 11 includes a broadcast signal input terminal 201, a tuner 202, a demodulation unit 203, a descrambler 204, an encryption / decryption processing unit 205, a stream processing unit 206, a video decoder 207, an audio decoder 208, a clock unit 209, video Processing unit 210, audio processing unit 211, video output unit 212, audio output unit 213, video / audio input / output terminal 214, network connection unit 215, network connection terminal 216, external device control unit 217, external device connection terminal 218, control unit 219, a storage unit 220, and a memory 221. However, if this embodiment can be realized, the video / audio output apparatus 11 does not have to have all the configurations included in FIG. 2 and excludes other configurations not included in FIG. 2. Not a thing.

  Broadcast signal input terminal 201 accepts input of broadcast signal data received by an antenna, a cable, or the like. Broadcast signals received by the broadcast signal input terminal 201 are terrestrial digital signals, analog terrestrial signals, and broadcast signals such as BS and CS. When the broadcast signal input terminal 201 receives an input of a terrestrial digital signal, the tuner 202 extracts information on a specific program from the broadcast signal data received by the broadcast signal input terminal 201 and converts it into a digital signal. The demodulator 203 generates a stream in which encoded video / audio data and various data for a television program are multiplexed from information on a specific program extracted by the tuner 202.

The descrambler 204 is not shown when the stream generated by the demodulator 203 is scrambled, such as when viewing only by a contractor with the service provider or when viewing terrestrial digital broadcasting. The scramble is canceled by using information issued from the Internet or information obtained from the B-CAS card (registered trademark) and key information multiplexed on the broadcast wave.
A case where the scrambled stream is stored in the storage unit 220 or the like will be described. When the stream copy restriction information has a generation copy restriction, the stream processing unit 206 transmits the stream transmitted from the descrambler 204 to the encryption / decryption processing unit 205. The encryption / decryption processing unit 205 encrypts the received stream and causes the storage unit 220 to store the encrypted stream. The key for encryption is generated from, for example, unique information of the video / audio output device 11, unique information of the storage unit 220, and other random numbers. Streams stored in the storage unit 220 are managed as a stream list by the control unit 219.

When viewing a stream input from the broadcast signal input terminal 201 and the network connection terminal 215, the stream is input to the stream processing unit 206. The stream reproduced from the storage unit 220 is input to the stream processing unit 206 after being decrypted by the encryption / decryption processing unit 205.
When the stream received from the broadcast signal input terminal 201 and the network connection terminal 215 and the stream stored in the storage unit 220 are MPEG2 transport streams (TS: Transport Stream), video data and audio data can be output in synchronization. As described above, the program clock reference (PCR), which is the time base information value referred to by the video / audio output device 11, is multiplexed in the stream. The stream processing unit 206 acquires a PAT (Program Association Table) / PMT (Program Map Table) from the input transport stream, and determines a packet identifier (PID). The stream processing unit 206 demultiplexes the TS packet having the determined PID. The stream processing unit 206 outputs the compression encoded video data, the compression encoded audio data, and the PCR to the video decoder 207, the audio decoder 208, and the clock unit 209 according to the PID, respectively.

  The compressed encoded video data is decompressed by the video decoder 207, and then the video processing unit 210 superimposes the attached information into a video signal, which is output by the video output unit 212. Here, the video processing unit 210 can superimpose character information or the like on the video signal. The compressed encoded audio data is carefully processed by the audio decoder 208 and then subjected to processing such as a left / right audio balance adjustment by the audio processing unit 211 to be converted into an audio signal, which is output by the audio output unit 213. The Further, the video signal and the audio signal can be output from the video / audio input / output terminal 214 to external devices, respectively. If necessary, the video processing unit 210 and the audio processing unit 211 can convert the video signal and the audio signal from a digital format, respectively. The data is converted into an analog format and output to the video / audio input / output terminal 214. Note that the video / audio input / output terminal 214 can be integrated into a single terminal that can simultaneously output video and audio, such as a terminal such as HDMI (registered trademark). Furthermore, the video / audio input / output terminal 214 can accept input of a video signal and an audio signal from an external device, and the video signal and the audio signal input from the video / audio input / output terminal 214 are input to the video output unit 212 and the audio signal, respectively. Output from the audio output unit 213. The video / audio input / output terminal 214 may be divided into a video input / output terminal and an audio input / output terminal.

  The clock unit 209 sets the PCR output from the stream processing unit 206 as the initial value of the count value of the system time clock (STC) counter. The clock unit 209 increases the count value of the counter, and the video decoder 207 and the audio decoder 208 are configured to perform decoding (decoding) at a time when the decoding time information (DTS) attached to each video data matches the count value. To give instructions. The video / audio output device 11 outputs video or audio data at a time when reproduction output time information (PTS) attached to the video or audio data coincides.

When the received stream is an MPEG2 PES packet, the decoding start and output start timings are controlled based on the PTS and DTS values included in the PES and the counter value of the clock unit 209.
The network connection terminal 216 is connected to the LAN 5 in FIG. The network connection unit 215 transmits and receives various types of information to and from the server 2 and other video / audio output devices via the network connection terminal 216. In addition, the network connection unit 215 has, for example, a transmission mode that has no real time data arrival guarantee and is not reliable but has a real time property (hereinafter sometimes referred to as a real time transmission mode), and data arrival guaranteed and reliability. However, the operation can be switched to a transmission mode that does not have real-time characteristics (hereinafter also referred to as a reliable transmission mode).

Here, for example, UDP (User Datagram Protocol) and RTP (Real-Time Transport Protocol) are used for the real-time transmission mode. This method does not check whether the transmitted data has arrived at the other party, so the transmission packet may be lost and may not reach the other party, and the video and audio may be interrupted. Therefore, there is little delay and the real-time property can be maintained.
For example, in RTP, packet loss and delivery delay occur when transferred via a network. However, video and audio data can be reproduced even if a part of the data is missing. The data receiving side ignores lost or delayed packets, and uses only the packet that arrives at the time expected by the receiving side to reproduce the data. The receiving side does not send a reception acknowledgment (ACKnowledgement) for each received packet.
Further, for example, TCP (Transmission Control Protocol), HTTP (Hyper Text Transfer Protocol), or FTP (File Transfer Protocol) is used as the reliable transmission mode. In this method, it is checked whether the transmitted data has arrived at the other party, and if the transmission packet is lost and does not reach the other party, the transmission process is performed again, so the video and audio may stop during that time. However, data reliability is ensured.

The network connection unit 215 receives a stream from the server 2 via the network connection terminal 216 connected to the LAN 5. The external device control unit 217 is connected to the external device 400 of FIG. 1 via the external device connection terminal 218, receives input information from the external device 400 such as a USB (Universal Serial Bus) device, and creates the created external device Control information for controlling the device 400 is transmitted to the external device 400.
The control unit 219 controls the entire operation of the video / audio output device 11. The synchronization processing unit 227 realizes the function of the synchronization processing by software by causing the control unit 219 to develop and execute the synchronization processing program 222 stored in the storage unit 220 in the memory 221. The function of the synchronization processing realized as software can also be realized as hardware by integrating it as a processing unit that performs synchronization processing like the synchronization processing unit 227. In the following, in order to simplify the description, it is assumed that each process realized by the control unit 219 executing the synchronization processing program 222 is performed mainly by the synchronization processing unit 227. When the synchronization processing unit 227 is realized by hardware, the synchronization processing unit 227 performs each process mainly.

FIG. 3 is a diagram illustrating an example of the configuration of the server.
The server 2 includes a control unit 301, a memory 302, a storage unit 303, a network connection unit 304, a network connection terminal 305, an external device control unit 306, an external device connection terminal 307, and an encoder 308.
The control unit 301 expands the program stored in the storage unit 303 to the memory 302 and executes the expanded program, thereby realizing functions as a server such as activation of the server 2, information processing, and transmission / reception of information. The storage unit 303 is a storage device such as an HDD, SSD, DVD, BD, or IC card, and can store content to be output to the video / audio output device 11, programs and tables developed by the control unit 301 in the memory 302. it can.

  The network connection terminal 305 is connected to the LAN 5 in FIG. The network connection unit 304 transmits and receives various types of information to and from other servers and the video / audio output device 11 via the network connection terminal 305. The external device control unit 306 receives input from an external device connected to an external device connection terminal 307 for connecting an external device such as a USB (Universal Serial Bus) device, and controls the operation of the external device. The encoder 309 encodes output information such as video and audio to be output to the video / audio output device 11 into a moving image format and transmits the encoded information to the network connection unit 304.

Since the video / audio output devices 11, 12, 13, and 14 receive the distribution of the video / audio data from the server 2, for example, the server 2 transmits the video / audio data to each of the video / audio output devices in 4 by the IP multicast method. To do. In the IP multicast method, for example, video / audio data is transmitted to all terminal devices connected to the router 4 as destinations. With this method, the server 2 can efficiently transmit the same video / audio data to a plurality of video / audio output devices without increasing the processing amount of the server 2 and the occupied transmission bandwidth of the network.
When the video and audio output devices 11, 12, 13, and 14 simultaneously output the video and audio data distributed from the server 2, when the video and audio of each video and audio output device are combined and output, Therefore, it is necessary to synchronize the output timing of video and audio with each other. For this purpose, any device on the network outputs a synchronization packet indicating the reference time, and each video / audio output device outputs video and audio in accordance with the reference time. For example, when the video / audio output device 11 is a time master device and receives video / audio data, a synchronization packet indicating the reference time is transmitted to the other video / audio output devices 12, 13, and 14, and the other video / audio output devices are transmitted. Reference numerals 12, 13, and 14 output received video and audio in accordance with the received synchronization packet. For example, there is a method in which the user makes a setting for one device in each video / audio output device in advance as to whether or not to become the time master device.

FIG. 4 is a diagram illustrating an example of the configuration of the clock unit 109.
The clock unit 209 includes a PCR acquisition unit 2091, a clock control unit 2092, a 27 MHz counter 2093, an oscillation unit 2094, and a 90 kHz counter 2095.
The PCR acquisition unit 2091 receives the PCR transmitted from the stream processing unit 206 and transmits it to the clock control unit 2092. The clock control unit 2092 sets the PCR received from the PCR acquisition unit 2091 in the 27 MHz counter 2093 and the 90 kHz counter 2095. The oscillation unit 2094 generates a clock for operating the 27 MHz counter 2093 and the 90 kHz counter 2095 and supplies the clock to the 27 MHz counter 2093 and the 90 kHz counter 2095, respectively.
The 27 MHz counter 2093 counts up the count value with reference to the clock supplied from the oscillation unit 2094 and supplies the count value to the network transmission / reception unit 215. The 90 kHz counter 2095 counts up the count value with reference to the clock supplied from the oscillation unit 2094, and supplies the count value to the video decoder 207 and the audio decoder 208.

FIG. 5 is an example of a flowchart of the synchronized playback process. When a video / audio output is requested by a user operation, the network connection unit 127 of the video / audio output device 11 requests the server 2 to distribute the video / audio data (step S501). Also, the synchronization processing unit 227 notifies the video / audio output device on the local area network 5 that synchronized playback is to be performed (step S503).
Next, the synchronization processing unit 227 confirms whether or not the own device is a master device (step S504). If the device itself is a master device, the stream processing unit 206 of the video / audio output device acquires the PCR from the video / audio data transmitted from the server in response to the distribution request in step S501. Next, the stream processing unit 206 notifies the acquired PCR to the clock unit 209, and the clock control unit 2092 of the clock unit 209 sets the notified PCR as an initial value of the STC (step S505). Thereafter, the synchronization processing unit 227 transmits a synchronization packet indicating the reference time acquired from the clock unit 209 to another video / audio output device on the network 5 (step 506).

  If the video / audio output device is not the master device in step S504, the network connection unit 127 of the video / audio output device receives a synchronization packet transmitted from another video / audio output device which is the master device (step S507). The stream processing unit 206 of the video / audio output apparatus transmits the synchronization packet received via the network connection unit 127 to the clock unit 117. The clock control unit 2092 that has acquired the synchronization packet via the PCR acquisition unit 2091 sets the acquired synchronization packet to the initial value of the STC (step S508).

Next, the clock control unit 2092 of the clock unit 209 in the video / audio output device increments the count value of the counter, and at the time when the decoding time information (DTS) attached to each video / audio data matches the count value, the video decoder 207 and audio decoder 208 decode and decode video and audio, respectively, and perform reproduction (display) at times when reproduction output time information (PTS) attached to the video or audio data coincides (steps 509 and 510).
Further, when the video / audio output devices 11, 12, 13, and 14 simultaneously output the video / audio data distributed from the server 2, when the video and audio of each video / audio output device are combined and output, the video / audio output is performed. The synchronization processing unit 227 of each video / audio output device of the device acquires the position of the own device, and the synchronization processing unit 227 that acquired the position of the own device notifies the video processing unit 118 of the enlargement magnification and the position of the own device. . The video processing unit 210 notified of the position to be output and the enlargement magnification from the synchronization processing unit 227 enlarges the video at the received position from the video decoded by the video decoder 207 at the notified enlargement magnification (step 511). . Note that the position of the character device acquired by the synchronization processing unit 227 and the magnification of the video are determined by the user using an infrared remote controller or the like, and the ID number of each video / audio output device and its installation position (the number of upper and lower stages, the left and right columns). A method of sequentially inputting the number) may be adopted.

As a method of enlarging a part of the video, a method of enlarging by changing the aspect ratio of a part of the video so that a part of the video is output on the entire screen, or the video output unit 212 maintaining the aspect ratio of the part of the video. There is a method of enlarging in accordance with the vertical or horizontal size, etc. However, any method may be used as long as each video / audio output device enlarges the video by the same method.
Further, the left / right balance of the audio to be output is subjected to the audio balance processing of the left channel and the right channel according to the combination position of the video / audio output device, and is output to the audio output unit 123 (step 512).

FIG. 6 is an example of a video transmitted from the server 2 to the video / audio output device.
FIG. 7 is a diagram showing an example of a display screen when video is displayed by combining four video / audio output devices. In FIG. 7, four video / audio output devices 11, 12, 13, and 14 are arranged in two rows and two rows. It is a display example of a display panel when outputting video and audio of each video and audio output device in combination when outputting video and audio data distributed from the server 2 at the same time. Reference numeral 61 denotes a video distributed from the server 2, and reference numerals 711, 712, 713, and 714 denote videos displayed on the display panels of the video / audio output apparatuses 11, 12, 13, and 14, respectively. Each video / audio output device has its combination installation position set in advance by an instruction from the user or the like.
By performing the synchronous playback process in this way, it is possible to provide content on a large screen combining a plurality of video / audio output devices to the viewer of the content.

For example, in the case of the video / audio output device 711 installed at the upper left, the control means incorporated in the video / audio output device 11 is the vertical / horizontal 2 portion of the upper left quarter of the video / audio output device 61 distributed from the server 2. The image is enlarged at a double magnification and displayed as an image 711. Similarly, other video / audio output devices also enlarge and display a part of the video 61 according to the combination installation position. Although not shown, for example, the left video and audio output devices 11 and 13 output the left channel audio from the left channel speaker as to the audio output from the speaker according to the position of the combination of the video and audio output devices. The right and audio output devices 12 and 14 output the right channel audio from the right channel speaker.
In this way, the video / audio output devices from the server 2 efficiently without increasing the occupied transmission bandwidth of the network by displaying the video according to the combination installation position and outputting the audio in synchronization with each other. Can be output. In this embodiment, an example in which four video / audio output devices are combined has been described. However, the number of video / audio output devices is not limited to four, and the cut-out position of the video 61 is determined according to the number of combinations. Change the enlargement ratio.
Further, a part of the video data distributed from the server 2 is cut out at a predetermined cut-out rate centering on an arbitrary portion, and each video / audio output device further cuts it out, based on the cut-out ratio of the video data, If the enlargement ratio of each video / audio output device is automatically calculated, an arbitrary portion of the video data distributed from the server 2 can be zoomed using each video / audio output device 11, 12, 13, 14. It is also possible to upgrade.

(Example 2)
FIG. 8 is a diagram illustrating an example of the configuration of the video / audio output apparatus.
In FIG. 8, the video / audio output device 11 is a digital broadcast receiving device. Also, 222 is a video signal compression unit, 223 is an imaging unit including a camera and an A / D converter, 224 is an audio signal compression unit, 225 is an audio input terminal including a microphone and an A / D converter, 226 is an encoder, and others The configuration of is the same as that of the embodiment shown in FIG.
In this embodiment, the video / audio output device includes an imaging unit 223 for photographing the state of the viewer who views the video and audio, for example, in order to examine the reaction of the viewer to the video and audio to be output. It becomes possible to detect the combined installation position of the video and audio output devices.

FIG. 9 is an example of a method for detecting the installation position of the video / audio output device. In this embodiment, the relative installation position of each video / audio output device is detected based on the video signal captured by the imaging unit 222 of each video / audio output device. Reference numeral 901 denotes the display panel described above, and reference numeral 902 denotes a camera of the imaging unit. 911, 912, 913, and 914 are taken by each camera 902 such as a CCD corresponding to the display panels 711, 712, 713, and 714 of FIG. 7 when four display panels are combined as in the above-described embodiment. It is an example of a video.
For example, when the subject 91 in front of the video / audio output devices 11, 12, 13, and 14 is shot by each imaging circuit, the subject that is a specific imaging target according to the installation position of each video / audio output device If the 91 pieces of video information are specified by known video processing, as shown in FIG. 9, the left and right directions (X1 to X4) and the up and down directions (Y1 to Y4) are picked up corresponding to the difference in the installation positions of the respective image pickup devices. The image changes.

That is, as shown in the figure, the position of the subject 91 with respect to the shooting area is the same in the horizontal direction (distance X1, distance X2) of the shooting area between the shot video 911 and the shot video 913. Between the photographic video 912 and the photographic video 914, the horizontal position (distance X3, distance X4) of the photographic region is the same.
In addition, the vertical positions (distance Y1, distance Y2) and (distance Y3, distance Y4) of the shooting area are the same between the shot video 911 and the shot video 912, and between the shot video 913 and the shot video 914. .
Therefore, each of the video / audio output devices 11, 12, 13, and 14 calculates the horizontal position and the vertical position of the shooting region, and the calculation result is sent to another video / audio output device via the network connection unit 215. The relative installation position of each display panel can be determined by comparing the calculation results output and the calculation results received from other video / audio output devices with each other. It should be noted that the calculation results may be mutually input and output using the video / audio input / output terminal 214 of each video / audio output device without using the network connection unit 215.

Each subject 91 is identified by detecting the contour of the subject from the shade of the photographed image and obtaining the position thereof, or by searching for a preset shape pattern in the photographed image and detecting the position based on the degree of agreement. and so on.
Here, each video / audio output device captures a video in front of the imaging circuit by each camera 902 when receiving an installation position determination instruction, for example, by an operation from a user. At this time, the user may install a predetermined standard subject at an arbitrary position in front of the imaging circuit of each video / audio output device.
The control unit 219 transmits the captured video to the other video / audio output device, receives the video from the other video / audio output device, compares the videos by the above-described method, and the like, and installs them relative to each other. The position can be obtained. Each video / audio output device does not transmit the captured video, but transmits the processing results such as the position of the subject by the above-described method, and receives the processing results such as the position of the subject from other video / audio output devices. However, the installation position may be determined by comparison. In the above example, an example in the case of four video / audio output devices has been shown. However, in the case of a larger number of combined installations, installation positions can be obtained in the same manner.

When determining the installation position of the own device, the control unit 219 determines how many units from the number of videos transmitted from other video / audio output devices, the number of video / audio output devices connected to the LAN 5, and the like. The video / audio output device determines whether the video is combined and output. In this embodiment, since the video / audio output device 11 has acquired the captured videos 912, 913, and 914, it can be seen that the control unit 219 outputs the video with four units including its own device. From the positions of the subject X-axis and Y-axis of the captured images 911, 912, 913, and 914, it can be seen that two video audio output devices are arranged vertically and two as described above. The control unit 219 has two video and audio output devices arranged vertically and two horizontally. Therefore, when outputting video in combination with other video and audio output devices, the control unit 219 is doubled vertically and doubled horizontally. It is determined that an image is displayed.
As described above, the control unit 219 can obtain the installation position of the own device, the number of video / audio output devices that display the video in combination, and the enlargement ratio of the video, and this information as the installation position information is stored in the storage unit 220. Alternatively, it is stored in the memory 221 or the like. When displaying a video in combination with another video / audio output device, the control unit 219 refers to the installation position information to acquire a video enlargement ratio or cutout position, and the video processing unit 210 acquires the video processing unit 210. The video is enlarged according to the enlargement ratio, a part of the enlarged video is cut according to the cut position, and the cut video is output to the video output unit 212.

Furthermore, an installation sensor for detecting whether another video / audio output device is installed vertically or horizontally is arranged in a frame which is an outer frame of each video / audio output device, and each video / audio output device outputs its sensor output. Can be compared with each other to automatically determine the installation position.
In other words, installation sensors such as push pins that can detect the close contact of the frames of other video / audio output devices at the same location on the top, bottom, and both sides of the frame and that can mutually input and output signals are arranged. For example, when a certain video / audio output device is set in the top row and the leftmost row, only the installation sensors arranged on the lower surface and the right side surface of the frame are turned on, and the installation sensors arranged on the upper surface and the left side surface are turned on. Since is turned off, it can be determined from the combination of the sensor outputs that the video / audio output device is set to the uppermost row and the leftmost row.
Then, the video / audio output device in the second row from the left in the uppermost row uses the discrimination data from the video / audio output device in the uppermost row and the leftmost row as described above and the sensor output on the left side to output the video in the uppermost row and the leftmost row. Since it can be determined that the audio output device is connected to the left side surface, each video / audio output device can sequentially determine its installation location sequentially.

Furthermore, when using an audio / video output device that incorporates ultra-thin speakers below or on the left and right of the display, it is based on installation position information instructed by the user or automatically determined installation position information. Based on the multi-channel audio signal, it is also possible to cut out the audio signal in the same manner as the video signal described above and to link the speakers of the respective video / audio output devices so as to realize the surround effect.
Of course, when a video / audio output device capable of separating speakers is used, the surround effect may be realized by outputting the cut out audio signals to the speakers or other speakers installed individually. .

  As described above, according to the present embodiment, it is possible to set the combination installation position of each video / audio output device without designating the user, so that the installation work of the user is reduced. In addition, as described above, it is possible to output video / audio data from the server 2 efficiently without increasing the processing amount of the server 2 and the occupied transmission bandwidth of the network, and various video effects and audio effects can be output. Can be realized as a whole system, so it can be expected to be widely used as a large multi-screen display used in stadiums and advertising towers.

In addition, this invention is not limited to an above-described Example, Various modifications are included. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.
Each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by the control unit 219 interpreting and executing a program that realizes each function. Information such as programs, tables, and files for realizing each function is stored in a recording device such as a memory, a hard disk, and an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, and a DVD (Digital Versatile Disk). Can be put.
Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

DESCRIPTION OF SYMBOLS 11, 12, 13, 14 ... Audio / video output device, 2 ... Server, 3 ... Network, 4 ... Router, 5 ... LAN, 201 ... Broadcast signal input terminal, 202 ... Tuner, 203 ... Demodulator, 204 ... Descrambler, 205 ... Encryption / decryption processing unit, 206 ... Stream processing unit, 207 ... Video decoder, 208 ... Audio decoder, 209 ... Clock unit, 210 ... Video processing unit, 211 ... Audio processing unit, 212 ... Video output unit, 213 ... Audio output unit, 214 ... video / audio input / output terminal, 215 ... network connection unit, 216 ... network connection terminal, 217 ... external device control unit, 218 ... external device connection terminal, 219 ... control unit, 220 ... storage unit, 221 ... Memory 301... Control unit 302 302 Memory 303 Storage unit 304 Network connection unit 305 Network connection terminal 3 6 ... external device control unit, 307 ... external device connection terminal, 308 ... encoder

Claims (10)

A video / audio output device that outputs a video / audio signal by combining a plurality of video / audio output devices,
A video display unit for outputting a video signal included in the video and audio signal;
A storage unit that stores installation position information indicating a portion displayed by the video / audio output device of the video signal;
Based on the installation position information, a control unit that cuts out the video signal of the video signal that is displayed by the video / audio output device, and displays the cut out video signal on the video display unit;
A video / audio output device comprising: The video / audio output device according to claim 1,
The installation position information includes magnification rate information indicating a magnification for enlarging a video signal displayed by the video / audio output device,
The video / audio output device, wherein the control unit enlarges the cut-out video signal when displaying the video signal based on enlargement ratio information included in the installation position information. The video / audio output device according to claim 1 or 2,
The video / audio output device further includes an audio output unit,
The installation position information includes information indicating an audio signal of a portion output from the video / audio output device in the audio signal,
The video and audio output device, wherein the control unit controls an output balance when outputting the audio signal output from the video and audio output device based on the installation position information. In the video and audio output device according to claim 1,
The video / audio output apparatus according to claim 1, wherein the installation position information is a position when a plurality of video / audio output apparatuses are installed adjacent to each other. In the video and audio output device according to claim 1,
A video shooting unit that captures a video of a predetermined subject;
A network connection unit for receiving information from the other video / audio output device,
The control unit acquires the position of the subject in the captured video based on the image captured by the video display unit, and the position of the subject in the subject image captured by the other video / audio output device To determine the installation position of the video / audio output apparatus, and record the determined installation position in the installation position information. The video and audio output device according to claim 5,
The video / audio output device, wherein the network connection unit transmits the video captured by the video imaging unit to the other video / audio output device. The video / audio output device according to claim 6,
The control unit calculates a viewing angle of the subject from the video shooting unit based on a horizontal position and a vertical position of the subject in the video shot by the video shooting unit, and the network connection unit The image is characterized in that the installation position is acquired by comparing the viewing angles of the subject with each other from the video photographing unit included in the other video / audio output device calculated by the control unit of the other video / audio output device. Audio output device. The video / audio output device according to claim 4,
On the upper surface, lower surface, left surface, and right surface of the video / audio output device, an installation sensor that detects that another video / audio output device is installed on the upper, lower, left, or right,
The control unit obtains the installation position by determining the installation position when the installation sensor detects that another video / audio output device is installed on the top, bottom, left, or right. A featured audio / video output device. A video output method for outputting a video / audio signal by combining a plurality of video / audio output devices,
Outputting a video signal included in the video and audio signal;
Of the video signal, storing installation position information indicating a portion displayed by the video and audio output device,
A video / audio output method comprising: cutting out a video signal of a portion of the video signal displayed by the video / audio output device based on the installation position information and displaying the cut-out video signal on the video display unit. The video and audio output method according to claim 9, wherein
An audio / video output characterized by controlling an output balance when outputting the audio signal output by the audio / video output device based on the installation position information including an audio signal of a portion output by the audio / video output device. Method.

Images