JP2004040351A - Image distribution system and image distribution reproducing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a receiver side or the like to select image data in a required rectangular area in single image data composed from a plurality of moving picture data and transmit only the selected image data. <P>SOLUTION: An image processing means 46 composes a plurality of moving picture data photographed with a plurality of image input apparatuses 3 into single image data. A code string preparation means 44 divides the frames of the moving picture data into a plurality of tiles and applies discrete wavelet transform to pixel values of each tile to produce code string data subjected to hierarchical compression coding. A syntax analysis means 43 analyzes the syntax of the code string data. The code string preparation means 44 selects a required tile from the code string data on the basis of the result of analysis and produces another code string data including only the title data. Then the code string data are transmitted to a transmission destination via a communication interface 45. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image distribution system and an image distribution and reproduction system.
[0002]
[Prior art]
Conventionally, as a means for providing a plurality of pieces of moving image data or the like obtained by dividing a non-planar screen into a plurality of pieces and photographing each of them, an image range to be divided first is determined in advance, and each image range is separately photographed. An image input device to be used is allocated, and a plurality of image input devices share and shoot, and compression encoding is performed on each of the shot divided images if necessary.
[0003]
When transmitting these divided images, if there is room in the transmission line, each divided image is transferred at a time using a separate channel, and the receiving side is used to transmit a plurality of divided images. Some or all are received and displayed on one or more displays.
[0004]
[Problems to be solved by the invention]
However, in the conventional art, since it is necessary to determine in advance how to divide an image when taking the image by the image input apparatus as described above, at the request of the receiving side, or the like, divides the image It was not possible to determine the method or select the required image part.
[0005]
In this case, it is conceivable that the method of dividing the image is determined according to the request of the receiving side, and the image input device is controlled on the receiving side as a means for selecting a necessary image portion. It is necessary to assign one or a plurality of image input devices to the recipients, and the cost of equipment to be used becomes very large.
[0006]
SUMMARY OF THE INVENTION An object of the present invention is to make it easy for a receiving side or the like to select image data of a necessary rectangular area from an image obtained by combining a plurality of moving image data into one, and to transmit only the selected image data. And the range of the rectangular area can be changed in accordance with the request of the receiving side.
[0007]
Another object of the present invention is to enable switching between screens following specific information in the screen.
[0008]
Another object of the present invention is to easily create a reduced image of the entire image so that the receiving side can see the overview of the entire image at a glance.
[0009]
[Means for Solving the Problems]
According to the first aspect of the present invention, a frame of moving image data obtained by synthesizing a plurality of moving image data into one is divided into a plurality of rectangular regions, and pixel values are discrete wavelet-transformed for each of the rectangular regions to form a hierarchical structure. Code string creating means for creating compression-encoded code string data, syntax analyzing means for analyzing the syntax of the code string data, and selecting the necessary rectangular area from the code string data based on the analysis result. An image distribution system comprising: a code string creating unit that creates another code string data of only the data of the rectangular area; and a sending unit that sends the code string data created by the code string creating unit to a destination. is there.
[0010]
Accordingly, the transmission side creates code string data of an image obtained by combining a plurality of pieces of moving image data into one, and allows the reception side or the like to select image data of a necessary rectangular area from the image, and the selection is performed. It is possible to easily realize that only the image data is transmitted. Further, the range of the rectangular area can be changed according to the request of the receiving side.
[0011]
According to a second aspect of the present invention, in the image distribution system according to the first aspect, a receiving unit that receives the selection of the rectangular region, and instructs the code string creating unit to select the rectangular region according to the received selection. Instruction means for performing the operation.
[0012]
Therefore, the transmission side creates code string data of an image in which a plurality of pieces of moving image data are combined into one, and allows the reception side to select image data of a required rectangular area of the image, and the selection is made. Transmission of only image data can be easily realized.
[0013]
According to a third aspect of the present invention, in the image distribution system according to the first aspect, extraction means for extracting specific information in a screen of the moving image data combined into one, and And instructing means for instructing the code string creating means to select the rectangular area based on the information.
[0014]
Therefore, the screen can be switched following specific information in the screen.
[0015]
According to a fourth aspect of the present invention, in the image distribution system according to any one of the first to third aspects, the code string creating means reduces the size of each of the rectangular areas to 以下 or less from the code string data. Create another code string data of only the size data.
[0016]
Therefore, a reduced image of the entire image can be easily created, and the outline of the entire image can be seen at a glance on the receiving side.
[0017]
According to a fifth aspect of the present invention, there is provided an image distribution system that distributes moving image data via a network, and a plurality of image reproduction systems that receive the distributed moving image data and display the image on an image display device. The moving image distribution system includes a frame of moving image data obtained by combining a plurality of moving image data into one, divided into a plurality of rectangular areas, and a pixel value for each of the rectangular areas is discretely wavelet transformed and hierarchically compressed. For the encoded code string data, syntax analysis means for analyzing the syntax of the code string data, and based on the analysis result, select the necessary rectangular area from the code string data and select the rectangular area. A code string creating unit that creates another code string data of only data, and a sending unit that sends the code string data created by the code string creating unit to a transmission destination, Each of the image reproduction systems includes a receiving unit that receives the code string data transmitted from the transmitting unit, a decoding unit that decodes the received code string data, and a buffer that buffers the decoded moving image data. And a display device for displaying the decoded image data.
[0018]
Accordingly, the transmission side creates code string data of an image obtained by combining a plurality of pieces of moving image data into one, and allows the reception side or the like to select image data of a necessary rectangular area from the image, and the selection is performed. It is possible to easily realize that only the image data is transmitted. Further, the range of the rectangular area can be changed according to the request of the receiving side.
[0019]
According to a sixth aspect of the present invention, in the image distribution / reproduction system according to the fifth aspect, the moving image distribution system accepts a selection of the rectangular area, and selects the rectangular area according to the received selection. Instruction means for instructing the code string creation means.
[0020]
Therefore, the transmission side creates code string data of an image in which a plurality of pieces of moving image data are combined into one, and allows the reception side to select image data of a required rectangular area of the image, and the selection is made. Transmission of only image data can be easily realized.
[0021]
According to a seventh aspect of the present invention, in the image distribution / reproduction system according to the fifth aspect, the moving image distribution system includes an extracting unit configured to extract specific information in a screen of the moving image data combined into one. And instructing means for instructing the code string creating means to select the rectangular area based on the extracted information.
[0022]
Therefore, the screen can be switched following specific information in the screen.
[0023]
According to an eighth aspect of the present invention, in the image distribution / reproduction system according to any one of the fifth to seventh aspects, the code string creation unit is configured to determine, from the code string data, a half or less of each of the rectangular areas. Create another code string data of only the reduced size data.
[0024]
Therefore, a reduced image of the entire image can be easily created, and the outline of the entire image can be seen at a glance on the receiving side.
[0025]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a conceptual diagram illustrating an image distribution system 2 according to an embodiment of the present invention. The image distribution system 2 includes a plurality of image input devices 3 for capturing moving images, and a server 4. The plurality of image input devices 3 share one large screen P and shoot, and the moving image data shot by each image input device 3 is transmitted to the server 4. In the example of FIG. 1, the large screen P is divided into nine divided screens P1 to P9, and each divided screen is shared by each image input device 3 and photographed.
[0026]
FIG. 2 is a conceptual diagram of an image distribution / reproduction system 1 according to this embodiment. As shown in FIG. 2, the image distribution / reproduction system 1 includes the above-described image distribution system 2 and a client 5 for implementing the image reproduction system. The server 4 compresses and encodes the moving image data captured by each image input device 3 as follows, and distributes the data to the client 5 via the communication path 6.
[0027]
That is, a plurality of pieces of moving image data photographed by each image input device 3 are subjected to predetermined processing by the image processing means 46 of the server 4, and the plurality of pieces of moving image data are combined into one piece, and buffered by the frame buffer 47. Ringed. Then, the image compression means 41 compresses and encodes this one piece of moving image data by the JPEG2000 algorithm. That is, the single moving image data is divided into a plurality of rectangular areas (tiles) for each frame, and pixel values are discrete wavelet transformed (DWT: Discrete Wavelet Transform) for each tile to hierarchically compress and encode. Created code string data.
[0028]
The magnetic storage device 42 stores the code string data. The syntax analysis unit 43 analyzes the syntax of the code string data stored in the magnetic storage device 42, that is, the information described in the header data. The code string creating means 44 selects a necessary tile from the code string data created by the image compressing means 41 based on the analysis result, and creates another code string data of only data corresponding to the tile. The communication interface 45 that implements a transmitting unit and a receiving unit transmits the code string data created by the code string creating unit 44 to the client 5.
[0029]
The client 5 reproduces an image by streaming reproduction. That is, the client 5 receives the code string data from the server 4 by the communication interface 51 that realizes a transmitting unit and a receiving unit. The received code string data is decoded by the decoding means 52, and the decoded moving image data is buffered in the buffer 53 and displayed on the display device 54.
[0030]
The selecting unit 55 enables the user to select a desired tile from the code string data compressed and encoded by the image compressing unit 41 in the client 5, and the content of this selection is transmitted to the server via the communication interface 51. 4 is sent. When the contents of this selection are received by the communication interface 45 of the server 4, the instruction means 48 extracts the tiles desired by the user according to the contents of the selection and creates new code string data. It instructs the creating means 44.
[0031]
As described above, the image compression unit 41 performs discrete wavelet transform by dividing moving image data shot by each image input device 3 and synthesized into one into a plurality of tiles for each frame. In this case, each tile may be a single tile, each one of the moving image data shot by each image input device 3, or one moving image data shot by a single image input device 3. May be further divided into a plurality of tiles. Alternatively, two or more pieces of moving image data captured by two or more image input devices 3 may be combined into a single tile.
[0032]
Therefore, according to the image distribution / reproduction system 1, the image compression unit 41 creates code string data of an image obtained by combining a plurality of pieces of moving image data taken and shot by the plurality of image input devices 3 into one. Since the receiving side can select and transmit a required tile from the image, it is possible to easily transmit only the selected image data.
[0033]
In this case, the receiving side selects the type of tile to be divided by the selecting unit 55, and according to this selection, divides the image by the image compressing unit 41 (for example, divides into four, eight, or sixteen). It is also possible to do so.
[0034]
Next, a plurality of examples of specific means for sharing and photographing a single large screen P by the image input device 3 will be described.
[0035]
In the example of FIG. 3, screen areas 101 to 104 of one large screen P are photographed by separate image input devices 3. The photographing regions 105 to 108 photographed by the respective image input devices 3 overlap each other so that no gap is formed. The image processing means 46 extracts images one by one so that there is no gap from the photographed areas 105 to 108 displayed in this way. That is, the images 109 to 112 corresponding to the screen regions 101 to 104 are extracted. These images 109 to 112 are taken out without overlapping each other and without gaps. Then, the image processing unit 46 combines the extracted images 109 to 112 with image data of one image.
[0036]
The image compressing means 41 divides the frame into a plurality of tiles and compresses and encodes the single image data. The division of the tiles is not necessarily performed by each image captured by each image input device 3 as described above. It is not necessary to make each tile correspond to 109-112 one-to-one. The example in FIG. 4 illustrates an example in which one image obtained by combining the images of the four images 109 to 112 is further divided into twelve tiles 121 to 132.
[0037]
The image distribution / reproduction system 1 may have a configuration as shown in FIG. 5 instead of the configuration as shown in FIG. That is, the difference between the image distribution / reproduction system 1 of FIG. 5 and the image distribution / reproduction system 1 of FIG. 2 is that the server 4 outputs specific information from the screen of one image obtained by synthesizing a plurality of images captured by each image input device 3. Extracting means 49 for extracting the character string, and instructing means 48 to instruct the code string creating means 44 to select a specific tile and create another code string data in accordance with the information extracted by the extracting means 49. Is a point. With such a configuration, the client 5 is not provided with the selection unit 55.
[0038]
The processing performed by the extracting means 49 will be specifically described with reference to FIG. In FIG. 6, the large screen P is divided into divided screens P1 to P9, captured by each image input device 3, and the code string data combined into one is also tiled for each of the divided screens P1 to P9. I do. In this example, the extracting unit 49 extracts the position of the image of the ball 141 as specific information in the large screen P. Reference numeral 142 indicates the trajectory of the movement of the ball 141. Then, the extracting means 49 extracts the position of the image of the ball 141 on the large screen P, and selectively extracts tiles including the image of the ball 141 to generate another code string data. It instructs the column creation means 44. As a result, in the example of FIG. 6, the split screens P1, P2, P5, and P9 are displayed on the display device 54 of the client 5 in this order, and only the area where the ball 141 is present on the large screen P is displayed in close-up. Will be.
[0039]
In order to extract a specific image by the extracting means 49, the following processing is performed. That is, when the image compression means 41 performs the above-described discrete wavelet transform, the frequency conversion is performed by scanning the inside of the tile in raster order. Then, as shown in FIG. 7, assuming that the object 152 is included in the single tile 151, and the tile 151 is scanned in raster order, the comparison target image to be detected in order from the first line 153, the number of lines is gradually increased, and when the comparison target image 153 and the information of a certain point in the tile 151 become smaller than the point where the difference exists, the object 152 is included in the tile 151. It can be determined that it is included.
[0040]
In the above-described example, the single plane information is photographed by a plurality of image input devices 3, but the application of the image distribution system 2 is not limited to this.
[0041]
For example, as shown in FIG. 8, a single object 161 can be photographed by a plurality of image input devices 3 from front to back, right and left, and up and down, and can be combined into one image. Each piece of image information photographed by each image input device 3 becomes planar information, but when the images of all the image input devices 3 are connected, it becomes three-dimensional information. By synthesizing a single image by this method, a partial image can be created from a three-dimensional single image and provided to the client 5.
[0042]
In addition, as shown in FIG. 9, a usage method in which each image input device 3 captures an image radially from one point can be considered. This can be used when observing the night sky like a planetarium. This is to observe the state of the sky from a certain point using a plurality of image input devices 3. In this case, the image input devices 3 are arranged so that there is no gap between the images projected by the respective image input devices 3. Then, in the video projected by each image input device 3, the overlapping part is deleted to create one image data. Thus, an arbitrary partial image of the sky can be provided to the client 5.
[0043]
Further, as shown in FIG. 10, a method of using the image input device 3 to take a picture of a racing course in a shared manner is also conceivable. In this case, it is necessary to take an image of the racing course and its surroundings (audience seats and pits). The image input device 3 may be installed at each of the race course and its surroundings so that all these states can be observed.
[0044]
Also, as shown in FIG. 11A, when the image data 171 s to 179 s of と し て size are included as the code string data of each of the tiles 171 to 179 created by the image compression means 41, In step 44, the image data 171s to 179s are extracted and connected, and as shown in FIG. 11B, code string data can be created as each divided image. Of course, if the code string data created by the image compression means 41 includes image data of a reduced size of 1/2 or less, such as 1/2 or 1/8, the image data of this reduced size is extracted. To generate code string data for each divided image.
[0045]
As a result, a reduced image of the entire image can be easily created, and the receiving side can see the overview of the entire image at a glance.
[0046]
【The invention's effect】
According to the first and fifth aspects of the present invention, the transmission side creates code string data of an image in which a plurality of pieces of moving image data are combined into one, and the image data of a necessary rectangular area of the image is formed on the reception side or the like. , And transmission of only the selected image data can be easily realized. Further, the range of the rectangular area can be changed according to the request of the receiving side.
[0047]
According to the second and sixth aspects of the present invention, in the invention of the first and fifth aspects, code stream data of an image in which a plurality of pieces of moving image data are combined into one is created on the transmission side. It is possible to easily realize that the receiving side selects image data of a necessary rectangular area and transmits only the selected image data.
[0048]
According to the third and seventh aspects of the present invention, in the first and fifth aspects of the present invention, the screen can be switched following specific information within the screen.
[0049]
According to a fourth aspect of the present invention, in the invention of any one of the first to third to fifth to seventh aspects, a reduced image of the whole image can be easily created, and the whole image is formed on the receiving side. At a glance.
[Brief description of the drawings]
FIG. 1 is a block diagram of an overall configuration of an image distribution system according to an embodiment of the present invention.
FIG. 2 is a block diagram of an overall configuration of an image distribution / reproduction system according to an embodiment of the present invention.
FIG. 3 is an explanatory diagram illustrating extraction of an image performed by the image distribution system.
FIG. 4 is an explanatory diagram illustrating image division performed by an image distribution system.
FIG. 5 is a block diagram of an overall configuration showing another example of the image distribution / reproduction system.
FIG. 6 is an explanatory diagram of a process performed by the image distribution system to extract specific information in a screen.
FIG. 7 is an explanatory diagram of a process performed by the image distribution system to extract specific information in a screen.
FIG. 8 is an explanatory diagram of shooting performed on a single object by a plurality of image input devices from front and rear, left and right, and up and down.
FIG. 9 is an explanatory diagram of imaging performed radially from one point by a plurality of image input devices.
FIG. 10 is an explanatory diagram of shooting of a racing course performed by a plurality of image input devices.
FIG. 11 is an explanatory diagram when a reduced image of the entire image is created.
[Explanation of symbols]
REFERENCE SIGNS LIST 1 image distribution / reproduction system 2 image distribution system 3 image input device 5 image reproduction system 41 image compression means 43 syntax analysis means 44 code string creation means 45 transmission means, reception means 48 instruction means 49 extraction means 51 transmission means, reception means 52 decoding Means 54 Display device 55 Selection means

Claims (8)

A frame of moving image data obtained by combining a plurality of moving image data into one is divided into a plurality of rectangular regions, and pixel values are discrete wavelet-transformed for each of the rectangular regions to generate code string data hierarchically compressed and encoded. Code string creating means for
Syntax analysis means for analyzing the syntax of the code string data;
Code string creating means for selecting the required rectangular area from the code string data based on the analysis result and creating separate code string data of only the data of the rectangular area;
A transmission unit for transmitting the code string data created by the code string creation unit to a destination. Receiving means for receiving the selection of the rectangular area;
Instructing means for instructing the code string creating means to select the rectangular area as the accepted selection;
The image distribution system according to claim 1, further comprising: Extracting means for extracting specific information in the screen of the moving image data combined into one,
Instructing means for instructing the code string creating means to select the rectangular area based on the extracted information;
The image distribution system according to claim 1, further comprising: The code string creating means creates, from the code string data, another code string data of only data having a reduced size equal to or smaller than の of each of the rectangular areas,
The image distribution system according to claim 1. An image distribution system that distributes moving image data via a network,
A plurality of image reproduction systems that receive the distributed moving image data and display the images on an image display device;
With
The video distribution system,
Code string data which is obtained by dividing a frame of moving image data obtained by combining a plurality of moving image data into one into a plurality of rectangular regions, and performing discrete wavelet transform of pixel values for each of the rectangular regions and hierarchically compression-encoding them Parsing means for parsing the syntax of the code string data for
Code string creating means for selecting the required rectangular area from the code string data based on the analysis result and creating another code string data only for the data of the rectangular area;
Transmission means for transmitting the code string data created by the code string creation means to a destination,
Each of the image reproduction systems,
Receiving means for receiving the code string data transmitted from the transmitting means,
Decoding means for decoding the received code string data;
A buffer for buffering the decoded moving image data;
A display device for displaying the decoded image data,
Has,
Image distribution and playback system. The video distribution system,
Receiving means for receiving the selection of the rectangular area;
Instructing means for instructing the code string creating means to select the rectangular area as the accepted selection;
The image distribution / reproduction system according to claim 5, further comprising: The video distribution system,
Extracting means for extracting specific information in the screen of the moving image data combined into one,
Instructing means for instructing the code string creating means to select the rectangular area based on the extracted information;
The image distribution / reproduction system according to claim 5, further comprising: The code string creating means creates, from the code string data, another code string data of only data having a reduced size equal to or smaller than の of each of the rectangular areas,
The image distribution / reproduction system according to claim 5.

Images