CN102143368A - Image signal processing apparatus, image signal processing method, image display apparatus, image display method, and image display system - Google Patents
Image signal processing apparatus, image signal processing method, image display apparatus, image display method, and image display system Download PDFInfo
- Publication number
- CN102143368A CN102143368A CN201010294231XA CN201010294231A CN102143368A CN 102143368 A CN102143368 A CN 102143368A CN 201010294231X A CN201010294231X A CN 201010294231XA CN 201010294231 A CN201010294231 A CN 201010294231A CN 102143368 A CN102143368 A CN 102143368A
- Authority
- CN
- China
- Prior art keywords
- visual point
- image
- signal processing
- difference
- point image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
Abstract
The present invention discloses an image signal processing apparatus, an image signal processing method, an image display apparatus, an image display method, and an image display system. The image signal processing apparatus that supplies entire circumferential viewpoint images including plural viewpoint images respectively corresponding to plural viewpoints provided on a circumference around a subject to an image display apparatus that displays a stereoscopic image of the subject seen from an entire circumference, includes: arranging means for arranging the input entire circumferential viewpoint images in a time-series sequence by regarding corresponding differences in viewpoints as differences in an imaging sequence; and encoding means for treating the respective viewpoint images arranged in the time-series sequence by regarding the differences in viewpoints as differences in the imaging sequence as single frames and encoding the viewpoint images using an encoding method including at least inter-frame prediction to generate video encoded signals.
Description
Technical field
The present invention relates to image signal processing equipment, image-signal processing method, picture signal equipment, method for displaying image, program and image display system, and relate to image signal processing equipment, image-signal processing method, picture signal equipment, method for displaying image, program and the image display system that preferably for example when the stereo-picture (stereoscopic image) of display object, uses.
Background technology
In correlation technique, exist the image that to watch to be presented at technology on the flat-panel display devices that television receiver etc. adopted three-dimensionally.This technology can be utilized the not same sex of the people's who watches display device right and left eyes.Particularly, for example, the image that is used for left eye is displayed on same flat-panel display devices with the image that is used for right eye, and watch by polaroid filter, so that only see the image that is used for left eye and only see the image that is used for right eye for right eye for left eye, thus, realized stereos copic viewing.
On the other hand, proposed (entire circumference) 3 D image display device of many full circle weeks, it can utilize the stereo-picture (with reference to JP-A-2004-177709 or JP-2005-114771) that shows the whole circumference of crossing over this object from a plurality of images that are arranged on (or being generated) different points of view that obtains around the different points of view on the circumference of object (viewpoint) imaging under the hypothesis of the state that comes to watch from whole circumference object by computer graphical (below be called visual point image).
The all 3 D image display devices of full circle are suitable for having the display unit of cylindrical shape, and show the image of watching the user of the side surface of cylindrical shape to see from any direction three-dimensionally.
Summary of the invention
As mentioned above, all visual point images of full circle are transfused to full circle week visual point image display device, and data volume is huge.Therefore, can envision full circle week visual point image and be encoded and be transfused to full circle week 3 D image display device, and decoded and be shown in full circle week 3 D image display device.
Yet, under the present situation, do not set up the method for the full circle week visual point image of encoding efficiently as yet.
Therefore, hope is set up efficiently the full circle week visual point image of object is encoded the full circle week visual point image of object is imported efficiently the method for all 3 D image display devices of full circle.
The first embodiment of the present invention relates to a kind of image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, a plurality of visual point images are corresponding with a plurality of viewpoints that are arranged on around on the circumference of object respectively, this image signal processing equipment comprises: collating unit is used for to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order; And code device, be used for and be used as single frame by the difference of viewpoint difference being regarded as the imaging order with each visual point image that time sequencing is arranged, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video.
Image signal processing equipment in the first embodiment of the invention can also comprise control device, be used for by based on indicated object with respect to the parameter of the relative motion of viewpoint identify by the difference of viewpoint difference being regarded as the imaging order come with each visual point image that time sequencing is arranged have high relevance frame pattern and provide notice to institute's identification pattern, control and be used to utilize the coding method that comprises inter prediction at least code device the visual point image coding.
Image signal processing equipment in the first embodiment of the invention also comprises estimation unit, be used for each visual point image of arranging with time sequencing based on by the difference of viewpoint difference being regarded as imaging order, estimate the parameter of indicated object, and will give control device the notice of the estimated parameter that goes out with respect to the relative motion of viewpoint.
The first embodiment of the present invention also relates to a kind of image-signal processing method of image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, a plurality of visual point images are corresponding with a plurality of viewpoints that are arranged on around on the circumference of object respectively, and this image-signal processing method may further comprise the steps: come to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order by image signal processing equipment; And will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video.
The first embodiment of the present invention also relates to a kind of control program of image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, a plurality of visual point images are corresponding with a plurality of viewpoints that are arranged on around on the circumference of object respectively, and this program allows the computer of image signal processing equipment to carry out the processing that may further comprise the steps: come to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order; And will come to be used as single frame by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video with each visual point image that time sequencing is arranged.
In first embodiment of the invention, come to arrange the full circle week visual point image of being imported by the difference of corresponding viewpoint difference being regarded as the imaging order with time sequencing, each visual point image through arranging is taken as single frame, utilize and comprise that at least the coding method of inter prediction comes visual point image is encoded, thus, generate encoded video.
The second embodiment of the present invention relates to a kind of image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, image signal processing equipment comprises collating unit and code device, collating unit is used for by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of object with time sequencing, code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video, this image display comprises: code translator, be used for the encoded video of importing from image signal processing equipment is deciphered, and reproduce full circle week visual point image; And display control unit, be used to allow display unit to show through the full circle week of reproduction visual point image.
The second embodiment of the present invention also relates to a kind of method for displaying image of image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, image signal processing equipment comprises collating unit and code device, collating unit is used for by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of object with time sequencing, code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video, this method for displaying image may further comprise the steps: by picture signal equipment the encoded video of importing from image signal processing equipment is deciphered, and reproduced full circle week visual point image; And allow display unit to show through the full circle week of reproduction visual point image.
Second embodiment of the invention also relates to a kind of control program of image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, image signal processing equipment comprises collating unit and code device, collating unit is used for by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of object with time sequencing, code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video, this program allows the computer of image display to carry out the processing that may further comprise the steps: the encoded video of importing from image signal processing equipment is deciphered, and reproduced the decoding step of full circle week visual point image; And allow display unit to show the demonstration controlled step of all visual point images of full circle through reproducing.
In second embodiment of the invention, decoded and all visual point images of full circle are reproduced from the encoded video of image signal processing equipment input, and the week of the full circle through reproducing visual point image be displayed on the display unit.
The third embodiment of the present invention relates to a kind of picture signal system, and this system comprises: image display, and it shows the stereo-picture of the object of seeing from whole circumference; And image signal processing equipment, its full circle week visual point image that will comprise a plurality of visual point images offers image display, a plurality of visual point images are corresponding with a plurality of viewpoints that are arranged on around on the circumference of object respectively, wherein, image signal processing equipment comprises: collating unit, be used for to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order, and code device, be used for and be used as single frame by the difference of viewpoint difference being regarded as the imaging order with each visual point image that time sequencing is arranged, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video, and wherein, image display comprises: code translator, be used for deciphering from the encoded video of image signal processing equipment input, and reproduce full circle week visual point image, and display control unit, be used to allow display unit to show through the full circle week of reproduction visual point image.
In third embodiment of the invention, pass through image signal processing equipment, come to arrange the full circle week visual point image of being imported by corresponding viewpoint difference being regarded as imaging order difference with time sequencing, each visual point image through arranging is taken as single frame, utilize and comprise that at least the coding method of inter prediction comes visual point image is encoded, and thus, generated encoded video.In addition, decoded and all visual point images of full circle are reproduced by image display from the encoded video of image signal processing equipment input, and the week of the full circle through reproducing visual point image be displayed on the display unit.
According to first embodiment of the invention, all visual point images of the full circle of object can be transfused to image display efficiently.
According to second embodiment of the invention, the encoded video based on by the full circle week visual point image of object is encoded efficiently and obtained can be shown as object the stereo-picture of seeing from whole circumference.
According to third embodiment of the invention, all visual point images of the full circle of object can be inputed to image display efficiently, and object can be shown as the stereo-picture of seeing from whole circumference.
Description of drawings
Fig. 1 is the block diagram that the ios dhcp sample configuration IOS DHCP of the three-dimensional image display systems of having used the embodiment of the invention is shown.
Fig. 2 be used to illustrate 18 full circle week visual point image the diagrammatic sketch of situation.
Fig. 3 is used to illustrate the diagrammatic sketch that is used for arranging with time sequencing the sequence of full circle week visual point image.
Fig. 4 shows the first related pattern in response to the rotary speed of object itself.
Fig. 5 shows the second related pattern in response to the rotary speed of object itself.
Fig. 6 shows the 3rd related pattern in response to the rotary speed of object itself.
Fig. 7 is the diagrammatic sketch that is used to illustrate the searching method of the visual point image with high relevance.
Fig. 8 is the diagrammatic sketch that is used to illustrate the searching method of the visual point image with high relevance.
Fig. 9 is the diagrammatic sketch that is used to illustrate the searching method of the visual point image with high relevance.
Figure 10 is the block diagram that the ios dhcp sample configuration IOS DHCP of the image signal processing equipment among Fig. 1 is shown.
Figure 11 is used to illustrate the flow chart that is generated encoded video by image signal processing equipment.
Figure 12 is the block diagram that the ios dhcp sample configuration IOS DHCP of all 3 D image display devices of full circle among Fig. 1 is shown.
Figure 13 is the diagrammatic sketch that the ios dhcp sample configuration IOS DHCP of computer is shown.
Embodiment
Below, will describe in detail with reference to the accompanying drawings and be used to realize optimal mode of the present invention (being called embodiment in the following description).
[ios dhcp sample configuration IOS DHCP of three-dimensional image display systems]
Fig. 1 shows the ios dhcp sample configuration IOS DHCP of the three-dimensional image display systems of having used the embodiment of the invention.Three-dimensional image display systems 10 comprises image signal processing equipment 20, all 3 D image display devices 30 of full circle and flat display apparatus 40.
The viewpoint difference of all visual point images of the full circle that image signal processing equipment 20 will be imported is from the outside regarded the difference of imaging order as, arrange visual point image according to the imaging order, each visual point image is used as each single frame and to image encoding, and the encoded video that obtains is exported to full circle week 3 D image display device 30.
Full circle week, 3 D image display device 30 comprised display unit 54 (Figure 12), and display unit 54 is in the barrel portion 31 that is equipped with a plurality of slits (slit) 32.30 pairs of encoded videos from image signal processing equipment 20 inputs of full circle week 3 D image display device are deciphered, and according to predetermined sequence the full circle week visual point image that obtains are presented on the display unit 54.Simultaneously, barrel portion 31 drives with being rotated.Watch the user of the side surface of barrel portion 31 to catch a glimpse of the image of display unit 54 via slit 32 from any direction, thus, the user can go out the stereo-picture of the whole circumference of crossing object by visual identity.
In addition, 3 D image display device 30 will offer flat display apparatus 40 as the full circle week visual point image that the decode results of encoded video is obtained full circle week.Encoded video can be offered flat display apparatus 40 and decoded flat display apparatus 40 from all 3 D image display devices 30 of full circle.
Note,, can be applied in the full circle week 3 D image display device that proposes among the total Japanese patent application No.2008-317522 as full circle week 3 D image display device 30.
[explanation of all stereo-pictures of full circle]
Fig. 2 shows such situation, wherein, and by being divided into that 18 parts provide 18 viewpoints around the circumference of object and by imaging obtains visual point image to object simultaneously from each viewpoint.Visual point image also can be by imaging generate to object practically, but utilizes CG (computer graphical) to wait the state when each viewpoint is watched object to generate visual point image by hypothesis.
In the situation of this figure, obtain 18 visual point images at each imaging time place.Here, supposing that with precalculated position (for example, the front of object) be benchmark, is A00 from this visual point image of seeing, and next, the visual point image that obtains at 20 ° viewpoint intervals is A01, A02...A17.
The number of the viewpoint that is provided with in week at the full circle of object, in other words, the number of visual point image is not limited to 18, and can be more peanut or more big figure.Number is big more, just can get over the stereo-picture of display object smoothly.
[arranging the sequence of full circle week visual point image in chronological order]
Fig. 3 shows such sequence, wherein, is arranged in each imaging time place in chronological order simultaneously by 18 full circle week visual point image A00 to A17 of imaging.Below, at imaging time t
nThe place is called as A00t by 18 visual point images of imaging simultaneously
nTo A17t
n, at imaging time t
N+1Simultaneously be called as A00t with the follow-up time place by 18 visual point images of imaging
N+1To A17t
N+1Deng.
That is, at imaging time t
nThe place is simultaneously by 18 visual point image A00t of imaging
nTo A17t
nBe taken as each single frame, and come by sequence A00t by the difference of the difference of viewpoint being regarded as the imaging order
n, A01t
n..., A17t
nArrange.Next, visual point image A00t
N+1, A01t
N+1... A17t
N+1Be arranged according to this sequence.The image of back will be arranged according to identical mode.
As mentioned above, when simultaneously by the full circle of imaging week visual point image be taken as each single frame and when arranging by the difference of the difference of viewpoint being regarded as the imaging order, with the general motion image similarity of arranging frame with the imaging order, the content of last visual point image and back one visual point image is similar.In addition, even in the different situation of imaging time, as at visual point image A17t
nWith visual point image A00t
N+1Situation in, if it is at interval shorter, then the content of image also is similar.
Therefore, with general moving image similarly, can will be converted to general encoded video with each visual point image of series arrangement shown in Figure 3 by the existing coding method (for example, MPEG2 method, H264 etc.) of using infra-frame prediction and inter prediction.
Notice that in the number situation about increasing along with the increase of viewpoint number of full circle week visual point image, the frame per second of the encoded video that obtains increases, and the load that encoding process and decoding are handled becomes big.
In this case, when encoding process, visual point image can and be encoded by sparse (thin), can generate by carry out interpolation after decoding through sparse visual point image.
Alternatively, can be divided into many passages and execution concurrently separately if encoding process and decoding are handled, then all visual point images of full circle can be divided into many passages and processed.In this case, although the compression ratio step-down of visual point image can expect to obtain to handle faster.
As mentioned above, if all visual point images of full circle are arranged as shown in Figure 3, then can utilize existing coding method to convert them to general encoded video.
Note, in the situation that object relatively rotates, can utilize the relevance of the visual point image at different imaging times place to come to carry out coding with higher compression ratio.
[the related pattern when object relatively rotates]
Fig. 4 shows and the following situation corresponding first related pattern: wherein, object so that object at imaging time t
nWith t
N+1Between relatively rotate viewpoint at interval the speed of (being 20 ° in this case) to right rotation.
In this case, indicated as the arrow among this figure, visual point image A00t
nWith visual point image A17t
N+1, visual point image A01t
nWith visual point image A00t
N+1, visual point image A02t
nWith visual point image A01t
N+1... the relevance of combination higher, and utilize frame to carry out coding by using inter prediction with high relevance.
Fig. 5 shows and the following situation corresponding second related pattern: wherein, object so that object at imaging time t
nWith t
N+1Between relatively rotate viewpoint at interval the speed of (being 20 ° in this case) to anticlockwise.
In this case, indicated as the arrow among this figure, visual point image A00t
nWith visual point image A01t
N+1, visual point image A01t
nWith visual point image A02t
N+1, visual point image A03t
nWith visual point image A04t
N+1... the relevance of combination higher, and utilize frame to carry out coding by using inter prediction with high relevance.
Fig. 6 shows and following situation the corresponding the 3rd related pattern: wherein, object so that object at imaging time t
nWith t
N+1Between relatively rotate two viewpoints at interval the speed of (being 40 ° in this case) to right rotation.
In this case, indicated as the arrow among this figure, visual point image A00t
nWith visual point image A16t
N+1, visual point image A01t
nWith visual point image A17t
N+1, visual point image A02t
nWith visual point image A00t
N+1... the relevance of combination higher, and utilize frame to carry out coding by using inter prediction with high relevance.
Note, may be able to obtain in the situation of parameter of the relative rotational of indicated object and its direction of rotation (for example, generating in the situation of visual point image by CG etc.), then for example come as shown in Figs. 4-6 such to identify related pattern and carry out coding based on the parameter of being obtained.
[searching method] with visual point image of high relevance
Next, explanation is used for have the method for the visual point image of high relevance in the situation search of the parameter of the rotary speed that may not obtain indicated object itself and direction of rotation thereof.
In the situation of the parameter of the rotary speed that may not obtain indicated object itself and direction of rotation thereof, other visual point image to different imaging time the time is compared the specific view image with higher relevance and is searched for.In addition, estimate the rotary speed of indicated object itself and the parameter of direction of rotation thereof based on the specific view image and the combination of the visual point image that searches, and for example based on the estimated parameter that goes out identifying related pattern like that and carry out and encode as shown in Figs. 4-6.
Particularly, concern imaging time t as shown in Figure 7
nThe visual point image A α t at place
n, and as shown in Figure 8, will be at imaging time t
N+1The visual point image A α t at place
N+1Several visual point images and the visual point image A α t near viewpoint place
nCompare.Then, the image with minimum difference is designated as the image with high relevance.As shown in Figure 8, at visual point image A α-2t
N+1Be designated as t with visual point image A α
N+1Have in the situation of the highest relevance, object be estimated as so that object at imaging time t
nWith t
N+1Between relatively rotate two viewpoints speed at interval to right rotation.In this case, identify related pattern and execution coding as shown in Figure 9.
[ios dhcp sample configuration IOS DHCP of image signal processing equipment 20 and operation]
Next, explanation is formed the ios dhcp sample configuration IOS DHCP of the image signal processing equipment 20 of three-dimensional image display systems 10.
Figure 10 shows the detailed configuration example of image signal processing equipment 20.Image signal processing equipment 20 comprises visual point image buffer 21, search unit 22, coding control unit 23 and encoder 24.
The all visual point image quilts of full circle are received image signal treatment facility 20 from the outside.In addition, be expressed as the time rotary speed of object itself and the parameter of direction of rotation thereof be provided for image signal processing equipment 20.Yet, also can not provide these parameters.
The full circle week visual point image that visual point image buffer 21 bufferings are sequentially imported from the outside, simultaneously as shown in Figure 3, come to be arranged in each imaging time place by the full circle of while imaging week visual point image by the difference of each difference of viewpoint being regarded as the imaging order with time sequencing.
Be expressed as the time rotary speed of object itself and direction of rotation thereof parameter situation about not being provided in, utilize Fig. 7 and the described method of Fig. 8 dynamically to estimate the rotary speed of object itself and the parameter of direction of rotation thereof above search unit 22 bases, and parameter is exported to coding control unit 23.
Coding control unit 23 based on input from the outside or from the rotary speed of the object of search unit 22 input itself and the parameter of direction of rotation thereof, come the dynamically encoding process of controlled encoder 24.Particularly, in response to the parameter of input, this unit will offer encoder 24 to the notice of the combination (related pattern) of visual point image with high relevance, and allow it to carry out the coding of visual point image based on inter prediction.
Encoder 24 will be through visual point image buffer 21 buffering and visual point image that be rearranged regard the frame of arranging with time sequencing as, and according to the control that comes own coding control unit 23 they are encoded, and the encoded video that obtains is outputed to the downstream.
Search unit 22 and coding control unit 23 can be omitted, and can utilize existing coding method to come visual point image is encoded in encoder 24.
Next, Figure 11 is used to illustrate that the encoded video that is undertaken by image signal processing equipment 20 generates the flow chart of handling.
At step S1, image signal processing equipment 20 obtains full circle week visual point image from the outside.The full circle week visual point image that is obtained is transfused to visual point image buffer 21.At step S2, the full circle week visual point image of visual point image buffer 21 bufferings input from the outside simultaneously as shown in Figure 3, is arranged in each imaging time place in chronological order by the full circle of while imaging week visual point image.
At step S3, utilize Fig. 7 and the described method of Fig. 8 above search unit 22 bases, image by reference buffering in visual point image buffer 21 is estimated the rotary speed of object itself and the parameter of direction of rotation thereof, and parameter is exported to coding control unit 23.
At step S4, encoder 24 will be through visual point image buffer 21 buffering and visual point image that be rearranged regard the frame of arranging with time sequencing as, and according to the control that comes own coding control unit 23 they are encoded, and the encoded video that obtains is outputed to the downstream.
As mentioned above, generate processing according to this encoded video, the full circle week image of object can be counted as the frame of arranging with time sequencing and be encoded, and is offered the downstream efficiently as encoded video.
[ios dhcp sample configuration IOS DHCP and the operation of all 3 D image display devices 30 of full circle]
Next, Figure 12 shows encoded video by the ios dhcp sample configuration IOS DHCP of all 3 D image display devices 30 of the full circle that inputs to it from image signal processing equipment 20.
The all 3 D image display devices 30 of full circle comprise decoder 51, visual point image buffer 52, indicative control unit 53 and display unit 54.
51 pairs of encoded videos from image signal processing equipment 20 inputs of upstream of decoder are deciphered, and the visual point image that obtains is exported to visual point image buffer 52.Visual point image buffer 52 bufferings are from the visual point image of decoder 51 inputs.
Indicative control unit 53 is according to predefined procedure playback buffer each visual point image in visual point image buffer 52, and permission display unit 54 shows them.
In all 3 D image display devices 30 of full circle, encoded video is imported by the image signal processing equipment 20 from the upstream, and by decoder 51 decodings, and the visual point image that obtains is buffered in the visual point image buffer 52.Then, the visual point image through buffering is read out and is displayed in the display unit 54 with predefined procedure.
Now, the processing sequence of all 3 D image display devices 30 of above-described image signal processing equipment 20 and full circle can be carried out by hardware or software.In carry out the situation of handling sequence by software, the program that forms software is installed to from program recorded medium in the computer that is included in the specialized hardware, perhaps is installed to can utilize the various programs of being installed to carry out in the general purpose personal computer of various functions.
Figure 13 is the block diagram that the hardware configuration example of the computer that utilizes program to carry out above-mentioned processing sequence is shown.
In computer 100, CPU (CPU) 101, ROM (read-only memory) 102, RAM (random access memory) 103 are connected to each other by bus 104.
Input/output interface 105 also is connected to bus 104.The input unit 106 that comprises keyboard, mouse, microphone etc., the output unit 107 that comprises display unit, loud speaker etc., the memory cell 108 that comprises hard disk, nonvolatile memory etc., the driver 110 that comprises the communication unit 109 of network interface etc. and drive the removable media 111 that comprises disk, CD, magneto optical disk and semiconductor disc is connected to input/output interface 105.
In having the computer of above-mentioned configuration, CPU 101 is written into RAM 103 and execution via the program that input/output interface 105 and bus 104 will for example be stored in the memory cell 108, carries out above-mentioned processing sequence thus.
The program of being carried out by computer can be to carry out the program of processing according to the time series of order illustrated in specification, perhaps can be that the program of handling is carried out in required timing place concurrently or when calling etc.
In addition, program can be handled or can be handled with distributed way by a plurality of computers by single computer.In addition, program can be transmitted to computer at a distance.
In addition, in this manual, system is meant the total system that comprises a plurality of equipment.
Embodiments of the invention are not limited to above-described embodiment, and can carry out various changes without departing from the scope of the invention.
The application comprises and on the October 2nd, 2009 of relevant theme of disclosed content in the Japanese priority patent application JP 2009-230874 that Japan Patent office submits to, and the full content of this application is incorporated into this by reference.
Claims (13)
1. image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, described a plurality of visual point image is corresponding with a plurality of viewpoints that are arranged on around on the circumference of described object respectively, and described image signal processing equipment comprises:
Collating unit is used for to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order; And
Code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilizes the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video.
2. image signal processing equipment according to claim 1, also comprise: control device, be used for by based on the described object of expression with respect to the parameter of the relative motion of viewpoint identify by the difference of viewpoint difference being regarded as the imaging order come with each visual point image that time sequencing is arranged have high relevance frame pattern and provide notice to institute's identification pattern, control and be used to utilize the coding method that comprises inter prediction at least described code device the visual point image coding.
3. image signal processing equipment according to claim 2, also comprise: estimation unit, be used for each visual point image of arranging with time sequencing based on by the difference of viewpoint difference being regarded as imaging order, estimate to represent the parameter of described object, and will give described control device the notice of the estimated parameter that goes out with respect to the relative motion of viewpoint.
4. the image-signal processing method of an image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, described a plurality of visual point image is corresponding with a plurality of viewpoints that are arranged on around on the circumference of described object respectively, and described image-signal processing method may further comprise the steps:
By described image signal processing equipment
Come to arrange the full circle week visual point image of being imported by the difference of corresponding viewpoint difference being regarded as the imaging order with time sequencing; And
To be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video.
5. the control program of an image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, described a plurality of visual point image is corresponding with a plurality of viewpoints that are arranged on around on the circumference of described object respectively, and described program allows the computer of described image signal processing equipment to carry out the processing that may further comprise the steps:
Come to arrange the full circle week visual point image of being imported by the difference of corresponding viewpoint difference being regarded as the imaging order with time sequencing; And
To come to be used as single frame by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video with each visual point image that time sequencing is arranged.
6. image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, described image signal processing equipment comprises collating unit and code device, described collating unit is used for by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of described object with time sequencing, described code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come visual point image is encoded to generate encoded video, described image display comprises:
Code translator is used for the described encoded video of importing from described image signal processing equipment is deciphered, and reproduces all visual point images of described full circle; And
Display control unit is used to allow display unit to show through the full circle week of reproduction visual point image.
7. the method for displaying image of an image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, described image signal processing equipment comprises collating unit and code device, described collating unit is used for by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of described object with time sequencing, described code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come visual point image is encoded to generate encoded video, described method for displaying image may further comprise the steps:
By described image display
The described encoded video of importing from described image signal processing equipment is deciphered, and reproduced all visual point images of described full circle; And
Allow display unit to show through the full circle week of reproduction visual point image.
8. the control program of an image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, described image signal processing equipment comprises collating unit and code device, described collating unit is used for by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of described object with time sequencing, described code device is used for and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come visual point image is encoded to generate encoded video, described program allows the computer of described image display to carry out the processing that may further comprise the steps:
The described encoded video of importing from described image signal processing equipment is deciphered, and reproduced all visual point images of described full circle; And
Allow display unit to show through the full circle week of reproduction visual point image.
9. image display system comprises:
Image display, it shows the stereo-picture of the object of seeing from whole circumference; And
Image signal processing equipment, its full circle week visual point image that will comprise a plurality of visual point images offers described image display, and described a plurality of visual point images are corresponding with a plurality of viewpoints that are arranged on around on the circumference of described object respectively,
Wherein, described image signal processing equipment comprises
Collating unit is used for to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order, and
Code device, be used for and be used as single frame by the difference of viewpoint difference being regarded as the imaging order with each visual point image that time sequencing is arranged, and utilize the coding method that comprises inter prediction at least to come visual point image is encoded with the generation encoded video, and
Wherein, described image display comprises
Code translator is used for the described encoded video of importing from described image signal processing equipment is deciphered, and reproduces all visual point images of described full circle, and
Display control unit is used to allow display unit to show through the full circle week of reproduction visual point image.
10. one kind will comprise that the full circle week visual point image of a plurality of visual point images of object offers the image signal processing equipment of image display, comprising:
Collating unit is used to arrange the full circle week visual point image of being imported, and
Code device is used for each visual point image is used as single frame, and utilization comprises that at least the coding method of inter prediction comes visual point image is encoded.
11. image signal processing equipment, this image signal processing equipment will comprise that full circle week visual point image of a plurality of visual point images offers the image display of the stereo-picture of the object that demonstration sees from whole circumference, described a plurality of visual point image is corresponding with a plurality of viewpoints that are arranged on around on the circumference of described object respectively, and described image signal processing equipment comprises:
Arrangement units is configured to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order; And
Coding unit, be configured to and be used as single frame by the difference of viewpoint difference being regarded as the imaging order with each visual point image that time sequencing is arranged, and utilize the coding method that comprises inter prediction at least to come the visual point image coding to generate encoded video.
12. image display, this image display shows the stereo-picture of the object of seeing from whole circumference based on the encoded video from image signal processing equipment input, described image signal processing equipment comprises arrangement units and coding unit, described arrangement units is configured to by corresponding viewpoint difference being regarded as the difference of imaging order, come to arrange and comprise respectively and the full circle week visual point image that is arranged on the corresponding a plurality of visual point images of a plurality of viewpoints on the circumference of described object with time sequencing, described coding unit is configured to and will be used as single frame with each visual point image that time sequencing is arranged by the difference of viewpoint difference being regarded as the imaging order, and utilize the coding method that comprises inter prediction at least to come visual point image is encoded to generate encoded video, described image display comprises:
Decoding unit is configured to the described encoded video of importing from described image signal processing equipment is deciphered, and reproduces all visual point images of described full circle; And
Indicative control unit is configured to allow display unit to show through the full circle week of reproduction visual point image.
13. an image display system comprises:
Image display, it shows the stereo-picture of the object of seeing from whole circumference; And
Image signal processing equipment, its full circle week visual point image that will comprise a plurality of visual point images offers described image display, and described a plurality of visual point images are corresponding with a plurality of viewpoints that are arranged on around on the circumference of described object respectively,
Wherein, described image signal processing equipment comprises
Arrangement units is configured to arrange the full circle week visual point image of being imported with time sequencing by the difference of corresponding viewpoint difference being regarded as the imaging order, and
Coding unit, be configured to and be used as single frame by the difference of viewpoint difference being regarded as the imaging order with each visual point image that time sequencing is arranged, and utilize the coding method that comprises inter prediction at least to come visual point image is encoded with the generation encoded video, and
Wherein, described image display comprises
Decoding unit is configured to the described encoded video of importing from described image signal processing equipment is deciphered, and reproduces all visual point images of described full circle, and
Indicative control unit is configured to allow display unit to show through the full circle week of reproduction visual point image.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009-230874 | 2009-10-02 | ||
| JP2009230874A JP2011082622A (en) | 2009-10-02 | 2009-10-02 | Apparatus and method for processing image signal, apparatus and method for displaying image, program therefor, and system for displaying image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102143368A true CN102143368A (en) | 2011-08-03 |
Family
ID=43411252
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010294231XA Pending CN102143368A (en) | 2009-10-02 | 2010-09-25 | Image signal processing apparatus, image signal processing method, image display apparatus, image display method, and image display system |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20110080469A1 (en) |
| EP (1) | EP2306742A3 (en) |
| JP (1) | JP2011082622A (en) |
| KR (1) | KR20110036671A (en) |
| CN (1) | CN102143368A (en) |
| SG (1) | SG169944A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104284193A (en) * | 2013-07-12 | 2015-01-14 | 索尼公司 | Encoding device and encoding method, and decoding device and decoding method |
| CN109716763A (en) * | 2016-09-26 | 2019-05-03 | 索尼公司 | Encoding device, coding method, decoding device, coding/decoding method, sending device and receiving device |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011082675A (en) * | 2009-10-05 | 2011-04-21 | Sony Corp | Apparatus and method for processing image signal, apparatus and method for displaying image, program therefor, and system for displaying image |
| FR2974966A1 (en) * | 2011-05-05 | 2012-11-09 | France Telecom | METHOD FOR ENCODING AND DECODING INTEGRAL IMAGES, DEVICE FOR ENCODING AND DECODING INTEGRAL IMAGES, AND CORRESPONDING COMPUTER PROGRAMS |
| JP5873255B2 (en) * | 2011-05-20 | 2016-03-01 | キヤノン株式会社 | Image processing apparatus and method, and image reproduction apparatus |
| JP5907016B2 (en) * | 2012-09-12 | 2016-04-20 | 富士通株式会社 | Moving picture coding apparatus, moving picture coding method, moving picture coding program, and moving picture communication apparatus |
| JP2014086968A (en) * | 2012-10-25 | 2014-05-12 | Ricoh Co Ltd | Image processing device, image processing method, and program |
| CN107147895A (en) * | 2017-04-18 | 2017-09-08 | 中山大学 | A kind of method for processing video frequency presented for multi views sequential |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080043014A1 (en) * | 2004-12-28 | 2008-02-21 | Japan Science And Technology Agency | 3D Image Display Method |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4431280A (en) * | 1981-11-24 | 1984-02-14 | Carvelo Lenard B | Planar rotational autostereoscopic display |
| US5148310A (en) * | 1990-08-30 | 1992-09-15 | Batchko Robert G | Rotating flat screen fully addressable volume display system |
| US6183088B1 (en) * | 1998-05-27 | 2001-02-06 | Actuality Systems, Inc. | Three-dimensional display system |
| US20020085219A1 (en) * | 2000-08-11 | 2002-07-04 | Victor Ramamoorthy | Method of and system for generating and viewing multi-dimensional images |
| JP3906146B2 (en) | 2002-11-27 | 2007-04-18 | 株式会社東芝 | Stereoscopic image display apparatus and stereoscopic image display method |
| US8118674B2 (en) * | 2003-03-27 | 2012-02-21 | Wms Gaming Inc. | Gaming machine having a 3D display |
| JP4470432B2 (en) | 2003-10-02 | 2010-06-02 | ソニー株式会社 | Display device |
| US7364300B2 (en) * | 2004-01-12 | 2008-04-29 | Actuality Systems, Inc. | Theta-parallax-only (TPO) displays |
| US7728877B2 (en) * | 2004-12-17 | 2010-06-01 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for synthesizing multiview videos |
| KR101235273B1 (en) * | 2005-07-07 | 2013-02-20 | 삼성전자주식회사 | Volumetric 3D display system using a plurality of transparent flexible display panels |
| JP2011082675A (en) * | 2009-10-05 | 2011-04-21 | Sony Corp | Apparatus and method for processing image signal, apparatus and method for displaying image, program therefor, and system for displaying image |
-
2009
- 2009-10-02 JP JP2009230874A patent/JP2011082622A/en not_active Abandoned
-
2010
- 2010-09-06 SG SG201006462-4A patent/SG169944A1/en unknown
- 2010-09-14 EP EP20100176660 patent/EP2306742A3/en not_active Withdrawn
- 2010-09-21 US US12/886,676 patent/US20110080469A1/en not_active Abandoned
- 2010-09-24 KR KR20100092868A patent/KR20110036671A/en not_active Application Discontinuation
- 2010-09-25 CN CN201010294231XA patent/CN102143368A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080043014A1 (en) * | 2004-12-28 | 2008-02-21 | Japan Science And Technology Agency | 3D Image Display Method |
Non-Patent Citations (1)
| Title |
|---|
| XING SAN 等: "Multiview Image Coding Based on Geometric Prediction", 《IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104284193A (en) * | 2013-07-12 | 2015-01-14 | 索尼公司 | Encoding device and encoding method, and decoding device and decoding method |
| CN109716763A (en) * | 2016-09-26 | 2019-05-03 | 索尼公司 | Encoding device, coding method, decoding device, coding/decoding method, sending device and receiving device |
Also Published As
| Publication number | Publication date |
|---|---|
| US20110080469A1 (en) | 2011-04-07 |
| KR20110036671A (en) | 2011-04-08 |
| EP2306742A2 (en) | 2011-04-06 |
| EP2306742A3 (en) | 2011-06-22 |
| SG169944A1 (en) | 2011-04-29 |
| JP2011082622A (en) | 2011-04-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102143368A (en) | Image signal processing apparatus, image signal processing method, image display apparatus, image display method, and image display system | |
| KR101768604B1 (en) | 3-D Matrix Barcode Presentation | |
| EP3646609B1 (en) | Viewport selection based on foreground audio objects | |
| US20080101455A1 (en) | Apparatus and method for multiple format encoding | |
| CN102364945B (en) | Multi-picture image decoding display method and video monitoring terminal | |
| CN113302928B (en) | System and method for transmitting multiple video streams | |
| CN107851425B (en) | Information processing apparatus, information processing method, and program | |
| CN101771853A (en) | Method and device for playing conference content | |
| JP2017068255A (en) | Device and method for processing image | |
| CN101232611A (en) | Image process apparatus and method thereof | |
| EP3007449B1 (en) | Protected storage of content with two complementary memories | |
| CN107925838B (en) | Information processing apparatus, information processing method, and program | |
| KR101151107B1 (en) | Moving picture encryption system and method | |
| US8687950B2 (en) | Electronic apparatus and display control method | |
| EP3384670A1 (en) | Method and apparatus live virtual reality streaming | |
| US20180302636A1 (en) | Method of mixing video bitstreams and apparatus performing the method | |
| JP2011216965A (en) | Information processing apparatus, information processing method, reproduction apparatus, reproduction method, and program | |
| EP3002953A1 (en) | Image processing apparatus and control method thereof | |
| JP2020524450A (en) | Transmission system for multi-channel video, control method thereof, multi-channel video reproduction method and device thereof | |
| CN103067785A (en) | Achieving method of graph user interface and conditional access module | |
| CN106792219B (en) | It is a kind of that the method and device reviewed is broadcast live | |
| JP5166567B2 (en) | Electronic device, video data display control method, and program | |
| KR101299245B1 (en) | Video reproduction device for decoding Region of Interest and method of thereof | |
| JP2014176016A (en) | Video reproduction device, video distribution device, video reproduction method, video distribution method and program | |
| US11743442B2 (en) | Bitstream structure for immersive teleconferencing and telepresence for remote terminals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110803 |