WO2017094318A1 - フレーム生成装置、フレーム生成方法、画像復元装置、画像復元方法、画像伝送システムおよび画像伝送方法 - Google Patents
フレーム生成装置、フレーム生成方法、画像復元装置、画像復元方法、画像伝送システムおよび画像伝送方法 Download PDFInfo
- Publication number
- WO2017094318A1 WO2017094318A1 PCT/JP2016/077114 JP2016077114W WO2017094318A1 WO 2017094318 A1 WO2017094318 A1 WO 2017094318A1 JP 2016077114 W JP2016077114 W JP 2016077114W WO 2017094318 A1 WO2017094318 A1 WO 2017094318A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video signal
- pixel
- vertical line
- unit
- output
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 101
- 238000000034 method Methods 0.000 title claims description 33
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000004519 manufacturing process Methods 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 14
- 238000000605 extraction Methods 0.000 description 14
- 230000000694 effects Effects 0.000 description 5
- 239000000284 extract Substances 0.000 description 5
- 239000000470 constituent Substances 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000001151 other effect Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N11/00—Colour television systems
- H04N11/06—Transmission systems characterised by the manner in which the individual colour picture signal components are combined
- H04N11/20—Conversion of the manner in which the individual colour picture signal components are combined, e.g. conversion of colour television standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N11/00—Colour television systems
- H04N11/02—Colour television systems with bandwidth reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8458—Structuring of content, e.g. decomposing content into time segments involving uncompressed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
- H04N7/0806—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division the signals being two or more video signals
Definitions
- the present disclosure relates to a frame generation device, a frame generation method, an image restoration device, an image restoration method, an image transmission system, and an image transmission method.
- the transmitter divides the video signal into a plurality of parts, and transmits each of the plurality of divided signals obtained through the division through corresponding transmission lines.
- a technique is used.
- a technique for changing the number of transmission paths used for transmitting a plurality of divided signals based on the color format information of the video signal is disclosed (for example, see Non-Patent Document 1). According to such a technique, the load on the transmission path can be reduced.
- the vertical line number in the video signal is an integer from 0 to N ⁇ 1 and the vertical line number in the video signal is an integer from 0 to M ⁇ 1
- the vertical line number is An operation of dividing a pixel group included in a line with 2 m and a pixel group included in a line with the vertical line number (2m + 1) based on the color format information of the video signal is 0 ⁇ m ⁇ (M / 2)
- An image dividing unit that obtains a plurality of divided signals by performing processing for all integers m satisfying ⁇ 1, and a frame generating unit that generates a plurality of frames separately including the plurality of divided signals.
- a generating device is provided.
- the vertical line number in the video signal is an integer from 0 to N ⁇ 1 and the vertical line number in the video signal is an integer from 0 to M ⁇ 1
- the vertical line number is An operation of dividing a pixel group included in a line with 2 m and a pixel group included in a line with the vertical line number (2m + 1) based on the color format information of the video signal is 0 ⁇ m ⁇ (M / 2)
- Obtaining a plurality of divided signals by performing processing for all integers m satisfying -1 and generating a plurality of frames separately including the plurality of divided signals are provided. Is done.
- a pixel group included in a line whose vertical line number is 2m and a pixel group included in a line whose vertical line number is (2m + 1) are divided based on color format information of a video signal.
- the plurality of divided signals are An image restoration device, comprising: a signal acquisition unit to obtain; and an image restoration unit to restore the video signal based on the divided signal.
- a pixel group included in a line whose vertical line number is 2m and a pixel group included in a line whose vertical line number is (2m + 1) are divided based on color format information of a video signal.
- the plurality of divided signals are An image restoration method comprising: obtaining and restoring the video signal based on the divided signal is provided.
- the vertical line number in the video signal is an integer from 0 to N ⁇ 1 and the vertical line number in the video signal is an integer from 0 to M ⁇ 1
- the vertical line number is An operation of dividing a pixel group included in a line with 2 m and a pixel group included in a line with the vertical line number (2m + 1) based on the color format information of the video signal is 0 ⁇ m ⁇ (M / 2) an image dividing unit that obtains a plurality of divided signals by performing processing for all integers m satisfying ⁇ 1, and a frame generating unit that generates a plurality of frames separately including the plurality of divided signals.
- a receiver a signal acquisition unit that acquires the plurality of divided signals when the plurality of frames are received, and an image restoration unit that recovers the video signal based on the divided signals; Comprises, it has a receiver, an image transmission system is provided.
- the vertical line number in the video signal is an integer from 0 to N ⁇ 1 and the vertical line number in the video signal is an integer from 0 to M ⁇ 1
- the vertical line number is An operation of dividing a pixel group included in a line with 2 m and a pixel group included in a line with the vertical line number (2m + 1) based on the color format information of the video signal is 0 ⁇ m ⁇ (M / 2) obtaining a plurality of divided signals by performing processing for all integers m satisfying -1, generating a plurality of frames separately including the plurality of divided signals, and receiving the plurality of frames And obtaining the plurality of divided signals, and restoring the video signal based on the divided signals.
- a technology capable of suppressing the production cost of a system in which a video signal is transmitted via a plurality of transmission paths is provided.
- the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.
- the transmitter divides the video signal into a plurality of parts, and transmits each of the plurality of divided signals obtained through the division through corresponding transmission lines.
- a technique is used.
- the position information of each pixel may be expressed as (horizontal pixel number, vertical line number).
- Non-Patent Document 1 a technique for changing the number of transmission lines used for transmission of a plurality of divided signals based on color format information is disclosed (for example, see Non-Patent Document 1).
- the number of pixels of the video signal is 7680 ⁇ 4320
- the number of bits per pixel is 36 bits
- the frame rate is 120 Hz.
- TH is the number of pixels in the horizontal direction
- TL is the number of pixels in the vertical direction
- n is an integer from 0 to (TH / 4) -1
- m is from 0 to (TL / 4) -1.
- k and l are 16 combinations of arbitrary integers from 0 to 3.
- the transmitter divides each pixel of the video signal into 16 groups of (4n + k, 4m + 1), and each pixel is R, G, B, or Y,
- the video signals are divided into 48 groups by decomposing the pixel elements into Cb and Cr.
- the transmitter combines 16 groups of 2 pixel elements into a total of 8 groups out of 16 groups of R, G, B, or Y, Cb, and Cr, leaving 16 groups of 1 pixel elements as they are, A total of 24 groups are transmitted via different transmission paths.
- the transmitter divides the video signal into 48 groups in the same manner.
- the Y element exists in all groups, it is divided into 16 groups.
- the transmitter similarly divides the video signal into 48 groups.
- the Y element exists in all groups, it is divided into 16 groups.
- the present specification mainly proposes a technique capable of suppressing the production cost of a system in which a video signal is transmitted through a plurality of transmission paths.
- FIGS. 1A and 1B are diagrams illustrating an example of a configuration of an image transmission system according to the present embodiment.
- the image transmission system includes a transmitter 100 and a receiver 200.
- the transmitter 100 and the receiver 200 are connected via a cable 300, and the cable 300 includes transmission paths 301-1 to 301-LN (LN is an integer of 2 or more).
- the transmission capacity per transmission path may be expressed as LC [bps].
- the transmitter 100 can function as a “frame generation device”.
- the receiver 200 can function as an “image restoration device”.
- the transmitter 100 includes an image generation unit 101, an image division unit 102, a division number calculation unit 103, a signal output unit 104, an allocation unit 105, a packet generation unit 106, a frame generation unit 107, and a transmission unit 108. -1 to 108-LN.
- the image generation unit 101 generates a video signal.
- the transmission rate of the video signal may be expressed as VC [bps].
- 1A shows an example in which the image generation unit 101 is incorporated in the transmitter 100, the image generation unit 101 may exist outside the transmitter 100. In the example illustrated in FIG. 1A, the image generation unit 101 generates one video signal, but the number of video signals generated by the image generation unit 101 may be plural.
- FIG. 2A is a diagram illustrating an example of a video signal according to the present embodiment.
- the number of horizontal pixels in the video signal Img is N
- the number of vertical lines in the video signal Img is M. That is, the horizontal pixel number in the video signal Img is an integer from 0 to N-1, and the vertical line number in the video signal Img is an integer from 0 to M-1.
- the video signal Img includes a blanking interval described later, but the blanking interval is omitted from FIG. 2A.
- FIG. 2B is a diagram illustrating an example of pixel elements included in each pixel constituting the video signal Img.
- each pixel (horizontal pixel number, vertical line number) constituting the video signal Img (0, 0), (1, 0), (2, 0),.
- the type of pixel element corresponding to each of n ⁇ 1, m ⁇ 1) may be RGB or YCbCr.
- the image division unit 102 receives color format information of the video signal Img from the image generation unit 101 via the input terminal 1027.
- the image dividing unit 102 performs an operation of dividing the pixel group included in the line having the vertical line number of 2 m and the pixel group included in the line having the vertical line number of (2m + 1) based on the color format information. , 0 ⁇ m ⁇ (M / 2) ⁇ 1 is performed for all integers m to obtain a plurality of divided signals.
- the image dividing unit 102 includes a pixel group included in a line having a vertical line number of 2 m and a pixel group included in a line having a vertical line number of (2m + 1) based on the color format information of the video signal Img. Are divided into a predetermined number of divisions. More specifically, the image dividing unit 102 calculates the number of divisions based on the transmission capacity per transmission path and the transmission rate of the video signal Img.
- FIG. 3 is a diagram illustrating a detailed configuration of the image dividing unit 102.
- the image dividing unit 102 includes a line output unit 1021, a pixel output unit 1022, and pixel element output units 1023-1 to 1023-LN.
- the line output unit 1021 has a line memory for holding a pixel group for one line.
- the line output unit 1021 temporarily holds a pixel group included in a line having a vertical line number of 2 m by the line memory. This is output to the pixel output unit 1022 together with the pixel group included in the line having the number (2m + 1).
- FIG. 4A is a diagram illustrating an example of a pixel group input to the pixel output unit 1022 when the color format information is RGB or YCbCr444.
- the color format information is RGB or YCbCr444
- a pixel group and odd lines vertical line number is (2m + 1)
- even lines lines whose vertical line numbers are 2 m.
- RGB or YCbCr exists in all of the pixel groups included in the line).
- FIG. 4B is a diagram illustrating an example of a pixel group input to the pixel output unit 1022 when the color format information is YCbCr422.
- the color format information is YCbCr422
- the pixel groups and odd lines vertical line number is (2m + 1)
- even lines lines whose vertical line number is 2m.
- Y exists, but CbCr exists only when the horizontal pixel number is an even number.
- FIG. 4C is a diagram illustrating an example of a pixel group input to the pixel output unit 1022 when the color format information is YCbCr420.
- the color format information is YCbCr420
- the pixel groups and odd lines vertical line number is (2m + 1)
- even lines lines whose vertical line numbers are 2 m.
- Y exists, but CbCr exists only when the horizontal pixel number is even and the vertical line number is even.
- Y is present in all pixels regardless of the color format, but in which pixel CbCr is present differs depending on the color format.
- four pixels of (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) are one unit constituting the video signal Img.
- the pixel output unit 1022 (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) based on the division number D input from the division number calculation unit 103 via the input terminal 1026.
- the operation of classifying these four pixels as a pixel unit into any one group of the division number D / 4 is performed for all integers n satisfying 0 ⁇ n ⁇ (N / 2) ⁇ 1. That is, the pixel output unit 1022 classifies this pixel unit into the ((n% (D / 2)) + 1) group.
- the pixel output unit 1022 [(0,0) (0,1) (1,0) (1,1)] [(8,0) (8,1) (9,0) (9,1)] ⁇ ⁇ [(2,0) (2,1) (3,0) (3,1)] [(10,0) (10,1) (11,0) (11,1)].
- the pixel output unit 1022 assigns the (D / 4) th group from the first group to the pixel element output units 1023-1 to 1023- of the pixel element output units 1023-1 to 1023- (LN / 4), respectively. Output to (D / 4).
- the four pixels (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) are input to the input terminals P1 to P4 of the pixel element output units 1023-1 to 1023- (D / 4), respectively. Is done.
- the pixel element output units 1023-1 to 1023- (D / 4) are input from the pixel output unit 1022 via the input terminals P1 to P4 based on the color format information (2n, 2m) (2n, 2m + 1) Each of the four pixels indicated by (2n + 1, 2m) (2n + 1, 2m + 1) is output to one of the four output terminals L1 to L4.
- FIG. 5A is a diagram illustrating an example of pixel group input / output in the pixel element output units 1023-1 to 1023- (D / 4) when the color format information is RGB or YCbCr444.
- RGB or YCbCr exists in all of the pixel group included in the even line and the pixel group included in the odd line (see FIG. 4A). Therefore, in such a case, the pixel element output units 1023-1 to 1023- (D / 4) receive (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2) input from the pixel output unit 1022
- Each of the four pixels indicated by 2m + 1) is output to a different output terminal.
- the output terminal is connected to the signal output unit 104.
- the pixel element output units 1023-1 to 1023- (D / 4) are input by (2n, 2m) input from the pixel output unit 1022 via the input terminal P1.
- the indicated pixel (RGB or YCbCr) is output to the output terminal L1.
- the pixel element output units 1023-1 to 1023- (D / 4) receive pixels (2n, 2m + 1) indicated by (2n, 2m + 1) input from the pixel output unit 1022 via the input terminal P2.
- RGB or YCbCr is output to the output terminal L2.
- the pixel element output units 1023-1 to 1023- (D / 4) are pixels (2n + 1, 2m) input from the pixel output unit 1022 via the input terminal P3. RGB or YCbCr) is output to the output terminal L3. Further, as shown in FIG. 5A, the pixel element output units 1023-1 to 1023- (D / 4) receive pixels (2n + 1, 2m + 1) (2n + 1, 2m + 1) input from the pixel output unit 1022 via the input terminal P4. RGB or YCbCr) is output to the output terminal L4.
- FIG. 5B is a diagram illustrating an example of pixel group input / output in the pixel element output units 1023-1 to 1023- (D / 4) when the color format information is YCbCr422.
- Y exists in all of the pixel groups included in the even lines and the pixel groups included in the odd lines, but CbCr exists only when the horizontal pixel numbers are even (FIG. 4B). reference).
- the pixel element output units 1023-1 to 1023- (D / 4) have two pixels (RGB or RGB) indicated by (2n, 2m) (2n, 2m + 1) input from the pixel output unit 1022 YCbCr) are output to different output terminals, and two pixels (Y) indicated by (2n + 1, 2m) (2n + 1, 2m + 1) are output to the same output terminal.
- the pixel element output units 1023-1 to 1023- (D / 4) are input by (2n, 2m) input from the pixel output unit 1022 via the input terminal P1.
- the indicated pixel (YCbCr) is output to the output terminal L1.
- the pixel element output units 1023-1 to 1023- (D / 4) receive pixels (2n, 2m + 1) indicated by (2n, 2m + 1) input from the pixel output unit 1022 via the input terminal P2.
- YCbCr is output to the output terminal L2.
- the pixel element output units 1023-1 to 1023- receive the pixel (2n + 1, 2m) (2n + 1, 2m) input from the pixel output unit 1022 via the input terminal P3.
- Y) is output to the output terminal L3
- the pixel (Y) indicated by (2n + 1, 2m + 1) input from the pixel output unit 1022 via the input terminal P4 is output to the output terminal L4.
- FIG. 5C is a diagram showing an example of pixel group input / output in the pixel element output units 1023-1 to 1023- (D / 4) when the color format information is YCbCr420.
- Y exists in all of the pixel group included in the even line and the pixel group included in the odd line, but CbCr has an even number in the horizontal direction and an even number in the vertical direction. It exists only in certain cases (see FIG. 4C).
- the pixel element output units 1023-1 to 1023- (D / 4) output the pixel (RGB or YCbCr) indicated by (2n, 2m) input from the pixel output unit 1022 to a predetermined output.
- 3 pixels (Y) indicated by (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) are output to the same output terminal.
- the pixel element output units 1023-1 to 1023- (D / 4) are input by (2n, 2m) input from the pixel output unit 1022 via the input terminal P1.
- the indicated pixel (YCbCr) is output to the output terminal L1.
- the pixel element output units 1023-1 to 1023- (D / 4) receive (2n, 2m + 1) (2n + 1, 2m) input from the pixel output unit 1022 via the input terminal P2.
- Three pixels (Y) indicated by (2n + 1, 2m + 1) are output to the output terminal L2.
- the division number D is 2
- even lines and odd lines are output to the pixel output unit 1022 as in the case where the division number D is a multiple of four.
- the pixel output unit 1022 is (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1).
- the pixel output unit 1022 outputs one group to the pixel element output unit 1023-1 among the pixel element output units 1023-1 to 1023- (LN / 4).
- the four pixels (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) are input to the input terminals P1 to P4 of the pixel element output unit 1023-1.
- the pixel element output unit 1023-1 (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2) input from the pixel output unit 1022 via the input terminals P1 to P4 based on the color format information.
- Each of the four pixels indicated by 2m + 1) is output to one of the four output terminals L1 to L4.
- FIG. 6A is a diagram illustrating an example of pixel group input / output in the pixel element output unit 1023-1 when the color format information is RGB or YCbCr444.
- RGB or YCbCr exists in all of the pixel group included in the even line and the pixel group included in the odd line (see FIG. 4A). Therefore, in such a case, the pixel element output unit 1023-1 has four pixels indicated by (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) input from the pixel output unit 1022. Any two of them are output to the same output terminal, and the other two are output to the same output terminal.
- the pixel element output unit 1023-1 has a pixel (RGB or YCbCr) indicated by (2n, 2m) input from the pixel output unit 1022 via the input terminal P1. Is output to the output terminal L1. As shown in FIG. 6A, the pixel element output unit 1023-1 outputs the pixel (RGB or YCbCr) indicated by (2n, 2m + 1) input from the pixel output unit 1022 via the input terminal P2 as the output terminal L2. Output to.
- the pixel element output unit 1023-1 outputs the pixel (RGB or YCbCr) indicated by (2n + 1, 2m) input from the pixel output unit 1022 via the input terminal P3 as the output terminal L1. Output to. Further, as shown in FIG. 6A, the pixel element output unit 1023-1 receives the pixel (RGB or YCbCr) indicated by (2n + 1, 2m + 1) input from the pixel output unit 1022 via the input terminal P4 as the output terminal L2. Output to.
- FIG. 6B is a diagram illustrating an example of pixel group input / output in the pixel element output unit 1023-1 when the color format information is YCbCr422.
- Y exists in all of the pixel groups included in the even lines and the pixel groups included in the odd lines, but CbCr exists only when the horizontal pixel numbers are even (FIG. 4B). reference). Therefore, in such a case, the pixel element output unit 1023-1 outputs the two pixels indicated by (2n, 2m) (2n + 1, 2m) input from the pixel output unit 1022 to the same output terminal, and ( 2n, 2m + 1) (2n + 1, 2m + 1) are output to the same output terminal.
- the pixel element output unit 1023-1 has a pixel (RGB or YCbCr) indicated by (2n, 2m) input from the pixel output unit 1022 via the input terminal P1. And the pixel (Y) indicated by (2n + 1, 2m) input from the pixel output unit 1022 via the input terminal P3 is output to the same output terminal L1.
- the pixel element output unit 1023-1 includes a pixel (RGB or YCbCr) indicated by (2n, 2m + 1) input from the pixel output unit 1022 via the input terminal P2 and a pixel output unit.
- the pixel (Y) indicated by (2n + 1, 2m + 1) input from the input terminal 1022 via the input terminal P4 is output to the same output terminal L2.
- FIG. 6C is a diagram illustrating an example of pixel group input / output in the pixel element output unit 1023-1 when the color format information is YCbCr420.
- Y exists in all of the pixel group included in the even line and the pixel group included in the odd line, but CbCr has an even number in the horizontal direction and an even number in the vertical direction. It exists only in certain cases (see FIG. 4C). Therefore, in such a case, the pixel element output unit 1023-1 outputs four pixels indicated by (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) input from the pixel output unit 1022. Output to the same output terminal.
- the pixel element output unit 1023-1 has a pixel (RGB or YCbCr) indicated by (2n, 2m) input from the pixel output unit 1022 via the input terminal P1.
- the pixel (Y) indicated by (2n, 2m + 1) input via the input terminal P2 the pixel (Y) indicated by (2n + 1, 2m) input via the input terminal P3, and the pixel output unit 1022
- the pixel (Y) indicated by (2n + 1, 2m + 1) input via the input terminal P4 is output to the same output terminal L1.
- the pixel columns output to the output terminals L1 to L4 are output to the signal output unit 104 as divided signals.
- the assigning unit 105 assigns different transmission paths 301 to the divided signals output from the output terminals L1 to L4 based on the division number D. Furthermore, the assignment unit 105 controls the signal output unit 104 to output each of the plurality of divided signals to the lane connected to the transmission path 301 assigned to each of the plurality of divided signals.
- the signal output unit 104 outputs the divided signal to the lane connected to the transmission path 301 allocated to each of the plurality of divided signals according to the control by the allocation unit 105.
- the packet generator 106 packetizes the plurality of divided signals by dividing the plurality of divided signals into predetermined packet units, and outputs the packets to the frame generator 107.
- the frame generation unit 107 generates a plurality of frames that separately include a plurality of divided signals input from the packet generation unit 106.
- a configuration example of a frame generated by the frame generation unit 107 will be described.
- FIG. 7 is a diagram illustrating a configuration example of a frame generated by the frame generation unit 107.
- the division number D of the video signal Img is 16
- the pixel sequence (2n, 2m) divided from the video signal Img and output from the output terminal L1 is divided into signals Img ⁇ .
- the division number D of the video signal Img is not particularly limited.
- the divided signal Img-1 will be mainly described, but the pixel columns output from the output terminals L2 to L4 can also be described in the same manner as the pixel columns output from the output terminal L1.
- the entire Nth frame is shown as an Nth frame (N is an integer equal to or greater than 0), and a part of the N + 1th frame is shown as an N + 1th frame.
- the frame generation unit 107 includes the first line (the 0th line in the video signal Img), the second line (the 8th line in the video signal Img), and the divided signals Img ⁇ 1. A frame including the following lines in order is generated.
- the frame generation unit 107 adds a frame start identifier (SYNC) to the head of the frame.
- SYNC frame start identifier
- At least one of predetermined codes (hereinafter also referred to as “special data”) that does not exist in the video signal is assigned to the frame start identifier.
- the special data depends on the encoding of data transmitted / received through the transmission path 301.
- a K code may be assigned to the special data.
- data in which N bytes of K code (0xBC) called K28.5 are continuous may be assigned to the frame start identifier.
- a blanking interval is inserted after each line of the divided signal.
- special data different from the special data assigned to the frame start identifier is assigned to the blanking interval.
- the frame generation unit 107 attaches position information (horizontal pixel number, vertical line number) of the video signal Img of the first pixel of each line of the divided signal Img-1 to a predetermined position of the frame. For example, in the example shown in FIG. 7, a frame start identifier or a blanking interval exists before each line of the divided signal Img-1 in the frame. Here, special data different from the special data assigned to the frame start identifier is assigned to the blanking section. Therefore, the frame generation unit 107 attaches the position information to a predetermined position based on the position of the frame start identifier or the blanking interval.
- the frame generation unit 107 may perform encoding on the frame. Specifically, the frame generation unit 107 may perform 8b / 10b encoding on the frame. For example, the frame generation unit 107 replaces the frame start identifier with the corresponding special data in the frame, replaces the blanking interval with the corresponding special data, and replaces the other data with 10-bit unit data. Also good. Further, the frame generation unit 107 may convert the encoded frame from parallel data to serial data so as to be in a format suitable for high-speed transmission.
- the transmission unit 108 transmits the frame input from the lane connecting the signal output unit 104 and the transmission unit 108 to the receiver 200 via the transmission path 301.
- a transmission path 301-1 is assigned to the divided signal Img-1
- a frame including the divided signal Img-1 from the lane connecting the signal output unit 104 and the transmitting unit 108-1 is assigned to the transmission unit 108-1. Therefore, the transmission unit 108-1 transmits the frame including the divided signal Img-1 to the receiver 200 via the transmission path 301-1.
- the transmission unit 108 when the transmission path 301 is configured by an optical fiber, the transmission unit 108 is configured by an LD (laser diode) and an LDD (laser diode driver), and the frame generated by the frame generation unit 107 is driven by the LDD. After being converted into an optical signal by the LD, it is transmitted to the receiver 200 via the transmission line 301.
- the type of signal transmitted from the transmitter 100 to the receiver 200 via the transmission path 301 is not limited.
- the transmission unit 108 may be configured by an electrical signal transmitter, and the electrical signal may be transmitted to the receiver 200 via the transmission path 301 by the electrical signal.
- the reception unit 208 receives the frame transmitted from the transmission unit 108 via the transmission path 301.
- the reception unit 208-1 receives the frame transmitted from the transmission unit 108-1 via the transmission path 301-1.
- the reception unit 208-2 receives the frame transmitted from the transmission unit 108-2 via the transmission path 301-2.
- the receiving unit 208-LN receives the frame transmitted from the transmitting unit 108-LN via the transmission path 301-LN.
- the reception unit 208 is configured by a PD (photo detector) and an amplifier. Is received by the PD and converted into an electrical signal.
- the amplifier obtains a voltage signal by performing impedance conversion on the current signal, and then performs amplitude amplification on the voltage signal.
- the type of signal transmitted from the transmitter 100 to the receiver 200 via the transmission path 301 is not limited.
- the reception unit 208 may be configured by an electric signal receiver, and the frame may be received from the transmitter 100 by the electric signal receiver via the transmission path 301 by the electric signal.
- the identification information extraction unit 207 converts each frame received by the reception unit 208 from serial data to parallel data before extracting various types of identification information from the frames received by the reception unit 208, and converts the frames into parallel data.
- the decoded frame may be decoded.
- the identification information extraction unit 207 may perform 8b / 10b decoding on each frame received by the reception unit 208.
- the identification information extraction unit 207 replaces the special data corresponding to the frame start identifier (SYNC) among the frames received by the reception unit 208 with the frame start identifier (SYNC), and the special information corresponding to the blanking interval. Data may be replaced with a blanking interval.
- the identification information extraction unit 207 may replace the remaining data with data in units of 8 bits in each frame received by the reception unit 208.
- the identification information extraction unit 207 extracts a frame start identifier from the frame received by the reception unit 208. Then, the identification information extracting unit 207 extracts the position information attached to the predetermined position of the frame from the frame based on the position of the frame start identifier. For example, as shown in FIG. 7, in the frame, a frame start identifier or a blanking interval exists before each line of the divided signal Img-1. Therefore, the identification information extraction unit 207 extracts position information in the video signal Img of the first pixel of each line of the divided signal from a predetermined position based on the frame start identifier or the blanking interval.
- the identification information extraction unit 207 extracts a divided signal packetized from the frame received by the reception unit 208. For example, the identification information extraction unit 207 extracts a divided signal packetized from the frame based on the position of the frame start identifier attached to the head of the frame received by the reception unit 208. More specifically, if the identification information extraction unit 207 knows the relative position of the divided signal with reference to the position of the frame start identifier, the packetized division is performed based on the relative position. A signal can be extracted.
- the packetized divided signal is output to the signal acquisition unit 206 by the identification information extraction unit 207.
- the signal acquisition unit 206 acquires the divided signal based on the video packet obtained by packetizing the divided signal. More specifically, the divided signal is restored by canceling packetization (separation in units of packets) for the divided signal.
- the divided signal is output to the signal output unit 204.
- the restoration control unit 203 controls the image restoration unit 202 to restore the video signal Img by combining a plurality of divided signals. For example, the restoration control unit 203 restores the video signal Img by combining a plurality of divided signals based on the position information in the video signal Img of the first pixel of each line of the divided signal input from the identification information extracting unit 207. The image restoration unit 202 is controlled to do so. Alternatively, when receiving the notification of the division number D from the transmitter 100, the restoration control unit 203 may grasp the position information of each pixel of the division signal included in each frame based on the division number D.
- the image restoration unit 202 restores the video signal Img based on the plurality of divided signals. Specifically, the image restoration unit 202 restores the video signal Img by combining the divided signals included in each frame according to the control by the restoration control unit 203.
- the image display unit 201 displays a video based on the video signal Img. Specifically, the image display unit 201 reproduces the video signal # 1 to display the video, and reproduces the video signal Img to display the video.
- the image display unit 201 may be a display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro-Luminescence) display, and a projector.
- 1B shows an example in which the image display unit 201 is incorporated in the receiver 200, the image display unit 201 may exist outside the receiver 200.
- the horizontal pixel number in the video signal Img is an integer from 0 to N-1
- the vertical line number in the video signal Img is from 0 to M-1.
- the pixel group included in the line whose vertical line number is 2m and the pixel group included in the line whose vertical line number is (2m + 1) are divided based on the color format information of the video signal Img.
- An image dividing unit 102 that obtains a plurality of divided signals by performing the operation for all integers m satisfying 0 ⁇ m ⁇ (M / 2) ⁇ 1, and a frame that generates a plurality of frames separately including the plurality of divided signals
- a frame generation apparatus 100 including the generation unit 107 is provided.
- the image dividing unit 102 has a line memory for holding a pixel group for one line, and this line memory temporarily stores a pixel group included in a line having an even number of vertical line numbers. And a pixel group included in a line whose vertical line number is an odd number. Therefore, it is possible to suppress the production cost of the image transmission system in which the video signal Img is transmitted via the plurality of transmission paths 301-1 to 301-LN.
- the image division unit 102, the packet generation unit 106, and the frame generation unit 107 are shared by all the transmission units 108-1 to 108-LN.
- Unit 106 and frame generation unit 107 may be provided separately for each of transmission units 108-1 to 108-LN.
- the identification information extraction unit 207 and the signal acquisition unit 206 are shared by all of the reception units 208-1 to 208-LN. May be provided individually for each of the receiving units 208-1 to 208-4.
- the receiver 200 may grasp the transmission path 301 through which no frame is transmitted. For example, the transmission path 301 through which no frame is transmitted may be notified from the transmitter 100 to the receiver 200 in advance. Alternatively, the receiver 200 may recognize the transmission path 301 connected to the reception unit 208 that does not receive a frame describing meaningful content as the transmission path 301 in which no frame is transmitted.
- the receiver 200 may stop the operation of the receiving unit 208 connected to the transmission path 301 through which no frame is transmitted. Further, as described above, a case where the identification information extraction unit 207 and the signal acquisition unit 206 are individually provided for each of the reception units 208-1 to 208-LN is also assumed. In such a case, the receiver 200 can also stop the operations of the packet generation unit 106 and the frame generation unit 107 corresponding to the transmission path 301 in which no frame is transmitted.
- the image generation unit 101, the image division unit 102, the division number calculation unit 103, the allocation unit 105, the packet generation unit 106, and the frame generation unit 107 may be implemented in separate ICs (Integrated Circuits), Any combination may be mounted on the same IC.
- the identification information extraction unit 207, the signal acquisition unit 206, the restoration control unit 203, and the image restoration unit 202 may be mounted on separate ICs, or any combination may be mounted on the same IC. Good.
- the vertical line number in the video signal is an integer from 0 to N ⁇ 1 and the vertical line number in the video signal is an integer from 0 to M ⁇ 1, the vertical line number is 2 m.
- the operation of dividing the pixel group included and the pixel group included in the line whose vertical line number is (2m + 1) based on the color format information of the video signal is 0 ⁇ m ⁇ (M / 2) ⁇ 1.
- An image dividing unit that obtains a plurality of divided signals by performing processing for all integers m that satisfy, A frame generation unit that generates a plurality of frames separately including the plurality of divided signals; A frame generation apparatus comprising: (2) The frame generation unit attaches a frame start identifier to the head of the frame; The frame generation device according to (1). (3) The frame generation unit attaches position information in the video signal of the first pixel of each line of the divided signal to a predetermined position of the frame. The frame generation device according to (2).
- the frame generation unit attaches the position information to the predetermined position based on the position of the frame start identifier or the blanking section.
- the frame generation device according to (3).
- the image dividing unit divides a pixel group included in a line whose vertical line number is 2 m and a pixel group included in a line whose vertical line number is (2m + 1) into a predetermined number of divisions.
- the frame generation device according to any one of (1) to (4).
- the frame generation device includes: A division number calculation unit that calculates the division number based on a transmission capacity per transmission path and a transmission rate of the video signal; The frame generation device according to (5).
- the image dividing unit when the division number is a multiple of 4,
- the color format information is YCbCr42222
- two pixels indicated by (2n, 2m) (2n, 2m + 1) are output to different lanes, and 2 indicated by (2n + 1, 2m) (2n + 1, 2m + 1).
- a frame generation method comprising: (10) An operation of dividing a pixel group included in a line whose vertical line number is 2m and a pixel group included in a line whose vertical line number is (2m + 1) based on color format information of a video signal is 0 ⁇ m
- a signal acquisition unit that acquires the plurality of divided signals
- An image restoration unit for restoring the video signal based on the divided signal
- An image restoration apparatus comprising: (11) The signal acquisition unit acquires the divided signal
- the image restoration unit restores the video signal based on position information in the video signal of the first pixel of each line of the divided signal attached to a predetermined position of the frame.
- the image restoration apparatus according to (10) or (11).
- (13) In the frame, a frame start identifier or a blanking interval exists before each line of the divided signal.
- the image restoration unit restores the video signal based on the position information attached to a predetermined position based on the frame start identifier or the position of the blanking interval;
- the image restoration apparatus according to (12).
- the signal acquisition unit divides the pixel group included in the line whose vertical line number is 2m and the pixel group included in the line whose vertical line number is (2m + 1) into a predetermined number of divisions.
- the image restoration device according to any one of (10) to (13), wherein the obtained plurality of divided signals are acquired.
- the number of divisions is calculated based on the transmission capacity per transmission path and the transmission rate of the video signal.
- the image restoration apparatus according to (14).
- (16) When the number of divisions is a multiple of 4, When the color format information is RGB or YCbCr444, (horizontal pixel number, vertical line number) (2n, 2m) (2n, 2m + 1) (2n + 1,2m) (2n + 1,2m + 1) 4 Each pixel is input from a different lane, When the color format information is YCbCr422, (2n, 2m) (2n, 2m + 1) are input from different lanes, and (2n + 1, 2m) (2n + 1, 2m + 1) are input from the same lane.
- (2n, 2m) (2n + 1, 2m + 1) is input from the same lane
- (2n, 2m + 1) (2n + 1, 2m) is input from the same lane.
- the color format information is YCbCr420
- (2n, 2m) (2n, 2m + 1) (2n + 1, 2m) (2n + 1, 2m + 1) is input from the same lane.
- the image restoration apparatus according to (14) or (15).
- An image dividing unit that obtains a plurality of divided signals by performing processing for all integers m that satisfy,
- a frame generation unit that generates a plurality of frames separately including the plurality of divided signals;
- a transmitter comprising: When the plurality of frames are received, a signal acquisition unit that acquires the plurality of divided signals;
- An image restoration unit for restoring the video signal based on the divided signal;
- a receiver comprising: An image transmission system.
- the vertical line number in the video signal is an integer from 0 to N ⁇ 1 and the vertical line number in the video signal is an integer from 0 to M ⁇ 1, the vertical line number is 2 m.
- the operation of dividing the pixel group included and the pixel group included in the line whose vertical line number is (2m + 1) based on the color format information of the video signal is 0 ⁇ m ⁇ (M / 2) ⁇ 1.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Processing Of Color Television Signals (AREA)
Abstract
Description
1.背景
2.画像伝送システムの構成例
2.1.送信器の構成例
2.2.受信器の構成例
3.むすび
まず、本実施形態の背景について説明する。近年、映像信号の情報量が飛躍的に向上しており、超高解像度超高階調ベースバンド映像信号が普及しつつある。例えば、有効画素数が7680×4320であるスーパーハイビジョン(SHV)が推進されており、スーパーハイビジョンでは、1画素あたりの画素要素(R,G,B、および、Y,Cb,Cr)それぞれのビット数は、10ビットまたは12ビットである。また、カラーフォーマットとしても、既に存在している方式(RGB方式、YCbCr444方式、および、YCbCr422方式)に加えて、YCbCr420方式も使用されようとしている。
さらに、
続いて、本実施形態に係る画像伝送システムの構成例について説明する。図1Aおよび図1Bは、本実施形態に係る画像伝送システムの構成の一例を示す図である。図1Aおよび図1Bに示すように、画像伝送システムは、送信器100と、受信器200とを有する。送信器100と受信器200とは、ケーブル300を介して接続されており、ケーブル300には伝送路301-1~301-LN(LNは2以上の整数)が含まれている。以下では、伝送路一本あたりの伝送容量を、LC[bps]と表現する場合がある。
まず、送信器100の構成について説明する。画像生成部101は、映像信号を生成する。以下では、映像信号の伝送レートをVC[bps]と表現する場合がある。なお、図1Aには、画像生成部101が送信器100に組み込まれている例が示されているが、画像生成部101は、送信器100の外部に存在していてもよい。また、図1Aに示した例では、画像生成部101が一つの映像信号を生成するが、画像生成部101によって生成される映像信号の数は複数であってもよい。
第1のグループに[(0,0)(0,1)(1,0)(1,1)][(8,0)(8,1)(9,0)(9,1)]・・・を分類し、
第2のグループに[(2,0)(2,1)(3,0)(3,1)][(10,0)(10,1)(11,0)(11,1)]・・・を分類し、
第3のグループに[(4,0)(4,1)(5,0)(5,1)][(12,0)(12,1)(13,0)(13,1)]・・・を分類し、
第4のグループに[(6,0)(6,1)(7,0)(7,1)][(14,0)(14,1)(15,0)(15,1)]・・・を分類する。
続いて、受信器200の構成について説明する。受信部208は、送信部108から送信されたフレームを、伝送路301を介して受信する。例えば、受信部208-1は、送信部108-1から送信されたフレームを、伝送路301-1を介して受信する。また、受信部208-2は、送信部108-2から送信されたフレームを、伝送路301-2を介して受信する。また、受信部208-LNは、送信部108-LNから送信されたフレームを、伝送路301-LNを介して受信する。
以上説明したように、本開示の実施形態によれば、映像信号Imgにおける水平方向画素番号を0からN-1までの整数とし、映像信号Imgにおける垂直方向ライン番号を0からM-1までの整数とした場合、垂直方向ライン番号が2mであるラインに含まれる画素群と垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを映像信号Imgのカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得る画像分割部102と、複数の分割信号を別個に含む複数のフレームを生成するフレーム生成部107と、を備える、フレーム生成装置100が提供される。
(1)
映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得る画像分割部と、
前記複数の分割信号を別個に含む複数のフレームを生成するフレーム生成部と、
を備える、フレーム生成装置。
(2)
前記フレーム生成部は、前記フレームの先頭にフレーム開始識別子を付する、
前記(1)に記載のフレーム生成装置。
(3)
前記フレーム生成部は、前記分割信号の各ラインの先頭画素の前記映像信号における位置情報を前記フレームの所定位置に付する、
前記(2)に記載のフレーム生成装置。
(4)
前記フレームのうち、前記分割信号の各ラインの前には、前記フレーム開始識別子または少なくとも前記映像信号には存在しない所定のコードに置換されるブランキング区間が存在し、
前記フレーム生成部は、前記フレーム開始識別子または前記ブランキング区間の位置を基準とした前記所定位置に前記位置情報を付する、
前記(3)に記載のフレーム生成装置。
(5)
前記画像分割部は、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを所定の分割数に分割する、
前記(1)~(4)のいずれか一項に記載のフレーム生成装置。
(6)
前記フレーム生成装置は、
伝送路一本あたりの伝送容量と前記映像信号の伝送レートとに基づいて前記分割数を算出する分割数算出部を備える、
前記(5)に記載のフレーム生成装置。
(7)
前記画像分割部は、前記分割数が4の倍数である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される4画素それぞれを異なるレーンに出力し、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n,2m+1)によって示される2画素をそれぞれ異なるレーンに出力するとともに、(2n+1,2m)(2n+1,2m+1)によって示される2画素を同一のレーンに出力し、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)によって示される画素を所定のレーンに出力するとともに、(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される3画素を同一のレーンに出力する、
前記(5)または(6)に記載のフレーム生成装置。
(8)
前記画像分割部は、前記分割数が2である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n,2m+1)(2n+1,2m+1)によって示される4画素のうちいずれか2つを同一レーンに(2n+1,2m)出力するとともに、他の2つを同一レーンに出力し、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n+1,2m)によって示される2画素を同一のレーンに出力するとともに、(2n,2m+1)(2n+1,2m+1)によって示される2画素を同一のレーンに出力し、または、(2n,2m)(2n+1,2m+1)によって示される2画素を同一のレーンに出力するとともに、(2n,2m+1)(2n+1,2m)によって示される2画素を同一のレーンに出力し、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される4画素を同一のレーンに出力する、
前記(5)または(6)に記載のフレーム生成装置。
(9)
映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得ることと、
前記複数の分割信号を別個に含む複数のフレームを生成することと、
を備える、フレーム生成方法。
(10)
垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより得られた複数の分割信号を別個に含む複数のフレームが受信されると、前記複数の分割信号を取得する信号取得部と、
前記分割信号に基づいて、前記映像信号を復元する画像復元部と、
を備える、画像復元装置。
(11)
前記信号取得部は、フレーム開始識別子の位置に基づいて前記分割信号を取得する、
前記(10)に記載の画像復元装置。
(12)
前記画像復元部は、前記フレームの所定位置に付された前記分割信号の各ラインの先頭画素の前記映像信号における位置情報に基づいて前記映像信号を復元する、
前記(10)または(11)に記載の画像復元装置。
(13)
前記フレームのうち、前記分割信号の各ラインの前には、フレーム開始識別子またはブランキング区間が存在し、
前記画像復元部は、前記フレーム開始識別子または前記ブランキング区間の位置を基準とした所定位置に付された前記位置情報に基づいて前記映像信号を復元する、
前記(12)に記載の画像復元装置。
(14)
前記信号取得部は、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを所定の分割数に分割することによって得られた前記複数の分割信号を取得する
前記(10)~(13)のいずれか一項に記載の画像復元装置。
(15)
前記分割数は、伝送路一本あたりの伝送容量と前記映像信号の伝送レートとに基づいて算出される、
前記(14)に記載の画像復元装置。
(16)
前記分割数が4の倍数である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される4画素それぞれが異なるレーンから入力され、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n,2m+1)がそれぞれ異なるレーンから入力されるとともに、(2n+1,2m)(2n+1,2m+1)が同一のレーンから入力され、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)が所定のレーンから入力されるとともに、(2n,2m+1)(2n+1,2m)(2n+1,2m+1)が同一のレーンから入力される、
前記(14)または(15)に記載の画像復元装置。
(17)
前記分割数が2である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n+1,2m)(2n,2m+1)(2n+1,2m+1)によって示される4画素のうちいずれか2つが同一レーンから入力されるとともに、他の2つが同一レーンから入力され、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n+1,2m)が同一のレーンから入力されるとともに、(2n,2m+1)(2n+1,2m+1)が同一のレーンから入力され、または、(2n,2m)(2n+1,2m+1)が同一のレーンから入力されるとともに、(2n,2m+1)(2n+1,2m)が同一のレーンから入力され、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)が同一のレーンから入力される、
前記(14)または(15)に記載の画像復元装置。
(18)
垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより得られた複数の分割信号を別個に含む複数のフレームが受信されると、前記複数の分割信号を取得することと、
前記分割信号に基づいて、前記映像信号を復元することと、
を備える、画像復元方法。
(19)
映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得る画像分割部と、
前記複数の分割信号を別個に含む複数のフレームを生成するフレーム生成部と、
を備える、送信器と、
前記複数のフレームが受信されると、前記複数の分割信号を取得する信号取得部と、
前記分割信号に基づいて、前記映像信号を復元する画像復元部と、
を備える、受信器と、
を有する、画像伝送システム。
(20)
映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得ることと、
前記複数の分割信号を別個に含む複数のフレームを生成することと、
前記複数のフレームが受信されると、前記複数の分割信号を取得することと、
前記分割信号に基づいて、前記映像信号を復元することと、
を含む、画像伝送方法。
101 画像生成部
102 画像分割部
1021 ライン出力部
1022 画素出力部
1023 画素要素出力部
103 分割数算出部
104 信号出力部
105 割り当て部
106 パケット生成部
107 フレーム生成部
108 送信部
200 受信器(画像復元装置)
201 画像表示部
202 画像復元部
203 復元制御部
204 信号出力部
206 信号取得部
207 識別情報抽出部
208 受信部
300 ケーブル
301 伝送路
Claims (20)
- 映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得る画像分割部と、
前記複数の分割信号を別個に含む複数のフレームを生成するフレーム生成部と、
を備える、フレーム生成装置。 - 前記フレーム生成部は、前記フレームの先頭にフレーム開始識別子を付する、
請求項1に記載のフレーム生成装置。 - 前記フレーム生成部は、前記分割信号の各ラインの先頭画素の前記映像信号における位置情報を前記フレームの所定位置に付する、
請求項2に記載のフレーム生成装置。 - 前記フレームのうち、前記分割信号の各ラインの前には、前記フレーム開始識別子または少なくとも前記映像信号には存在しない所定のコードに置換されるブランキング区間が存在し、
前記フレーム生成部は、前記フレーム開始識別子または前記ブランキング区間の位置を基準とした前記所定位置に前記位置情報を付する、
請求項3に記載のフレーム生成装置。 - 前記画像分割部は、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを所定の分割数に分割する、
請求項1に記載のフレーム生成装置。 - 前記フレーム生成装置は、
伝送路一本あたりの伝送容量と前記映像信号の伝送レートとに基づいて前記分割数を算出する分割数算出部を備える、
請求項5に記載のフレーム生成装置。 - 前記画像分割部は、前記分割数が4の倍数である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される4画素それぞれを異なるレーンに出力し、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n,2m+1)によって示される2画素をそれぞれ異なるレーンに出力するとともに、(2n+1,2m)(2n+1,2m+1)によって示される2画素を同一のレーンに出力し、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)によって示される画素を所定のレーンに出力するとともに、(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される3画素を同一のレーンに出力する、
請求項5に記載のフレーム生成装置。 - 前記画像分割部は、前記分割数が2である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n,2m+1)(2n+1,2m+1)によって示される4画素のうちいずれか2つを同一レーンに(2n+1,2m)出力するとともに、他の2つを同一レーンに出力し、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n+1,2m)によって示される2画素を同一のレーンに出力するとともに、(2n,2m+1)(2n+1,2m+1)によって示される2画素を同一のレーンに出力し、または、(2n,2m)(2n+1,2m+1)によって示される2画素を同一のレーンに出力するとともに、(2n,2m+1)(2n+1,2m)によって示される2画素を同一のレーンに出力し、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される4画素を同一のレーンに出力する、
請求項5に記載のフレーム生成装置。 - 映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得ることと、
前記複数の分割信号を別個に含む複数のフレームを生成することと、
を備える、フレーム生成方法。 - 垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより得られた複数の分割信号を別個に含む複数のフレームが受信されると、前記複数の分割信号を取得する信号取得部と、
前記分割信号に基づいて、前記映像信号を復元する画像復元部と、
を備える、画像復元装置。 - 前記信号取得部は、フレーム開始識別子の位置に基づいて前記分割信号を取得する、
請求項10に記載の画像復元装置。 - 前記画像復元部は、前記フレームの所定位置に付された前記分割信号の各ラインの先頭画素の前記映像信号における位置情報に基づいて前記映像信号を復元する、
請求項10に記載の画像復元装置。 - 前記フレームのうち、前記分割信号の各ラインの前には、フレーム開始識別子またはブランキング区間が存在し、
前記画像復元部は、前記フレーム開始識別子または前記ブランキング区間の位置を基準とした所定位置に付された前記位置情報に基づいて前記映像信号を復元する、
請求項12に記載の画像復元装置。 - 前記信号取得部は、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを所定の分割数に分割することによって得られた前記複数の分割信号を取得する
請求項10に記載の画像復元装置。 - 前記分割数は、伝送路一本あたりの伝送容量と前記映像信号の伝送レートとに基づいて算出される、
請求項14に記載の画像復元装置。 - 前記分割数が4の倍数である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)によって示される4画素それぞれが異なるレーンから入力され、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n,2m+1)がそれぞれ異なるレーンから入力されるとともに、(2n+1,2m)(2n+1,2m+1)が同一のレーンから入力され、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)が所定のレーンから入力されるとともに、(2n,2m+1)(2n+1,2m)(2n+1,2m+1)が同一のレーンから入力される、
請求項14に記載の画像復元装置。 - 前記分割数が2である場合、
前記カラーフォーマット情報がRGBまたはYCbCr444である場合には、(水平方向画素番号,垂直方向ライン番号)=(2n,2m)(2n+1,2m)(2n,2m+1)(2n+1,2m+1)によって示される4画素のうちいずれか2つが同一レーンから入力されるとともに、他の2つが同一レーンから入力され、
前記カラーフォーマット情報がYCbCr422である場合には、(2n,2m)(2n+1,2m)が同一のレーンから入力されるとともに、(2n,2m+1)(2n+1,2m+1)が同一のレーンから入力され、または、(2n,2m)(2n+1,2m+1)が同一のレーンから入力されるとともに、(2n,2m+1)(2n+1,2m)が同一のレーンから入力され、
前記カラーフォーマット情報がYCbCr420である場合には、(2n,2m)(2n,2m+1)(2n+1,2m)(2n+1,2m+1)が同一のレーンから入力される、
請求項14に記載の画像復元装置。 - 垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより得られた複数の分割信号を別個に含む複数のフレームが受信されると、前記複数の分割信号を取得することと、
前記分割信号に基づいて、前記映像信号を復元することと、
を備える、画像復元方法。 - 映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得る画像分割部と、
前記複数の分割信号を別個に含む複数のフレームを生成するフレーム生成部と、
を備える、送信器と、
前記複数のフレームが受信されると、前記複数の分割信号を取得する信号取得部と、
前記分割信号に基づいて、前記映像信号を復元する画像復元部と、
を備える、受信器と、
を有する、画像伝送システム。 - 映像信号における水平方向画素番号を0からN-1までの整数とし、前記映像信号における垂直方向ライン番号を0からM-1までの整数とした場合、前記垂直方向ライン番号が2mであるラインに含まれる画素群と前記垂直方向ライン番号が(2m+1)であるラインに含まれる画素群とを前記映像信号のカラーフォーマット情報に基づいて分割する動作を0≦m≦(M/2)-1を満たすすべての整数mについて行うことにより複数の分割信号を得ることと、
前記複数の分割信号を別個に含む複数のフレームを生成することと、
前記複数のフレームが受信されると、前記複数の分割信号を取得することと、
前記分割信号に基づいて、前記映像信号を復元することと、
を含む、画像伝送方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017553660A JPWO2017094318A1 (ja) | 2015-12-03 | 2016-09-14 | フレーム生成装置、フレーム生成方法、画像復元装置、画像復元方法、画像伝送システムおよび画像伝送方法 |
US15/777,840 US10674132B2 (en) | 2015-12-03 | 2016-09-14 | Frame generation apparatus, frame generation method, image restoration apparatus, image restoration method, image transmission system, and image transmission method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015-236226 | 2015-12-03 | ||
JP2015236226 | 2015-12-03 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017094318A1 true WO2017094318A1 (ja) | 2017-06-08 |
Family
ID=58796935
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/077114 WO2017094318A1 (ja) | 2015-12-03 | 2016-09-14 | フレーム生成装置、フレーム生成方法、画像復元装置、画像復元方法、画像伝送システムおよび画像伝送方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US10674132B2 (ja) |
JP (1) | JPWO2017094318A1 (ja) |
WO (1) | WO2017094318A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210002103A (ko) * | 2018-05-25 | 2021-01-06 | 라인플러스 주식회사 | 복수의 채널을 이용하여 동적 비트레이트의 비디오를 송출 및 재생하는 방법 및 시스템 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10560755B2 (en) * | 2016-09-23 | 2020-02-11 | Verizon Patent And Licensing Inc. | Methods and systems for concurrently transmitting object data by way of parallel network interfaces |
KR20230052980A (ko) * | 2020-08-29 | 2023-04-20 | 후아웨이 테크놀러지 컴퍼니 리미티드 | 이미지 전송 방법 및 장치 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014038597A1 (ja) * | 2012-09-04 | 2014-03-13 | 日本放送協会 | 映像信号送信装置、映像信号受信装置、映像信号送信方法、映像信号受信方法、プログラム及び記録媒体 |
JP2014146924A (ja) * | 2013-01-28 | 2014-08-14 | Sony Corp | ソース機器、シンク機器、通信システムおよび画像送信方法 |
-
2016
- 2016-09-14 WO PCT/JP2016/077114 patent/WO2017094318A1/ja active Application Filing
- 2016-09-14 US US15/777,840 patent/US10674132B2/en not_active Expired - Fee Related
- 2016-09-14 JP JP2017553660A patent/JPWO2017094318A1/ja not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014038597A1 (ja) * | 2012-09-04 | 2014-03-13 | 日本放送協会 | 映像信号送信装置、映像信号受信装置、映像信号送信方法、映像信号受信方法、プログラム及び記録媒体 |
JP2014146924A (ja) * | 2013-01-28 | 2014-08-14 | Sony Corp | ソース機器、シンク機器、通信システムおよび画像送信方法 |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20210002103A (ko) * | 2018-05-25 | 2021-01-06 | 라인플러스 주식회사 | 복수의 채널을 이용하여 동적 비트레이트의 비디오를 송출 및 재생하는 방법 및 시스템 |
CN112219404A (zh) * | 2018-05-25 | 2021-01-12 | 连普乐士株式会社 | 利用多个通道来发送及播放动态比特率的视频的方法及系统 |
JP2021532613A (ja) * | 2018-05-25 | 2021-11-25 | ライン プラス コーポレーションLINE Plus Corporation | 複数のチャネルを利用して動的ビットレートのビデオを配信および再生する方法およびシステム |
JP7183304B2 (ja) | 2018-05-25 | 2022-12-05 | ライン プラス コーポレーション | 複数のチャネルを利用して動的ビットレートのビデオを配信および再生する方法およびシステム |
JP7183304B6 (ja) | 2018-05-25 | 2022-12-20 | ライン プラス コーポレーション | 複数のチャネルを利用して動的ビットレートのビデオを配信および再生する方法およびシステム |
US11539991B2 (en) | 2018-05-25 | 2022-12-27 | LINE Plus Corporation | Method and system for transmitting and reproducing video of dynamic bitrate with a plurality of channels |
KR102559966B1 (ko) * | 2018-05-25 | 2023-07-26 | 라인플러스 주식회사 | 복수의 채널을 이용하여 동적 비트레이트의 비디오를 송출 및 재생하는 방법 및 시스템 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2017094318A1 (ja) | 2018-09-20 |
US10674132B2 (en) | 2020-06-02 |
US20180338125A1 (en) | 2018-11-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7440702B2 (en) | Method for transmitting digital image signal, digital image transmitting device, digital image sending device and digital image receiver | |
US20130121692A1 (en) | Signal router | |
US8279747B2 (en) | Information processing apparatus and signal transmission method | |
WO2017094318A1 (ja) | フレーム生成装置、フレーム生成方法、画像復元装置、画像復元方法、画像伝送システムおよび画像伝送方法 | |
CN108183749A (zh) | 一种dvi视频和通讯信号混合传输的光纤通信装置 | |
US20180139478A1 (en) | Signal processing apparatus, signal processing method, program, and signal transmission system | |
JP2015532065A (ja) | ピクセル繰り返し帯域幅を利用したビデオストリーム及びオーディオストリームの結合 | |
JP2006191161A (ja) | 光伝送システム | |
JP2020074654A (ja) | 映像インターフェース用高速シリアルリンク | |
JP4483457B2 (ja) | 伝送システム | |
WO2017085969A1 (ja) | フレーム生成装置、フレーム生成方法、画像合成装置、画像合成方法、信号生成装置、信号生成方法、画像伝送システムおよび画像伝送方法 | |
CN111049624B (zh) | 一种基于滑动窗口的高容错无反馈链路影像传输方法及系统 | |
WO2018131233A1 (ja) | 送信制御装置、受信制御装置および送受信制御システム | |
KR20140115057A (ko) | 동축케이블을 통해 압축된 고해상도 디지털 비디오 신호 전송이 가능한 폐쇄회로 텔레비전 시스템 | |
US10791349B2 (en) | Frame generation apparatus, frame generation method, image synthesis apparatus, image synthesis method, signal generation apparatus, signal generation method, and image transmission system | |
JP5368895B2 (ja) | 映像データ送信装置及び受信装置 | |
WO2017077745A1 (ja) | フレーム生成装置、フレーム生成方法、信号抽出装置、信号抽出方法、画像伝送システムおよび画像伝送方法 | |
JP6454160B2 (ja) | 映像信号送信装置及び映像信号送信方法 | |
Yamashita et al. | A 100gbps interface for 4k/8k uhdtv signals | |
WO2017090284A1 (ja) | フレーム生成装置、フレーム生成方法、画像復元装置、画像復元方法および画像伝送システム | |
US20150049820A1 (en) | Circuit arrangement and method for coding and/or decoding | |
WO2017077746A1 (ja) | フレーム生成装置、フレーム生成方法、パケット分離装置、パケット分離方法、画像伝送システムおよび画像伝送方法 | |
JP2006191160A (ja) | 光伝送システム | |
Seth-Smith et al. | 11.88 Gbits/sec: Continuing the Evolution of Serial Digital Interface | |
JP2012109676A (ja) | 非圧縮データ送信装置及び受信装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16870258 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017553660 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15777840 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16870258 Country of ref document: EP Kind code of ref document: A1 |