CN102469277B - Image output device and method, image processing apparatus and method and imaging device - Google Patents

Abstract

It is disclosed image output device, image output method, image processing apparatus, image processing method, data structure and imaging device.Described image output device includes: header produces part, it is used for producing header, and whether this header by the pixel data included about payload is first and second frame informations of first and last column of a frame, the most effective the first row information of pixel data included about payload and the second row information of the line number of row formed about the pixel data included by payload is formed；And fluffing check code, it is for detecting makeing mistakes of header information.Packet produces part and produces packet, and this is grouped in its payload and includes constituting the pixel data of a line of the image obtained by the imaging of described imaging moiety, and with the addition of described header.The packet produced is exported to image processing apparatus by output part.

Description

Image output device and method, image processing apparatus and method and imaging device

Technical field

It relates to image output device, image output method, image processing apparatus, image processing method, program, number According to structure and imaging device.

Background technology

Together with the frame speed of enhancing with image quality and imageing sensor increases, imageing sensor with process imageing sensor pickup Image DSP (Digital Signal Processor, digital signal processor) the data required by interface transmission hold Amount increases.

In order to meet such requirement described above, such as, employing such as improves the clock frequency of interface and reduces letter Number the such technology of voltage.But, these technology increase the difficulty producing sampling timing in DSP side, and make it difficult to Correctly transmit data.

As prior art literature, the Serial ATA:High Speed Serialized AT on January 7th, 2003 Attachment Revision1.0a is available.

Summary of the invention

Incidentally, as increasing the standard of transmission capacity between chip, PCI-Express, Serial ATA etc. It is available.PCI represents peripheral component interconnection, and ATA represents attached (the advanced technology of advanced technology attachment).In PCI Express or Serial ATA, by CDR (Clock Data Recovery, clock data Recovering) enhancing of the performance of circuit or equalizer realizes high-transmission capacity.Further, for the core for pocket telephone Interface between sheet, MIPI (Mobile Industry Processor Interface, mobile Industry Processor Interface) standard It is available.

These standards as mentioned above relate to the many redundancy features for the interface between imageing sensor and DSP, by In this reason, they are prepared as more general interface standard, and (such as CPU, (Central Processing Unit, central authorities process Unit) between interface).If attempted connecing that this standard as mentioned above is used between imageing sensor and DSP Mouthful, then also it is incorporated to for the unwanted function of interface between imageing sensor and DPS.For being incorporated to, which increase electricity Road surface is long-pending, power consumption and cost.

Especially, the impact being incorporated to for the circuit of the countermeasure of loading error occurring is significant.At mark as such in MIPI In standard, the request resending data is issued the chip of sending side as the countermeasure for loading error occurring by the chip receiving side. But, this causes the increase of circuit area etc. of imageing sensor, described imageing sensor be generally difficult to use senior/fine The device of transistor, this is owing to imaging characteristic is critically important.In the such standard of such as MIPI, will owing to receiving the chip of side The chip of sending side is issued in the request resending data, is therefore prepared as resending buffer by relatively large buffer In the chip of sending side.

Further, when loading error occurring occurs, if this is resend covering by data, then real-time characteristic is damaged Bad.This makes it difficult to send view data with high frame rate.

Accordingly, it is desired to provide can be in order to the image output device of high efficiency of transmission view data, image output method, image Processing means, image processing method, program, data structure and imaging device.

Embodiment according to disclosure technology, it is provided that a kind of image output device, comprises imaging moiety；And header produces First portion, its be adapted for produce header, this header includes: header information, and it is by the first frame information, the second frame information, the first row Information and the second row information are formed, and described first frame information table shows that whether pixel data that payload includes is the of a frame The pixel data of a line, described second frame information table shows that whether pixel data that payload includes is last column of a frame Pixel data, described the first row information table shows that whether pixel data that payload includes is the data of valid pixel, institute Second row information of stating represents the line number of the row that the pixel data included by payload formed, and fluffing check code, its For detecting makeing mistakes of header information.This image output device farther includes to be grouped generation part, and it is adapted for producing packet, This is grouped in its payload and includes configuring the pixel data of a line of the image that the imaging of described imaging moiety obtains, and With the addition of described header；And output part, its packet being adapted for producing described packet part generation exports to image Reason device.

Each in first frame information, the second frame information and the first row information may each be the information of 1, and second Row information can be the information of 13.

Described header generation part can produce the header information including organizing and the header of fluffing check code more.

Described image output device can comprise further: adds part, its starting position being adapted for would indicate that packet Opening code add to the most described packet produce part produce packet before, would indicate that the end code of the end position of packet adds Add to the end of packet.

In this case, via the data transmission rate of transmission line between described image output device and image processing apparatus During higher than the transfer rate of the pixel data of described imaging moiety output pixel data, filler code can be added by described interpolation part Payload to packet.

Further, described add part can for image processing apparatus offset code interpolation to end code it After, in order to guarantee the synchronicity of data of the packet sent via plurality of transmission lines, and the described part that can export uses many Transmission lines, will export to image processing apparatus with the addition of the data syn-chronization of the packet of opening code, end code and offset code.

Further, in this case, described add part can from as Given information and each of which by predetermined number Among multiple code elements of the sequence configuration of amount position, four codes of the combination three types code element in order to produce opening code and end code Unit, and opening code and end code are added to packet；Among the plurality of code element, combine to produce four kinds of filler code Four code elements of type code element, and filler code is added the payload to packet；And combine in the plurality of code element pre- Two fixed code elements are to produce offset code, and add offset code to packet.

In this case, described interpolation part can produce opening code, end code and offset code, so that opening code, knot The code element of bundle code and offset code includes those code elements same type of.

Described image output device can comprise further: distribution portion, and it is adapted for that described packet is produced part and produces The data of raw packet distribute to described plurality of transmission lines, wherein provide quantity to be equal to transmission line quantity accordingly with transmission line This interpolation part and output part.

According to first embodiment, it is provided that a kind of image output method, comprising: captured image；Produce header, this header Including header information, it is formed by the first frame information, the second frame information, the first row information and the second row information, described first frame Information table shows that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table Showing that whether pixel data that payload includes is the pixel data of last column of a frame, described the first row information table is shown with Whether the effect pixel data that includes of load is the data of valid pixel, and described second row information represents and included by payload The line number of row that formed of pixel data, and fluffing check code, it is for detecting makeing mistakes of header information.This image exports Device farther includes: produce packet, and this is grouped in its payload and includes configuring a line of the image obtained by imaging Pixel data, and with the addition of described header；And the packet produced is exported to image processing apparatus.

Additionally, according to first embodiment, it is provided that a kind of program for making computer operation process, described process bag Contain: captured image；Producing header, this header includes: header information, and it is by the first frame information, the second frame information, the first row information Being formed with the second row information, described first frame information table shows that whether pixel data that payload includes is the first row of a frame Pixel data, described second frame information table shows that whether pixel data that payload includes is the picture of last column of a frame Prime number evidence, described the first row information table shows that whether pixel data that payload includes is the data of valid pixel, described Two row information represent the line number of the row that the pixel data included by payload formed, and fluffing check code, and it is used for Makeing mistakes of detection header information.This process farther includes: producing packet, this is grouped in its payload and includes that configuration is passed through The pixel data of a line of the image that imaging obtains, and with the addition of described header；And the packet produced is exported to image Processing means.

According to first embodiment, additionally provide the data structure of the transmission data of a kind of data to be used for transmission, described number According to including the pixel data that configures a line of the image obtained by imaging, described data structure includes: packet, wherein by header Adding to payload, this payload includes the pixel data configuring a line of the image obtained by imaging, this header bag Including: header information, it is formed by the first frame information, the second frame information, the first row information and the second row information, described first frame letter Breath represents that whether the pixel data that includes of payload is the pixel data of the first row of a frame, and described second frame information represents Whether the pixel data that payload includes is the pixel data of last column of a frame, and described the first row information table is shown with effect Whether the pixel data that load includes be the data of valid pixel, and described second row information represents and included by payload The line number of the row that pixel data is formed, and fluffing check code, it is for detecting makeing mistakes of header information；Opening code, it adds Add to the top of packet, represent the starting position of packet；End code, it adds the end to packet, represents the stop bits of packet Put；Offset code, it adds to after end code, and the image processing apparatus of the data being grouped by reception uses to guarantee point The synchronicity of the data of group.

In the first embodiment of disclosure technology, producing header, this header includes header information and fluffing check code, institute State header information to be formed by the first frame information, the second frame information, the first row information and the second row information, described first frame information table Showing that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table is shown with effect Whether the pixel data that load includes is the pixel data of last column of a frame, and described the first row information table shows payload Whether the pixel data included is the data of valid pixel, and described second row information represents the pixel included by payload The line number of the row that data are formed, described fluffing check code is for detecting makeing mistakes of header information.Further, produce packet, should It is grouped in its payload and includes configuring the pixel data of a line of the image obtained by imaging, and with the addition of described report Head.Then, the packet produced is exported to image processing apparatus.

The second embodiment according to disclosure technology, it is provided that a kind of image processing apparatus, including: receiving portion, it is fitted Join for receiving that the image output device provided in same device produces and from image output device output packet, described point Group includes adding the header to payload, and this payload includes the imaging configuring the imaging moiety by image output device The view data of a line of the image obtained, this header includes header information and fluffing check code, and this header information is by the first frame Information, the second frame information, the first row information and the second row information are formed, and described first frame information table shows what payload included Whether pixel data is the pixel data of the first row of a frame, and described second frame information table shows the pixel count that payload includes According to being whether the pixel data of last column of a frame, described the first row information table shows that the pixel data that payload includes is No is the data of valid pixel, and described second row information represents the row volume of the row that the pixel data included by payload formed Number；This fluffing check code is for detecting makeing mistakes of header information.This image processing apparatus also includes image processing section, and it is adaptive For the image of place's reason row configuration, the pixel count that the payload of the packet that every a line is received by described receiving portion includes According to formation.

Described header can include header information and the fluffing check code organized more.Described image processing apparatus can be further Comprising: fluffing check part, it is adapted for, based on the fluffing check code of group belonging to configuration header information, detecting the report in each group Makeing mistakes of header；And generation part, it is adapted for being not detected by, based on described fluffing check part, the header information made mistakes, Produce the image of the frame that the pixel data included by payload is formed.Described image processing section can process described product The image that first portion produces.

Can would indicate that the opening code of the starting position of packet adds the top to packet, and would indicate that the stop bits of packet The end code put adds the end to packet, and described receiving portion can be until receiving knot after receiving opening code Data are received, till the data as packet till bundle code.

In this case, described image processing apparatus can comprise further: removes part, and it is adapted for exporting at image The transfer rate of the transmission line between device and described image processing apparatus is higher than from the imaging moiety output of image output device During the transfer rate of the pixel data of image, remove opening code and end code, and remove and added to having by image output device The filler code of effect load.

Can use the data that multiple this transmission line is grouped from image output device synchronism output, this packet has interpolation Offset code after its end code is so that with the addition of opening code, end code and offset code.Described image processing apparatus is permissible Comprising further: correction portion, it is adapted for correcting, based on offset code, the position that described receiving portion receives the time of reception of data Move.There is provided accordingly with transmission line quantitatively equal to this receiving portion of transmission line, correction portion and removal part.

In this case, by image output device, can from as Given information and each of which by predetermined quantity Among multiple code elements of the sequence configuration of position, four code elements of combination three types code element are to produce opening code and end code, and Opening code and end code are added to packet；Four code elements of four type code elements can be combined to produce among multiple code elements Filler code, and filler code is added the payload to packet；And predetermined two code elements in multiple code element can be combined To produce offset code, and offset code is added to packet.

By image output device, opening code, end code and offset code can be produced so that opening code, end code and The code element of offset code includes those code elements same type of.

Further, according to the second embodiment, it is provided that a kind of image processing method for image processing apparatus, comprise: Receive produced by the image output device provided in the same device that image processing apparatus is provided and from image output dress Putting the packet of output, this packet includes adding the header to payload, and this payload includes configuring by image output dress The view data of a line of the image that the imaging of the imaging moiety put obtains, this header includes: header information, and it is believed by the first frame Breath, the second frame information, the first row information and the second row information are formed, and described first frame information table shows the picture that payload includes Whether prime number according to being the pixel data of the first row of a frame, and described second frame information table shows the pixel data that payload includes Whether is the pixel data of last column of a frame, described the first row information table shows pixel data that payload includes whether Being the data of valid pixel, described second row information represents that the going of row that the pixel data included by payload is formed is compiled Number, and fluffing check code, it is for detecting makeing mistakes of header information.This image processing method farther includes: place's reason row The image of configuration, the pixel data that each of which row is included by the payload of the packet received is formed.

Additionally, according to the second embodiment, it is provided that a kind of program for making computer operation process, described process bag Contain: receive produced by the image output device provided in the same device that image processing apparatus is provided and export from image The packet of device output, this packet includes adding the header to payload, and this payload includes that configuration is exported by image The view data of one row of the image that the imaging of the imaging moiety of device obtains, this header includes: header information, and it is by first Frame information, the second frame information, the first row information and the second row information are formed, and described first frame information table shows that payload includes Pixel data be whether the pixel data of the first row of a frame, described second frame information table shows the pixel that payload includes Whether data are the pixel datas of last column of a frame, and described the first row information table shows the pixel data that payload includes Whether are the data of valid pixel, described second row information represents the row of the row that the pixel data included by payload formed Numbering, and fluffing check code, it is for detecting makeing mistakes of header information.This process farther includes: place's reason row configuration Image, the pixel data that each of which row is included by the payload of the packet received is formed.

In the second embodiment of disclosure technology, receive the figure provided in the same device that image processing apparatus is provided As output device packet that is produced and that export from image output device.This packet includes adding the report to payload Head, this payload includes the picture number configuring a line of the image of the imaging acquisition of the imaging moiety by image output device According to.This header includes header information and fluffing check code, and this header information is by the first frame information, the second frame information, the first row letter Breath and the second row information are formed, and described first frame information table shows whether the pixel data that payload includes is the first of a frame The pixel data of row, described second frame information table shows that whether pixel data that payload includes is last column of a frame Pixel data, described the first row information table shows that whether pixel data that payload includes is the data of valid pixel, described Second row information represents the line number of the row that the pixel data included by payload formed, and this fluffing check code is used for detecting Makeing mistakes of header information.Then, the image of place's reason row configuration, each of which row is wrapped by the payload of the packet received The pixel data included is formed.

The 3rd embodiment according to disclosure technology, it is provided that a kind of imaging device, comprises: image output device and image Processing means.Described image output device includes imaging moiety and header generation part, and this header generation part is adapted for producing Including header information and the header of fluffing check code, described header information is by the first frame information, the second frame information, the first row information Being formed with the second row information, described first frame information table shows that whether pixel data that payload includes is the first row of a frame Pixel data, described second frame information table shows that whether pixel data that payload includes is the picture of last column of a frame Prime number evidence, described the first row information table shows that whether pixel data that payload includes is the data of valid pixel, described Two row information represent the line number of the row that the pixel data included by payload formed, and described fluffing check code is used for detecting Makeing mistakes of header information.Described image output device farther includes to be grouped generation part, and it is adapted for producing packet, this packet Include the pixel data configuring a line of the image of the imaging acquisition of described imaging moiety in its payload, and with the addition of Described header；And output part, its packet being adapted for producing described packet part generation exports to image processing apparatus. Described image processing apparatus includes: receiving portion, and it is adapted for receiving packet；And image processing section, it is adapted for processing The image configured by row, the pixel data shape that the payload of the packet that every a line is received by described receiving portion includes Become.

In third embodiment of the present disclosure, image output device produces and includes header information and the report of fluffing check code Head, described header information is formed by the first frame information, the second frame information, the first row information and the second row information, described first frame Information table shows that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table Showing that whether pixel data that payload includes is the pixel data of last column of a frame, described the first row information table is shown with Whether the effect pixel data that includes of load is the data of valid pixel, and described second row information represents and included by payload The line number of row that formed of pixel data, described fluffing check code is for detecting makeing mistakes of header information.Further, described figure As output device produces packet, this is grouped in its payload and includes configuring the pixel of a line of the image obtained by imaging Data, and with the addition of described header.The packet produced is exported to image processing apparatus by the most described image output device.Separately On the one hand, described image processing apparatus receives packet, and locates the image that reason row configures, and each of which row is by dividing of receiving The pixel data that the payload of group includes is formed.

In a word, utilize this image output device, image output method, image processing apparatus, image processing method, program, Data structure and imaging device, can efficiently send view data.

Accompanying drawing explanation

Fig. 1 is the block diagram of the first example of the configuration illustrating transmission system；

Fig. 2 is the block diagram of the second example of the configuration illustrating transmission system；

Fig. 3 is the block diagram of the 3rd example of the configuration illustrating transmission system；

Fig. 4 is the diagrammatic view of the example of diagram frame format；

Fig. 5 is the block diagram of the example of the configuration illustrating transmitting portion and receiving portion；

Fig. 6 is the diagrammatic view of diagram header (header) structure；

Fig. 7 is content (substance) and the view of quantity of information of diagram header information；

Fig. 8 is the view of the example of diagram bit array；

Fig. 9 is to be shown in the view by the pixel-byte conversion in the case of 8 pixel values representing each pixel；

Figure 10 is to be shown in the view by the pixel-byte conversion in the case of 10 pixel values representing each pixel；

Figure 11 is to be shown in the view by the pixel-byte conversion in the case of 12 pixel values representing each pixel；

Figure 12 is to be shown in the view by the pixel-byte conversion in the case of 14 pixel values representing each pixel；

Figure 13 is to be shown in the view by the pixel-byte conversion in the case of 16 pixel values representing each pixel；

Figure 14 is the diagrammatic view of the different examples of diagram payload data；

Figure 15 is the diagrammatic view of the different examples of diagram payload data；

Figure 16 is the diagrammatic view that diagram inserts the example of the payload data of parity bit；

Figure 17 is the diagrammatic view that diagram with the addition of the payload data of header；

Figure 18 is the diagrammatic view that diagram with the addition of the payload data of header and footnote (footer)；

Figure 19 is that diagram inserts parity bit and with the addition of the diagrammatic view of payload data of header；

Figure 20 is the diagrammatic view of the example of the distribution of diagram grouped data；

Figure 21 is the view of the example of diagram control code；

Figure 22 is the view of the value of diagram K character；

Figure 23 is the diagrammatic view of the example of the insertion of diagram Pad Code；

Figure 24 is the diagrammatic view of the example of the grouped data after diagram control code is inserted；

Figure 25 is the diagrammatic view of the example of the correction of diagram Data Skew；

Figure 26 is the flow chart of the process of diagram imaging device；

Figure 27 is the flow chart being shown in the data sending processing that step S2 of Figure 26 is carried out；

Figure 28 is to be shown in the flow chart that the data receiver that step S3 of Figure 26 carries out processes；

Figure 29 is the sequence chart of the control sequence in the case of diagram switching channel quantity；And

Figure 30 is the block diagram of the example of the hardware configuration of diagram computer.

Detailed description of the invention

<configuration example of transmission system>

Fig. 1 illustrates the first example of the configuration of the transmission system of the embodiment according to disclosure technology.

With reference to Fig. 1, shown transmission system 1 includes imageing sensor 11 and DSP 12.Imageing sensor 11 and DSP12 by ((Large Scale Integrated Circuit, large scale integrated circuit) configures LSI different from each other, and provides In the same imaging device with imaging function of such as digital camera or pocket telephone etc.Imageing sensor 11 wraps Including imaging blocks 21 and a transmission block 22, DSP 12 includes that one receives block 31 and image processing block 32.

The imaging blocks 21 of imageing sensor 11 includes such as CMOS (Complementary Metal Oxide Semiconductor, complementary metal oxide semiconductors (CMOS)) image-forming component of image-forming component etc, and receive by lens To light carry out opto-electronic conversion.Further, the imaging blocks 21 signal to being obtained by opto-electronic conversion carries out A/D conversion etc., and The pixel data constituting a two field picture is exported to individual element data successively to sending block 22.

Send block 22 such as to provide the order of data from imaging blocks 21, the number of pixel that will provide it from imaging blocks 21 According to distributing to plurality of transmission lines, and by plurality of transmission lines, data parallel is sent to DSP 12.In the example of fig. 1, eight Transmission lines is used for sending pixel data.Transmission line between imageing sensor 11 and DSP 12 can be wire transmission line and nothing Any one in line transmission line.In the following description, by the transmission line between imageing sensor 11 and DSP 12 suitably It is referred to as passage.

The block 31 that receives of DSP 12 receives by eight passages from sending the pixel data that block 22 is sent to, and by picture The data of element export to image processing block 32.

Image processing block 32 is based on producing a two field picture from receiving the pixel data that provides it of block 31, and uses and produced Raw image carries out various image procossing.The view data sent to DSP 12 from imageing sensor 11 is initial data, and Image processing block 32 carries out various process, such as: compressing image data, display image, on the recording medium or interior record picture number According to.

Fig. 2 illustrates the second example of the configuration of transmission system 1.The transmission system 1 of Fig. 2 includes the transmission of several and Fig. 1 The element that system 1 is common, the repeated description of these mutual components omits to avoid redundancy at this.

With reference to Fig. 2, the imageing sensor 11 of transmission system 1 includes imaging blocks 21 and two transmitting portions 22-1 and 22-2, DSP12 includes two receiving portions 31-1 and 31-2 and image processing block 32.

Imaging blocks 21 individual element data ground will constitute the pixel data of the two field picture obtained by performing imaging also Export to transmitting portion 22-1 and 22-2 capablely.Such as, the data of the pixel in odd-numbered line are exported to sending block by imaging blocks 21 The data of the pixel in even number line are exported to sending block 22-2 by 22-1.

Send block 22-1 such as to provide the order of pixel data, the picture that will provide it from imaging blocks 21 from imaging blocks 21 Prime number is according to distributing to multiple passage, and is sent data parallel to DSP 12 by multiple passages.Additionally, send block 22-2 The most such as to provide the order of pixel data from imaging blocks 21, the pixel data provided it from imaging blocks 21 is distributed to The most multiple passages, and by multiple passages, data parallel is exported to DSP 12.

Additionally, in the figure 2 example, imageing sensor 11 and DSP 12 is connected with each other by eight passages.Send block 22- 1 uses four passages to send pixel datas with sending block 22 each of which.

The reception block 31-1 of DSP 12 receives by four passages from sending the pixel data that block 22-1 is sent to, and Pixel data is sequentially output to image processing block 32.Receive similarly by four passages from transmission additionally, receive block 31-2 The pixel data that block 22-2 is sent to, and pixel data is sequentially output to image processing block 32.

Image processing block 32 based on the pixel data provided it from reception block 31-1 and provides it from receiving block 31-2 Pixel data produce a two field picture, and use produced image to carry out various image procossing.

If as Fig. 2 sees, imageing sensor 11 provides two transmitting portions and in DSP 12 Correspondingly provide two receiving portions, then even if the transfer rate from the view data of imaging blocks 21 output is high, it is also possible to will Pixel data sends to DSP 12.

Fig. 3 illustrates the 3rd example of the configuration of transmission system 1.Equally, the transmission system 1 of Fig. 3 includes several and Fig. 1's The element that transmission system 1 is common, the repeated description of these mutual components omits to avoid redundancy at this.

With reference to Fig. 3, transmission system 1 includes two imageing sensor 11-1 and 11-2.Imageing sensor 11-1 includes imaging A block 21-1 and transmission block 22-1, and imageing sensor 11-2 includes an imaging blocks 21-2 and transmission block 22-2.Meanwhile, DSP 12 shown in DSP 12 and Fig. 2 is similarly included two receiving portions 31-1 and 31-2 and image processing block 32.

Configuration is obtained by the imaging blocks 21-1 individual element data ground of imageing sensor 11-1 successively by performing imaging A two field picture pixel data output to send block 22-1.

Send block 22-1 such as to provide the order of pixel data from imaging blocks 21-1, will provide it from imaging blocks 21-1 Pixel data distribute to multiple passage, and by multiple passages, data parallel is sent to DSP 12.

Configuration is obtained by the imaging blocks 21-2 individual element data ground of imageing sensor 11-2 successively by performing imaging A two field picture pixel data output to send block 22-2.

Send block 22-2 such as to provide the order of pixel data from imaging blocks 21-2, will provide it from imaging blocks 21-2 Pixel data distribute to multiple passage, and by multiple passages, data parallel is sent to DSP 12.

Additionally, in the example of fig. 3, imageing sensor side and DSP 12 are connected with each other by eight passages.Four passages Each in imageing sensor 11-1 and imageing sensor 11-2, thus send block 22-1 and send in block 22-2 every One all uses four passages to send pixel data.

The reception block 31-1 of DSP 12 receives by four passages from the transmission block 22-1 of imageing sensor 11-1 to it The pixel data sent, and pixel data is sequentially output to image processing block 32.Receive logical similarly additionally, receive block 31-2 Cross the pixel data that four different passages are sent to from the transmission block 22-2 of imageing sensor 11, and pixel data is depended on Secondary output is to image processing block 32.

Image processing block 32 based on producing a two field picture from receiving the pixel data that provides it of block 31-1, and based on from The pixel data that reception block 31-2 provides it produces a two field picture.It is various that image processing block 32 uses produced image to carry out Image procossing.

By providing two imageing sensors as Fig. 3 sees, such as, can process by means of single DSP 12 The 3D rendering formed by the left-eye image of imageing sensor 11-1 imaging and the eye image of imageing sensor 11-2 imaging.Left eye Image and eye image have parallax.

As it has been described above, the imageing sensor of transmission system 1 includes one or more transmitting portion, picked up for transmission One frame image data.Meanwhile, DSP includes one or more receiving portion, for one or more with imageing sensor The relation sending part corresponding receives the data being sent to from imageing sensor.

The data transmission carried out by the transmission system 1 of Fig. 1 is described below, wherein in transmission system 1, at imageing sensor One transmitting portion is provided in 11 and a receiving portion is provided in DSP 12.Transmission block 22-1 shown in figs 2 and 3 And receive between block 31-1 and send block 22-2 and receive between block 31-2, data transmission is carried out in a similar fashion.

<frame format>

The example of the form of Fig. 4 diagram frame image data transmission between imageing sensor 11 and DSP 12.

Effective pixel area A1 is the region of the valid pixel of the two field picture by imaging blocks 21 imaging.In effective pixel region The left side of territory A1, is provided with surplus (margin) region A2, and wherein the pixel quantity in vertical direction is equal to effective pixel area Pixel quantity in the vertical direction of A1.

In the upside of effective pixel area A1, it is provided with front sky (dummy) region A3, the wherein pixel count in horizontal direction Pixel quantity in the amount overall horizontal direction equal to effective pixel area A1 and surplus region A2.In the example of fig. 4, will Embedded Data (embedding data) is inserted in front dummy section A3.Embedded Data includes and by the imaging of imaging blocks 21 The information of relevant setting value, such as shutter speed, f-number and gain.Embedded Data is inserted in rear dummy section A4 sometimes In.

In the downside of effective pixel area A1, being provided with rear dummy section A4, wherein the pixel quantity in horizontal direction is equal to Pixel quantity in the overall horizontal direction of effective pixel area A1 and surplus region A2.

Image data area A11 is by effective pixel area A1, surplus region A2, front dummy section A3 and rear dummy section A4 structure Become.

Header is added to constituting before every a line of image data area A11, and Start Code (is started Code) add to header.Further, alternatively footnote is added to every a line of composition image data area A11 Face, and the control code of such as End Code (end code) described below etc is added to footnote.If do not added Add footnote, then the control code of such as End Code etc is added to constituting after every a line of image data area A11.

Whenever by when being sent to DSP 12 from imageing sensor 11 by a two field picture of imaging blocks 21 imaging, send in Fig. 4 The total data of diagram form is as transmission data.

Area, upside in Fig. 4 illustrates the structure of the packet that the transmission of transmission data described below is used.To In the case of a series of pixels in horizontal direction are expressed as row, the number of the pixel of a line of image data area A11 will be constituted According in the payload (payload) being placed in packet.Use the pixel quantity not less than vertical direction epigraph data area A11 Pixel quantity carry out the transmission of whole pixel datas of a frame.

A packet is constituted by header and footnote are added the payload being placed in one-row pixels data.As follows As literary composition describes in detail, header includes the extraneous information for the pixel data placed in payload, such as Frame Start (frame starts), Frame End (frame end), Line Valid (row is effectively), Line Number (line number) and ECC.For often Individual packet, at least adds Start Code and End Code as control code.

In this way, by this form is used for sending the pixel data of composition one two field picture, for every a line, Ke Yi The extraneous information of such as header etc and such as Start Code and End Code etc is sent in the blanking period of every a line Control code.

<send block 22 and receive the configuration of block 31>

Fig. 5 illustrates the example of the configuration sending block 22 and reception block 31.

In Fig. 5, left-hand broken line is the configuration sending block 22 around shown configuration, and in Fig. 5, right side dotted line is joined around shown Put the configuration being to receive block 31.Send block 22 and each of which received in block 31 includes the configuration of link layer and joining of physical layer Put.It is the configuration of link layer in the configuration shown in upside relative to solid line L2, relative to solid line L2 in the configuration shown in downside is The configuration of physical layer.

Noting, configuration illustrated above for solid line L1 is the configuration of application layer.Systems control division divides 51, frame data importation 52 and depositor 53 implement in imaging blocks 21.Systems control division divides the LINK-TX consultative management part 61 of 51 and transmission block 22 Communicate, and by providing the information etc. about frame format to control the transmission of view data.Frame data importation 52 Instruction in response to user etc. carries out imaging, and the data of the pixel of image composition obtained by imaging are supplied to send The pixel of block 22-byte conversion part 62.Depositor 53 stores the information of the figure place of pixel-byte conversion, channel number etc..Figure As the transmission process of data is carried out according to the information stored in depositor 53.

Meanwhile, in the configuration of application layer, frame data output part 141, depositor 142 and systems control division divide 143 to lead to Cross image processing block 132 to implement.Frame data output part 141 produces based on from the pixel data receiving the row that block 31 provides it One two field picture, and export produced image.The image from frame data output part 141 output is used to carry out various process. The various setting values that depositor 142 storage is relevant with the reception of view data, figure place and passage such as byte-pixel conversion are compiled Number.The reception of view data processes and carries out according to the information stored in depositor 142.Systems control division divides 143 and LINK-RX Consultative management part 121 communicates and changes sequence etc. for controlling the mode.

[sending the configuration of the link layer of block 22]

First the configuration of the link layer sending block 22 is described.

Send block 22 and include that LINK-TX consultative management part 61, pixel-byte conversion part 62, payload ECC are inserted Part 63, packet produce part 64 and channel allocation part 65, as the configuration of link layer.LINK-TX consultative management part 61 Including status unit 71, header generation unit 72, data interpolating unit 73 and footnote generation unit 74.

Status unit 71 management of LINK-TX consultative management part 61 sends the state of the link layer of block 22.

Header generation unit 72 produces the header adding to a line view data the payload being placed in, and will report Head output produces part 64 to packet.

Fig. 6 illustrates the structure of the header that header generation unit 72 produces.

As it has been described above, a payload data being grouped by header with as a line view data is constituted.Sometimes by foot Note adds to packet.Header is made up of with Header ECC header information.

Header information includes Frame Start, Frame End, Line Valid, Line Number and Reserved.Respectively The content of the information of kind and quantity of information illustrate in the figure 7.

Frame Start is the information of a position, and it represents the beginning of frame.For the image data area A11 of Fig. 4 The Frame Start of the header of the packet that the transmission of a line view data is used, arranges the value of 1, and for other row any The Frame Start of the header of packet that used of the transmission of pixel data, the value of 0 is set.

Frame End is the information of 1, the ending of its instruction frame.Effective pixel area A1 is included for payload The Frame End of header of packet of pixel data of last column, the value of 1 is set, and for the pixel of other row any The Frame End of the header of the packet that the transmission of data is used, arranges the value of 0.

Frame Start and Frame End is the frame information as the information about frame.

Line Valid is the information of 1, and whether its row representing the pixel data being placed in payload is effective picture The row of element.The Line of the header of the packet that the transmission of the pixel data in the row in effective pixel area A1 is used Valid, arranges the value of 1, and the Line of the header of the packet that the transmission of pixel data in other row any is used Valid, arranges the value of 0.

Line Number is the information of 13, and it represents the row of the row being made up of the pixel data being placed in payload Numbering.

Line Valid and Line Number is the row information as the information about row.

Reserved is the region of 32, and it is used for extending.The data volume of whole header information is 6 bytes.

As see in Fig. 6, the Header ECC adjacently positioned with header information includes: CRC (Cyclic Redundancy Check) code, it is the fluffing check code of 2 bytes that header information based on 6 bytes calculates.Header ECC farther includes two information of 8 bytes adjacent with CRC code, and it is the group of header information and CRC code.

Especially, the header of a packet includes three groups of identical header information and CRC code.The data volume of whole header is total Count 24 bytes, comprising: first group of header information and 8 bytes of 8 bytes of CRC code, second group of header information and CRC code And the 3rd group of header information and 8 bytes of CRC code.

Fig. 8 illustrates the example of the bit array of 8 bytes constituting one group of header information and CRC code.

With reference to Fig. 8, byte H7 as the first byte of eight bytes constituting header includes from first successively Each of Frame Start, Frame End and Line Valid and the first of 13 Line Number～the 5th One.Further, byte H6 as second byte include from the 6th among 13 positions of Line Number～ 13rd.

From as the 3rd byte byte H5 to byte H2 as the 6th byte each byte constitute Reserved. Byte H1 as the 7th byte and byte H0 as the 8th byte include everybody of CRC code.

Referring back to Fig. 5, header generation unit 72 produces header information under systems control division divides the control of 51.Such as, Systems control division divide 51 offers represent will from frame data importation 52 output pixel data Line Number information and Represent the information of frame beginning and end.

Further, header information is used for generator polynomial to calculate CRC code by header generation unit 72.Add to header The generator polynomial of the CRC code of information is such as represented by following expression formula (1):

CRC16=X¹⁶+X¹⁵+X²+1...(1)

CRC code is added to header information to produce one group of header information and CRC code by header generation unit 72, and by phase Header information and CRC code with group repeat to arrange three groups to produce header.The header produced is exported extremely by header generation unit 72 Packet produces part 64.

Data interpolating unit 73 produces the data being used for filling, and exports these data to pixel-byte conversion portion Points 62 and channel allocation part 65.Payload as the filling data being supplied to pixel-byte conversion part 62 is filled Data are added to pixel data after pixel-byte conversion, and the data of the pixel data in payload to be placed in The regulation of amount.Meanwhile, the passage as the filling data being supplied to channel allocation part 65 is filled data after channel allocation Add to data, and the regulation of data volume among passage.

Payload data, under systems control division divides the control of 51, is suitably applied to generate by footnote generation unit 74 Multinomial is with the CRC code of calculating 32, and the CRC code that will be defined as footnote by calculating is exported to packet generation part 64. Such as to be represented by following expression formula (2) as the generator polynomial of the CRC code that footnote adds:

CRC32=X³²+X³¹+X⁴+X³+X+1...(2)

Pixel-byte conversion part 62 obtains the pixel data provided it from frame data importation 52, and carries out The data of each pixel are converted to the pixel-byte conversion of data in units of 1 byte.Such as, imaging blocks 21 picks up The pixel value (RGB) of each pixel of image is represented by the figure place as one of 8,10,12,14 and 16.

Fig. 9 diagram is by the example of the pixel-byte conversion in the case of 8 pixel values representing each pixel.

Represent LSB (least significant bit, least significant bit) with reference to Fig. 9, Data [0], and there is the highest number The Data [7] of word represents MSB (most significant bit, highest significant position).As indicated by solid white line arrow mark , would indicate that what eight Data [0] of the pixel value of pixel N～Data [7] were converted to be formed by Data [0]～Data [7] Byte N.In the case of the pixel value being represented each pixels by 8, data in units of byte after pixel-byte conversion Quantity is equal to pixel quantity.

Figure 10 diagram is by the example of the pixel-byte conversion in the case of 10 pixel values representing each pixel.

In this case, would indicate that 10 Data [0]～the Data [9] of the pixel value of pixel N are converted to include Data [2] ～the Byte 1.25*N of Data [9].

Similarly for pixel N+1～N+3, would indicate that 10 Data [0] of the pixel value of this pixel～Data [9] turn respectively It is changed to include Data [2]～Byte 1.25*N+1～Byte1.25*N+3 of Data [9].Further, as pixel N～N+3 The Data [0] and Data [1] of low-order bit are collected and are converted to Byte 1.25*N+4.At the picture being represented each pixel by 10 In the case of element value, as pixel quantity 1.25 times of data bulk in units of byte after pixel-byte conversion.

Figure 11 diagram is by the example of the pixel-byte conversion in the case of 12 pixel values representing each pixel.

In this case, would indicate that 12 Data [0]～the Data [11] of the pixel value of pixel N are converted to by Data [4] ～the Byte 1.5*N that Data [11] is formed.

Similarly for pixel N+1, would indicate that 12 Data [0] of the pixel value of pixel N+1～Data [11] be converted to by The Byete 1.5*N+1 that Data [4]～Data [11] is formed.Further, as pixel N and the low-order bit of N+1 Data [0]～ Data [3] is collected and is converted to Byte 1.5*N+2.In the case of the pixel value being represented each pixel by 12, pixel- As pixel quantity 1.5 times of data bulk in units of byte after byte conversion.

Figure 12 diagram is by the example of the pixel-byte conversion in the case of 14 pixel values representing each pixel.

In this case, would indicate that 14 Data [0]～the Data [13] of the pixel value of pixel N are converted to include Data [6]～the Byte 1.75*N of Data [13].

Similarly for pixel N+1～N+3, would indicate that 14 Data [0]～Data [13] difference of the pixel value of this pixel Be converted to include the Byte 1.75*N+1～Byte 1.75*N+3 of Data [6]～Data [13].Further, from pixel N～N Remaining bit among the pixel of+3 is gathered successively and is converted to Byte 1.75*N+4.Such as, using the position as pixel N The Data [0] and Data [1] of Data [0]～Data [5] and the position as pixel N+1 are converted to Byte 1.75*N+4.

Similarly, using the Data [2]～the Data [0] of Data [5] and the position as pixel N+2 of the position as pixel N+1 ～Data [3] is converted to Byte 1.75*N+5, and using the Data [4] and Data [5] of the position as pixel N+2 with as picture The Data [0]～Data [5] of the position of element N+3 are converted to Byte 1.75*N+6.At the pixel value by 14 each pixels of expression In the case of, as pixel quantity 1.75 times of data bulk in units of byte after pixel-byte conversion.

Figure 13 diagram is by the example of the pixel-byte conversion in the case of 16 pixel values representing each pixel.

In this case, would indicate that 16 Data [0]～the Data [15] of the pixel value of pixel N are converted to by Data [0] ～the Byte 2*N that formed of Data [7] and the Byte 2*N+1 that formed by Data [8]～Data [15].Each by 16 expressions In the case of the pixel value of pixel, as pixel quantity 2 times of data bulk in units of byte after pixel-byte conversion.

The order that pixel shown in Fig. 5-byte conversion part 62 such as starts according to the pixel of the left end with row, for Each pixel carries out such pixel-byte conversion described above.Further, pixel-byte conversion part 62 will be inserted from data Enter the payload that unit 73 provides it to fill data and add to the picture that byte is unit obtained by pixel-byte conversion Prime number produces payload data according to this, and exports payload data to payload ECC insertion portion 63.

Figure 14 illustrates the example of payload data.

Figure 14 illustrates in the case of the pixel value being represented each pixel by 10, including by pixel-byte conversion The payload data of the pixel data obtained.The block not applying color represent with pixel-byte conversion after byte Pixel data for unit.Meanwhile, the block applying color represents that the payload formed by data interpolating unit 73 is filled out Make up the number evidence.

Pixel data after pixel-byte conversion is grouped into the order that conversion obtains the group of predetermined quantity.At figure In the example of 14, pixel data is grouped into group 0～group 15 these 16 groups, and the pixel data of the MSB of pixel P0 will be included Distribute to organize 0, distribute to organize 1 by the pixel data including the MSB of pixel P1.Further, the pixel of the MSB of pixel P2 will be included Data distribute to organize 2, and the pixel data including the MSB of pixel P3 distributes to organize 3, and will include pixel P0～P3 The pixel data of LSB is distributed to organize 4.

Additionally, the pixel data of the MSB of pixel P4 pixel data subsequently is sequentially allocated give to organize 5 beginnings each with After group.When certain pixel data is distributed to organize 15, pixel data subsequently is sequentially allocated the group giving to organize 0 beginning. Noting, among the block representing pixel data, those blocks of three dotted lines of internal applications represent to produce during pixel-byte conversion The raw pixel data that byte is unit, thus they include the LSB of pixel N～N+3.

In the link layer sending block 22, it is grouped in this mode described above, then, defines for clock signal Each period, process for being positioned at the pixel data of same position in group concurrently.Especially, as shown in figure 14 that In the case of pixel data is distributed to 16 packets by sample, carry out pixel data is processed so that juxtaposition 16 in each row Individual pixel data is processed within the same period.

As described above, the payload of a packet includes the pixel data of a line.Whole pixels shown in Figure 14 Data are to constitute the pixel data of a line.Retouch although being given for the process of the pixel data in effective pixel area A1 of Fig. 4 State, but during also pixel data process together with effective pixel area A1 processes other region of such as surplus region A2 etc Pixel data.

After the pixel data of a line is grouped, adds payload filler and make each group to have equal number according to this According to length.It is a byte data that payload fills data.

In the example in figure 14, fill data and be not added with the pixel data to group 0, but add one by one to group 1～15 Pixel data, as illustrated with the dotted box.Under the data length (byte) of the payload formed by pixel data and filling data Row expression formula (3) represents:

$\mathrm{PayloadLength}=\mathrm{LineLength}\&times;\frac{\mathrm{BitPix}}{8}+\mathrm{PayloadStuffing}...\left(3\right)$

Wherein, LineLength represents capable pixel count, and BitPix represents the figure place of the pixel value representing a pixel, and PayloadStuffing represents that payload fills the quantity of data.

In the case of as shown in Figure 14 pixel data being distributed to 16 groups, payload fills the quantity of data Representing with following equalities (4), wherein % represents remainder.

$\mathrm{PayloadStuffing}=16-((\mathrm{LineLength}\&times;\frac{\mathrm{BitPix}}{8})\%16)...\left(4\right)$

Figure 15 illustrates another example of payload data.

More specifically, in the case of Figure 15 is shown in by 12 pixel values representing each pixel, including by pixel-word The payload of the pixel data that joint conversion obtains.

In the example of fig. 15, distribute to organize 0 by the pixel data including the MSB of pixel P0, the MSB of pixel P1 will be included Pixel data distribute to organize 1, and distribute to organize 2 by the pixel data including the LSM of pixel P0 and pixel P1.Additionally, will bag The pixel data pixel data subsequently of the MSB including pixel P2 is sequentially allocated the group subsequently giving to organize 3 beginnings.Further, in generation Among the block of table pixel data, those blocks of one dotted line of its internal applications represent the word to produce during pixel-byte conversion Joint is the pixel data of unit, so that they include the LSB of pixel N and pixel N+1.

In the example of fig. 15, payload is filled data and is not added with to group 0 and the pixel data of group 1, and effectively carries Lotus is filled data and is applied to organize the end (terminal end) of the pixel data of 2～15 one by one.

The payload data with this configuration described above is provided to effectively carrying from pixel-byte conversion part 62 Lotus ECC insertion portion 63.

Payload ECC insertion portion 63 based on the payload data provided it from pixel-byte conversion part 62, The error correction code of the error correction of calculating payload data to be used for, and using as the school of makeing mistakes determined by calculating The parity bit (parity) of code is inserted into payload data.As error correction code, such as, use Reed-Solomon code. Further, the insertion of error correction code is optional, and such as, by the parity bit of payload ECC insertion portion 63 Insert and by the only one in the interpolation of the footnote of footnote generation unit 74 be permission.

Figure 16 illustrates the example of the payload data that parity bit is inserted into.

Payload data shown in Figure 16 is to be represented each picture by 12 as describing as explained above with Figure 15 The payload data of the pixel data obtained by pixel-byte conversion is included in the case of the pixel value of element.By trellis diagram The block of case instruction represents parity bit.

In the example of Figure 16, starting with pixel data before group, each from group 0～15 selects 14 continuously Pixel data, and 224 pixel datas of total based on 224 bytes selected in this way, determine the odd even of 2 bytes Position.The parity bit of 2 bytes is inserted into after 224 pixel datas of calculating as the 15th data of group 0 and 1.By This, formed a Basic Block (basic block) by the parity bit of 224 pixel datas and 2 bytes.

In this way, pixel-byte conversion part 62 substantially produces the parity bit of 2 bytes based on 224 pixel datas, And after the parity bit of 2 bytes is inserted into 224 pixel datas.

Further, in the example of Figure 16, in group, select 224 pixel counts after a Basic Block continuously According to, and the parity bit of 2 bytes is determined based on 224 selected pixel datas.Using the parity bit of 2 bytes as group 2 and 3 After 29th data are inserted into 224 pixel datas for calculating, and by 224 pixel datas and the odd even of 2 bytes Position forms the 2nd Basic Block.

At 16 × M (it is the quantity that the pixel data after certain Basic Block and payload fill data) not In the case of reaching 224, determine based on remaining 16 × M block (that is, 16 × M pixel data and payload fill data) The parity bit of 2 bytes.Further, after the parity bit of 2 bytes determined is inserted into payload filling data, and Extra Block (additional blocks) is formed by the parity bit of 16 × M block and 2 bytes.

The payload data inserting parity bit to it is exported to being grouped generating unit by payload ECC insertion portion 63 Divide 64.If not carrying out the insertion of parity bit, then will provide to payload ECC insertion section from pixel-byte conversion part 62 The payload data dividing 63 exports as it is to packet generation part 64.

The header that header generation unit 72 is produced by packet generation part 64 adds to from payload ECC insertion portion 63 The payload data provided it is to produce packet.In the case of the generation being carried out footnote by footnote generation unit 74, Packet produces part 64 and is also carried out the footnote interpolation to payload data.

Header is added the state to payload data by Figure 17 diagram.

With reference to Figure 17, with the addition of 24 blocks instructions of character H0～H23 byte with the CRC code as header information as list The header information of position or header data.As discussed above concerning described in Fig. 6, the header of a packet include three groups header information and CRC code.

Such as, header data H0～H5 are the header information of 6 bytes of first group, and header data H6 and H7 are first group The CRC code of 2 bytes.Header data H8～H13 be the header information of second group, header data H14 and H15 be second group CRC code.Header data H16～H21 are the header information of the 3rd group, and header data H22 and H23 are the CRC code of the 3rd group.

In the example of Figure 17, header data H0～H7 are added separately to organize the payload data of 8～15.Enter one Step, is added separately to organize the payload data of 0～15 by header data H8～H23.

Header and footnote are added the state to the payload data inserting parity bit by Figure 18 diagram.

The foot of the CRC code of 4 bytes that footnote produces it is denoted as by four blocks that with the addition of indicated by character F0～F3 Note data.In the example of Figure 18, footnote data F0～F3 are added separately to organize the payload data of 0～3.

Header is added the state to the payload data inserting parity bit by Figure 19 diagram.

In the example of Figure 19, with Figure 17 and 18 in the case of similarly, header data H0～H23 are added to Figure 16's Insert the payload data of parity bit.

Packet produces part 64 and the grouped data of the data of the packet produced in this way as configuration is exported extremely Channel allocation part 65.By the grouped data configured by header data and payload data, by header data, payload number According to the grouped data of footnote data configuration or by header data and the payload data configuration inserting parity bit point Group data provide to channel allocation part 65.The packet configuration of Fig. 6 is logic groups structure, and in link layer and physical layer In, in units of byte, process the data of the packet of the structure with Fig. 6.

Channel allocation part 65 starts to produce, from packet, the grouped data that part 64 provides it successively with earlier data Distribute to those passages that the data to be used among passage Lane0～Lane7 are transmitted.

Figure 20 illustrates the example of the distribution of grouped data.

Here, describe as shown in Figure 18 by header data, payload data and this point of footnote data configuration The distribution of group data.Front at solid white arrow labelling #1, it is illustrated that use eight passage Lane0～Lane7 to carry out data The example of the distribution of the grouped data in the case of transmission.

In this case, with header data above start header data H0～H23 to be distributed to successively passage Lane0～ Lane7.If certain header data to be distributed to Lane 7, then header data continuous dispensing subsequently is given Lane 0 and start Passage.For each in passage Lane0～Lane7, distribute three header data.

Meanwhile, start payload data to be distributed to successively passage Lane0～Lane7 with above payload data. If certain payload data to be distributed to Lane 7, then payload data continuous dispensing subsequently is given Lane 0 and open The passage begun.

Start successively footnote data F0～F3 to be distributed to passage Lane0～Lane7 with above payload data.At figure In the example of 20, the last payload of configuration payload data is filled data and distributes to Lane 7, and by footnote number It is individually assigned to passage Lane0～Lane3 according to F0～F3.

The block of black instruction represents that the passage that data interpolating unit 73 produces fills data.This passage is filled data distribution Give the passage with small number of data, so that the data length distributing to passage can be equal to each other.Passage filler According to the data being a byte.In the example of Figure 20, a passage is filled data and distributes to distributed data bulk relatively Each in few passage Lane4～Lane7.

Data are being filled by the passage in the case of header data, payload data and footnote data configuration grouped data Quantity following expression formula (5) represents:

LaneStuffing=LaneNum-((PayloadLength+FooterLength) %LaneNum) ... (5)

Wherein, LaneNum is the quantity of passage, and PayloadLength is payload data length (byte), FooterLength is footnote length (byte).

In the case of being formed grouped data by header data and the payload data inserting parity bit, passage is filled The quantity of data is represented by following expression formula (6), and wherein ParityLength represents the total of parity bit that payload includes Common byte quantity.

LaneStuffing=LaneNum-((PayloadLength+ParityLength) %LaneNum) ... (6)

Front at solid white arrow labelling #2, it is illustrated that use six passage Lane0～Lane5 to carry out data transmission In the case of the example of distribution of grouped data.

In this case, with above header data start header data H0～H23 to be distributed to successively passage Lane0～ Lane5.If certain header data to be distributed to Lane 5, then by header data subsequently with Lane 0 start to be sequentially allocated to Each passage.Four header data are distributed to each in passage Lane0～Lane5.

Further, with above payload data start payload data to be distributed to successively passage Lane0～ Lane5.If certain payload data to be distributed to Lane 5, then payload data continuous dispensing subsequently is given The passage that Lane 0 starts.

Start successively footnote data F0～F3 to be distributed to passage with above footnote data.In the example of Figure 20, will join The last payload filling data being set effective load data distribute to Lane1, and footnote data F0～F3 are distributed one by one To passage Lane2～Lane5.Owing to the quantity of the grouped data of Lane0～Lane5 is equal to each other, the most in this case, do not have Use passage is had to fill data.

Front at solid white arrow labelling #3, it is illustrated that use four passage Lane0～Lane3 to carry out data transmission In the case of the example of distribution of grouped data.

In this case, with above header data start header data H0～H23 to be distributed to successively passage Lane0～ Lane3.If certain header data to be distributed to Lane 3, then by header data subsequently with Lane 0 start to be sequentially allocated to Each passage.Six header data are distributed to each in passage Lane0～Lane3.

Further, with above payload data start payload data to be distributed to successively passage Lane0～ Lane3.If certain payload data to be distributed to Lane 3, then payload data continuous dispensing subsequently is given The passage that Lane 0 starts.

Start successively footnote data F0～F3 to be distributed to passage with above footnote data.In the example of Figure 20, will join The last payload filling data being set effective load data distribute to Lane 3, and footnote data F0～F3 are distributed one by one To passage Lane0～Lane3.Owing to the quantity of the grouped data of Lane0～Lane3 is equal to each other, the most in this case, do not have Use passage is had to fill data.

The grouped data distributing to passage in this way is exported to physical layer by channel allocation part 65.Below in principle Description is given for the situation using eight passage Lane0～Lane7 to send data.But, in leading to of data to be used for transmission In the case of the quantity in road is varying number, it is also carried out the process being similar to.

[sending the configuration of the physical layer of block 22]

Presently describe the configuration of the physical layer sending block 22.

Referring back to Fig. 5, send block 22 and include that PHY-TX state controls part 81, clock produces part 82 and signal processing Part 83-0～83-N are as the configuration of its physical layer.Signal processing 83-0 includes that control code inserts unit 91,8B10B code Primitive encoding device 92, lock unit 93 and transmitting element 94.That channel allocation part 65 is exported and distribute to Lane 0 point Group data input is to signal processing 83-0, and inputs the grouped data distributing to Lane1 to signal processing 83-1. Further, the grouped data distributing to Lane N is inputted to signal processing 83-N.

In this way, the physical layer sending block 22 includes that quantity is equal to multiple signal processings 83-0 of the quantity of passage ～83-N, in order to the process of the grouped data that passage to be used sends is entered concurrently by signal processing 83-0～83-N OK.Although being described below the configuration of signal processing 83-0, but signal processing 83-1～83-N also having similar Configuration.

PHY-TX state controls part 81 control signal and processes part 83-0～83-N.Such as, PHY-TX state control portion Divide 81 sequential controlling the process to be carried out by signal processing 83-0～83-N.

Clock produces part 82 and produces clock signal, and by clock signal output to signal processing 83-0～83-N Lock unit 93.

The control code of signal processing 83-0 insert unit 91 control code is added to from channel allocation part 65 to it The grouped data provided.Control code is by the single code element selected among pre-prepd multiple different code elements or many The code that the combination of individual different code element represents.It is the data of 8 that control code inserts each code element of unit 91 insertion.Control code is inserted The code element that unit 91 inserts is changed by the circuit experience 8B10B of rear class, thus is converted into the data of 10.Another Aspect, receives block 31 and as described below reception data is carried out 10B8B conversion.The 10B8B that reception data include turns Each code element before alternatively is 10 bit data, and each code element after 10B8B conversion is 8 bit data.

Figure 21 diagram to be inserted the example of the control code that unit 91 adds by control code.

As control code, Idle Code, Start Code, End Code, Pad Code, Sync Code, Deskew Code and Standby Code is available.

Idle Code is the set of symbols repeating to send within the period in addition to the grouped data transmission period.Idle Code is represented by the D00.0 (00000000) of the D character as 8B10B Code.

Start Code is to represent the set of symbols that packet starts.As described above, Start Code is added to packet Above.Start Code is by K28.5, K27.7, K28.2 and K27.7 (it is the combination of three types K character) these four code elements Represent.K character value illustrates in fig. 22.

End Code is the set of symbols representing packet end.As described above, End Code is added the afterbody to packet. End Code is represented by K28.5, K29.7, K30.7 and K29.7 (it is the combination of three types K character) these four code elements.

Pad Code is to be inserted into payload so that the code element of the difference between filler pixels data band and PHY transmission belt Group.Pixel data band is from imaging moiety 21 output and to the transfer rate of the pixel data sending block 22 input, PHY passes Defeated band is from the transfer rate sending the pixel data that block 22 sends and inputs to reception block 31.Pad Code by K23.7, K28.4, K28.6 and K28.7 (it is the combination of three types K character) these four code elements represent.

Figure 23 illustrates the example of the insertion of Pad Code.

The upper part of Figure 23 illustrates the payload data in the forward direction difference channel allocation inserting Pad Code, under Face part illustrates the payload data inserted after Pad Code.In the example of Figure 22, Pad Code is inserted in from Between the 3rd pixel data and the 4th pixel data that above pixel data rises, the 6th pixel data and the 7th pixel data it Between, between the 12nd pixel data and the 13rd pixel data.In this way, Pad Code is inserted in passage Lane0～ In the same position of the payload of Lane7.

Pad Code is to the inserting by the control code of signal processing 83-0 of payload data distributing to Lane 0 Insert unit 91 to carry out.Additionally, Pad Code is to distributing to the insertion of payload of other passage any similarly by signal Process part 83-1～83-N is carried out at synchronization.The quantity of Pad Code is based between pixel data band and PHY transmission belt Difference, clock produces the frequency etc. of clock signal that part 82 produces and determines.

In this way, in the case of and PHY transmission bandwidth narrow at pixel data band, insert PAD code so that regulation carries it Between difference.Such as, the difference between regulation pixel data band and PHY transmission belt is so that it can be fallen by the insertion of PAD code Enter in fixed range.

Same in order to guarantee transmission block 22 and the bit synchronization received between block 31 and code element referring back to Figure 21, Sync Code Step.Sync Code is by K28.5 and Any^**The two code element represents.Any^**Expression can use any kind of code element.Such as Repeatedly send under training (training) pattern before beginning packet data transmission between block 22 and reception block 31 sending Sync Code。

Deskew Code is that (that is, the passage being used for correcting reception block 31 connects the Data Skew between correction channel Receive the displacement of the time of reception of data) set of symbols.Deskew Code is by K28.5 and Any^**The two code element represents.Hereafter retouch State the Data Skew used between Deskew Code correction channel.

Standby Code is for entering such as High-Z (high resistant) shape to the output receiving block 31 notice transmission block 22 The such state of state and data transmit forbidden set of symbols.Specifically, when the end of transmission of grouped data and enter During Standby state, Standby Code is sent to receiving block 31.Standby Code is by K28.5 and Any^**The two code Unit represents.

Control code is inserted unit 91 and the grouped data output that these control codes are added to is as mentioned above compiled to 8B10B code element Code device 92.

Figure 24 illustrates the example of the grouped data after control code is inserted.

With reference to Figure 24, Start Code is added to grouped data by signal processing 83-0～83-N respectively, And Pad Code is added to payload data.End Code is added the afterbody to grouped data, and by Deskew Code adds the afterbody to End Code.In the example of Figure 24, Idle Code is added the afterbody to Deskew Code.

8B10B symbolic encoder 92 inserts packet that is that unit 91 provides it and that with the addition of control code to from control code Data carry out 8B10B conversion, and export the grouped data of the data being converted in units of 10 to lock unit 93.

Lock unit 93 produces, according to clock, the clock signal that part 82 produces, will be from 8B10B symbolic encoder 92 to it The position of the grouped data provided exports to transmitting element 94.

The grouped data provided it from lock unit 93, via the transmission line of configuration Lane 0, is sent by transmitting element 94 To receiving block 31.In the case of using eight passages to carry out data transmission, the transmission line of configuration Lane1～Lane 7 is also used for Grouped data is sent to receiving block 31.

[receiving the configuration of the physical layer of block 31]

Presently describe the configuration of the physical layer receiving block 31.

With reference to Fig. 5, receive block 31 and include that PHY-RX state controls part 101 and signal processing 102-0～102-N makees Configuration for physical layer.Signal processing 102-0 include receive unit 111, clock generating unit 112, lock unit 113, Symbol synchronization unit 114,10B8B symbol decoder 115, skew (skew) correction unit 116 and control code removal unit 117. The grouped data sent by constituting the transmission line of Lane 0 is inputted to signal processing 102-0, will be by constituting Lane1 Transmission line send grouped data input to signal processing 102-1.Further, by the transmission line by constituting Lane N The grouped data sent inputs to signal processing 102-N.

In this way, the physical layer receiving block 31 provides multiple signal processing parts that quantity is equal with the quantity of passage Point 102-0～102-N, in order to use the process of the grouped data that passage sends respectively by signal processing 102-0～ 102-N is carried out concurrently.Although provide description below for the configuration of signal processing 102-0, but signal processing 102-1～102-N also has similar configuration.

Receive unit 111 and receive expression from sending the grouped data that block 22 is sent to via the transmission line constituting Lane 0 Signal, and by this signal export to clock generating unit 112.

Clock generating unit 112 detects from receiving the edge of signal that unit 111 provides it to set up bit synchronization, and The detection period based on edge produces clock signal.The signal provided it from reception unit 111 is connected by clock generating unit 112 Export together to lock unit 113 with clock signal.

The clock signal that lock unit 113 produces according to clock generating unit 112, to receiving the letter that unit 111 receives Number sample, and the grouped data obtained by sampling is exported to symbol synchronization unit 114.Clock generating unit 112 The function for CDR (Clock Data Recovery, clock and data recovery) is realized with lock unit 113.

Symbol synchronization unit 114 detects control code that grouped data includes or some code that detection control code includes Unit is to set up symbol synchronization.Such as, during symbol synchronization unit 114 detects Start Code, End Code or Deskew Code Including the code element of K28.5 to set up bit synchronization.Symbol synchronization unit 114 would indicate that what 10 of each code element were unit divides Group data export to 10B8B symbol decoder 115.

Further, under the training mode before packet data transmission starts, symbol synchronization unit 114 detects from sending block Border between the code element that the Sync Code that 22 are repeatedly sent to includes is to set up symbol synchronization.

The 10B8B symbol decoder 115 grouped data in units of 10 to providing it from symbol synchronization unit 114 Carry out 10B8B conversion, and the grouped data data by being converted to 8 units obtained exports to offset correction portion 116。

Offset correction portion 116 detects the Deskew among the grouped data that 10B8B symbol decoder 115 provides it Code.The information detecting the moment for Deskew Code about offset correction portion 116 is provided to the control of PHY-RX state Part 101.

Further, the timing adjustment of Deskew Code is to be controlled part by PHY-RX state by offset correction portion 116 Timing represented by 101 information provided it, with the Data Skew between correction channel.Represent from signal processing The information of the timing recently among the timing of the Deskew Code that 102-0～102-N detects is from PHY-RX state control part 101 provide.

Figure 25 illustrates the example using the Data Skew between Deskew Code correction channel.

With reference to Figure 25, in the example shown in the series of figures, by each in passage Lane0～Lane7, carry out Sync Code, Sync Code ..., Idle Code, Deskew Code, Idle Code ... the transmission of Idle Code, Deskew Code, And control code is received by receiving block 31.The time of reception of same control code is different between different passages, and not With presenting Data Skew between passage.

In this case, excursion correction unit 116 detects the Deskew Code C1 as a Deskew Code, and And the moment before correction Deskew Code C1 is to control, with from PHY-RX state, the information institute that part 101 provides it The time t1 represented is consistent.About from for passage Lane0～Lane7 detection Deskew Code C1 moment among in Now recently the moment, control part 101 for the information of the time t1 of Lane7 detection Deskew Code C1 from PHY-RX state There is provided.

Further, excursion correction unit 116 detects the Deskew Code C2 as the 2nd Deskew Code, and school Moment before positive Deskew Code C2 is to control represented by the information that part 101 provides it with from PHY-RX state Time t2 consistent.From for passage Lane0～Lane7 detection Deskew Code C2 moment among when presenting nearest The information of time t2 that carve, detect Deskew Code C2 for Lane 7 controls part 101 from PHY-RX state to be provided.

As indicated by the front of arrow mark #1 in fig. 25, signal processing 102-1～102-N are each The process carrying out being similar to is with the Data Skew between correction channel.

The grouped data correcting Data Skew is exported to control code removal unit 117 by excursion correction unit 116.

Control code removal unit 117 removes the control code added to grouped data, and will be from Start Code to End The data of Code export to link layer as grouped data.

PHY-RX state control part 101 control signal process each assembly of part 102-0～102-N with carry out passage it Between the correction of Deskew Code.Further, if occurring that in pre-routing loading error occurring and control code are lost, then PHY- RX state is controlled part 101 and adds the control code of the control code replacement loss sent by different passages, to be controlled code Error correction.

[receiving the configuration of the link layer of block 31]

Presently describe the configuration of the link layer receiving block 31.

With reference to Fig. 5, receive block 31 and include LINK-RX consultative management part 121, passage integrated part 122, packet separated part Divide 123, payload error correction part 124 and byte-pixel conversion portion 125 as the configuration of link layer.LINK-RX assists View administrative section 121 includes that state managing unit 131, header error correction unit 132, data removal unit 133 and footnote go out Wrong detector unit 134.

The passage integrated part 122 grouped data to providing it from signal processing 102-0～the 102-N of physical layer Reset so that the order of grouped data with by send block 22 channel allocation part 65 channel allocation order phase Instead, thus integrate grouped data.

Such as, right if carrying out channel allocation part 65 in this mode indicated by the front of the arrow mark #1 of Figure 20 In the distribution of grouped data, the then integration of the grouped data from passage carried out by passage integrated part 122, obtain Figure 20 The grouped data in middle left side.When integrating the grouped data of each passage, passage integrated part 122 is in data removal unit 133 Control lower removal passage and fill data.The grouped data output extremely packet separate section 123 that passage integrated part 122 will be integrated.

The grouped data of the packet that passage integrated part 122 is integrated by packet separate section 123 is separated into composition report The grouped data of head data and the grouped data of composition payload data.Header data is exported extremely by packet separate section 123 Header error correction unit 132, and payload data is exported to payload error correction part 124.

Further, if packet includes footnote, then a data separating being grouped is composition report by packet separate section 123 The grouped data of head data, the grouped data constituting payload data and the grouped data of composition footnote data.Packet separates Header data is exported to header error correction unit 132 by part 123, and payload data output is gone out to payload Wrong correction portion 124.Further, footnote data are exported to footnote fluffing check unit 134 by packet separate section 123.

If the payload data that packet separate section 123 provides includes the parity bit being inserted among it, the most effectively Load error correction part 124 carries out error correction arithmetical operation makeing mistakes with detection payload data based on this parity bit, And carry out the correction made mistakes detected.Such as, if inserting parity bit, the most effectively in this mode as seen in Figure 16 Load error correction part 124 uses and was inserted in two last for Basic Block parity bits before carrying out parity bit The error correction of 224 pixel datas.

Payload error correction part 124 will be by makeing mistakes for each Basic Block and Extra Block Pixel data after the error correction that correction is obtained exports to byte-pixel conversion portion 125.If from packet separated part Divide in the payload datas of 123 offers and be not inserted into parity bit, then the payload number that will provide from packet separate section 123 According to exporting as it is to byte-pixel conversion portion 125.

Byte-pixel conversion portion 125, under the control of data removal unit 133, is removed from payload error correction The payload that the payload data that part 124 provides it includes fills data.

Further, byte-pixel conversion portion 125 carry out with by remove payload fill data obtain byte be The pixel data of unit is changed to the byte-pixel of the pixel data in units of 8,10,12,14 or 16.Word Joint-pixel conversion portion 125 is carried out and the pixel-byte conversion part 62 sending block 22 described above with reference to Fig. 9～13 The conversion that pixel-byte conversion is contrary.

8,10,12,14 or 16 that byte-pixel conversion portion 125 will be obtained by byte-pixel conversion Pixel data for unit exports to frame data output part 141.Frame data output part 141 is based on byte-pixel converter section The pixel datas dividing 125 acquisitions produce the row of the valid pixel such as specified by the Line Valid of header information.These row roots Arrange according to the Line Number of header information, to produce a two field picture.

State managing unit 131 management of LINK-RX consultative management part 121 receives the state of the link layer of block 31.

Header error correction unit 132 obtains three groups based on the header data provided it from packet separate section 123 Header information and CRC code.Header error correction unit 132, for each in three groups of header information and CRC code, uses same Header information and CRC code in group carry out fluffing check arithmetical operation, and this fluffing check arithmetical operation is for detecting header letter The arithmetical operation made mistakes of breath.

Further, header error correction unit 132 error correction based on the header information often organized result and fluffing check At least one in the comparative result of the data that arithmetical operation is determined estimates correct header information, and output is estimated as Correct header information and decoded result.The data that fluffing check arithmetical operation is determined are by by the generator polynomial of CRC It is applied to the value that header information is determined.Further, decoded result is to represent successfully decoded or decode failed information.

Three groups of header information and CRC code are referred to as group 1, group 2 and group 3.In this case, header error correction unit 132 Group 1 is carried out fluffing check arithmetical operation to obtain whether the header information about organizing 1 includes make mistakes (that is, fluffing check result) Information and as the data 1 of the data determined by fluffing check arithmetical operation.Further, header error correction unit The 132 pairs of groups 2 carry out fluffing check arithmetical operation using obtain the header information about group 2 whether include the information made mistakes and as The data 2 of the data determined by fluffing check arithmetical operation.And then, header error correction unit 132 goes out false retrieval to group 3 Survey arithmetical operation to obtain whether the header information about organizing 3 includes the information made mistakes and as by fluffing check arithmetical operation The data 3 of the data determined.

Further, header error correction unit 132 judges data 1 and data 2 are the most consistent with each other, data 2 and data 3 are No consistent with each other, data 3 and data 1 are the most consistent with each other.

Such as, if by being not detected by makeing mistakes and passing through for the fluffing check arithmetical operation of group 1, group 2 and group 3 The comparative result of the data that fluffing check arithmetical operation is determined is consistent with each other, then header error correction unit 132 selects to represent The information of successfully decoded is as decoded result.Further, header error correction unit 132 estimates that all of header information is correct , and in the header information of the header information of selection group 1, the header information of group 2 and group 3 is as output information.

On the other hand, if only being not detected by makeing mistakes in the fluffing check arithmetical operation for group 1, then header is made mistakes Correction unit 132 selects the information representing successfully decoded to be correct as decoded result, the header information of estimation group 1, and The header information of selection group 1 is as output information.

But, if only being not detected by makeing mistakes in the fluffing check arithmetical operation for group 2, then header error correction Unit 132 selects the information representing successfully decoded to be correct as decoded result, the header information of estimation group 2, and select The header information of group 2 is as output information.

Further, if only being not detected by makeing mistakes in the fluffing check arithmetical operation for group 3, then header is made mistakes school Positive unit 132 selects the information representing successfully decoded to be correct as decoded result, the header information of estimation group 3, and select Select the header information of group 3 as output information.

The decoded result selected in this mode described above and output information are exported extremely by header error correction unit 132 Depositor 142 is to store.In this way, examined by using CRC code detection not have the header information made mistakes and exporting The header information measured, carries out the header error correction unit 132 error correction for header information.

Data removal unit 133 controls passage integrated part 122 and removes passage filling data, and control byte-pixel Conversion portion 125 is removed payload and is filled data.

Footnote fluffing check unit 134 is placed in footnote based on the footnote data acquisition provided from packet separate section 123 CRC code.Footnote fluffing check unit 134 uses acquired CRC code to carry out fluffing check arithmetical operation and effectively carries with detection Makeing mistakes of lotus data.Footnote fluffing check unit 134 exports fluffing check result to store it in depositor 142.

<work of imageing sensor 11 and DSP12>

Presently describe and there is sending block 22 and receiving a series of process of block 31 of this configuration described above.

Flow chart with reference first to Figure 26 describes the work of the imaging device with transmission system 1.Such as when pressing imaging When the shutter release button provided on device is to send the instruction starting imaging, the process of Figure 26 starts.

First, in step S1, the imaging moiety 21 of imageing sensor 11 carries out imaging.Shown in Fig. 5 of imaging moiety 21 Frame data importation 52 the view data data the most pixel-by-pixel of composition one two field picture obtained by imaging are exported.

In step S2, it is transmitted the data sending processing of block 22.By data sending processing, produce effective be grouped Load placed the packet of the pixel data of a line, and the grouped data constituting this packet is sent to receiving block 31.Under Literary composition describes data sending processing with reference to the flow chart of Figure 27.

In step S3, receive block 31 and carry out data receiver process.Processed by data receiver, receive and send from transmission block 22 Grouped data, and the pixel data that is placed in payload exports to image processing block 32.Stream below with reference to Figure 28 Journey figure describes data receiver and processes.

Send data sending processing that block 22 carries out in step S2 and receive block 31 at the data receiver that step S3 is carried out Reason is alternately carried out for one-row pixels data.Specifically, when have sent one-row pixels data by data sending processing, enter Row data reception processes, and when receiving one-row pixels data by data receiver process, for the pixel data of next line Carry out data sending processing.Send block 22 data sending processing and receive block 31 data receiver process the most suitably time Carry out concurrently between.In step S4, the frame data output part 141 of image processing block 32 judges to constitute all of a two field picture Whether transmission and the reception of the pixel data of row terminate.Do not terminate if it is determined that sending and receiving, then repeat with step S2 The process of each step started.

If judging that in step S4 the transmission of the pixel data of all row of composition one two field picture and reception terminate, then image The frame data output part 141 processing block 32 produces a frame figure in step S5 based on the pixel data provided it from reception block 31 Picture.

In step S6, image processing block 32 uses a two field picture to carry out image procossing, then terminates to process.

It is described in the data sending processing that step S2 of Figure 26 is carried out referring now to the flow chart of Figure 27.

In step S11, header generation unit 72 produces and includes Frame Start, Frame End, Line Valid, Line The header information of Number and Reserved.

In step S12, header generation unit 72 calculates CRC code by header information is applied to generator polynomial.

In step S13, CRC code is added to header information to produce one group of header information and CRC by header generation unit 72 Code, and repeatedly arrange that the header information of three this group and CRC code are to produce header.

In step S14, pixel-byte conversion part 62 obtains the pixel data provided from frame data importation 52, and And carry out the pixel-byte conversion of view data.Pixel-byte conversion part 62 is to utilize pixel-byte conversion, payload The byte that the interpolation etc. of filling data is obtained is unit, exports payload produced by the packet by carrying out view data Data.Parity bit is appropriately interposed to payload data by payload ECC insertion portion 63.

In step S15, packet produces part 64 based on payload and the header generation unit including a line view data 72 headers produced produce packet, and export the grouped data constituting a packet.

In step S16, the grouped data provided it from packet generation part 64 is distributed to want by channel allocation part 65 Multiple passages for data transmission.

In step S17, control code is inserted unit 91 and is added control code to dividing of providing it from channel allocation part 65 Group data.

In step S18, the grouped data that control code is added to by 8B10B symbolic encoder 92 carries out 8B10B conversion, and Output grouping data after being converted to the data in units of 10.

In step S19, lock unit 93 produces, according to clock, the clock signal that part 82 produces, and output is from 8B10B code element The grouped data that encoder 92 provides, in order to send grouped data from transmitting element 94.Place's justification signal of step S17～S19 Process part 83-0～83-N is carried out concurrently.When the end of transmission of a line view data, process and return to step Figure 26 Step S2, in order to carry out the process of each step started with step S2.

Referring now to the flow chart of Figure 28, the data receiver process that step S3 of Figure 26 is carried out is described.

In step S31, receive unit 111 and receive the signal represented from sending the grouped data that block 22 is sent to.Step The process of S31～S36 is carried out concurrently by signal processing 102-0～102-N.

In step S32, clock generating unit 112 detects from receiving the edge of the signal that unit 111 provides it to set up Bit synchronization.The signal that reception unit 111 is received by lock unit 113 is sampled, and exports grouped data to code Unit's lock unit 114.

In step S33, symbol synchronization unit 114 detects control code that grouped data includes to set up symbol synchronization.

In step S34,10B8B symbol decoder 115 carries out 10B8B conversion to grouped data after symbol synchronization, and And after conversion to data in units of 8 output grouping data.

In step S35, excursion correction unit 116 detects Deskew Code, and the Data Skew between correction channel, So that the timing of Deskew Code is regulated to the timing controlled by PHY-RX state represented by the information that part 101 provides.

In step S36, the control code added to grouped data is removed by control code removal unit 117.

In step S37, the packet count that passage integrated part 122 will provide it from signal processing 102-0～102-N According to integrating.

In step S38, the grouped data that passage integrated part 122 is integrated is separated into composition report by packet separate section 123 The grouped data of head data and the grouped data of composition payload data.

In step S39, the header data that header error correction unit 132 separates for packet separate section 123 includes Header information and each group of CRC code, use CRC code carry out fluffing check arithmetical operation.Further, header error correction Fluffing check result that unit 132 is organized based on these and the comparative result of the data that fluffing check arithmetical operation determines, select not There is the header information made mistakes, and export the header information do not made mistakes.

In step S40, byte-pixel conversion portion 125 carries out byte-pixel conversion to payload data, and defeated Go out the pixel data in units of 10,12,14 or 16.For becoming effective load of the object of byte-pixel conversion Lotus data, use the error correction of parity bit suitably to be carried out by payload error correction part 124.

At the end of the process of the pixel data of a line, process step S3 being back to Figure 26, in order to carry out with step S3 The process of each step started.

In this mode described above, a line of a frame is used to carry out image sensing corresponding to a packet format being grouped Data transmission between device 11 and DSP12.

The packet format that the data being used between imageing sensor 11 and DSP 12 are transmitted can be regarded as header information Transmission with the control code (e.g., Start code and End code) of instruction class boundary is suppressed to the form of minimum, and is possible to prevent The decline of efficiency of transmission.If the amount of pixel data in using the payload being wherein placed in a packet is less than the pixel of a line The packet format of data volume, then in order to send a complete frame pixel data, need to send greater number of packet.Then, Along with the quantity of header information to be sent and control code increases, efficiency of transmission declines.

Further, become to suppress transmission latency (latency) by preventing efficiency of transmission from declining, and can To realize the high pixel rate (pixel rate) and the high frame rate rate (frame rate) that need to send at a high speed great amount of images data Interface.

Got a promotion by the reliability/redundancy using indication transmission and carried out dividing of error correction by receiving block 31 side Group form, it can be ensured that the loading error occurring countermeasure of header information.Owing to using header information to carry out Frame/Line's (V/H) etc. The transmission of synchronizing information, if therefore header information is due to loading error occurring loss, then there is system and can suffer significant trouble Probability.However, it is possible to prevent this situation.

Furthermore, it is possible to suppression is for guaranteeing installation cost or the increase of power consumption of the loading error occurring countermeasure of header information.Tool Body ground, the packet format transmitted according to the data between imageing sensor 11 and DSP 12, owing to the addition of CRC code, because of This DSP 12 can detect whether header information includes loading error occurring.Further, by the header information and the CRC that send three groups Code, when there is the loading error occurring of header information, DSP12 can correct header information with control information.

If it is assumed that error correction code to be used as the loading error occurring countermeasure of header information, then need in sending block 22 accurate The circuit of the standby calculating carrying out error correction code, and in receiving block 31, it is ready for the circuit of error correction arithmetical operation. Owing to the CRC code as fluffing check code is added to header information, therefore circuit scale and power consumption compared to prepare to be used for into Row can be reduced about the alternative case of the circuit of the arithmetical operation of error correction.Further, when detection header information When makeing mistakes, do not ask transmission block 22 to resend header information owing to receiving block 31, therefore need not prepare rightabout biography Defeated line is used for resending request.

By promoting redundancy and combining multiple K characters of 8B10B code to configure control code, going out of control code can be reduced Wrong probability.It is thus possible to guarantee the loading error occurring countermeasure for control code by fairly simple circuit.

Especially, although four grouping of bits of three types K character are used for Start Code, but if at least The code element in addition to K28.5 can be detected, then receive block 31 and can specify Start Code.It is therefore contemplated that anti-transmission Characteristic of makeing mistakes is high.This is similarly applicable to End Code.

Further, although four type K character combinations are used for Pad Code, but controlled compared to other by distribution The K character of code greater number kind processed, so that higher than other control code of anti-characteristic of makeing mistakes.Especially, if permissible Detect a kind of code element among four types, then receive block 31 and can specify Pad Code.Owing to Pad Code is at transmitting pin Higher than Start Code or End Code in rate, therefore it is equipped with the structure that may insure that higher anti-characteristic of makeing mistakes.

Further, though send identical control code by each passage simultaneously and passage loading error occurring occurs and In the case of causing control code to be lost, it is possible to use the control code of other passage reproduces control code mistake occur.

Further, owing to the quantity of K character is limited, therefore combine the character of minimum number to configure each control Code.Such as, for by repeat transmission can relatively allow the Sync Code of loading error occurring, Deskew Code and Standby Code, uses this data structure not requiring additional allocation K character.

Because the control code needed for re-synchronization to be distributed to each packet (that is, distributing to each line), work as The when of losing bit synchronization due to the interference of such as electrostatic or noise etc, re-synchronization can be set up rapidly.Enter One step, can be suppressed to minimum by the impact for loading error occurring that loses of synchronicity.

Especially, in the CDR realized by clock generating unit 112 and lock unit 113, can be by turning at 8B10B After alternatively, bit synchronization is set up at the transformation/edge of detecting position data.If sending block 22 to continue to send data, then can estimate Bit synchronization is set up in being calculated as the period of CDR locking time.

Further, even if in the case of losing symbol synchronization, detect specific K word by symbol synchronization unit 114 Symbol (K28.5), it is also possible to be quickly carried out re-synchronization.Owing to making in Start Code, End Code and Deskew Code With K28.5, therefore within the transmission period of the grouped data of a packet, symbol synchronization can be set up three positions.

Further, by allowing to the Data Skew between use Deskew Code correction channel, it is also possible to set up Synchronicity between passage.

By collocation link layer so that (in the case of the example of Figure 14, with 16 words in units of the group of 16 data Joint is unit) process grouped data, circuit scale or amount of storage concurrently compared to process point one by one in a clock period The alternative case of group data can be inhibited.About installation, in the process one by one for grouped data with for predetermined quantity Between being uniformly processed of unit, the latter can be with suppression circuit scale etc..Owing to therefore can also be able to suppress with suppression circuit scale Power consumption.

Further, by continuous print grouped data being distributed to different passages when channel allocation, anti-make mistakes characteristic can To get a promotion.Even if crossing over multiple continuous packet data, occur more than the error correction capacity of parity bit in certain passage Mistake, if receiving block 31 to carry out passage combination (coupling), then the position dispersion of the grouped data occurring makeing mistakes, and This makes the error correction using parity bit be possible sometimes.Utilize the error correction volume dependent of parity bit in odd even bit length Degree.

Further, by with than the rank (order) closer to physical layer be the other channel allocation of lower level and passage whole Close higher rank and carry out ECC process, can reduce and send block 22 and receive the circuit scale of block 31.Such as, if sending block The parity bit of ECC is inserted into payload carrying out grouped data after the distribution of passage by 22, then need for each logical Road prepares payload ECC insertion portion, causes the increase of circuit scale.However, it is possible to prevent this feelings as just mentioned Shape.

Within the physical layer, although carried out the parallel processing of grouped data by multiple circuit, if but sharing PHY-TX shape State controls part 81 and clock and produces part 82, then compared to preparing the alternative case of those circuit for each passage, and Ke Yishi The simplification of existing circuit.Further, used the agreement not sending control code by different passages, dividing for the treatment of channel can be expected The simplification of the circuit of group data.

<switching of number of channels>

Not only when common data transmission but also such as numbering at switching channel time carry out via passage with for the moment Carve and send identical control code.Additionally, in the case of the numbering of switching channel, those of movable (that is, transmitting for data) Passage has identical state.

Figure 29 illustrates the control order in the case of switching channel numbering.

Right side at Figure 29, it is illustrated that vertical synchronizing signal XVS and the sequential of horizontal drive signals XHS.Until detecting In period to the time t1 of vertical synchronizing signal, send the figure of each row constituting a two field picture according to horizontal-drive signal Picture.Then, when time t1, the quantity of active tunnel becomes two passages from four passages.This is more specifically retouched State.Note, until time t1, use four passages to carry out data transmission.

The vertical direction that Figure 29 is substantially middle illustrates the state of passage." PIX DATA " expression is applied by character To passage carry out the transmission of pixel data." E ", " BLK " and " S " after " PIX DATA " represents Frame End respectively, disappears Hidden period and Frame Start.

If the transmission of the pixel data of frame to be sent is until terminating in the frame period of t1, then image procossing Number of channels is switched to 2 from 4 in step S81 command reception block 31 by block 32.Receive block 31 to receive at image in step S71 The instruction of reason block 32.

Then, as the t1 time of advent, image processing block 32 changes a mode into request in step S82 and is distributed to image sensing The imaging moiety 21 of device 11.To the pattern change request of imaging blocks 21, transmission also includes that number of channels to be switched to 2 from 4 by expression Information.Although not shown in waiting at Fig. 1, but there is provided for by preset value (e.g., shutter speed and the increasing about imaging Benefit) information send the transmission line to imaging blocks 21 from image processing block 32.Additionally, change a mode into request via this transmission line Send to imaging blocks 21.

In step S51, the pattern that imaging blocks 21 receives from image processing block 32 changes request, and will in step S52 It is distributed to transmitting portion 22 in order to number of channels is switched to the instruction of 2 from 4.In step S61, send block 22 and receive from imaging The instruction of block 21.

Sending the process carrying out Standby Sequence (standby sequence) between block 22 and reception block 31, and using Standby Code is repeatedly sent to receiving block 31 by passage Lane0～Lane3 from sending block 22.Work as Standby At the end of Sequence processes, keep passage Lane0 and Lane1 of active state to have Low (low) state, and terminate data and pass Defeated passage Lane2 and Lane3 has High-Z (high resistant) state.

Sending block 22 and receiving between block 31, carrying out the process of Training Sequence (training sequence), and make With passage Lane0 and Lane1, Sync Code is repeatedly sent to receiving block 31 from sending block 22.In receiving block 31, it is ensured that Bit synchronization, and guarantee symbol synchronization by the detection of Sync Code.

At the end of Training Sequence processes, receive block 31 and prepare to image processing block 32 notice in step S73 Terminate.In step S84, image processing block 32 receives from the notice receiving block 31, and the control when number of channels is to be switched Sequence processed therewith terminates.

In this way, in the control sequence of switching channel quantity, finish data transmission passage Lane2 and Lane3 sends Standby Code when processing Standby Sequence, thus they can have and be continuously employed in data biography The state that the state of defeated passage Lane0 with Lane1 is identical.Although such as passage Lane2 and Lane3 is not carrying out Standby Keep being in High-Z state in the case of the transmission of Code as it is and appear to be possible conception, but they start tool There is and be continuously employed in the different state of those passages of data transmission, cause the complexity controlled.

<example of the configuration of computer>

Although a series of process described above can run with hardware, but it can also additionally use running software.? In the case of a series of process of running software, the program constituting software is installed to being incorporated within hardware from program recorded medium For special computer, general personal computer etc..

Figure 30 illustrates the example of the hardware configuration of the computer running above-mentioned a series of process according to program.

With reference to Figure 30, in shown computer, CPU (CPU) 301, read only memory (ROM) 302 and with Machine access memorizer (RAM) 303 is connected with each other by bus 304.

Further, input/output interface 305 is connected to bus 304.Including keyboard, mouse etc. importation 306 and Output part 307 including display unit, speaker etc. is connected to input/output interface 305.Additionally, by hard disk, non-volatile Memorizer etc. formed storage part 308, the communications portion 309 formed such as network interface and be used for driving detachable media The driver 310 of 311 is connected to input/output interface 305.

In the computer configured in this mode described above, CPU 301 is by input/output interface 305 and bus The program being such as stored in storage part 308 is loaded onto RAM 303 by 304, and program of running to carry out above-mentioned one is Column processing.

The program to be run by CPU 301 can be recorded in and be provided as (such as) detachable media 311, or permissible Thered is provided by the wired or wireless transmission medium of such as LAN, the Internet or digital broadcasting etc, and installed to depositing Storage part 308.

Noting, the program will run by computer can be to carry out in chronological order with the order described in this specification The type of reason, or can be to carve (e.g., when calling process) parallel running or the type of isolated operation process when necessary.

Although having used particular term to describe the preferred embodiment of disclosed technology, but it is used for during this description Bright purpose, and it is understood that can be changed and become in the case of without departing from the spirit or scope of claims Type.

The disclosure comprises Japanese Priority Patent Application JP2010-submitted to on November 12nd, 2010 to Japan Office The theme that theme disclosed in 254261 is relevant, entire contents is incorporated in this by way of reference.

Claims (19)

1. an image output device, comprises:

Imaging moiety；

Header produces part, and it is adapted for producing header, and this header includes:

Header information, it forms by the first frame information, the second frame information, the first row information and the second row information, described first frame Information table shows that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table Showing that whether pixel data that payload includes is the pixel data of last column of a frame, described the first row information table is shown with Whether the effect pixel data that includes of load is the data of valid pixel, and described second row information represents and included by payload The line number of row that formed of pixel data, and

Fluffing check code, it is for detecting makeing mistakes of header information；

Packet produces part, and it is adapted for producing packet, and this is grouped in its payload and includes constituting by described imaging section Point imaging and the pixel data of a line of image that obtains, and with the addition of described header；And

Output part, its packet being adapted for producing described packet part generation exports to image processing apparatus.

2. image output device as claimed in claim 1, wherein, in the first frame information, the second frame information and the first row information Each of which be 1 information, and

Second row information is 13 information.

3. image output device as claimed in claim 1, wherein, described header produces part generation and includes organizing header information more Header with fluffing check code.

4. image output device as claimed in claim 1, comprises further:

Adding part, it is adapted for would indicate that the opening code of the starting position of packet adds and is grouped what generation part produced to described Before Fen Zu, and would indicate that the end code of the end position of packet adds the end to packet.

5. image output device as claimed in claim 4, wherein, between described image output device and image processing apparatus During via the data transmission rate of transmission line higher than the transfer rate of pixel data of described imaging moiety output pixel data, described in add Add part and filler code is added the payload to packet.

6. image output device as claimed in claim 5, wherein, described interpolation part will be used by image processing apparatus Offset code is added to after end code, in order to guarantee the synchronicity of the data of the packet sent via plurality of transmission lines, and

Described output part uses plurality of transmission lines, will with the addition of the data of the packet of opening code, end code and offset code simultaneously Output is to image processing apparatus.

7. image output device as claimed in claim 6, wherein, described interpolation part

Among as Given information and each of which by multiple code elements of the Sequence composition of predetermined number of bits, combine three kinds Four code elements of type code element are to produce opening code and end code, and add opening code and end code to packet,

Among the plurality of code element, combine to produce four code elements of four type code elements of filler code, and by filler code Add the payload to packet, and

Combine two code elements predetermined in the plurality of code element to produce offset code, and offset code is added to packet.

8. image output device as claimed in claim 7, wherein, described part of adding produces opening code, end code and skew Code, so that the code element of opening code, end code and offset code includes those code elements same type of.

9. image output device as claimed in claim 6, comprises further:

Distribution portion, it is adapted for producing described packet data of packet that part produces and distributes to described plurality of transmission lines,

Multiple this interpolation part equal to transmission line quantity and output part are provided accordingly with transmission line.

10. an image output method, comprises:

Captured image；

Producing header, this header includes:

Header information, it forms by the first frame information, the second frame information, the first row information and the second row information, described first frame Information table shows that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table Showing that whether pixel data that payload includes is the pixel data of last column of a frame, described the first row information table is shown with Whether the effect pixel data that includes of load is the data of valid pixel, and described second row information represents and included by payload The line number of row that formed of pixel data, and

Fluffing check code, it is for detecting makeing mistakes of header information；

Producing packet, this is grouped in its payload and includes constituting the pixel count of a line of the image obtained by imaging According to, and with the addition of described header；And

The packet produced is exported to image processing apparatus.

11. 1 kinds of image processing apparatus, comprise:

Receiving portion, it is adapted for receiving in same device that the image output device provided produces and from image output device The packet of output, described packet includes adding the header to payload, and this payload includes constituting by image output dress The imaging of the imaging moiety put and the view data of a line of image that obtains, this header includes:

Header information, it forms by the first frame information, the second frame information, the first row information and the second row information, described first frame Information table shows that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table Showing that whether pixel data that payload includes is the pixel data of last column of a frame, described the first row information table is shown with Whether the effect pixel data that includes of load is the data of valid pixel, and described second row information represents and included by payload The line number of row that formed of pixel data, and

Fluffing check code, it is for detecting makeing mistakes of header information；And

Image processing section, it is adapted for locating the image that reason row is constituted, the packet that every a line is received by described receiving portion The pixel data that includes of payload formed.

12. image processing apparatus as claimed in claim 11, wherein, described header includes organizing header information and fluffing check more Code；

Described image processing apparatus comprises further:

Fluffing check part, it is adapted for, based on constituting the fluffing check code of group belonging to header information, detecting the report in each group Makeing mistakes of header；And

Producing part, it is adapted for being not detected by, based on described fluffing check part, the header information made mistakes, produces by effectively carrying The image of the frame that the pixel data that lotus includes is formed；

The image that part produces is produced described in described image processing part divisional processing.

13. image processing apparatus as claimed in claim 11, wherein, would indicate that the opening code of the starting position of packet adds extremely The top of packet, and would indicate that the end code of the end position of packet adds the end to packet, and

Described receiving portion after receiving opening code until receive end code receive data, as packet number According to.

14. image processing apparatus as claimed in claim 13, comprise further:

Removing part, its transfer rate being adapted for the transmission line between image output device and described image processing apparatus is higher than When the transfer rate of the pixel data of the image that the imaging moiety of image output device exports, remove opening code and end code, and And remove the filler code by image output device interpolation to payload.

15. image processing apparatus as claimed in claim 13, wherein, use multiple this transmission line same from image output device Time output grouping data, this packet has to be added to the offset code after its end code so that with the addition of beginning to packet Code, end code and offset code；

Described image processing apparatus comprises further:

Correction portion, its displacement being adapted for correcting the time of reception of the data that described receiving portion receives based on offset code；

Multiple this receiving portion equal to transmission line quantity, correction portion and removal part are provided accordingly with transmission line.

16. image processing apparatus as claimed in claim 15, wherein, by image output device, from as Given information also And each of which by multiple code elements of the Sequence composition of predetermined number of bits among, combination three types code element four code elements with produce Raw opening code and end code, and opening code and end code are added to packet,

Among multiple code elements, combine four code elements of four type code elements to produce filler code, and filler code is added to point The payload of group, and

Combine predetermined two code elements in multiple code element to produce offset code, and offset code is added to being grouped.

17. image processing apparatus as claimed in claim 16, wherein, by image output device, produce opening code, end code And offset code, so that the code element of opening code, end code and offset code includes those code elements same type of.

18. 1 kinds, for the image processing method of image processing apparatus, comprise:

Receive provide image processing apparatus same device in provide image output device produced by and defeated from image Going out the packet of device output, this packet includes adding the header to payload, and this payload includes that composition is defeated by image The view data of a line of the image going out the imaging of the imaging moiety of device and obtain, this header includes:

Header information, it forms by the first frame information, the second frame information, the first row information and the second row information, described first frame Information table shows that whether pixel data that payload includes is the pixel data of the first row of a frame, described second frame information table Showing that whether pixel data that payload includes is the pixel data of last column of a frame, described the first row information table is shown with Whether the effect pixel data that includes of load is the data of valid pixel, and described second row information represents and included by payload The line number of row that formed of pixel data, and

Fluffing check code, it is for detecting makeing mistakes of header information；And

The image of place's reason row configuration, the pixel data shape that each of which row is included by the payload of the packet received Become.

19. 1 kinds of imaging devices, comprise:

Image output device, and

Image processing apparatus；

Described image output device includes

Imaging moiety；

Header produces part, and it is adapted for producing and includes header information and the header of fluffing check code, and described header information is by the One frame information, the second frame information, the first row information and the second row information are formed, and described first frame information table shows bag in payload Whether the pixel data included is the pixel data of the first row of a frame, and described second frame information table shows the picture that payload includes Whether prime number according to being the pixel data of last column of a frame, and described the first row information table shows the pixel count that payload includes According to being whether the data of valid pixel, described second row information represents the row that the pixel data included by payload formed Line number, described fluffing check code is for detecting makeing mistakes of header information；

Packet produces part, and it is adapted for producing packet, and this is grouped in its payload and includes constituting by described imaging section Point imaging and the pixel data of a line of image that obtains, and with the addition of described header；And

Output part, its packet being adapted for producing described packet part generation exports to image processing apparatus；

Described image processing apparatus includes:

Receiving portion, it is adapted for receiving packet；And

Image processing section, it is adapted for locating the image that reason row is constituted, the packet that every a line is received by described receiving portion The pixel data that includes of payload formed.