JPH08294033A - Digital camera - Google Patents

Abstract

PURPOSE: To attain multiplexing of auxiliary information in response to a length of a blanking period by varying the blanking period in response to image data whose image format is converted. CONSTITUTION: An output signal from an image pickup means 11 is processed by a video signal processing means 12, a luminance signal and a color difference signal are outputted to an image format conversion means 13 and image data are generated in response to an image size set to a control means 18. When the data are outputted to a digital interface means 14 and a blanking length output means 16, the means 16 provides an output of auxiliary data which are generated by multiplexing a vertical horizontal blanking length counted by an output signal of the means 13 by the means 14 via an auxiliary information generating means 17 and an auxiliary information entry means 15. The means 14 multiplexes the image data including the luminance and color difference signals being the output of the means 13 on auxiliary information data being an output of the means 15 to provide a parallel or serial signal to output it to external personal computer or work station.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to images and sounds of personal computers, workstations, videophones, video conferences, etc.
The present invention relates to a digital camera device having an interface that multiplexes and transmits auxiliary information such as still images.

[0002]

2. Description of the Related Art Conventionally, an apparatus for transmitting image data and auxiliary information from a video camera to a personal computer, a work station, etc., has a transmission area for transmitting image data and auxiliary information data as specified in IEEE P1394. Is defined, and auxiliary information is multiplexed in the defined area.

[0003]

If the transmission processing as described above is performed, the CI is converted by the image format conversion processing.
Image formats such as F, QVGA, VGA are generated. When image data and auxiliary information are multiplexed and transmitted through the digital interface in this image format, if the transmission speed is constant, the auxiliary information is constant,
There will be a space in the image data area. in this case,
There was an unused area in the data portion output from the digital interface, which was inefficient as the data transmission efficiency deteriorated.

[0004]

In order to solve the above-mentioned problems, the digital camera device of the present invention changes the blanking period according to the image data whose image format has been converted, and according to the length of the blanking period. The auxiliary information can be multiplexed, and the length accepted as the auxiliary information is output to the auxiliary information generating circuit so that the auxiliary information of any length can be easily multiplexed. In addition, the compression ratio of audio and still images can be changed according to the length of the blanking period.

[0005]

Therefore, according to the above configuration, data such as audio and still images other than video can be automatically and efficiently multiplexed in the digital interface for transmitting video.
You can build a very good digital interface.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the digital camera device of the present invention will be described below with reference to FIGS. FIG. 1 is a block diagram showing a first embodiment of a digital camera device of the present invention. In FIG. 1, an image pickup means 11 converts an optical image captured by a lens into an electric signal, and an output from the image pickup element. CDS that samples and holds the signal, AGC that performs automatic gain correction on the output signal from the CDS, drive timing pulse for driving to control the image sensor, timing for generating a video signal synchronization pulse and a video signal processing clock It consists of a pulse generator.

The video signal processing means 12 is an AD converter for converting the output signal from the image pickup means 11 into digital data pixel by pixel, and a luminance signal (Y) and a color difference signal (based on the digital data output from the AD converter. RY, BY) is generated, white balance processing, gamma correction processing, etc. are performed, and the luminance signal (Y) and color difference signals (RY, BY) are output as dot sequential color difference digital signals. It is composed of a video signal processing unit.

The image format converting means 13 converts the luminance signal and the color difference signal output from the video processing means 12 into a predetermined image size such as CIF or QVGA and outputs the image to the digital interface means.
That is, the image format conversion means 13 processes the signal from the image pickup device of the image pickup means 11 by the video signal processing means 12, and outputs the luminance signal (Y) and the color difference signal (R-).
Y, B-Y), image data corresponding to an arbitrary image size set in the control means 18 is generated from an externally connected personal computer or the like.

The control means 18 is an image pickup means 11, a video signal processing means 12, an image format conversion means 13,
Digital interface means 14, auxiliary information input means 1
5. It controls the operation of the blanking length output means 16. The digital interface unit 14 multiplexes image data including the luminance signal (Y) and color difference signals (RY, BY) output from the image format unit 13 and auxiliary information data output from the auxiliary information input unit 15. It is a digital interface that outputs a parallel signal or serial signal to an external personal computer or workstation.

The auxiliary information input means 15 receives the auxiliary information input permission signal output from the auxiliary information input means 15 and multiplexes the auxiliary information output from the auxiliary information generation means 17 in the blanking period of the digital interface means 14. It is a thing. The image format conversion means 13
The image signals converted in image formats such as CIF and QCIF generated in step 1 have different resolutions. That is, for example, in the case of CIF, the resolution is 352 (H) ×
The horizontal active data length is 288 (V), and the luminance and color difference are 4: 2: 2, and the horizontal active data length is 704 words. Also, QCI
In the case of F, the resolution is 176 (H) × 144 (V), and the horizontal active data length of luminance and color difference is 352 words. 288 lines and 144 in the vertical direction, respectively
It is a line.

Now, assuming that the sampling frequency is 27 MHz, that is, the data transfer rate is 27 MHz, the total line length for data transfer is 1 for both CIF and QCIF.
It becomes 716 words. As a result, the vertical blanking length, which is the length of data other than active data, that is, the length of data multiplexed during the blanking period, is CIF, QCI.
Both F have 27 lines.

Further, the image format conversion means 13
Outputs a horizontal synchronizing signal, a vertical synchronizing signal, a sampling clock, and a signal indicating active data together with the image format-converted video data.

As can be seen from the above, the lengths of the image active data of various formats, which have been converted into image formats, vary depending on the mode. That is, the blanking length (vertical blanking period) also varies depending on the mode (FIGS. 2, 3, and 4). Also,
Although CIF and QCIF have been described at present, it is most effective for any image size. This actual blanking length is the "L" portion of the HVACT signal indicating that the horizontal video data is valid, and the VLACT "L" portion indicating that the vertical video data is valid. The HVACT signal and VVACT signal are output from the image format conversion means 13.

The blanking length output means 16 outputs the HVACT output from the image format conversion means 13.
The period from the fall of the signal to the rise of the "L" period is counted, and the counted value is set as the horizontal blanking length. Also, from the fall of the VVACT signal, "L"
The period is counted until rising, and the counted value is taken as the vertical blanking length. The counted vertical and horizontal blanking lengths are output to the auxiliary information generating means 17. The auxiliary information generation means 17 generates auxiliary data to be multiplexed on the digital interface means 14 through the auxiliary information input means 15 based on this vertical and horizontal blanking length.

FIGS. 5 to 7 show a second embodiment (corresponding to claim 2) of the digital camera apparatus according to the present invention. Hereinafter, the second embodiment of the digital camera apparatus according to the present invention will be described with reference to FIGS. It will be described together with 7. In FIG. 5, the horizontal blanking counter 21 outputs the horizontal blanking length as data to the horizontal blanking register 22 at the timing shown in FIG. 2b. In the counting operation, the period in which HVACT is "H" is counted by the transfer clock DCLK, and the count value is stored in the horizontal blanking register 22 at the falling edge of HSYC. Then, the counter for counting the horizontal blanking is reset at the rising edge of HSYC.

The horizontal blanking register 24 stores the horizontal blanking length output from the horizontal blanking counter 21 in the register 1 in synchronism with the horizontal synchronizing signal.
When the counter values sequentially input during the field are compared and N or more are the same, another field synchronization signal VS
Store in register 2 in synchronization with YNC. Then, it is compared N times in synchronization with the stored field synchronization signal, and if all N have the same value, they are stored in the register 3 and output to the vertical and horizontal blanking data generator 26.

The vertical blanking counter 23 counts the VSYNC pulse input during the period when the signal VVACT indicating the vertical blanking period is "L", and outputs the count value to the vertical blanking register 24 as a field signal. The vertical blanking counter is reset at the rising edge of the field signal as shown in FIG.

The vertical blanking register 24 stores the counter value output from the vertical blanking counter 23 in the register 4 in synchronization with the field signal, compares the counter value N times in synchronization with the field synchronization signal, and has the same N value. If so, it is stored in the register 5 and output to the vertical / horizontal blanking data generator 26.

The mode switching signal generator 25 receives the signal output from the control means 18 indicating that the resolution setting has changed, and outputs a mode switching signal and a BSEL signal for setting the auxiliary information bus to the output mode. The vertical / horizontal blanking data generation unit 26 uses the horizontal blanking register 22.
Based on the horizontal blanking length data output from the vertical blanking register 24 and the vertical blanking data output from the vertical blanking register 24, the horizontal vertical blanking data output from the auxiliary information generating means 17 is generated in synchronization with the mode switching signal. Then, the data is output to the data bus switching unit 27 in synchronization with the BSEL signal. The data of each blanking is stored in units of 2 bytes.

The data bus switching unit 27 multiplexes the horizontal / vertical blanking data output from the horizontal / vertical blanking data generating unit 26 onto the auxiliary information data bus. Normally, the data bus switching unit 27 is an input and is supplied from the auxiliary information generating means 17. The auxiliary information data is received and output to the auxiliary information input means 15. However, since the auxiliary information bus is a bidirectional bus, it becomes an output bus when the BSEL signal is "H", and is output to the auxiliary information generating means 17. Output vertical blanking data. This output timing is shown in FIG.

By switching the image conversion mode,
A mode switching signal and a BSEL signal are generated, and the blanking data is sequentially output as horizontal blanking data and vertical blanking data in accordance with this timing. The horizontal / vertical blanking data can be output only when the image conversion mode is switched. The period in which this data is output is one field.

FIGS. 8 to 10 show a third embodiment (corresponding to claim 3) of the digital camera apparatus of the present invention.
A third embodiment of the digital camera device of the present invention will be described with reference to FIGS. In FIG. 8, the auxiliary input means 15, the horizontal blanking counter 21, the horizontal blanking register 22, the vertical blanking counter 23, the vertical blanking register 24, and the horizontal / vertical blanking data generator 26 are described in the second embodiment. The same operation as that with the same reference numeral is performed.

The mode switching signal generator 32 receives the signal output from the control means 18 indicating that the resolution setting has changed, and outputs the mode switching signal and the effective data output indicating the effective blanking signal period data to the auxiliary information generating means. Output a signal. The serial interface unit 31 is an interface that converts the parallel data output from the vertical / horizontal blanking data generation unit 26 into a serial data signal, and outputs the serial data to the auxiliary information generation unit according to the timing of FIG. 7.

FIG. 10 shows a fourth embodiment (corresponding to claim 4) of the digital camera apparatus of the present invention, and the fourth embodiment of the digital camera apparatus of the present invention will be described below with reference to FIG. FIG. 10 shows a block diagram of the auxiliary information generating means 17 of FIG. Here, the compression of the audio signal is mentioned as an example, but the compression of a still image is not a problem and the same can be done.

The microphone 41 is a microphone for inputting a voice signal, and the AD converter 42 digitizes the analog voice signal input from the microphone 41 into a digital signal.
The sampled digital audio signal is output. The audio compression unit 43 is a digital audio signal compressor that compresses the digital audio signal input from the AD converter 42 to an arbitrary bit rate.

The auxiliary information output interface 44 receives the data from the audio compression section 43 compressed at the compression bit rate controlled by the compression control section 45 together with the information data of the compression rate, and the auxiliary information input means 15 of the digital camera means.
Output to. The blanking length input interface 46 receives the total blanking length data for one field from the blanking length data input from the blanking length output means 16, and outputs it to the compression control unit 45.

The compression control unit 45 adds all blanking length data input from the blanking length input interface 46 and calculates the total blanking length for one field period. The bit rate of audio compression is calculated from this total blanking length data. That is, if the audio signal is not discontinuous and the data is not continuously transferred, the sound becomes discontinuous. Therefore, the audio data must be continuously transferable.

For this reason, the amount of data to be transferred in one field period is set in advance, the data for one field period is stored in the memory on the receiving side, and the audio decompression process is performed.
Therefore, the horizontal blanking length and the vertical blanking length in one field period are summed up, and the summed blanking length determines the capacity for transmitting the audio signal. The maximum amount of data that can fit in this capacity is the bit capacity that can be transmitted. That is, it becomes the compression bit rate of audio compression. The compression rate of the audio control unit 45 is determined by the compression bit rate obtained by the compression control unit 45.

[0029]

Since the digital camera device of the present invention has the above-described structure, the area for storing a large amount of auxiliary information is variable according to the capacity of the image data whose image format has been converted. Since the auxiliary information from the outside can be easily input by outputting the length of the variable period, it is possible to configure a digital interface that transmits efficient data with a simple circuit.

Further, when the resolution of the image changes arbitrarily in the interface having a fixed transmission capacity, the data capacity occupied by the image data also changes accordingly. Due to this change, the capacity for transmitting data other than the image also changes. By automatically recognizing the length of the area for transmitting data other than this image, that is, the length of the auxiliary information data area, and efficiently multiplexing auxiliary information such as voice, it is possible to provide a video digital interface with little waste. .

[Brief description of drawings]

FIG. 1 is a block diagram showing a first embodiment of a digital camera device of the present invention.

FIG. 2 is an explanatory diagram of a video area and a blanking area in FIG.

3 is a timing diagram showing a horizontal video active period and a horizontal blanking period in FIG.

4 is a timing diagram showing a vertical video active period and a vertical blanking period in FIG.

FIG. 5 is a block diagram showing a second embodiment of the digital camera device of the present invention.

FIG. 6 is a timing diagram of the horizontal blanking counter in FIG.

7 is a timing chart of blanking data output in FIG.

FIG. 8 is a block diagram showing a third embodiment of the digital camera device of the present invention.

9 is a timing diagram of serial data output in FIG.

FIG. 10 is a block diagram showing a fourth embodiment of the digital camera device of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 digital camera section 11 image pickup means 12 video signal processing means 13 image format conversion means 14 digital interface means 15 auxiliary information input means 16 blanking length output means 17 auxiliary information generation means 18 control means

Claims (4)

[Claims] 1. An image pickup device for converting image pickup light from an incident subject into an electric signal, and an image pickup device for performing preprocessing for suppressing noise and performing automatic gain control on an output signal from the image pickup device. An AD converter for converting an output signal from the image pickup means from an analog signal to a digital signal, a video signal processing means for performing luminance signal processing and color signal processing from digital data output from the AD converter, and a video signal processing means Image format conversion means for converting the digital image data output from the device into various image formats, control means for controlling this system, digital face means for outputting the video data as digital signals, and external auxiliary means for the digital interface means. Auxiliary information input means for inputting auxiliary information from the information generation means and the length of the blanking period And a digital camera section comprising blanking length output means for outputting to the auxiliary information generating means, and auxiliary information generating means for outputting auxiliary information to the digital camera means in accordance with blanking period information output from the digital camera means. A digital camera device comprising, and outputting blanking period information to auxiliary information means. 2. The digital camera device according to claim 1, wherein the blanking length is detected, multiplexed on the auxiliary information data bidirectional bus as data, and output to the auxiliary information generating means. 3. The digital camera device according to claim 1, wherein the blanking length is detected, and the blanking length is output to the auxiliary information generating means by using a serial bus different from the auxiliary information data bus. Digital camera device. 4. The digital camera device according to claim 1, wherein a compression rate of a signal to be multiplexed as auxiliary information is interlocked and varied according to the length of a blanking period.